Work in Progress

Telepathic Play: Towards Playful Experiences Based on Brain-to-brain Interfacing

Authors:

Nathan Semertzidis,

Michaela Vranic-Peters,

Fabio Zambetta,

Florian 'Floyd' MuellerAuthors Info & Claims

CHI PLAY '21: Extended Abstracts of the 2021 Annual Symposium on Computer-Human Interaction in Play

Pages 268 - 273

https://doi.org/10.1145/3450337.3483468

Published: 15 October 2021 Publication History

Abstract

Brain-to-Brain interfaces (BBIs) are systems that facilitate direct information transmission between two brains via a combination of neuroimaging and neuromodulation technologies. These systems can stimulate one user’s brain based on the neural signals of another. While Brain-Computer Interfacing is often discussed in the Human-Computer Interaction (HCI) game and play community, BBI is underexplored. In this paper, we investigate the social play potentials of BBI systems by proposing three types of ”telepathic play experiences” based on a wearable BBI system called ”PsiNet” which we designed, engineered, and evaluated in a previous study. This system measures the neural activity of players via electroencephalogram (EEG) as the input to the system and stimulates associated brain activity in other users using transcranial electrical stimulation (tES) as the system output. We hope this work will inspire game design researchers to create novel play experiences using neurotechnology such as BBI systems.

References

[1]

[n.d.]. PsiNet: A Brain-to-Brain Interface for Enhancing Inter-BrainSynchrony. The Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT) (forthcoming) ([n. d.]).

[2]

[n.d.]. Telephone Rewired. http://produceconsumerobot.com/telephonerewired/

[3]

Andrea Antal and Walter Paulus. 2013. Transcranial alternating current stimulation (tACS). Frontiers in Human Neuroscience 7 (2013). https://doi.org/10.3389/fnhum.2013.00317 Publisher: Frontiers.

[4]

Laurent Bonnet, Fabien Lotte, and Anatole Lécuyer. 2013. Two Brains, One Game: Design and Evaluation of a Multiuser BCI Video Game Based on Motor Imagery. IEEE Transactions on Computational Intelligence and AI in Games 5, 2 (June 2013), 185–198. https://doi.org/10.1109/TCIAIG.2012.2237173 Conference Name: IEEE Transactions on Computational Intelligence and AI in Games.

[5]

Kathy Charmaz and Linda Liska Belgrave. 2015. Grounded Theory. In The Blackwell Encyclopedia of Sociology. American Cancer Society. https://doi.org/10.1002/9781405165518.wbeosg070.pub2 _eprint: https://onlinelibrary.wiley.com/doi/pdf/10.1002/9781405165518.wbeosg070.pub2.

[6]

Inês Cruz, Carlos Moreira, Mannes Poel, Hugo Ferreira, and Anton Nijholt. 2018. Kessel Run - A Cooperative Multiplayer SSVEP BCI Game. In Intelligent Technologies for Interactive Entertainment(Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering), Yoram Chisik, Jussi Holopainen, Rilla Khaled, José Luis Silva, and Paula Alexandra Silva (Eds.). Springer International Publishing, Cham, 77–95. https://doi.org/10.1007/978-3-319-73062-2_6

[7]

Suzanne Dikker, Sean Montgomery, and Suzan Tunca. 2019. Using Synchrony-Based Neurofeedback in Search of Human Connectedness. In Brain Art: Brain-Computer Interfaces for Artistic Expression, Anton Nijholt (Ed.). Springer International Publishing, Cham, 161–206. https://doi.org/10.1007/978-3-030-14323-7_6

[8]

Carles Grau, Romuald Ginhoux, Alejandro Riera, Thanh Lam Nguyen, Hubert Chauvat, Michel Berg, Julià L. Amengual, Alvaro Pascual-Leone, and Giulio Ruffini. 2014. Conscious Brain-to-Brain Communication in Humans Using Non-Invasive Technologies. PLoS ONE 9, 8 (Aug. 2014), e105225. https://doi.org/10.1371/journal.pone.0105225

[9]

Gerd Grübler, Abdul Al-Khodairy, Robert Leeb, Iolanda Pisotta, Angela Riccio, Martin Rohm, and Elisabeth Hildt. 2014. Psychosocial and Ethical Aspects in Non-Invasive EEG-Based BCI Research—A Survey Among BCI Users and BCI Professionals. Neuroethics 7, 1 (April 2014), 29–41. https://doi.org/10.1007/s12152-013-9179-7

[10]

Sara Ilstedt Hjelm. 2003. Research + design: the making of Brainball. interactions 10, 1 (Jan. 2003), 26–34. https://doi.org/10.1145/604575.604576

Digital Library

[11]

Soraj Hongladarom. 2015. Brain-brain integration in 2035: metaphysical and ethical implications. Journal of Information, Communication and Ethics in Society 13, 3/4 (Aug. 2015), 205–217. https://doi.org/10.1108/JICES-10-2014-0042

[12]

Linxing Jiang, Andrea Stocco, Darby M. Losey, Justin A. Abernethy, Chantel S. Prat, and Rajesh P. N. Rao. 2019. BrainNet: A Multi-Person Brain-to-Brain Interface for Direct Collaboration Between Brains. Scientific Reports 9, 1 (April 2019), 6115. https://doi.org/10.1038/s41598-019-41895-7 Bandiera_abtest: a Cc_license_type: cc_by Cg_type: Nature Research Journals Number: 1 Primary_atype: Research Publisher: Nature Publishing Group Subject_term: Human behaviour;Neural decoding;Problem solving Subject_term_id: human-behaviour;neural-decoding;problem-solving.

[13]

A. Lecuyer, F. Lotte, R.B. Reilly, R. Leeb, M. Hirose, and M. Slater. 2008. Brain-Computer Interfaces, Virtual Reality, and Videogames. Computer 41, 10 (Oct. 2008), 66–72. https://doi.org/10.1109/MC.2008.410

Digital Library

[14]

Fannie Liu, Chunjong Park, Yu Jiang Tham, Tsung-Yu Tsai, Laura Dabbish, Geoff Kaufman, and Andrés Monroy-Hernández. 2021. Significant Otter: Understanding the Role of Biosignals in Communication. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. ACM, Yokohama Japan, 1–15. https://doi.org/10.1145/3411764.3445200

Digital Library

[15]

Andrés Lucero, Jussi Holopainen, Elina Ollila, Riku Suomela, and Evangelos Karapanos. 2013. The playful experiences (PLEX) framework as a guide for expert evaluation. In Proceedings of the 6th International Conference on Designing Pleasurable Products and Interfaces - DPPI ’13. ACM Press, Newcastle upon Tyne, United Kingdom, 221. https://doi.org/10.1145/2513506.2513530

Digital Library

[16]

Hideyuki Matsumoto and Yoshikazu Ugawa. 2017. Adverse events of tDCS and tACS: A review. Clinical Neurophysiology Practice 2 (Jan. 2017), 19–25. https://doi.org/10.1016/j.cnp.2016.12.003

[17]

Florian Mueller, Stefan Agamanolis, and Rosalind Picard. 2003. Exertion interfaces: sports over a distance for social bonding and fun. In Proceedings of the conference on Human factors in computing systems - CHI ’03. ACM Press, Ft. Lauderdale, Florida, USA, 561. https://doi.org/10.1145/642611.642709

Digital Library

[18]

Florian Mueller, Rakesh Patibanda, Rich Byrne, Zhuying Li, Yan Wang, Josh Andres, Xiang Li, Jonathan Marquez, Stefan Greuter, Jonathan Duckworth, and Joe Marshall. 2021. Limited Control Over the Body as Intriguing Play Design Resource. https://doi.org/10.1145/3411764.3445744

Digital Library

[19]

Lennart Erik Nacke, Michael Kalyn, Calvin Lough, and Regan Lee Mandryk. 2011. Biofeedback game design: using direct and indirect physiological control to enhance game interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, Vancouver BC Canada, 103–112. https://doi.org/10.1145/1978942.1978958

Digital Library

[20]

Femke Nijboer, Jens Clausen, Brendan Z. Allison, and Pim Haselager. 2013. The Asilomar Survey: Stakeholders’ Opinions on Ethical Issues Related to Brain-Computer Interfacing. Neuroethics 6, 3 (Dec. 2013), 541–578. https://doi.org/10.1007/s12152-011-9132-6

[21]

Anton Nijholt. 2008. BCI for Games: A ‘State of the Art’ Survey. In Entertainment Computing - ICEC 2008, Scott M. Stevens and Shirley J. Saldamarco (Eds.). Vol. 5309. Springer Berlin Heidelberg, Berlin, Heidelberg, 225–228. https://doi.org/10.1007/978-3-540-89222-9_29 Series Title: Lecture Notes in Computer Science.

Digital Library

[22]

Miguel Pais-Vieira, Mikhail Lebedev, Carolina Kunicki, Jing Wang, and Miguel A. L. Nicolelis. 2013. A Brain-to-Brain Interface for Real-Time Sharing of Sensorimotor Information. Scientific Reports 3, 1 (Dec. 2013), 1319. https://doi.org/10.1038/srep01319

[23]

Walter Paulus. 2011. Transcranial electrical stimulation (tES – tDCS; tRNS, tACS) methods. Neuropsychological Rehabilitation 21, 5 (Oct. 2011), 602–617. https://doi.org/10.1080/09602011.2011.557292 Publisher: Routledge _eprint: https://doi.org/10.1080/09602011.2011.557292.

[24]

Katie Salen and Eric Zimmerman. 2003. Rules of Play: Game Design Fundamentals. The MIT Press.

Digital Library

[25]

Bo Wan, Chi Vi, Sriram Subramanian, and Diego Martinez Plasencia. 2016. Enhancing Interactivity with Transcranial Direct Current Stimulation. In Companion Publication of the 21st International Conference on Intelligent User Interfaces. ACM, Sonoma California USA, 41–44. https://doi.org/10.1145/2876456.2879482

Digital Library

[26]

Filip Škola and Fotis Liarokapis. [n.d.]. Examining and Enhancing the Illusory Touch Perception in Virtual Reality Using Non-Invasive Brain Stimulation | Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. https://dl.acm.org/doi/10.1145/3290605.3300477

Cited By

Patibanda RSaini AOverdevest NMontoya MLi XChen YNisal SAndres JKnibbe Jvan den Hoven EMueller F(2023)Fused Spectatorship: Designing Bodily Experiences Where Spectators Become PlayersProceedings of the ACM on Human-Computer Interaction10.1145/36110497:CHI PLAY(769-802)Online publication date: 4-Oct-2023
https://dl.acm.org/doi/10.1145/3611049
Semertzidis NZambetta FMueller F(2023)Brain-Computer Integration: A Framework for the Design of Brain-Computer Interfaces from an Integrations PerspectiveACM Transactions on Computer-Human Interaction10.1145/360362130:6(1-48)Online publication date: 25-Sep-2023
https://dl.acm.org/doi/10.1145/3603621
Andres JSemertzidis NLi ZWang YFloyd Mueller F(2023)Integrated Exertion—Understanding the Design of Human–Computer Integration in an Exertion ContextACM Transactions on Computer-Human Interaction10.1145/352835229:6(1-28)Online publication date: 11-Jan-2023
https://dl.acm.org/doi/10.1145/3528352

Index Terms

Telepathic Play: Towards Playful Experiences Based on Brain-to-brain Interfacing

Index terms have been assigned to the content through auto-classification.

Recommendations

Brain-Computer Interfacing for Intelligent Systems

Advances in cognitive neuroscience and brain-imaging technologies give us the unprecedented ability to interface directly with brain activity. These technologies let us monitor physical processes in the brain that correspond with certain forms of ...
Brain stimulation and brain computer interfacing
HCI '18: Proceedings of the 32nd International BCS Human Computer Interaction Conference

In this workshop paper, we present two of our team's findings on the effect of brain electrical stimulation on BCI performance, reflecting a trend in neuro-engineering research. In many applications, BCI technology targets users with impaired neural ...
Brain-Computer Interface using Directional Auditory Perception
AHs '23: Proceedings of the Augmented Humans International Conference 2023

We investigate the potential of brain-computer interface (BCI) using electroencephalogram (EEG) induced by listening (or recalling) auditory stimuli of different directions. In the initial attempt, we apply a time series classification model based on ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI PLAY '21: Extended Abstracts of the 2021 Annual Symposium on Computer-Human Interaction in Play

October 2021

414 pages

ISBN:9781450383561

DOI:10.1145/3450337

Editors:
Günter Wallner
JKU Linz, Austria & TU Eindhoven, The Netherlands
,
Alexander Meschtscherjakov
Paris Lodron University of Salzburg, Austria
,
Max Birk
Eindhoven University of Technology, The Netherlands
,
Jo Iacovides
University of York, UK
,
Mitchell McEwan
Macquarie University, Australia

Copyright © 2021 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 15 October 2021

Check for updates

Author Tags

Qualifiers

Work in progress
Research
Refereed limited

Conference

CHI PLAY '21

Sponsor:

SIGCHI

CHI PLAY '21: The Annual Symposium on Computer-Human Interaction in Play

October 18 - 21, 2021

Virtual Event, Austria

Acceptance Rates

Overall Acceptance Rate 421 of 1,386 submissions, 30%

Upcoming Conference

CHI PLAY '24

Sponsor:
sigchi

The Annual Symposium on Computer-Human Interaction in Play

October 14 - 17, 2024

Tampere , Finland

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
277
Total Downloads

Downloads (Last 12 months)61
Downloads (Last 6 weeks)5

Reflects downloads up to 15 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Patibanda RSaini AOverdevest NMontoya MLi XChen YNisal SAndres JKnibbe Jvan den Hoven EMueller F(2023)Fused Spectatorship: Designing Bodily Experiences Where Spectators Become PlayersProceedings of the ACM on Human-Computer Interaction10.1145/36110497:CHI PLAY(769-802)Online publication date: 4-Oct-2023
https://dl.acm.org/doi/10.1145/3611049
Semertzidis NZambetta FMueller F(2023)Brain-Computer Integration: A Framework for the Design of Brain-Computer Interfaces from an Integrations PerspectiveACM Transactions on Computer-Human Interaction10.1145/360362130:6(1-48)Online publication date: 25-Sep-2023
https://dl.acm.org/doi/10.1145/3603621
Andres JSemertzidis NLi ZWang YFloyd Mueller F(2023)Integrated Exertion—Understanding the Design of Human–Computer Integration in an Exertion ContextACM Transactions on Computer-Human Interaction10.1145/352835229:6(1-28)Online publication date: 11-Jan-2023
https://dl.acm.org/doi/10.1145/3528352

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents