research-article

The TUIO 2.0 Protocol: An Abstraction Framework for Tangible Interactive Surfaces

Authors:

Martin Kaltenbrunner,

Florian EchtlerAuthors Info & Claims

Proceedings of the ACM on Human-Computer Interaction, Volume 2, Issue EICS

Article No.: 8, Pages 1 - 35

https://doi.org/10.1145/3229090

Published: 19 June 2018 Publication History

Abstract

Since its introduction in 2005, the TUIO protocol has been widely employed within a multitude of usage contexts in tangible and multi-touch interaction. While its simple and versatile design still covers the core functionality of interactive tabletop systems, the conceptual and technical developments of the past decade also led to a variety of ad-hoc extensions and modifications for specific scenarios. In this paper, we present an analysis of the strengths and shortcomings of TUIO 1.1, leading to the constitution of an extended abstraction model for tangible interactive surfaces and the specification of the second-generation TUIO 2.0 protocol, along with several example encodings of existing tangible interaction concepts.

References

[1]

Lisa Anthony and Jacob O. Wobbrock. 2012. $N-protractor: A Fast and Accurate Multistroke Recognizer. In Proceedings of Graphics Interface 2012 (GI '12). Canadian Information Processing Society, Toronto, Ont., Canada, Canada, 117--120. http://dl.acm.org/citation.cfm?id=2305276.2305296

Digital Library

[2]

Sandra Baldassarri, Eva Cerezo, and José Ramón Beltrán. 2017. Immertable: A Configurable and Customizable Tangible Tabletop for Audiovisual and Musical Control. In Proceedings of the XVIII International Conference on Human Computer Interaction (Interaccion '17). ACM, New York, NY, USA, Article 32, 8 pages.

Digital Library

[3]

Michel Beaudouin-Lafon. 2004. Designing Interaction, Not Interfaces. In Proceedings of the Working Conference on Advanced Visual Interfaces (AVI '04). ACM, New York, NY, USA, 15--22.

Digital Library

[4]

S. Mealla Cincuegrani, S. Jordà, and A. Väljamäe. 2016. Physiopucks: Increasing User Motivation by Combining Tangible and Implicit Physiological Interaction. ACM Trans. Comput.-Hum. Interact. 23, 1, Article 4 (Feb. 2016), 22 pages.

Digital Library

[5]

Paul Dietz and Darren Leigh. 2001. DiamondTouch: A Multi-user Touch Technology. In Proceedings of the 14th Annual ACM Symposium on User Interface Software and Technology. ACM.

Digital Library

[6]

Florian Echtler and Andreas Butz. 2012. GISpL: Gestures Made Easy. In Proceedings of the Sixth International Conference on Tangible, Embedded and Embodied Interaction. ACM.

Digital Library

[7]

Florian Echtler, Manuel Huber, and Gudrun Klinker. 2008. Shadow Tracking on Multi-touch Tables. In Proceedings of the Working Conference on Advanced Visual Interfaces. ACM.

Digital Library

[8]

Florian Echtler and Gudrun Klinker. 2008. A Multitouch Software Architecture. In Proceedings of the 5th Nordic Conference on Human-computer Interaction: Building Bridges. ACM, New York, NY.

Digital Library

[9]

Philipp Ewerling, Alexander Kulik, and Bernd Froehlich. 2012. Finger and Hand Detection for Multi-touch Interfaces Based on Maximally Stable Extremal Regions. In Proceedings of the 2012 ACM International Conference on Interactive Tabletops and Surfaces (ITS '12). ACM, New York, NY, USA, 173--182.

Digital Library

[10]

Matthew G. Gorbet, Maggie Orth, and Hiroshi Ishii. 1998. Triangles: Tangible Interface for Manipulation and Exploration of Digital Information Topography. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM.

Digital Library

[11]

Jefferson Y. Han. 2005. Multi-touch Sensing Through Frustrated Total Internal Reflection. In ACM SIGGRAPH 2005 Sketches (SIGGRAPH '05). ACM.

Digital Library

[12]

Martin Kaltenbrunner. 2009. reacTIVision and TUIO: A Tangible Tabletop Toolkit. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces (ITS2009). ACM, Banff, Canada.

Digital Library

[13]

Martin Kaltenbrunner. 2018. An Abstraction Framework for Tangible Interactive Surfaces. Doctoral Thesis. BauhausUniversität Weimar. http://nbn-resolving.de/urn:nbn:de:gbv:wim2--20180205--37178

[14]

Martin Kaltenbrunner, Till Bovermann, Ross Bencina, and Enrico Costanza. 2005. TUIO - A Protocol for Table Based Tangible User Interfaces. In Proceedings of the 6th International Workshop on Gesture in Human-Computer Interaction and Simulation (GW 2005). Vannes, France.

[15]

Martin Kaltenbrunner and Florian Echtler. 2014. TUIO Hackathon. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces (ITS2014). Dresden, Germany.

Digital Library

[16]

Dietrich Kammer, Jan Wojdziak, Mandy Keck, Rainer Groh, and Severin Taranko. 2010. Towards a Formalization of Multi-Touch Gestures. In ACM International Conference on Interactive Tabletops and Surfaces (ITS '10). ACM, New York, NY, USA, 49--58.

Digital Library

[17]

Kenrick Kin, Björn Hartmann, Tony DeRose, and Maneesh Agrawala. 2012. Proton++: A Customizable Declarative Multitouch Framework. In Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology (UIST '12). ACM, New York, NY, USA, 477--486.

Digital Library

[18]

Scott R. Klemmer, Jack Li, James Lin, and James A. Landay. 2004. Papier-Mache: Toolkit Support for Tangible Input. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM.

Digital Library

[19]

David Ledo, Steven Houben, Jo Vermeulen, Nicolai Marquardt, Lora Oehlberg, and Saul Greenberg. 2018. Evaluation Strategies for HCI Toolkit Research. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, Article 36, 17 pages.

Digital Library

[20]

Jessica Lo and Audrey Girouard. 2017. Bendy: Exploring Mobile Gaming with Flexible Devices. In Proceedings of the Eleventh International Conference on Tangible, Embedded, and Embodied Interaction (TEI '17). ACM, New York, NY, USA, 163--172.

Digital Library

[21]

David Merrill, Jeevan Kalanithi, and Pattie Maes. 2007. Siftables: Towards Sensor Network User Interfaces. In Proceedings of the 1st International Conference on Tangible and Embedded Interaction. ACM.

Digital Library

[22]

James Patten and Hiroshi Ishii. 2007. Mechanical Constraints As Computational Constraints in Tabletop Tangible Interfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM.

Digital Library

[23]

Raf Ramakers, Davy Vanacken, Kris Luyten, Karin Coninx, and Johannes Schöning. 2012. Carpus: A Non-intrusive User Identification Technique for Interactive Surfaces. In Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology. ACM.

Digital Library

[24]

Christophe Scholliers, Lode Hoste, Beat Signer, and Wolfgang De Meuter. 2011. Midas: A Declarative Multi-Touch Interaction Framework. In Proceedings of the Fifth International Conference on Tangible, Embedded, and Embodied Interaction (TEI '11). ACM, New York, NY, USA, 49--56.

Digital Library

[25]

Brygg Ullmer and Hiroshi Ishii. 1999. mediaBlocks: Tangible Interfaces for Online Media. In CHI '99 Extended Abstracts on Human Factors in Computing Systems. ACM.

Digital Library

[26]

Brygg Ullmer and Hiroshi Ishii. 2000. Emerging frameworks for tangible user interfaces. IBM systems journal (2000).

Digital Library

[27]

Radu-Daniel Vatavu, Lisa Anthony, and Jacob O. Wobbrock. 2012. Gestures As Point Clouds: A $P Recognizer for User Interface Prototypes. In Proceedings of the 14th ACM International Conference on Multimodal Interaction (ICMI '12). ACM, New York, NY, USA, 273--280.

Digital Library

[28]

Malte Weiss, Julie Wagner, Yvonne Jansen, Roger Jennings, Ramsin Khoshabeh, James D. Hollan, and Jan Borchers. 2009. SLAP Widgets: Bridging the Gap Between Virtual and Physical Controls on Tabletops. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM.

Digital Library

[29]

Jacob O. Wobbrock, Andrew D. Wilson, and Yang Li. 2007. Gestures Without Libraries, Toolkits or Training: A $1 Recognizer for User Interface Prototypes. In Proceedings of the 20th Annual ACM Symposium on User Interface Software and Technology (UIST '07). ACM, New York, NY, USA, 159--168.

Digital Library

Cited By

Frisson CWanderley M(2023)Challenges and Opportunities of Force Feedback in MusicArts10.3390/arts1204014712:4(147)Online publication date: 10-Jul-2023
https://doi.org/10.3390/arts12040147
Da Costa VZen ETavares T(2023)The interface is on the table: Systematic Literature Review about interaction design to applications for tangible tabletops.Proceedings of the XXII Brazilian Symposium on Human Factors in Computing Systems10.1145/3638067.3638091(1-12)Online publication date: 16-Oct-2023
https://dl.acm.org/doi/10.1145/3638067.3638091
Echtler FMaierhöfer VHansen NWimmer R(2023)Demonstrating SurfaceCast: Ubiquitous, Cross-Device Surface SharingCompanion Proceedings of the 2023 Conference on Interactive Surfaces and Spaces10.1145/3626485.3626545(65-68)Online publication date: 5-Nov-2023
https://dl.acm.org/doi/10.1145/3626485.3626545
Show More Cited By

Index Terms

The TUIO 2.0 Protocol: An Abstraction Framework for Tangible Interactive Surfaces

Recommendations

Mouse 2.0: multi-touch meets the mouse
UIST '09: Proceedings of the 22nd annual ACM symposium on User interface software and technology

In this paper we present novel input devices that combine the standard capabilities of a computer mouse with multi-touch sensing. Our goal is to enrich traditional pointer-based desktop interactions with touch and gestures. To chart the design space, we ...
Development strategies for tangible interaction on horizontal surfaces
TEI '10: Proceedings of the fourth international conference on Tangible, embedded, and embodied interaction

Tangible interactions on horizontal surfaces are increasingly relevant for collaborative applications, embodied interaction, musical performance, and interaction with 3D information. This unique studio opportunity introduces approaches to developing ...
Design and evaluation of interaction models for multi-touch mice
GI '10: Proceedings of Graphics Interface 2010

Adding multi-touch sensing to the surface of a mouse has the potential to substantially increase the number of interactions available to the user. However, harnessing this increased bandwidth is challenging, since the user must perform multi-touch ...

Comments

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Human-Computer Interaction

Proceedings of the ACM on Human-Computer Interaction Volume 2, Issue EICS

June 2018

293 pages

EISSN:2573-0142

DOI:10.1145/3233739

Editors:
Clifford Lampe
University of Michigan
,
Jeff Nichols
Google
,
Karrie Karahalios
University of Illinois Urbana-Champaign
,
Geraldine Fitzpatrick
Vienna University of Technology
,
Uichin Lee
KAIST
,
Andres Monroy-Hernandez
Microsoft Research
,
Wolfgang Stuerzlinger
Simon Fraser University

Issue’s Table of Contents

Copyright © 2018 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 19 June 2018

Published in PACMHCI Volume 2, Issue EICS

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

15
Total Citations
View Citations
257
Total Downloads

Downloads (Last 12 months)26
Downloads (Last 6 weeks)5

Reflects downloads up to 15 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Frisson CWanderley M(2023)Challenges and Opportunities of Force Feedback in MusicArts10.3390/arts1204014712:4(147)Online publication date: 10-Jul-2023
Da Costa VZen ETavares T(2023)The interface is on the table: Systematic Literature Review about interaction design to applications for tangible tabletops.Proceedings of the XXII Brazilian Symposium on Human Factors in Computing Systems10.1145/3638067.3638091(1-12)Online publication date: 16-Oct-2023
Echtler FMaierhöfer VHansen NWimmer R(2023)Demonstrating SurfaceCast: Ubiquitous, Cross-Device Surface SharingCompanion Proceedings of the 2023 Conference on Interactive Surfaces and Spaces10.1145/3626485.3626545(65-68)Online publication date: 5-Nov-2023
Nakaue YUra CKano HHirai S(2023)MarbLED: Embedded and Transmissive LED Touch Display System and Its Application Platform for Surface Computing with Engineered MarbleCompanion Proceedings of the 2023 Conference on Interactive Surfaces and Spaces10.1145/3626485.3626543(57-60)Online publication date: 5-Nov-2023
Echtler FMaierhöfer VHansen NWimmer R(2023)SurfaceCast: Ubiquitous, Cross-Device Surface SharingProceedings of the ACM on Human-Computer Interaction10.1145/36264757:ISS(286-308)Online publication date: 31-Oct-2023
Mohialdin ASaleh DTaher ESabry KEl-Said HAtia A(2023)DriveGuard: An Automated Interactive Alerting System to track and Analyze Drivers’ Behaviors on Road2023 Intelligent Methods, Systems, and Applications (IMSA)10.1109/IMSA58542.2023.10217448(502-507)Online publication date: 15-Jul-2023
Kikuchi KAmaoka T(2022)Fab KUI : Proposal of Collaborative 3D Modeling Method in Real Space by using KUI and Smartphone ARFab KUI : KUI とスマートフォンARを用いた実空間における共同3Dモデリング手法の提案The Journal of the Society for Art and Science10.3756/artsci.21.2321:1(23-36)Online publication date: 30-Mar-2022
Ullmer BShaer OMazalek AHummels C(2022)Weaving Fire into FormundefinedOnline publication date: 20-Jul-2022
Mthunzi EGetschmann CEchtler F(2021)Fast 3D point-cloud segmentation for interactive surfacesCompanion Proceedings of the 2021 Conference on Interactive Surfaces and Spaces10.1145/3447932.3491141(33-37)Online publication date: 14-Nov-2021
Mthunzi EEchtler F(2021)Artefact: A UML-based framework for model-driven development of interactive surface prototypesCompanion Proceedings of the 2021 Conference on Interactive Surfaces and Spaces10.1145/3447932.3490523(16-20)Online publication date: 14-Nov-2021
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents