research-article

BYO*: Utilizing 3D Printed Tangible Tools for Interaction on Interactive Surfaces

Authors:

Sebastian Günther,

Martin Schmitz,

Florian Müller,

Max MühlhäuserAuthors Info & Claims

SmartObject '17: Proceedings of the 2017 ACM Workshop on Interacting with Smart Objects

Pages 21 - 26

https://doi.org/10.1145/3038450.3038456

Published: 13 March 2017 Publication History

Abstract

Sharing and manipulating information are essential for collaborative work in meeting scenarios. Nowadays, people tend to bring their own devices as a result of increasing mobility possibilities. However, transferring data from one device to another can be cumbersome and tedious if restrictions like different platforms, form factors or environmental limitations apply. In this paper, we present two concepts to enrich interaction on and between devices through 3D printed customized tangibles: 1) Bring your own information, and 2) bring your own tools. For this, we enable interactivity for low-cost and passive tangible 3D printed objects by adding conductive material and make use of touch-enabled surfaces. Our system allows users to easily share digital contents across various devices and to manipulate them with individually designed tools without additional hardware required.

References

[1]

Aurélien Ammeloot, David Benyon, and Oli Mival. 2015. Design principles for collaborative device ecologies. In Proceedings of the 2015 British HCI Conference on - British HCI '15. ACM Press, New York, New York, USA, 255--256. x9781450336437 http://dx.doi.org/10.1145/2783446.2783598

Digital Library

[2]

Patrick Baudisch, Torsten Becker, and Frederik Rudeck. 2010. Lumino : Tangible Blocks for Tabletop Computers Based on Glass Fiber Bundles. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '10) (2010), 1165--1174. x9781605589299 http://dx.doi.org/10.1145/1753326.1753500

Digital Library

[3]

Eric Brockmeyer, Ivan Poupyrev, and Scott Hudson. 2013. PAPILLON: Designing Curved Display Surfaces with Printed Optics. In Proceedings of the 26th annual ACM symposium on User interface software and technology - UIST '13. ACM Press, New York, New York, USA, 457--462. x9781450322683 http://dx.doi.org/10.1145/2501988.2502027

Digital Library

[4]

William Buxton, Ralph Hill, and Peter Rowley. 1985. Issues and Techniques in Touch-sensitive Tablet Input. In Proceedings of the 12th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH '85). ACM, New York, NY, USA, 215--224. x0--89791--166-0 http://dx.doi.org/10.1145/325334.325239

Digital Library

[5]

Liwei Chan, Stefanie Müller, Anne Roudaut, and Patrick Baudisch. 2012. CapStones and ZebraWidgets: sensing stacks of building blocks, dials and sliders on capacitive touch screens. In Proceedings of the 2012 ACM annual conference on Human Factors in Computing Systems - CHI '12. ACM Press, New York, New York, USA, 2189--2192. x9781450310154 http://dx.doi.org/10.1145/2207676.2208371

Digital Library

[6]

Jonathan Hook, Thomas Nappey, Steve Hodges, Peter Wright, and Patrick Olivier. 2014. Making 3D Printed Objects Interactive Using Wireless Accelerometers. In Proceedings of the extended abstracts of the 32nd annual ACM conference on Human factors in computing systems - CHI EA '14. ACM Press, New York, New York, USA, 1435--1440. x9781450324748 http://dx.doi.org/10.1145/2559206.2581137

Digital Library

[7]

Yoshio Ishiguro and Ivan Poupyrev. 2014. 3D Printed Interactive Speakers. In Proceedings of the 32nd annual ACM conference on Human factors in computing systems - CHI '14. ACM Press, New York, New York, USA, 1733--1742. x9781450324731 http://dx.doi.org/10.1145/2556288.2557046

Digital Library

[8]

Hiroshi Ishii and Brygg Ullmer. 1997. Tangible Bits: Towards Seamless Interfaces Between People, Bits and Atoms. In Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems (CHI '97). ACM, New York, NY, USA, 234--241. x0--89791--802--9 http://dx.doi.org/10.1145/258549.258715

Digital Library

[9]

S Kratz, T Westermann, M Rohs, and G Essl. 2011. CapWidgets: tangile widgets versus multi-touch controls on mobile devices. Proceedings of CHI 2011 (2011), 1351--1356. x9781450302685 http://dx.doi.org/10.1145/1979742.1979773

Digital Library

[10]

Gierad Laput, Eric Brockmeyer, Scott E. Hudson, and Chris Harrison. 2015. Acoustruments: Passive, Acoustically-Driven Interactive Controls for Hand Held Devices. Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems - CHI '15 (2015). x9781450331456 http://dx.doi.org/10.1145/2702123.2702416

Digital Library

[11]

Simon J Leigh, Robert J Bradley, Christopher P Purssell, Duncan R Billson, and David a Hutchins. 2012. A Simple, Low-Cost Conductive Composite Material for 3D Printing of Electronic Sensors. In PloS one, Vol. 7. e49365. 1932--6203 http://dx.doi.org/10.1371/journal.pone.0049365

[12]

Jakob Leitner and Michael Haller. 2011. Geckos: Combining Magnets and Pressure Images to Enable New Tangible-object Design and Interaction. In Proceedings of the 2011 annual conference on Human factors in computing systems - CHI '11. ACM Press, New York, New York, USA, 2985. x9781450302289 http://dx.doi.org/10.1145/1978942.1979385

Digital Library

[13]

Rong-Hao Liang, Han-Chih Kuo, Liwei Chan, De-Nian Yang, and Bing-Yu Chen. 2014. GaussStones : Shielded Magnetic Tangibles for Multi-Token Interactions on Portable Displays. In Proceedings of the 27th annual ACM symposium on User interface software and technology - UIST '14. ACM Press, New York, New York, USA, 365--372. x9781450330695 http://dx.doi.org/10.1145/2642918.2647384

Digital Library

[14]

Rung-Huei Rong-Hao RH Liang, KY Kai-Yin Cheng, Liwei Chan, Rong-hao Liang Kai-yin Cheng, Liwei Chan, Rung-Huei Rong-Hao RH Liang, KY Kai-Yin Cheng, Liwei Chan, Chuan-Xhyuan Peng, Mike Y. Chen, Rung-Huei Rong-Hao RH Liang, De-Nian Yang, and Bing-Yu Chen. 2013. GaussBits: Magnetic Tangible Bits for Portable and Occlusion-Free Near-Surface Interactions. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems - CHI '13 (2013), 1391--1400. x9781450318990 http://dx.doi.org/10.1145/2470654.2466185

Digital Library

[15]

Makoto Ono, Buntarou Shizuki, and Jiro Tanaka. 2013. Touch & Activate : Adding Interactivity to Existing Objects using Active Acoustic Sensing. In Proceedings of the 26th annual ACM symposium on User interface software and technology - UIST '13. ACM Press, New York, New York, USA, 31--40. x9781450322683 http://dx.doi.org/10.1145/2501988.2501989

Digital Library

[16]

Jun Rekimoto. 2002. SmartSkin: an infrastructure for freehand manipulation on interactive surfaces. In Proceedings of the SIGCHI conference on Human factors in computing systems Changing our world, changing ourselves - CHI '02. ACM Press, New York, New York, USA, 113. x1581134533 http://dx.doi.org/10.1145/503376.503397

Digital Library

[17]

Munehiko Sato, Ivan Poupyrev, and Chris Harrison. 2012. Touché: Enhancing Touch Interaction on Humans, Screens, Liquids, and Everyday Objects. In Proceedings of the 2012 ACM annual conference on Human Factors in Computing Systems - CHI '12. ACM Press, New York, New York, USA, 483. x9781450310154 http://dx.doi.org/10.1145/2207676.2207743

Digital Library

[18]

Valkyrie Savage, Colin Chang, and Björn Hartmann. 2013. Sauron: Embedded Single-camera Sensing of Printed Physical User Interfaces. In Proceedings of the 26th annual ACM symposium on User interface software and technology - UIST '13. ACM Press, New York, New York, USA, 447--456. x9781450322683 http://dx.doi.org/10.1145/2501988.2501992

Digital Library

[19]

Valkyrie Savage, Ryan Schmidt, Tovi Grossman, George Fitzmaurice, and Björn Hartmann. 2014. A Series of Tubes: Adding Interactivity to 3D Prints Using Internal Pipes. In Proceedings of the 27th annual ACM symposium on User interface software and technology - UIST '14. ACM Press, New York, New York, USA, 3--12. x9781450330695 http://dx.doi.org/10.1145/2642918.2647374

Digital Library

[20]

Martin Schmitz, Mohammadreza Khalilbeigi, Matthias Balwierz, Roman Lissermann, Max Mühlhauser, and Jürgen Steimle. 2015. Capricate: A Fabrication Pipeline to Design and 3D Print Capacitive Touch Sensors for Interactive Objects. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology - UIST '15. ACM Press, New York, New York, USA, 253--258. x9781450337793 http://dx.doi.org/10.1145/2807442.2807503

Digital Library

[21]

Martin Schmitz, Andreas Leister, Niloofar Dezfuli, Jan Riemann, Florian Müller, and Max Mühlhauser. 2016. Liquido: Embedding Liquids into 3D Printed Objects to Sense Tilting and Motion. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems - CHI EA '16. ACM Press, New York, New York, USA, 2688--2696. x9781450340823 http://dx.doi.org/10.1145/2851581.2892275

Digital Library

[22]

Simon Voelker, Christian Cherek, Jan Thar, Thorsten Karrer, Christian Thoresen, Kjell Ivar Øvergård, and Jan Borchers. 2015. PERCs: Persistently Trackable Tangibles on Capacitive Multi-Touch Displays. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology - UIST '15. ACM Press, New York, New York, USA, 351--356. x9781450337793 http://dx.doi.org/10.1145/2807442.2807466

Digital Library

[23]

Simon Voelker, Kosuke Nakajima, Christian Thoresen, Yuichi Itoh, Kjell Ivar Øvergård, and Jan Borchers. 2013. PUCs: Detecting transparent, passive untouched capacitive widgets on unmodified multi-touch displays. In Proceedings of the 2013 ACM international conference on Interactive tabletops and surfaces - ITS '13. ACM Press, New York, New York, USA, 101--104. x9781450322713 http://dx.doi.org/10.1145/2512349.2512791

Digital Library

[24]

Daniel Wigdor, Hao Jiang, Clifton Forlines, Michelle Borkin, and Chia Shen. 2009. WeSpace. In Proceedings of the 27th international conference on Human factors in computing systems - CHI 09. ACM Press, New York, New York, USA, 1237. x9781605582467 http://dx.doi.org/10.1145/1518701.1518886

Digital Library

[25]

Cary Williams, Xing Dong Yang, Grant Partridge, Joshua Millar-Usiskin, Arkady Major, and Pourang Irani. 2011. TZee: Exploiting the Lighting Properties of Multi-touch Tabletops for Tangible 3D Interactions. In Proceedings of the 2011 annual conference on Human factors in computing systems - CHI '11. ACM Press, New York, New York, USA, 1363. x9781450302289 http://dx.doi.org/10.1145/1978942.1979143

Digital Library

[26]

Karl Willis, Eric Brockmeyer, Scott Hudson, and Ivan Poupyrev. 2012. Printed Optics: 3D Printing of Embedded Optical Elements for Interactive Devices. In Proceedings of the 25th annual ACM symposium on User interface software and technology - UIST '12. ACM Press, New York, New York, USA, 589--598. x9781450315807 http://dx.doi.org/10.1145/2380116.2380190

Digital Library

[27]

Neng-Hao Yu, Li-Wei Chan, Seng-yong Yong Lau, Sung-Sheng Tsai, I-Chun Hsiao, Dian-je Tsai, Lung-pan Cheng, Fang-i Hsiao, Mike Y Chen, Polly Huang, Yi-ping Hung, Li-Wei Chan, Seng-yong Yong Lau, Sung-Sheng Tsai, I-Chun Hsiao, Dian-je Tsai, Fang-i Hsiao, Lung-pan Cheng, and Mike Y Chen. 2011. TUIC: Enabling Tangible Interaction on Capacitive Multi-touch Display. Proceedings of the 2011 annual conference on Human factors in computing systems - CHI '11 (2011), 2995--3014. x9781450302289 http://dx.doi.org/10.1145/1978942.1979386

Digital Library

Cited By

Campos Zamora DDogan MSiu AKoh EXiao C(2024)MoiréWidgets: High-Precision, Passive Tangible Interfaces via Moiré EffectProceedings of the CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642734(1-10)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642734
Dogan MGarcia-Martin RHaertel PO'Keefe JTaka AAurora ASanchez-Reillo RMueller S(2023)BrightMarker: 3D Printed Fluorescent Markers for Object TrackingProceedings of the 36th Annual ACM Symposium on User Interface Software and Technology10.1145/3586183.3606758(1-13)Online publication date: 29-Oct-2023
https://dl.acm.org/doi/10.1145/3586183.3606758
Ikematsu KKato K(2023)ShiftTouch: Extending Touchscreens with Passive Interfaces using Small Occluded Area for Discrete Touch InputProceedings of the Seventeenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3569009.3572742(1-15)Online publication date: 26-Feb-2023
https://dl.acm.org/doi/10.1145/3569009.3572742
Show More Cited By

Index Terms

BYO*: Utilizing 3D Printed Tangible Tools for Interaction on Interactive Surfaces
1. Human-centered computing

Recommendations

Flexibles: Deformation-Aware 3D-Printed Tangibles for Capacitive Touchscreens
CHI '17: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems

We introduce Flexibles: 3D-printed flexible tangibles that are deformation-aware and operate on capacitive touchscreens. Flexibles add expressive deformation input to interaction with on-screen tangibles. Based on different types of deformation mapping, ...
Capricate: A Fabrication Pipeline to Design and 3D Print Capacitive Touch Sensors for Interactive Objects
UIST '15: Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology

3D printing is widely used to physically prototype the look and feel of 3D objects. Interaction possibilities of these prototypes, however, are often limited to mechanical parts or post-assembled electronics. In this paper, we present Capricate, a ...
Exploring 3D Printed Interaction
TEI '16: Proceedings of the TEI '16: Tenth International Conference on Tangible, Embedded, and Embodied Interaction

3D printing is widely used to physically prototype the look and feel of 3D objects. However, interaction possibilities of these prototypes are often limited to mechanical parts or post-assembled electronics. Moreover, fabricating interactive 3D printed ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

SmartObject '17: Proceedings of the 2017 ACM Workshop on Interacting with Smart Objects

March 2017

44 pages

ISBN:9781450349024

DOI:10.1145/3038450

General Chairs:
Dirk Schnelle-Walka
Harman International, Germany
,
Florian Müller
TU Darmstadt, Germany

Copyright © 2017 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 March 2017

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Conference

IUI'17

Sponsor:

IUI'17: 22nd International Conference on Intelligent User Interfaces

March 13, 2017

Limassol, Cyprus

Acceptance Rates

SmartObject '17 Paper Acceptance Rate 3 of 3 submissions, 100%;

Overall Acceptance Rate 3 of 3 submissions, 100%

Upcoming Conference

IUI '25

Sponsor:
sigai
sigai

30th International Conference on Intelligent User Interfaces

March 24 - 27, 2025

Cagliari , Italy

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

22
Total Citations
View Citations
411
Total Downloads

Downloads (Last 12 months)28
Downloads (Last 6 weeks)6

Reflects downloads up to 03 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Campos Zamora DDogan MSiu AKoh EXiao C(2024)MoiréWidgets: High-Precision, Passive Tangible Interfaces via Moiré EffectProceedings of the CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642734(1-10)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642734
Dogan MGarcia-Martin RHaertel PO'Keefe JTaka AAurora ASanchez-Reillo RMueller S(2023)BrightMarker: 3D Printed Fluorescent Markers for Object TrackingProceedings of the 36th Annual ACM Symposium on User Interface Software and Technology10.1145/3586183.3606758(1-13)Online publication date: 29-Oct-2023
https://dl.acm.org/doi/10.1145/3586183.3606758
Ikematsu KKato K(2023)ShiftTouch: Extending Touchscreens with Passive Interfaces using Small Occluded Area for Discrete Touch InputProceedings of the Seventeenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3569009.3572742(1-15)Online publication date: 26-Feb-2023
https://dl.acm.org/doi/10.1145/3569009.3572742
Lazna RBarvir RVondrakova ABrus J(2022)Creating a Haptic 3D Model of Wenceslas Hill in OlomoucApplied Sciences10.3390/app12211081712:21(10817)Online publication date: 25-Oct-2022
https://doi.org/10.3390/app122110817
Steuerlein BMayer S(2022)Conductive Fiducial Tangibles for EveryoneProceedings of the ACM on Human-Computer Interaction10.1145/35467186:MHCI(1-22)Online publication date: 20-Sep-2022
https://dl.acm.org/doi/10.1145/3546718
Günther SNelles FHorn FMühlhäuser M(2022)Demonstrating MagneTisch: Tangibles in Motion on an Interactive SurfaceProceedings of Mensch und Computer 202210.1145/3543758.3547520(590-593)Online publication date: 4-Sep-2022
https://dl.acm.org/doi/10.1145/3543758.3547520
Schön DKosch TSchmitz MMüller FGünther SKreutz JMühlhäuser M(2022)TrackItPipe: A Fabrication Pipeline To Incorporate Location and Rotation Tracking Into 3D Printed ObjectsAdjunct Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology10.1145/3526114.3558719(1-5)Online publication date: 29-Oct-2022
https://dl.acm.org/doi/10.1145/3526114.3558719
Dogan MTaka ALu MZhu YKumar AGupta AMueller S(2022)InfraredTags: Embedding Invisible AR Markers and Barcodes Using Low-Cost, Infrared-Based 3D Printing and Imaging ToolsProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3501951(1-12)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3501951
Visschedijk AKim HTejada CAshbrook D(2022)ClipWidgets: 3D-printed Modular Tangible UI Extensions for SmartphonesProceedings of the Sixteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3490149.3501314(1-11)Online publication date: 13-Feb-2022
https://dl.acm.org/doi/10.1145/3490149.3501314
Ikematsu KKato KKawahara YKitamura YQuigley AIsbister KIgarashi TBjørn PDrucker S(2021)LightTouch Gadgets: Extending Interactions on Capacitive Touchscreens by Converting Light Emission to Touch InputsProceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445581(1-11)Online publication date: 6-May-2021
https://dl.acm.org/doi/10.1145/3411764.3445581
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents