research-article

Investigating How Smartphone Movement is Affected by Lying Down Body Posture

Authors:

Kaori Ikematsu,

Rachel Eardley,

Itiro SiioAuthors Info & Claims

Proceedings of the ACM on Human-Computer Interaction, Volume 4, Issue ISS

Article No.: 192, Pages 1 - 17

https://doi.org/10.1145/3427320

Published: 04 November 2020 Publication History

Abstract

In this paper, we investigated how "lying down'' body postures affected the use of the smartphone user interface (UI) design. Extending previous research that studied body postures, handgrips, and the movement of the smartphone. We have done this in three steps; (1) An online survey that examined what type of lying down postures, participants, utilized when operating a smartphone; (2) We broke down these lying down postures in terms of body angle (i.e., users facing down, facing up, and on their side) and body support; (3) We conducted an experiment questioning the effects that these body angles and body supports had on the participants' handgrips. What we found was that the smartphone moves the most (is the most unstable) in the "facing up (with support)'' condition. Additionally, we discovered that the participants preferred body posture was those that produced the least amount of motion (more stability) with their smartphones.

Supplementary Material

ZIP File (v4issa192aux.mp4.zip)

Download
123.63 MB

References

[1]

Myroslav Bachynskyi, Gregorio Palmas, Antti Oulasvirta, Jürgen Steimle, and Tino Weinkauf. 2015. Performance and Ergonomics of Touch Surfaces: A Comparative Study Using Biomechanical Simulation. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (Seoul, Republic of Korea) (CHI '15). ACM, New York, NY, USA, 1817--1826. https://doi.org/10.1145/2702123.2702607

Digital Library

[2]

Joanna Bergstrom-Lehtovirta and Antti Oulasvirta. 2014. Modeling the Functional Area of the Thumb on Mobile Touchscreen Surfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Toronto, Ontario, Canada) (CHI '14). ACM, New York, NY, USA, 1991--2000. https://doi.org/10.1145/2556288.2557354

Digital Library

[3]

Matthias Böhmer, Brent Hecht, Johannes Schöning, Antonio Krüger, and Gernot Bauer. 2011. Falling Asleep with Angry Birds, Facebook and Kindle: A Large Scale Study on Mobile Application Usage. In Proceedings of the 13th International Conference on Human Computer Interaction with Mobile Devices and Services (Stockholm, Sweden) (MobileHCI '11). ACM, New York, NY, USA, 47--56. https://doi.org/10.1145/2037373.2037383

Digital Library

[4]

Daniel Buschek and Florian Alt. 2017. ProbUI: Generalising Touch Target Representations to Enable Declarative Gesture Definition for Probabilistic GUIs. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI '17). ACM, New York, NY, USA, 4640--4653. https://doi.org/10.1145/3025453.3025502

Digital Library

[5]

Kelly Caine. 2016. Local Standards for Sample Size at CHI. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (San Jose, California, USA) (CHI '16). ACM, New York, NY, USA, 981--992. https://doi.org/10.1145/2858036.2858498

Digital Library

[6]

Lung-Pan Cheng, Fang-I Hsiao, Yen-Ting Liu, and Mike Y. Chen. 2012. IRotate: Automatic Screen Rotation Based on Face Orientation. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Austin, Texas, USA) (CHI '12). ACM, New York, NY, USA, 2203--2210. https://doi.org/10.1145/2207676.2208374

[7]

Lung-Pan Cheng, Meng Han Lee, Che-Yang Wu, Fang-I Hsiao, Yen-Ting Liu, Hsiang-Sheng Liang, Yi-Ching Chiu, Ming-Sui Lee, and Mike Y. Chen. 2013. IrotateGrasp: Automatic Screen Rotation Based on Grasp of Mobile Devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Paris, France) (CHI '13). ACM, New York, NY, USA, 3051--3054. https://doi.org/10.1145/2470654.2481424

[8]

Jacob Cohen. 1992. A power primer. Psychological bulletin, Vol. 112, 1 (1992), 155.

[9]

Christian Corsten, Bjoern Daehlmann, Simon Voelker, and Jan Borchers. 2017. BackXPress: Using Back-of-Device Finger Pressure to Augment Touchscreen Input on Smartphones. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI '17). ACM, New York, NY, USA, 4654--4666. https://doi.org/10.1145/3025453.3025565

Digital Library

[10]

Jeffrey Dean and Michael Brüwer. 1994. Control of human arm movements in two dimensions: Paths and joint control in avoiding simple linear obstacles. Experimental brain research, Vol. 97, 3 (1994), 497--514.

[11]

Rachel Eardley, Steve Gill, Anne Roudaut, Stephen Thompson, and Joanna Hare. 2016. Investigating How the Hand Interacts with Different Mobile Phones. In Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct (Florence, Italy) (MobileHCI '16). ACM, New York, NY, USA, 698--705. https://doi.org/10.1145/2957265.2961840

Digital Library

[12]

Rachel Eardley, Anne Roudaut, Steve Gill, and Stephen J. Thompson. 2017. Understanding Grip Shifts: How Form Factors Impact Hand Movements on Mobile Phones. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI '17). ACM, New York, NY, USA, 4680--4691. https://doi.org/10.1145/3025453.3025835

[13]

Rachel Eardley, Anne Roudaut, Steve Gill, and Stephen J. Thompson. 2018a. Designing for Multiple Hand Grips and Body Postures Within the UX of a Moving Smartphone. In Proceedings of the 2018 Designing Interactive Systems Conference (Hong Kong, China) (DIS '18). ACM, New York, NY, USA, 611--621. https://doi.org/10.1145/3196709.3196711

[14]

Rachel Eardley, Anne Roudaut, Steve Gill, and Stephen J. Thompson. 2018b. Investigating How Smartphone Movement is Affected by Body Posture. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI '18). ACM, New York, NY, USA, Article 202, bibinfonumpages8 pages. https://doi.org/10.1145/3173574.3173776

[15]

Franz Faul, Edgar Erdfelder, Axel Buchner, and Albert-Georg Lang. 2009. Statistical power analyses using G* Power 3.1: Tests for correlation and regression analyses. Behavior research methods, Vol. 41, 4 (2009), 1149--1160.

[16]

Mayank Goel, Leah Findlater, and Jacob Wobbrock. 2012a. WalkType: Using Accelerometer Data to Accomodate Situational Impairments in Mobile Touch Screen Text Entry. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Austin, Texas, USA) (CHI '12). ACM, New York, NY, USA, 2687--2696. https://doi.org/10.1145/2207676.2208662

Digital Library

[17]

Mayank Goel, Jacob Wobbrock, and Shwetak Patel. 2012b. GripSense: Using Built-in Sensors to Detect Hand Posture and Pressure on Commodity Mobile Phones. In Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology (Cambridge, Massachusetts, USA) (UIST '12). ACM, New York, NY, USA, 545--554. https://doi.org/10.1145/2380116.2380184

Digital Library

[18]

J.E. Gold, J.B. Driban, N. Thomas, T. Chakravarty, V. Channell, and E. Komaroff. 2012. Postures, typing strategies, and gender differences in mobile device usage: An observational study. Applied Ergonomics, Vol. 43, 2 (2012), 408 -- 412. https://doi.org/10.1016/j.apergo.2011.06.015 Special Section on Product Comfort.

[19]

Ken Hinckley, Seongkook Heo, Michel Pahud, Christian Holz, Hrvoje Benko, Abigail Sellen, Richard Banks, Kenton O'Hara, Gavin Smyth, and William Buxton. 2016. Pre-Touch Sensing for Mobile Interaction. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (San Jose, California, USA) (CHI '16). ACM, New York, NY, USA, 2869--2881. https://doi.org/10.1145/2858036.2858095

Digital Library

[20]

Ken Hinckley and Hyunyoung Song. 2011. Sensor Synaesthesia: Touch in Motion, and Motion in Touch. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Vancouver, BC, Canada) (CHI '11). ACM, New York, NY, USA, 801--810. https://doi.org/10.1145/1978942.1979059

Digital Library

[21]

Christian Holz and Patrick Baudisch. 2010. The Generalized Perceived Input Point Model and How to Double Touch Accuracy by Extracting Fingerprints. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Atlanta, Georgia, USA) (CHI '10). ACM, New York, NY, USA, 581--590. https://doi.org/10.1145/1753326.1753413

Digital Library

[22]

Kaori Ikematsu and Itiro Siio. 2018. Ohmic-Touch: Extending Touch Interaction by Indirect Touch Through Resistive Objects. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI '18). ACM, New York, NY, USA, Article 521, bibinfonumpages8 pages. https://doi.org/10.1145/3173574.3174095

Digital Library

[23]

Kaori Ikematsu and Shota Yamanaka. 2020. ScraTouch: Extending Interaction Technique Using Fingernail on Unmodified Capacitive Touch Surfaces. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol., Vol. 4, 3, Article 81 (Sept. 2020), bibinfonumpages19 pages. https://doi.org/10.1145/3411831

Digital Library

[24]

Tae-Hwan Kim, Soon-Ju Kwon, Hyun-Min Choi, and Youn-Sik Hong. 2019. Determination of Lying Posture through Recognition of Multitier Body Parts. Wireless Communications and Mobile Computing, Vol. 2019 (2019).

Digital Library

[25]

Joachim Normann Larsen, Tórur Højgaard Jacobsen, Sebastian Boring, Joanna Bergström, and Henning Pohl. 2019. The Influence of Hand Size on Touch Accuracy. In Proceedings of the 21st International Conference on Human-Computer Interaction with Mobile Devices and Services (Taipei, Taiwan) (MobileHCI '19). ACM, New York, NY, USA, Article 4, bibinfonumpages11 pages. https://doi.org/10.1145/3338286.3340115

Digital Library

[26]

Huy Viet Le, Thomas Kosch, Patrick Bader, Sven Mayer, and Niels Henze. 2018a. PalmTouch: Using the Palm As an Additional Input Modality on Commodity Smartphones. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI '18). ACM, New York, NY, USA, Article 360, bibinfonumpages13 pages. https://doi.org/10.1145/3173574.3173934

Digital Library

[27]

Huy Viet Le, Sven Mayer, and Niels Henze. 2018b. InfiniTouch: Finger-Aware Interaction on Fully Touch Sensitive Smartphones. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology (Berlin, Germany) (UIST '18). ACM, New York, NY, USA, 779--792. https://doi.org/10.1145/3242587.3242605

Digital Library

[28]

Florian Lehmann and Michael Kipp. 2018. How to Hold Your Phone When Tapping: A Comparative Study of Performance, Precision, and Errors. In Proceedings of the 2018 ACM International Conference on Interactive Surfaces and Spaces (Tokyo, Japan) (ISS '18). ACM, New York, NY, USA, 115--127. https://doi.org/10.1145/3279778.3279791

Digital Library

[29]

Danielle Levitas. 2013. Always connected: How smartphones and social keep us engaged. International Data Corporation (IDC) (2013).

[30]

Quentin Mourcou, Anthony Fleury, Bruno Diot, Céline Franco, and Nicolas Vuillerme. 2015. Mobile phone-based joint angle measurement for functional assessment and rehabilitation of proprioception. BioMed research international, Vol. 2015 (2015).

[31]

Alexander Ng, Stephen A. Brewster, and John H. Williamson. 2014a. Investigating the Effects of Encumbrance on One- and Two- Handed Interactions with Mobile Devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Toronto, Ontario, Canada) (CHI '14). ACM, New York, NY, USA, 1981--1990. https://doi.org/10.1145/2556288.2557312

[32]

Alexander Ng, John H. Williamson, and Stephen A. Brewster. 2014b. Comparing Evaluation Methods for Encumbrance and Walking on Interaction with Touchscreen Mobile Devices. In Proceedings of the 16th International Conference on Human-Computer Interaction with Mobile Devices & Services (Toronto, ON, Canada) (MobileHCI '14). ACM, New York, NY, USA, 23--32. https://doi.org/10.1145/2628363.2628382

[33]

Antti Oulasvirta, Tye Rattenbury, Lingyi Ma, and Eeva Raita. 2012. Habits Make Smartphone Use More Pervasive. Personal Ubiquitous Comput., Vol. 16, 1 (Jan. 2012), 105--114. https://doi.org/10.1007/s00779-011-0412--2

Digital Library

[34]

Anne Roudaut, Stéphane Huot, and Eric Lecolinet. 2008. TapTap and MagStick: Improving One-Handed Target Acquisition on Small Touch-Screens. In Proceedings of the Working Conference on Advanced Visual Interfaces (Napoli, Italy) (AVI '08). ACM, New York, NY, USA, 146--153. https://doi.org/10.1145/1385569.1385594

Digital Library

[35]

Tarja Salmela, Ashley Colley, and Jonna H"akkil"a. 2019. Together in Bed? Couples? Mobile Technology Use in Bed. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI '19). ACM, New York, NY, USA, 1--12. https://doi.org/10.1145/3290605.3300732

Digital Library

[36]

Len Thomas and Charlies J Krebs. 1997. A review of statistical power analysis software. Bulletin of the Ecological Society of America, Vol. 78, 2 (1997), 126--138.

[37]

Gary Weiss and Jeffrey Lockhart. 2012. The Impact of Personalization on Smartphone-Based Activity Recognition. AAAI Workshop - Technical Report (01 2012).

[38]

Robert Xiao, Julia Schwarz, and Chris Harrison. 2015. Estimating 3D Finger Angle on Commodity Touchscreens. In Proceedings of the 2015 International Conference on Interactive Tabletops and Surfaces (Madeira, Portugal) (ITS '15). ACM, New York, NY, USA, 47--50. https://doi.org/10.1145/2817721.2817737

Digital Library

[39]

Yang Zhang, Michel Pahud, Christian Holz, Haijun Xia, Gierad Laput, Michael McGuffin, Xiao Tu, Andrew Mittereder, Fei Su, William Buxton, and Ken Hinckley. 2019. Sensing Posture-Aware Pen

[40]

Touch Interaction on Tablets. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI '19). ACM, New York, NY, USA, 1--14. https://doi.org/10.1145/3290605.3300285

Cited By

Ling KZhao HFan XNiu XYin WLiu YWang CBi X(2024)Model Touch Pointing and Detect Parkinson's Disease via a Mobile GameProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36596278:2(1-24)Online publication date: 15-May-2024
https://dl.acm.org/doi/10.1145/3659627
Nepal SPillai AWang WGriffin TCollins AHeinz MLekkas DMirjafari SNemesure MPrice GJacobson NCampbell A(2024)MoodCapture: Depression Detection using In-the-Wild Smartphone ImagesProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642680(1-18)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642680
Vincent KWang LJing NLiu W(2024)AcHand: Detecting Respiratory Rate of Operator Via Smartphone MicrophoneIEEE Sensors Journal10.1109/JSEN.2024.337225524:8(12946-12956)Online publication date: 15-Apr-2024
https://doi.org/10.1109/JSEN.2024.3372255
Show More Cited By

Index Terms

Investigating How Smartphone Movement is Affected by Lying Down Body Posture
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Investigating How Smartphone Movement is Affected by Body Posture
CHI '18: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems

We present an investigation into how hand usage is affected by different body postures (Sitting at a table, Lying down and Standing) when interacting with smartphones. We theorize a list of factors (smartphone support, body support and muscle usage) and ...
Designing for Multiple Hand Grips and Body Postures within the UX of a moving Smartphone
DIS '18: Proceedings of the 2018 Designing Interactive Systems Conference

In this paper we explore how screen-based smartphone interaction can be enriched when designers focus on the physical interaction issues surrounding the device. These consist of the hand grips used (Symmetric bimanual, Asymmetric bimanual with thumb, ...
Evaluation of a smartphone-based assessment system in subjects with chronic ankle instability

The smartphone-based assessment system can be used to provide quantitative determination of differences in postural control performance.Smartphone can be used to discriminate the different postural control performance between healthier leg and injured ...

Comments

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Human-Computer Interaction

Proceedings of the ACM on Human-Computer Interaction Volume 4, Issue ISS

ISS

November 2020

488 pages

EISSN:2573-0142

DOI:10.1145/3433930

Editor:
Jeff Nichols
Apple Inc.

Issue’s Table of Contents

Copyright © 2020 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 04 November 2020

Published in PACMHCI Volume 4, Issue ISS

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

8
Total Citations
View Citations
310
Total Downloads

Downloads (Last 12 months)53
Downloads (Last 6 weeks)6

Reflects downloads up to 14 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Ling KZhao HFan XNiu XYin WLiu YWang CBi X(2024)Model Touch Pointing and Detect Parkinson's Disease via a Mobile GameProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36596278:2(1-24)Online publication date: 15-May-2024
https://dl.acm.org/doi/10.1145/3659627
Nepal SPillai AWang WGriffin TCollins AHeinz MLekkas DMirjafari SNemesure MPrice GJacobson NCampbell A(2024)MoodCapture: Depression Detection using In-the-Wild Smartphone ImagesProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642680(1-18)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642680
Vincent KWang LJing NLiu W(2024)AcHand: Detecting Respiratory Rate of Operator Via Smartphone MicrophoneIEEE Sensors Journal10.1109/JSEN.2024.337225524:8(12946-12956)Online publication date: 15-Apr-2024
https://doi.org/10.1109/JSEN.2024.3372255
Jacquier-Bret JGorce P(2023)Effect of day time on smartphone use posture and related musculoskeletal disorders risk: a survey among university studentsBMC Musculoskeletal Disorders10.1186/s12891-023-06837-524:1Online publication date: 12-Sep-2023
https://doi.org/10.1186/s12891-023-06837-5
Gorce PJacquier-Bret J(2023)Postural prevalence, time of day and spent time activities during smartphone weekday use among students: A survey to prevent musculoskeletal disordersHeliyon10.1016/j.heliyon.2023.e227969:12(e22796)Online publication date: Dec-2023
https://doi.org/10.1016/j.heliyon.2023.e22796
Zhang XIkematsu KKato KSugiura Y(2022)Evaluation of Grasp Posture Detection Method using Corneal Reflection Images through a Crowdsourced ExperimentCompanion Proceedings of the 2022 Conference on Interactive Surfaces and Spaces10.1145/3532104.3571457(9-13)Online publication date: 20-Nov-2022
https://dl.acm.org/doi/10.1145/3532104.3571457
Tao DYang KZhang TQu X(2022)Typing with mobile devices: A comparison of upper limb and shoulder muscle activities, typing performance and perceived workload under varied body postures, typing styles and device typesApplied Ergonomics10.1016/j.apergo.2022.103760102(103760)Online publication date: Jul-2022
https://doi.org/10.1016/j.apergo.2022.103760
Yamanaka SUsuba H(2021)Computing Touch-Point Ambiguity on Mobile Touchscreens for Modeling Target Selection TimesProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/34949765:4(1-21)Online publication date: 30-Dec-2021
https://dl.acm.org/doi/10.1145/3494976

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents