research-article

Force Touch Detection on Capacitive Sensors using Deep Neural Networks

Authors:

Sven MayerAuthors Info & Claims

MobileHCI '19: Proceedings of the 21st International Conference on Human-Computer Interaction with Mobile Devices and Services

Article No.: 42, Pages 1 - 6

https://doi.org/10.1145/3338286.3344389

Published: 01 October 2019 Publication History

Abstract

As the touchscreen is the most successful input method of current mobile devices, the importance to transmit more information per touch is raising. A wide range of approaches has been presented to enhance the richness of a single touch. With Apple's 3D Touch, they successfully introduce pressure as a new input dimension into consumer devices. However, they are using a new sensing layer, which increases production cost and hardware complexity. Moreover, users have to upgrade their phones to use the new feature. In contrast, with this work, we introduce a strategy to acquire the pressure measurements from the mutual capacitive sensor, which is used in the majority of today's touch devices. We present a data collection study in which we collect capacitive images where participants apply different pressure levels. We then train a Deep Neural Network (DNN) to estimate the pressure allowing for force touch detection. As a result, we present a model which enables estimating the pressure with a mean error of 369.0g.

References

[1]

Arif, A. S. and Stuerzlinger, W. Pseudo-pressure Detection and Its Use in Predictive Text Entry on Touchscreens. In Proc. of OzCHI '13.

[2]

Boring, S., Ledo, D., Chen, X. A., Marquardt, N., Tang, A., and Greenberg, S. The Fat Thumb: Using the Thumb's Contact Size for Single-handed Mobile Interaction. In Proc. of MobileHCI '12.

[3]

Coulibaly, P., Anctil, F., and Bobée, B. B. Daily reservoir inflow forecasting using artificial neural networks with stopped training approach. Journal of Hydrology (2000).

[4]

Guarneri, I., Capra, A., Castorina, A., Battiato, S., and Farinella, G. M. PCA based shape recognition for capacitive touch display. In Proc. of ICCE '13.

[5]

Heo, S. and Lee, G. Forcetap: Extending the Input Vocabulary of Mobile Touch Screens by Adding Tap Gestures. In Proc. of MobileHCI '11.

[6]

Huber, J., Sheik-Nainar, M., and Matic, N. Multi-Level Force Touch Discrimination on Central Information Displays in Cars. In Proc. of AutomotiveUI '17.

[7]

Hwang, S., Bianchi, A., and Wohn, K.-y. VibPress: Estimating Pressure Input Using Vibration Absorption on Mobile Devices. In Proc. of MobileHCI '13.

[8]

Ikematsu, K., Fukumoto, M., and Siio, I. Ohmic-Sticker: Force-to-Motion Type Input Device for Capacitive Touch Surface. In Proc. of CHI EA '19.

[9]

Inoue, Y., Makino, Y., and Shinoda, H. Estimation of the Pressing Force from Finger Image by Using Neural Network. In Proc. of EuroHaptics '18.

[10]

Le, H. V., Kosch, T., Bader, P., Mayer, S., and Henze, N. PalmTouch: Using the Palm As an Additional Input Modality on Commodity Smartphones. In Proc. of CHI '18.

[11]

Le, H. V., Mayer, S., Bader, P., and Henze, N. A Smartphone Prototype for Touch Interaction on the Whole Device Surface. In Proc. of MobileHCI '17.

[12]

Mayer, S., Le, H. V., and Henze, N. Estimating the Finger Orientation on Capacitive Touchscreens Using Convolutional Neural Networks. In Proc. of ISS '17.

[13]

Quinn, P. Estimating Touch Force with Barometric Pressure Sensors. In Proc. of CHI '19.

[14]

Ramos, G., Boulos, M., and Balakrishnan, R. Pressure Widgets. In Proc. of CHI '04.

[15]

Schweigert, R., Leusmann, J., Hagenmayer, S., Weiß, M., Le, H. V., Mayer, S., and Bulling, A. KnuckleTouch: Enabling Knuckle Gestures on Capacitive Touchscreens using Deep Learning. In Proc. of MuC '19.

[16]

Takada, R., Lin, W., Ando, T., Shizuki, B., and Takahashi, S. A Technique for Touch Force Sensing Using a Waterproof Device's Built-in Barometer. In Proc. of CHI EA '17.

Cited By

Li CYu JHe KFeng JZhou J(2024)SwivelTouch: Boosting Touchscreen Input with 3D Finger Rotation GestureProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36595848:2(1-30)Online publication date: 15-May-2024
https://dl.acm.org/doi/10.1145/3659584
Huang ZGao CWang HDeng XLai YMa CQin SLiu YWang H(2024)SpeciFingersProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36435598:1(1-28)Online publication date: 6-Mar-2024
https://dl.acm.org/doi/10.1145/3643559
He KLi CDuan YFeng JZhou J(2024)TrackPoseProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36314597:4(1-22)Online publication date: 12-Jan-2024
https://dl.acm.org/doi/10.1145/3631459
Show More Cited By

Index Terms

Force Touch Detection on Capacitive Sensors using Deep Neural Networks
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Designing for Hover- and Force-Enriched Touch Interaction
Computer-Human Interaction. Cognitive Effects of Spatial Interaction, Learning, and Ability
Abstract
As touch-based interfaces become more popular, there are attempts to enhance the touch interface by making the interface more sensitive to the finger. This means that touch surfaces not only sense the location of a finger contact, but also other ...
Enabling tangible interaction on capacitive touch panels
UIST '10: Adjunct proceedings of the 23nd annual ACM symposium on User interface software and technology

We propose two approaches to sense tangible objects on capacitive touch screens, which are used in off-the-shelf multi-touch devices such as Apple iPad, iPhone, and 3M's multi-touch displays. We seek for the approaches that do not require modifications ...
Multi-Level Force Touch Discrimination on Central Information Displays in Cars
AutomotiveUI '17: Proceedings of the 9th International Conference on Automotive User Interfaces and Interactive Vehicular Applications Adjunct

Multi-level force input on touchscreens in the car has the potential to increase input richness and to address scalability issues due to the increasing number of features and. However, the number of levels and the corresponding force threshold is not ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

MobileHCI '19: Proceedings of the 21st International Conference on Human-Computer Interaction with Mobile Devices and Services

October 2019

646 pages

ISBN:9781450368254

DOI:10.1145/3338286

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 October 2019

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Funding Sources

Deutsche Forschungsgemeinschaft

Conference

MobileHCI '19

Sponsor:

SIGCHI

MobileHCI '19: 21st International Conference on Human-Computer Interaction with Mobile Devices and Services

October 1 - 4, 2019

Taipei, Taiwan

Acceptance Rates

Overall Acceptance Rate 202 of 906 submissions, 22%

Upcoming Conference

MobileHCI '24

Sponsor:
sigchi

26th International Conference on Mobile Human-Computer Interaction

September 30 - October 3, 2024

Melbourne , VIC , Australia

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

19
Total Citations
View Citations
519
Total Downloads

Downloads (Last 12 months)77
Downloads (Last 6 weeks)8

Reflects downloads up to 03 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Li CYu JHe KFeng JZhou J(2024)SwivelTouch: Boosting Touchscreen Input with 3D Finger Rotation GestureProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36595848:2(1-30)Online publication date: 15-May-2024
https://dl.acm.org/doi/10.1145/3659584
Huang ZGao CWang HDeng XLai YMa CQin SLiu YWang H(2024)SpeciFingersProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36435598:1(1-28)Online publication date: 6-Mar-2024
https://dl.acm.org/doi/10.1145/3643559
He KLi CDuan YFeng JZhou J(2024)TrackPoseProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36314597:4(1-22)Online publication date: 12-Jan-2024
https://dl.acm.org/doi/10.1145/3631459
Zhan LXiong TZhang HGuo SChen XGong JLin JQin Y(2024)TouchEditorProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36314547:4(1-29)Online publication date: 12-Jan-2024
https://dl.acm.org/doi/10.1145/3631454
Stellmacher CMathis FWeiss YLoerakker MWagener NSchöning J(2024)Exploring Mobile Devices as Haptic Interfaces for Mixed RealityProceedings of the CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642176(1-17)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642176
Shen ZLi SZhao XZou J(2024)CT-Auth: Capacitive Touchscreen-Based Continuous Authentication on SmartphonesIEEE Transactions on Knowledge and Data Engineering10.1109/TKDE.2023.327787936:1(90-106)Online publication date: Jan-2024
https://doi.org/10.1109/TKDE.2023.3277879
Rizk HElbestar MYoussef M(2024)From Calls to Scales: Harnessing Smartphone Accelerometer and Vibration for Daily Mass Measurement2024 IEEE International Conference on Smart Computing (SMARTCOMP)10.1109/SMARTCOMP61445.2024.00035(101-108)Online publication date: 29-Jun-2024
https://doi.org/10.1109/SMARTCOMP61445.2024.00035
Nishida NIkematsu KSato JYamanaka STsubouchi K(2023)Single-tap Latency Reduction with Single- or Double- tap PredictionProceedings of the ACM on Human-Computer Interaction10.1145/36042717:MHCI(1-26)Online publication date: 13-Sep-2023
https://dl.acm.org/doi/10.1145/3604271
Yu JFeng JZhou J(2023)PrintShearProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35962577:2(1-22)Online publication date: 12-Jun-2023
https://dl.acm.org/doi/10.1145/3596257
Yi XZhang SPan ZShi LHan FKong YLi HShi Y(2023)Squeez’In: Private Authentication on Smartphones based on Squeezing GesturesProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581419(1-15)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581419
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents