Article

Tracking of deformable human hand in real time as continuous input for gesture-based interaction

Authors:

Guozhong DaiAuthors Info & Claims

IUI '07: Proceedings of the 12th international conference on Intelligent user interfaces

Pages 235 - 242

https://doi.org/10.1145/1216295.1216338

Published: 28 January 2007 Publication History

Abstract

Gesture input is a natural and effective interactive model. The tracking of deformable hand gesture is a very important task in gesture-based interaction. A novel real-time tracking approach is proposed to capture hand motion with single camera. It combines the characters of model-based and appearance-based method. The presented approach achieves auto-initialization by posture recognition and matching with image features. It solves the problem of interference among fingers successfully by the integration of K-Means clustering and Particle Filters. Moreover, tracking detection realizes resumption from tracking failure and automatic update of hand model. Experiments show that, the proposed method can achieve continuous real-time tracking of deformable hand gesture, and meets the requirements for gesture-based Human-Computer Interaction.

References

[1]

B. Stenger, P. R. Mendonca and R. Cipolla. Model based 3D tracking of an articulated hand. Proc. of IEEE conference of Computer Vision and Pattern Recognition, 2001.vol. 2. pp. 310--315.

[2]

C. Sminchisescu, B. Triggs. A robust multiple hypothesis approach to monocular human motion tracking. Technical Report RR-4208, INRIA, 2001.

[3]

Christian V. Hardenberg and Francois Berard. Bare-hand human-computer interaction. Proc. of ACM workshop on Perceptual User Interface, USA, 2001. pp.15--17.

Digital Library

[4]

G. R. Bradski. Real time face and object tracking as a component of a perceptual user interface. Proc. of IEEE 4th Workshop on Application of Computer Vision. 1998. pp. 214--219.

Digital Library

[5]

Ivan Laptev and Tony Lindeberg. Tracking of multi-state hand models using particle filtering and a hierarchy of multi-scale image features. Scale-Space 2001, LNCS 2106. pp. 63--74.

Digital Library

[6]

J. C. Cheng and Jose. Moura. Capture and representation of human walking in live video sequences. IEEE Trans.on Multimedia. 1999, 1(2), pp. 144--156.

Digital Library

[7]

Jessica JunLin Wang and Sammeer Singh. Video analysis of human dynamics-a survey. Real-time imaging. 2003, 9(5). pp. 321--346.

[8]

J. K. Aggarwal and Q. Cai, Human motion analysis: a review. Computer Vision and Image Understanding. 1999, 73(3). pp. 428--440.

Digital Library

[9]

Julier Letessier and F. Berard. Visual tracking of bare fingers for interactive surfaces. Proc. of 17th ACM symposium on User Interface Software and Technology. 2004. pp. 119--122.

Digital Library

[10]

James M. Rehg and Takeo Kanade. Visual tracking of high DOF articulated structures: an application to human hand tracking. Proc. of 3th European Conference on Computer Vision. 1994. pp. 35--46.

Digital Library

[11]

Jorg Zieren, Nils Unger and Suat Akyol. Hands tracking from frontal view for vision-based gesture recognition. Proc. of DAGM 2002, LNCS 2449. pp. 531--539.

Digital Library

[12]

Kenji Oka and Yoichi Sato. Real-time fingertip tracking and gesture recognition. Proc. of IEEE Computer Graphics and Applications. 2002, 22(6). pp. 64--71.

Digital Library

[13]

Lawrence Rabiner. A tutorial on Hidden Markov Models and selected applications in speech recognition. Proc. of the IEEE. 1989, 77(2). pp. 257--286.

[14]

Mathias Kolsch and Matthew Turk. Fast 2D hand tracking with flocks of features and multi-cue integration. Proc. of IEEE conference on Computer Vision and Pattern Recognition. 2004. pp. 158--164.

Digital Library

[15]

Matthieu Bray, Esther Koller-Meier and Luc Van Gool. Smart particle filtering for 3D hand tracking. Proc. of 6th IEEE Conference on Automatic Face and Gesture Recogntion. 2004. pp. 675--680.

Digital Library

[16]

M. H. Jaward, L. Mihaylova. A data association algorithm for multiple objects tracking in video sequence. The 2006 IEE Seminar on Target Tracking: Algorithms and Applications. 2006, Birmingham, UK.

[17]

Michael Isard and Andrew Blake. Contour tracking by stochastic propagation of conditional density. Proc. of European Conference of Computer Vision, 1996. pp. 343--356.

Digital Library

[18]

P. Robertson, R. Laddaga and M.V. Kleek. Virtual mouse vision based interface. In proceedings of IUI'2004. pp. 177--183.

Digital Library

[19]

R. Singh, B. Seth and U. B. Desai. Vision based GUI for interactive mobile robots. In proceedings of IUI'2005. pp. 254--256.

Digital Library

[20]

Shanon X. Ju, Micheal J. Black and Yaser Yacoob. Cardboard people: a parameterized model of articulated image motion. Second International Conference on Automatic Face and Gesture Recognition, 1996. pp. 38--44.

Digital Library

[21]

Yoichi Sato, Yoshinori Kobayashi and Hideki Koike. Fast tracking of hands and fingertips in infrared images for augmented desk interface. Proc. of IEEE International Conference on Automatic Face and Gesture Recognition. 2000. pp. 462--468.

Digital Library

[22]

Zhu JY, Wang XY, Wang WX, Dai GZ. Hand gesture recognition based on structure analysis. Accepted by ChinaGraph'2006 and will be published by Chinese Journal of Computers.

Cited By

Ali UAli WRamzan MRana MQuim A(2023)Transform Non-Touchable Screen into Touchable Screen Using Ultrasonic Sensor HC-SR04T2023 IEEE 21st Student Conference on Research and Development (SCOReD)10.1109/SCOReD60679.2023.10563414(296-300)Online publication date: 13-Dec-2023
https://doi.org/10.1109/SCOReD60679.2023.10563414
Xu BZhou ZChen XYang YYang Z(2018)Arm removal for static hand gesture recognitionJournal of Intelligent & Fuzzy Systems10.3233/JIFS-1868135:6(6489-6500)Online publication date: 24-Dec-2018
https://doi.org/10.3233/JIFS-18681
Wu HWang JZhang X(2017)Combining hidden Markov model and fuzzy neural network for continuous recognition of complex dynamic gesturesThe Visual Computer: International Journal of Computer Graphics10.1007/s00371-015-1147-233:10(1265-1278)Online publication date: 1-Oct-2017
https://dl.acm.org/doi/10.1007/s00371-015-1147-2
Show More Cited By

Index Terms

Tracking of deformable human hand in real time as continuous input for gesture-based interaction
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision problems
        Tracking
      2. Computer vision tasks
        Scene understanding
  2. Computer graphics
    1. Graphics systems and interfaces
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Graphics input devices

Recommendations

Real-time Hand Tracking Using Kinect
ICDSP '18: Proceedings of the 2nd International Conference on Digital Signal Processing

Real-time hand tracking is fundamental to human gesture recognition. However, due to the huge computation, previous studies are either off-line or limited to given poses. In order to satisfy the requirement of real-time hand tracking, in this paper we ...
A real time vision-based hand gestures recognition system
ISICA'10: Proceedings of the 5th international conference on Advances in computation and intelligence

Hand gesture recognition is an important aspect in Human-Computer interaction, and can be used in various applications, such as virtual reality and computer games. In this paper, we propose a real time hand gesture recognition system. It includes three ...
Real-time 3D hand-computer interaction: optimization and complexity reduction
NordiCHI '08: Proceedings of the 5th Nordic conference on Human-computer interaction: building bridges

This paper presents a low-cost method for enabling 3D hand-computer interaction. The method, accompanied by a system, uses the frame capturing functionality of a single consumer-grade webcam. Our recent work has been focused on examining and realizing a ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

IUI '07: Proceedings of the 12th international conference on Intelligent user interfaces

January 2007

388 pages

ISBN:1595934812

DOI:10.1145/1216295

General Chairs:
David Chin
University of Hawaii, USA
,
Michelle Zhou
IBM Watson Research Center, USA
,
Program Chairs:
Tessa Lau
Almaden Research, USA
,
Angel Puerta
RedWhale Software, USA

Copyright © 2007 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 28 January 2007

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

IUI07

Sponsor:

IUI07: 12th International Conference on Intelligent User Interfaces

January 28 - 31, 2007

Hawaii, Honolulu, USA

Acceptance Rates

Overall Acceptance Rate 746 of 2,811 submissions, 27%

Upcoming Conference

IUI '25

Sponsor:
sigai
sigai

30th International Conference on Intelligent User Interfaces

March 24 - 27, 2025

Cagliari , Italy

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

18
Total Citations
View Citations
1,805
Total Downloads

Downloads (Last 12 months)4
Downloads (Last 6 weeks)1

Reflects downloads up to 15 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Ali UAli WRamzan MRana MQuim A(2023)Transform Non-Touchable Screen into Touchable Screen Using Ultrasonic Sensor HC-SR04T2023 IEEE 21st Student Conference on Research and Development (SCOReD)10.1109/SCOReD60679.2023.10563414(296-300)Online publication date: 13-Dec-2023
https://doi.org/10.1109/SCOReD60679.2023.10563414
Xu BZhou ZChen XYang YYang Z(2018)Arm removal for static hand gesture recognitionJournal of Intelligent & Fuzzy Systems10.3233/JIFS-1868135:6(6489-6500)Online publication date: 24-Dec-2018
https://doi.org/10.3233/JIFS-18681
Wu HWang JZhang X(2017)Combining hidden Markov model and fuzzy neural network for continuous recognition of complex dynamic gesturesThe Visual Computer: International Journal of Computer Graphics10.1007/s00371-015-1147-233:10(1265-1278)Online publication date: 1-Oct-2017
https://dl.acm.org/doi/10.1007/s00371-015-1147-2
Kishore PPrasad MKumar DSastry A(2016)Optical Flow Hand Tracking and Active Contour Hand Shape Features for Continuous Sign Language Recognition with Artificial Neural Networks2016 IEEE 6th International Conference on Advanced Computing (IACC)10.1109/IACC.2016.71(346-351)Online publication date: Feb-2016
https://doi.org/10.1109/IACC.2016.71
Zafar ZBerns KRodić A(2016)Recognizing Hand Gestures Using Local Features: A Comparison StudyAdvances in Robot Design and Intelligent Control10.1007/978-3-319-49058-8_43(394-401)Online publication date: 29-Nov-2016
https://doi.org/10.1007/978-3-319-49058-8_43
Suan WMansor ECheok ASunar MNeo KChisik Y(2015)A lo-fi prototype testing with preschoolers to design organic user interfacesProceedings of the 12th International Conference on Advances in Computer Entertainment Technology10.1145/2832932.2832962(1-4)Online publication date: 16-Nov-2015
https://dl.acm.org/doi/10.1145/2832932.2832962
Mohr DZachmann G(2015)Hand Pose Recognition — Overview and Current ResearchVirtual Realities10.1007/978-3-319-17043-5_7(108-129)Online publication date: 1-Apr-2015
https://doi.org/10.1007/978-3-319-17043-5_7
Zhang LSaboune JEl Saddik A(2014)Transforming a Regular Screen Into a Touch Screen Using a Single WebcamJournal of Display Technology10.1109/JDT.2014.231248810:8(647-659)Online publication date: Aug-2014
https://doi.org/10.1109/JDT.2014.2312488
Tornow MAl-Hamadi ABorrmann V(2013)Gestic-Based Human Machine Interface for Robot ControlProceedings of the 2013 IEEE International Conference on Systems, Man, and Cybernetics10.1109/SMC.2013.461(2706-2711)Online publication date: 13-Oct-2013
https://dl.acm.org/doi/10.1109/SMC.2013.461
Poudel RFonseca JZhang JNait-Charif H(2013)A Unified Framework for 3D Hand TrackingProceedings, Part I, of the 9th International Symposium on Advances in Visual Computing - Volume 803310.1007/978-3-642-41914-0_14(129-139)Online publication date: 29-Jul-2013
https://dl.acm.org/doi/10.1007/978-3-642-41914-0_14
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents