poster

Using language complexity to measure cognitive load for adaptive interaction design

Authors:

M. Asif Khawaja,

Nadine MarcusAuthors Info & Claims

IUI '10: Proceedings of the 15th international conference on Intelligent user interfaces

Pages 333 - 336

https://doi.org/10.1145/1719970.1720024

Published: 07 February 2010 Publication History

Abstract

An adaptive interaction system, which is aware of the users' current cognitive load, can change its response, presentation and interaction flow to improve users' experience and their task performance. In this paper, we propose a novel speech content analysis approach for measuring users' cognitive load, based on their language and dialogue complexity. We have analysed the transcribed speech of operators working in computerized incident control rooms and involved in highly complex bushfire management tasks in Australia. The resulting patterns of language complexity show significant differences between the speech from cognitively low load and high load tasks. We also discuss the value of using this approach of cognitive load measurement for user interface evaluation and interaction design improvement.

References

[1]

Chandler, P. and Sweller, J., Cognitive load theory and the format of instruction. Cognition and Instruction 8,4 (1991), 293--332.

[2]

Paas, F., Tuovinen, J. E., et al. Cognitive load measurement as a means to advance cognitive load theory. Educational Psychologist 38, 1 (2003), 63--71.

[3]

Mayer, R. E., Multimedia learning. Cambridge, UK: Cambridge University Press, 2001.

Digital Library

[4]

Kramer, A. F., Physiological metrics of mental workload: a review of recent progress. Multiple task performance, Damos, D. L., Ed., (1991), 279--328.

[5]

Ark, W., et al.; The Emotion Mouse. HCI: Ergonomics and User Interfaces 1; Eds. Bullinger and Ziegler. London, Lawrence Erlbaum Assoc., 1 (1999), 818--823.

Digital Library

[6]

Windell, D. and Wiebe, N.; A comparison of two mental workload instruments in multimedia instruction. In Proc. HFES 2006, Human Factors and Ergonomics Society Press, Santa Monica, CA, USA, 2006.

[7]

Novak, D., et al. Using psychophysiological measurements in physically demanding virtual environments. Proc. Interact 2009; Eds T. Gross et al., Part I, LNCS 5726, pp. 490--493, 2009.

Digital Library

[8]

Yin, B., et al. Speech-based cognitive load monitoring system, Proc. ICASSP'08, IEEE Press, 2041--2044, 2008

[9]

Berthold, A. and Jameson, A., Interpreting Symptoms of Cognitive Load in Speech Input. In User Modeling 99, Springer Wien New York, 1999.

Digital Library

[10]

Muller, C., et al., Recognizing time pressure and cognitive load on the basis of speech: An experimental study, in Proc. 8th International Conference on User Modeling, 2001, pp. 24--33.

Digital Library

[11]

Kettebekov, S. Exploiting prosodic structuring of coverbal gesticulation, Proc. ICMI2004, ACM Press, pp. 105--112, 2004.

Digital Library

[12]

Sexton J. and Helmreich, R., Analyzing Cockpit Communication: The links between language, performance, error, and workload. University of Texas Team Research Project, Austin, USA, 2000.

[13]

Stirman, S. W., and Pennebaker J. W.; Word use in the poetry of suicidal and nonsuicidal poets. Psychosomatic Medicine 63, Amer. psychosomatic society press, 2001.

[14]

Kramer, A. et al. Using Linguistic Features to Measure Presence in Computer-Mediated Communication, Proc. CHI2006, ACM Press, (2006).

Digital Library

[15]

Khawaja, M. A., Ruiz, N., Chen, F. Potential Speech Features for Cognitive Load Measurement. Proc. OzCHI 2007, ACM Press, 2007.

Digital Library

[16]

Schilperoord, J. On the cognitive status of pauses in discourse production, T. Olive and C. M. Levy Eds., Contemporary tools and techniques for studying writing 10, pp. 61--88, 2001, London: Kluwer Academic Publishers, 2001.

[17]

Khawaja, M. A., Chen, F., and et al. Cognitive Load Measurement from User's Linguistic Speech Features for Adaptive Interaction Design. In Proc. Interact 2009; Eds T. Gross et al., Part I, LNCS 5726, pp. 485--489, 2009.

Digital Library

[18]

Lennon C. and Burdick H., The Lexile Framework as an approach for reading measurement and success; April 2004, http://www.lexile.com; Last accessed: July 2008.

[19]

Reck, P. and et el., Generating and rendering readability scores for Project Gutenberg texts, In Proc. Corpus Linguistics Conference, Birmingham, UK, 2007, Article #120.

[20]

Sokolova, M. and et el., Comparative analysis of text data in successful face-to-face and electronic negotiations, Group Decision and Negotiation 15, pp. 127--140, Springer 2006.

[21]

Kun-Moo Rhee and Eunil Kim, A Statistical Analysis of Text for Inferring Authenticity, Proc. 53rd Session of International Statistical Institute, Seoul, 2001. http://isi.cbs.nl/iamamember/index.htm

[22]

Ure, J. Lexical density and register differentiation. Applications of Linguistics, Perren and Trim (Eds), London: Cambridge University Press. 1971, pp. 443--452

[23]

Advanced Text Analyser, UsingEnglish, http://www.usingenglish.com; Last accessed: Sept. 2009

[24]

Gunning, R. The Technique of Clear Writing. McGraw-Hill, 1952.

[25]

Flesch, R. F., A New Readability Yardstick, Journal of Applied Psychology, 32, 1948, pp. 221--233.

[26]

McLaughlin, G. H., SMOG Grading - A new readability formula, Journal of Reading, May 1969, pp. 639--646.

Cited By

Savaş MKahraman Beğen SÇelik Başoğlu İAktan BÖge Daşdöğen Ö(2024)Comparison of micro- and macro- structural narrative features between Turkish-Kurdish bilinguals and Turkish monolingualsFolia Linguistica10.1515/flin-2024-2040Online publication date: 17-Sep-2024
https://doi.org/10.1515/flin-2024-2040
Kosch TKarolus JZagermann JReiterer HSchmidt AWoźniak P(2023)A Survey on Measuring Cognitive Workload in Human-Computer InteractionACM Computing Surveys10.1145/358227255:13s(1-39)Online publication date: 13-Jul-2023
https://dl.acm.org/doi/10.1145/3582272
Abbas TGadiraju UKhan VMarkopoulos P(2022)Understanding User Perceptions of Response Delays in Crowd-Powered Conversational SystemsProceedings of the ACM on Human-Computer Interaction10.1145/35557656:CSCW2(1-42)Online publication date: 11-Nov-2022
https://dl.acm.org/doi/10.1145/3555765
Show More Cited By

Index Terms

Using language complexity to measure cognitive load for adaptive interaction design
1. Human-centered computing
  1. Human computer interaction (HCI)
  2. Interaction design
    1. Interaction design theory, concepts and paradigms

Recommendations

Think before you talk: an empirical study of relationship between speech pauses and cognitive load
OZCHI '08: Proceedings of the 20th Australasian Conference on Computer-Human Interaction: Designing for Habitus and Habitat

Measuring a user's level of cognitive load while they are interacting with the system could offer another dimension to the development of adaptable user interfaces. High levels of cognitive load affect performance and efficiency. However, current ...
Multimodal behavior and interaction as indicators of cognitive load
Special issue on highlights of the decade in interactive intelligent systems

High cognitive load arises from complex time and safety-critical tasks, for example, mapping out flight paths, monitoring traffic, or even managing nuclear reactors, causing stress, errors, and lowered performance. Over the last five years, our research ...
Cognitive Load Measurement from User's Linguistic Speech Features for Adaptive Interaction Design
INTERACT '09: Proceedings of the 12th IFIP TC 13 International Conference on Human-Computer Interaction: Part I

An adaptive interaction system, which is aware of the user's current cognitive load (CL), can change its response, presentation and flow of interaction material accordingly, to improve user's experience and performance. We present a speech content ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

IUI '10: Proceedings of the 15th international conference on Intelligent user interfaces

February 2010

460 pages

ISBN:9781605585154

DOI:10.1145/1719970

General Chairs:
Charles Rich
Worcester Polytechnic Institute, USA
,
Qiang Yang
Hong Kong University of Science & Technology, China
,
Program Chairs:
Marc Cavazza
Teesside University, UK
,
Michelle Zhou
IBM Research, China

Copyright © 2010 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 February 2010

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Poster

Conference

IUI '10

Sponsor:

IUI '10: 15th International Conference on Intelligent User Interfaces

February 7 - 10, 2010

Hong Kong, China

Acceptance Rates

Overall Acceptance Rate 746 of 2,811 submissions, 27%

Upcoming Conference

IUI '25

Sponsor:
sigai
sigai

30th International Conference on Intelligent User Interfaces

March 24 - 27, 2025

Cagliari , Italy

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

27
Total Citations
View Citations
680
Total Downloads

Downloads (Last 12 months)53
Downloads (Last 6 weeks)7

Reflects downloads up to 15 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Savaş MKahraman Beğen SÇelik Başoğlu İAktan BÖge Daşdöğen Ö(2024)Comparison of micro- and macro- structural narrative features between Turkish-Kurdish bilinguals and Turkish monolingualsFolia Linguistica10.1515/flin-2024-2040Online publication date: 17-Sep-2024
https://doi.org/10.1515/flin-2024-2040
Kosch TKarolus JZagermann JReiterer HSchmidt AWoźniak P(2023)A Survey on Measuring Cognitive Workload in Human-Computer InteractionACM Computing Surveys10.1145/358227255:13s(1-39)Online publication date: 13-Jul-2023
https://dl.acm.org/doi/10.1145/3582272
Abbas TGadiraju UKhan VMarkopoulos P(2022)Understanding User Perceptions of Response Delays in Crowd-Powered Conversational SystemsProceedings of the ACM on Human-Computer Interaction10.1145/35557656:CSCW2(1-42)Online publication date: 11-Nov-2022
https://dl.acm.org/doi/10.1145/3555765
Smart MSood DVaccaro K(2022)Understanding Risks of Privacy Theater with Differential PrivacyProceedings of the ACM on Human-Computer Interaction10.1145/35557626:CSCW2(1-24)Online publication date: 11-Nov-2022
https://dl.acm.org/doi/10.1145/3555762
Bhandari AFreed DPilato TTaki FKaur GYale-Loehr SPowers JLong TBazarova N(2022)Multi-stakeholder Perspectives on Digital Tools for U.S. Asylum Applicants Seeking Healthcare and Legal InformationProceedings of the ACM on Human-Computer Interaction10.1145/35556426:CSCW2(1-21)Online publication date: 11-Nov-2022
https://dl.acm.org/doi/10.1145/3555642
Kong RZhang CSun RChhabra VNadimpalli TKonstan J(2022)Multi-Objective Personalization in Multi-Stakeholder Organizational Bulk E-mailProceedings of the ACM on Human-Computer Interaction10.1145/35556416:CSCW2(1-27)Online publication date: 11-Nov-2022
https://dl.acm.org/doi/10.1145/3555641
Wambsganss TZierau NSöllner MKäser TKoedinger KLeimeister J(2022)Designing Conversational Evaluation ToolsProceedings of the ACM on Human-Computer Interaction10.1145/35556196:CSCW2(1-27)Online publication date: 11-Nov-2022
https://dl.acm.org/doi/10.1145/3555619
Matatov HNaaman MAmir O(2022)Stop the [Image] StealProceedings of the ACM on Human-Computer Interaction10.1145/35555996:CSCW2(1-24)Online publication date: 11-Nov-2022
https://dl.acm.org/doi/10.1145/3555599
Zhu QLo LXia MChen ZMa X(2022)Bias-Aware Design for Informed Decisions: Raising Awareness of Self-Selection Bias in User Ratings and ReviewsProceedings of the ACM on Human-Computer Interaction10.1145/35555976:CSCW2(1-31)Online publication date: 11-Nov-2022
https://dl.acm.org/doi/10.1145/3555597
Rigaud CBailly GAvellino IJansen Y(2022)Exploring Capturing Approaches in Shared Fabrication Workshops: Current Practice and OpportunitiesProceedings of the ACM on Human-Computer Interaction10.1145/35551166:CSCW2(1-33)Online publication date: 11-Nov-2022
https://dl.acm.org/doi/10.1145/3555116
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents