research-article

Evaluating the effect of emotion on gender recognition in virtual humans

Authors:

Kerstin Ruhland,

Rachel McDonnellAuthors Info & Claims

SAP '13: Proceedings of the ACM Symposium on Applied Perception

Pages 45 - 49

https://doi.org/10.1145/2492494.2492510

Published: 22 August 2013 Publication History

Abstract

In this paper, we investigate the ability of humans to determine the gender of conversing characters, based on facial and body cues for emotion. We used a corpus of simultaneously captured facial and body motions from four male and four female actors. In our Gender Rating task, participants were asked to rate how male or female they considered the motions to be, under different emotional states. In our Emotion Recognition task, participants were asked to classify the emotions, in order to determine how accurately perceived those emotions were. We found that gender perception was affected by emotion, where certain emotions facilitated gender determination while others masked it. We also found that there was no correlation between how accurate an emotion was portrayed and how much gender information was present in that motion. Finally, we found that the model used to display the motion did not affect gender perception of motion but did alter emotion recognition.

Supplementary Material

MP4 File (p45-zibrek.mp4)

Download
39.44 MB

References

[1]

Atkinson, A. P., Dittrich, W. H., Gemmell, A. J., Young, A. W., et al. 2004. Emotion perception from dynamic and static body expressions in point-light and full-light displays. Perception 33, 6, 717--746.

[2]

Bassili, J. N. 1978. Facial motion in the perception of faces and of emotional expression. Journal of Experimental Psychology - Human Perception and Performance 4, 373--379.

[3]

Battocchi, A., Pianesi, F., and Goren-Bar, D. 2005. A first evaluation study of a database of kinetic facial expressions (dafex). In Proceedings of the 7th International Conference on Multimodal Interfaces, ICMI '05, 214--221.

Digital Library

[4]

Ben-David, B. M., van Lieshout, P. H. H. M., and Leszcz, T. 2011. A resource of validated affective and neutral sentences to assess identification of emotion in spoken language after a brain injury. Brain Injury 25, 2, 206--220.

[5]

Brewer, M. B. 1988. A dual process model of impression formation. Lawrence Erlbaum Associates, Inc.

[6]

Brody, L. R., and Hall, J. A. 2000. Gender, emotion, and expression. In Handbook of Emotions, Guilford, M. Lewis and J. Haviland-Jones, Eds., 338--349.

[7]

Chaminade, T., Hodgins, J., and Kawato, M. 2007. Anthropomorphism influences perception of computer-animated characters' actions. Social Cognitive and Affective Neuroscience 2, 3, 206--216.

[8]

Clavel, C., Plessier, J., Martin, J.-C., Ach, L., and Morel, B. 2009. Combining facial and postural expressions of emotions in a virtual character. In Proc. of the 9th International Conference on Intelligent Virtual Agents, IVA '09, 287--300.

Digital Library

[9]

De Meijer, M. 1989. The contribution of general features of body movement to the attribution of emotions. Journal of Nonverbal behavior 13, 4, 247--268.

[10]

Deaux, K. 1993. Commentary: Sorry, wrong number: A reply to gentile's call. Psychological Science 4, 2, pp. 125--126.

[11]

Devine, P. G. 1989. Stereotypes and prejudice: Their automatic and controlled components. Journal of personality and social psychology 56, 1, 5--18.

[12]

Ekman, P. 1992. An argument for basic emotions. Cognition & Emotion 6, 3-4, 169--200.

[13]

Fischer, A. H. 1993. Sex differences in emotionality: Fact or stereotype? Feminism & Psychology 3, 3, 303--318.

[14]

Hess, U., Adams, R. B., and Kleck, R. E. 2004. Facial appearance, gender, and emotion expression. Emotion 4, 4, 378--388.

[15]

Hill, H., and Johnston, A. 2001. Categorizing sex and identity from the biological motion of faces. Current Biology 11, 11, 880--885.

[16]

Hill, H., Jinno, Y., and Johnston, A. 2003. Comparing solid-body with point-light animations. Perception 32, 5, 561--566.

[17]

Hodgins, J. K., O'Brien, J. F., and Tumblin, J. 1998. Perception of human motion with different geometric models. IEEE Trans. on Visualization and Computer Graphics 4, 4, 307--316.

Digital Library

[18]

Johansson, G. 1973. Visual perception of biological motion and a model for its analysis. Perception & Psychophysics 14, 2, 201--211.

[19]

Johnson, K. L., and Tassinary, L. G. 2005. Perceiving sex directly and indirectly meaning in motion and morphology. Psychological Science 16, 11, 890--897.

[20]

Johnson, K. L., McKay, L. S., and Pollick, F. E. 2011. He throws like a girl (but only when he's sad): Emotion affects sex-decoding of biological motion displays. Cognition 119, 2, 265--280.

[21]

Kozlowski, L. T., and Cutting, J. E. 1977. Recognizing the sex of a walker from a dynamic point-light display. Perception & Psychophysics 21, 6, 575--580.

[22]

Lewis, K. M. 2000. When leaders display emotion: how followers respond to negative emotional expression of male and female leaders. Journal of Organizational Behavior 21, 2, 221--234.

[23]

McDonnell, R., and O'Sullivan, C. 2010. Movements and voices affect perceived sex of virtual conversers. In Proceedings of the 7th Symposium on Applied Perception in Graphics and Visualization, 125--128.

Digital Library

[24]

Morrison, E. R., Gralewski, L., Campbell, N., and Penton-Voak, I. S. 2007. Facial movement varies by sex and is related to attractiveness. Evolution and Human Behavior 28, 3, 186--192.

[25]

Schyns, P. G., Petro, L. S., and Smith, M. L. 2009. Transmission of facial expressions of emotion co-evolved with their efficient decoding in the brain: behavioral and brain evidence. PLoS One 4, 5, e5625.

[26]

Unger, R. K. 1979. Toward a redefinition of sex and gender. American Psychologist 34, 11, 1085--94.

Cited By

Montanha RRaupp GSchmitt AAraujo VMusse S(2025)Micro and macro facial expressions by driven animations in realistic Virtual HumansEntertainment Computing10.1016/j.entcom.2024.10085352(100853)Online publication date: Jan-2025
https://doi.org/10.1016/j.entcom.2024.100853
Montanha RRaupp GGonzalez VPartichelli YBins AFerreira MAraujo VMusse S(2023)Revisiting Micro and Macro Expressions in Computer Graphics CharactersProceedings of the 22nd Brazilian Symposium on Games and Digital Entertainment10.1145/3631085.3631228(38-45)Online publication date: 6-Nov-2023
https://dl.acm.org/doi/10.1145/3631085.3631228
Araujo VSchaffer DCosta AMusse S(2022)Towards Virtual Humans without Gender Stereotyped Visual FeaturesSIGGRAPH Asia 2022 Technical Communications10.1145/3550340.3564232(1-4)Online publication date: 6-Dec-2022
https://dl.acm.org/doi/10.1145/3550340.3564232
Show More Cited By

Index Terms

Evaluating the effect of emotion on gender recognition in virtual humans
1. Computing methodologies
  1. Computer graphics
    1. Animation

Recommendations

Exploring the Effect of Motion Type and Emotions on the Perception of Gender in Virtual Humans

In this article, we investigate the perception of gender from the motion of virtual humans under different emotional conditions and explore the effect of emotional bias on gender perception (e.g., anger being attributed to males more than females). As ...
Synthesising and evaluating cross-modal emotional ambiguity in virtual agents
IVA'12: Proceedings of the 12th international conference on Intelligent Virtual Agents

Emotional ambiguity, when more than one emotion appears present at a given time, or several emotions are superimposed, is common in human interaction and effects such as irony can be intentionally created through a mismatch of such emotional signals. ...
Identifying Gender Differences in Multimodal Emotion Recognition Using Bimodal Deep AutoEncoder
Neural Information Processing
Abstract
This paper mainly focuses on investigating the differences between males and females in emotion recognition using electroencephalography (EEG) and eye movement data. Four basic emotions are considered, namely happy, sad, fearful and neutral. The ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

SAP '13: Proceedings of the ACM Symposium on Applied Perception

August 2013

150 pages

ISBN:9781450322621

DOI:10.1145/2492494

Conference Chairs:
Ludovic Hoyet
Trinity College Dublin
,
Betsy Williams Sanders
Rhodes College
,
Program Chairs:
Joe Geigel
Rochester Institute of Technology
,
Jeanine Stefanucci
University of Utah

Copyright © 2013 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 22 August 2013

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Science Foundation Ireland

Conference

SAP' 13

Sponsor:

SIGGRAPH

SAP' 13: ACM Symposium on Applied Perception 2013

August 22 - 23, 2013

Dublin, Ireland

Acceptance Rates

SAP '13 Paper Acceptance Rate 22 of 54 submissions, 41%;

Overall Acceptance Rate 43 of 94 submissions, 46%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

12
Total Citations
View Citations
257
Total Downloads

Downloads (Last 12 months)18
Downloads (Last 6 weeks)2

Reflects downloads up to 14 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Montanha RRaupp GSchmitt AAraujo VMusse S(2025)Micro and macro facial expressions by driven animations in realistic Virtual HumansEntertainment Computing10.1016/j.entcom.2024.10085352(100853)Online publication date: Jan-2025
https://doi.org/10.1016/j.entcom.2024.100853
Montanha RRaupp GGonzalez VPartichelli YBins AFerreira MAraujo VMusse S(2023)Revisiting Micro and Macro Expressions in Computer Graphics CharactersProceedings of the 22nd Brazilian Symposium on Games and Digital Entertainment10.1145/3631085.3631228(38-45)Online publication date: 6-Nov-2023
https://dl.acm.org/doi/10.1145/3631085.3631228
Araujo VSchaffer DCosta AMusse S(2022)Towards Virtual Humans without Gender Stereotyped Visual FeaturesSIGGRAPH Asia 2022 Technical Communications10.1145/3550340.3564232(1-4)Online publication date: 6-Dec-2022
https://dl.acm.org/doi/10.1145/3550340.3564232
Do TMcMahan RWisniewski P(2022)A New Uncanny Valley? The Effects of Speech Fidelity and Human Listener Gender on Social Perceptions of a Virtual-Human SpeakerProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3517564(1-11)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3517564
Gäckle KReichert TMarsden NMarsden NWulf VRode JWeibert A(2018)Virtual reality or virtuous reality?Proceedings of the 4th Conference on Gender & IT10.1145/3196839.3196861(143-145)Online publication date: 14-May-2018
https://dl.acm.org/doi/10.1145/3196839.3196861
Spicker MArellano DSchaller URauh RHelzle VDeussen OJain EJoerg S(2016)Emotion recognition in autism spectrum disorderProceedings of the ACM Symposium on Applied Perception10.1145/2931002.2931004(97-104)Online publication date: 22-Jul-2016
https://dl.acm.org/doi/10.1145/2931002.2931004
Kokkinara EMcDonnell R(2015)Animation realism affects perceived character appeal of a self-virtual faceProceedings of the 8th ACM SIGGRAPH Conference on Motion in Games10.1145/2822013.2822035(221-226)Online publication date: 16-Nov-2015
https://dl.acm.org/doi/10.1145/2822013.2822035
Ruhland KPeters CAndrist SBadler JBadler NGleicher MMutlu BMcDonnell R(2015)A Review of Eye Gaze in Virtual Agents, Social Robotics and HCIComputer Graphics Forum10.1111/cgf.1260334:6(299-326)Online publication date: 1-Sep-2015
https://dl.acm.org/doi/10.1111/cgf.12603
Carretero MQureshi APeters CBailey RKuhl SMohler BSingh K(2014)Evaluating the perception of group emotion from full body movements in the context of virtual crowdsProceedings of the ACM Symposium on Applied Perception10.1145/2628257.2628266(7-14)Online publication date: 8-Aug-2014
https://dl.acm.org/doi/10.1145/2628257.2628266
Carreno-Medrano PGibet SLarboulette CMarteau P(2014)Corpus Creation and Perceptual Evaluation of Expressive Theatrical GesturesIntelligent Virtual Agents10.1007/978-3-319-09767-1_14(109-119)Online publication date: 2014
https://doi.org/10.1007/978-3-319-09767-1_14
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents