The accurate decoding of facial emotion expressions lies at the center of many research traditions in psychology. Much of this research, while paying lip service to the importance of context in emotion perception, has used stimuli that were carefully created to be deprived of contextual information. The participants' task is to associate the expression shown in the face with a correct label, essentially changing a social perception task into a cognitive task. In fact, in many cases, the task can be carried out correctly without engaging emotion recognition at all. The present article argues that infusing context in emotion perception does not only add an additional source of information but changes the way that participants approach the task by rendering it a social perception task rather than a cognitive task. Importantly, distinguishing between accuracy (perceiving the intended emotions) and bias (perceiving additional emotions to those intended) leads to a more nuanced understanding of social emotion perception. Results from several studies that use the Assessment of Contextual Emotions demonstrate the significance and social functionality of simultaneously considering emotion decoding accuracy and bias for social interaction in different cultures, their key personality and societal correlates, and their function for close relationships processes.

Department of Psychology Humboldt Universität zu Berlin Germany

Katedra Psychology Palacký University in Olomouc Czech Republic

School of Film Aristotle University of Thessaloniki Greece

Zobrazit více v PubMed

Bänziger, T., Grandjean, D., & Scherer, K. R. (2009). Emotion recognition from expressions in face, voice, and body: The Multimodal Emotion Recognition Test (MERT). Emotion, 9(5), 691–704. 10.1037/a0017088 PubMed DOI

Baron-Cohen, S., Wheelwright, S., Hill, J., Raste, Y., & Plumb, I. (2001). The “reading the mind in the eyes” test revised version: A study with normal adults, and adults with Asperger syndrome or high‐functioning autism. Journal of Child Psychology and Psychiatry, 42(2), 241–251. 10.1017/S0021963001006643 PubMed DOI

Barrett, L. F., & Kensinger, E. A. (2010). Context is routinely encoded during emotion perception. Psychological Science, 21(4), 595–599. 10.1177/0956797610363547 PubMed DOI PMC

Buck, R. (1984). Nonverbal receiving ability. In Buck R. (Ed.), The communication of emotion (pp. 209–242). Guilford Press.

Carroll, J. M., & Russell, J. A. (1996). Do facial expressions signal specific emotions? Judging emotion from the face in context. Journal of Personality and Social Psychology, 70(2), 205–218. 10.1037/0022-3514.70.2.205 PubMed DOI

Chris Fraley, R., Niedenthal, P. M., Marks, M., Brumbaugh, C., & Vicary, A. (2006). Adult attachment and the perception of emotional expressions: Probing the hyperactivating strategies underlying anxious attachment. Journal of Personality, 74(4), 1163–1190. 10.1111/j.1467-6494.2006.00406.x PubMed DOI

Diener, E., Wirtz, D., Tov, W., Kim-Prieto, C., Choi, D.-w., Oishi, S., & Biswas-Diener, R. (2010). New well-being measures: Short scales to assess flourishing and positive and negative feelings. Social Indicators Research, 97(2), 143–156. 10.1007/s11205-009-9493-y DOI

Ekman, P. (2003). Emotions revealed: Recognizing faces and feelings to improve communication and emotional life. Times Books.

Ekman, P., & Friesen, W. V. (1976). Pictures of facial affect. Consulting Psychologists Press.

Ekman, P., & Friesen, W. V. (1978). The facial action coding system: A technique for the measurement of facial movement. Consulting Psychologists Press.

Elfenbein, H. A., & Ambady, N. (2002). On the universality and cultural specificity of emotion recognition: A meta-analysis. Psychological Bulletin, 128(2), 203–235. 10.1037/0033-2909.128.2.203 PubMed DOI

Elfenbein, H. A., Marsh, A., & Ambady, W. (2002). Emotional intelligence and the recognition of emotion from facial expressions. In Barrett L. F. & Salovey P. (Eds.), The wisdom in feeling: Psychological processes in emotional intelligence (pp. 37–59). The Guilford Press.

Ellsworth, P.C., & Scherer, K.R. (2003). Appraisal processes in emotion. In Davidson R.J., Goldsmith H., & Scherer K.R. (Eds.), Handbook of the affective sciences (pp. 572–595). Oxford University Press.

Farrelly, D., & Austin, E. J. (2007). Ability EI as an intelligence? Associations of the MSCEIT with performance on emotion processing and social tasks and with cognitive ability. Cognition and Emotion, 21(5), 1043–1063. 10.1080/02699930601069404 DOI

Feldman, R. S., Philippot, P., & Custrini, R. J. (1991). Social competence and nonverbal behavior. In Feldman R. S. & Rime B. (Eds.), Fundamentals of nonverbal behavior (pp. 319–350). Cambridge University Press.

Foran, H. M., & O'Leary, K. D. (2012). The role of relationships in understanding the alexithymia–depression link. European Journal of Personality, 27(5), 470–480. 10.1002/per.1887 DOI

Funder, D. C. (1989). Accuracy in personality judgment and the dancing bear. In Buss D. M. & Cantor N. (Eds.), Personality psychology: Recent trends and emerging directions (pp. 210–223). Springer-Verlag. 10.1007/978-1-4684-0634-4_16 DOI

Funder, D. C. (1995). On the accuracy of personality judgment: A realistic approach. Psychological Review, 102(4), 652–670. 10.1037/0033-295X.102.4.652 PubMed DOI

Funder, D. C. (2009). Persons, behaviors and situations: An agenda for personality psychology in the postwar era. Journal of Research in Personality, 43(2), 120–126. 10.1016/j.jrp.2008.12.041 DOI

Gendron, M., Roberson, D., van der Vyver, J. M., & Barrett, L. F. (2014). Perceptions of emotion from facial expressions are not culturally universal: Evidence from a remote culture. Emotion, 14(2), 251–262. 10.1037/a0036052 PubMed DOI PMC

Gray, K. L. H., Barber, L., Murphy, J., & Cook, R. (2017). Social interaction contexts bias the perceived expressions of interactants. Emotion, 17(4), 567–571. 10.1037/emo0000257 PubMed DOI

Gross, J. J., & John, O. P. (2003). Individual differences in two emotion regulation processes: Implications for affect, relationships, and well-being. Journal of Personality and Social Psychology, 85(2), 348–362. 10.1037/0022-3514.85.2.348 PubMed DOI

Hall, J. A., Andrzejewski, S. A., & Yopchick, J. E. (2009). Psychosocial correlates of interpersonal sensitivity: A meta-analysis. Journal of Nonverbal Behavior, 33(3), 149–180. 10.1007/s10919-009-0070-5 DOI

Hall, J. A., Carter, J. D., & Horgan, T. G. (2000). Gender differences in nonverbal communication of emotion. In Fischer A. H. (Ed.), Gender and emotion: Social psychological perspectives (pp. 97–117). Cambridge University Press. 10.1017/cbo9780511628191.006 DOI

Hareli, S., & David, S. (2017). The effect of reactive emotions expressed in response to another's anger on inferences of social power. Emotion, 17(4), 717–727. 10.1037/emo0000262 PubMed DOI

Hareli, S., & Hess, U. (2010). What emotional reactions can tell us about the nature of others: An appraisal perspective on person perception. Cognition & Emotion, 24(1), 128–140. 10.1080/02699930802613828 DOI

Hassin, R. R., Aviezer, H., & Bentin, S. (2013). Inherently ambiguous: Facial expressions of emotions, in context. Emotion Review, 5(1), 60–65. 10.1177/1754073912451331 DOI

Hehman, E., Sutherland, C. A. M., Flake, J. K., & Slepian, M. L. (2017). The unique contributions of perceiver and target characteristics in person perception. Journal of Personality and Social Psychology, 113(4), 513–529. 10.1037/pspa0000090 PubMed DOI

Hertenstein, M. J., Keltner, D., App, B., Bulleit, B. A., & Jaskolka, A. R. (2006). Touch communicates distinct emotions. Emotion, 6(3), 528–533. 10.1037/1528-3542.6.3.528 PubMed DOI

Hess, U. (2017). Emotion categorization. In Lefebvre C. & Cohen H. (Eds.), Handbook of categorization in cognitive science (2nd ed., pp. 107–126). Elsevier. 10.1016/b978-0-08-101107-2.00005-1 DOI

Hess, U., Blaison, C., & Kafetsios, K. (2016). Judging facial emotion expressions in context: The influence of culture and self-construal orientation. Journal of Nonverbal Behavior, 40(1), 55–64. 10.1007/s10919-015-0223-7 DOI

Hess, U., Dietrich, J., Kafetsios, K., Elkabetz, S., & Hareli, S. (2019). The bidirectional influence of emotion expressions and context: Emotion expressions, situational information and real-world knowledge combine to inform observers' judgments of both the emotion expressions and the situation. Cognition and Emotion, 34(3), 539–552. 10.1080/02699931.2019.1651252 PubMed DOI

Hess, U., & Hareli, S. (2016). The impact of context on the perception of emotions. In Abell C. & Smith J. (Eds.), The expression of emotion: Philosophical, psychological, and legal perspectives (pp. 199–218). Cambridge University Press.

Hess, U., & Hareli, S. (2018). On the malleability of the meaning of contexts: The influence of another person's emotion expressions on situation perception. Cognition and Emotion, 32(1), 185–191. 10.1080/02699931.2016.1269725 PubMed DOI

Hess, U., Kafetsios, K., Mauersberger, H., Blaison, C., & Kessler, C.-L. (2016). Signal and noise in the perception of facial emotion expressions: From labs to life. Personality and Social Psychology Bulletin, 42(8), 1092–1110. 10.1177/0146167216651851 PubMed DOI

Hess, U., Landmann, H., David, S., & Hareli, S. (2018). The bidirectional relation of emotion perception and social judgments: The effect of witness' emotion expression on perceptions of moral behaviour and vice versa. Cognition and Emotion, 32(6), 1152–1165. 10.1080/02699931.2017.1388769 PubMed DOI

Hugenberg, K., & Bodenhausen, G. V. (2003). Facing prejudice: Implicit prejudice and the perception of facial threat. Psychological Science, 14(6), 640–643. 10.1046/j.0956-7976.2003.psci_1478.x PubMed DOI

Ickes, W. (1997). Empathic accuracy. Guilford.

Ihme, K., Sacher, J., Lichev, V., Rosenberg, N., Kugel, H., Rufer, M., Grabe, H.-J., Pampel, A., Lepsien, J., Kersting, A., Villringer, A., Lane, R. D., & Suslow, T. (2014). Alexithymic features and the labeling of brief emotional facial expressions – An fMRI study. Neuropsychologia, 64, 289–299. 10.1016/j.neuropsychologia.2014.09.044 PubMed DOI

Jongen, S., Axmacher, N., Kremers, N. A. W., Hoffmann, H., Limbrecht-Ecklundt, K., Traue, H. C., & Kessler, H. (2014). An investigation of facial emotion recognition impairments in alexithymia and its neural correlates. Behavioural Brain Research, 271, 129–139. 10.1016/j.bbr.2014.05.069 PubMed DOI

Kafetsios, K., Dostal, D., Seitl, M., & Hess, U. (2021). A contextualized emotion perception test relates to well-being: Social interaction as a mediator. Unpublished manuscript.

Kafetsios, K., & Hess, U. (2013). Effects of Activated and dispositional self-construal on emotion decoding Accuracy. Journal of Nonverbal Behavior, 37(3), 191–205. 10.1007/s10919-013-0149-x DOI

Kafetsios, K., & Hess, U. (2015). Are you looking at me? The influence of facial orientation and cultural focus salience on the perception of emotion expressions. Cogent Psychology, 2(1), 1005493. 10.1080/23311908.2015.1005493 DOI

Kafetsios, K., & Hess, U. (2019). Seeing mixed emotions: Alexithymia, emotion perception bias, and quality in dyadic interactions. Personality and Individual Differences, 137, 80–85. 10.1016/j.paid.2018.08.014 DOI

Kafetsios, K., & Hess, U. (in press). Personality and the accurate perception of facial emotion expressions: What is accuracy and how does it matter? Emotion. 10.1037/emo0001034 PubMed DOI

Kawachi, I., & Berkman, L. F. (2001). Social ties and mental health. Journal of Urban Health: Bulletin of the New York Academy of Medicine, 78(3), 458–467. 10.1093/jurban/78.3.458 PubMed DOI PMC

Kirouac, G., & Hess, U. (1999). Group membership and the decoding of nonverbal behavior. In Philippot P., Feldman R., & Coats E. (Eds.), The social context of nonverbal behavior (pp. 182–210). Cambridge University Press.

Kruglanski, A. W. (1989). The psychology of being “right”: The problem of accuracy in social perception and cognition. Psychological Bulletin, 106(3), 395–409. 10.1037/0033-2909.106.3.395 DOI

Levenson, R. W., Carstensen, L. L., Friesen, W. V., & Ekman, P. (1991). Emotion, physiology, and expression in old age. Psychology and Aging, 6(1), 28–35. 10.1037/0882-7974.6.1.28 PubMed DOI

Lewin, K. (1951). Field theory in social science. Harper.

Little, L. M., Kluemper, D., Nelson, D. L., & Gooty, J. (2012). Development and validation of the interpersonal emotion management scale. Journal of Occupational and Organizational Psychology, 85(2), 407–420. 10.1111/j.2044-8325.2011.02042.x DOI

Lyusin, D., & Ovsyannikova, V. (2016). Measuring two aspects of emotion recognition ability: Accuracy vs. sensitivity. Learning and Individual Differences, 52, 129–136. 10.1016/j.lindif.2015.04.010 DOI

Magai, C., Hunziker, J., Mesias, W., & Culver, L. C. (2000). Adult attachment styles and emotional biases. International Journal of Behavioral Development, 24(3), 301–309. 10.1080/01650250050118286 DOI

Manstead, A. S. R., Fischer, A. H., & Jakobs, E. (1999). The social and emotional functions of facial displays. In Philippot P., Feldman R. S., & Coats E. J. (Eds.), The social context of nonverbal behavior. Studies in emotion and social interaction (pp. 287–313). Cambridge University Press.

Martins, A. T., Ros, A., Valério, L., & Faísca, L. (2019). Basic emotion recognition according to clinical personality traits. Current Psychology, 38(3), 879–889. 10.1007/s12144-017-9661-1 DOI

Masuda, T., Ellsworth, P. C., Mesquita, B., Leu, J., Tanida, S., & Van de Veerdonk, E. (2008). Placing the face in context: Cultural differences in the perception of facial emotion. Journal of Personality and Social Psychology, 94(3), 365–381. 10.1037/0022-3514.94.3.365 PubMed DOI

Matsumoto, D. (2005). Scalar ratings of contempt expressions. Journal of Nonverbal Behavior, 29, 91–104. 10.1007/s10919-005-2742-0 DOI

Matsumoto, D., LeRoux, J., Wilson‐Cohn, C., Raroque, J., Kooken, K., Ekman, P., Yrizarry, N., Loewinger, S., Uchida, H., Yee, A., Amo, L., & Goh, A. (2000). A new test to measure emotion recognition ability: Matsumoto and Ekman's Japanese and Caucasian Brief Affect Recognition Test (JACBERT). Journal of Nonverbal Behavior, 24, 179–209. 10.1023/A:1006668120583 DOI

Matthews, G., Pérez-González, J.-C., Fellner, A. N., Funke, G. J., Emo, A. K., Zeidner, M., & Roberts, R. D. (2015). Individual differences in facial emotion processing: Trait emotional intelligence, cognitive ability, or transient stress? Journal of Psychoeducational Assessment, 33(1), 68–82. 10.1177/0734282914550386 DOI

Mayer, J. D., Salovey, P., Caruso, D. R., & Sitarenios, G. (2003). Measuring emotional intelligence with the MSCEIT V2.0. Emotion, 3(1), 97–105. 10.1037/1528-3542.3.1.97 PubMed DOI

Mischel, W., & Shoda, Y. (1995). A cognitive-affective system theory of personality: Reconceptualizing situations, dispositions, dynamics, and invariance in personality structure. Psychological Review, 102(2), 246–268. 10.1037/0033-295x.102.2.246 PubMed DOI

Motley, M. T., & Camden, C. T. (1988). Facial expression of emotion: A comparison of posed expressions versus spontaneous expressions in an interpersonal communication setting. Western Journal of Speech Communication, 52(1), 1–22. 10.1080/10570318809389622 DOI

Nelson, N. L., & Russell, J. A. (2016). A facial expression of pax: Assessing children's “recognition” of emotion from faces. Journal of Experimental Child Psychology, 141, 49–64. 10.1016/j.jecp.2015.07.016 PubMed DOI

Niedenthal, P. M., & Brauer, M. (2012). Social functionality of human emotion. Annual Review of Psychology, 63(1), 259–285. 10.1146/annurev.psych.121208.131605 PubMed DOI

North, M. S., Todorov, A., & Osherson, D. N. (2010). Inferring the preferences of others from spontaneous, low-emotional facial expressions. Journal of Experimental Social Psychology, 46(6), 1109–1113. 10.1016/j.jesp.2010.05.021 DOI

Nowicki, S., Jr., & Duke, M. P. (2001). Nonverbal receptivity: The diagnostic Analysis of nonverbal Accuracy (DANVA). In Hall J. A. & Bernieri F. J. (Eds.), Interpersonal sensitivity: Theory and measurement (pp. 183–198). Erlbaum.

Ong, D. C., Zaki, J., & Goodman, N. D. (2019). Computational models of emotion inference in theory of mind: A review and roadmap. Topics in Cognitive Science, 11(2), 338–357. 10.1111/tops.12371 PubMed DOI PMC

Overall, N. C., Fletcher, G. J. O., Simpson, J. A., & Fillo, J. (2015). Attachment insecurity, biased perceptions of romantic partners' negative emotions, and hostile relationship behavior. Journal of Personality and Social Psychology, 108(5), 730–749. 10.1037/a0038987 PubMed DOI

Papachiou, A., Hess, U. & Kafetsios, K. (2021). Emotion decoding accuracy and emotion regulation in couples. Unpublished manuscript. PubMed PMC

Penton-Voak, I. S., Munafò, M. R., & Looi, C. Y. (2017). Biased facial-emotion perception in mental health disorders: A possible target for psychological intervention? Current Directions in Psychological Science, 26(3), 294–301. 10.1177/0963721417704405 DOI

Ratcliff, N. J., Franklin, R. G., Nelson, A. J., Jr., & Vescio, T. K. (2012). The scorn of status: A bias toward perceiving anger on high-status faces. Social Cognition, 30(5), 631–642. 10.1521/soco.2012.30.5.631 DOI

Reis, H. T., Lemay, E. P., Jr., & Finkenauer, C. (2017). Toward understanding understanding: The importance of feeling understood in relationships. Social and Personality Psychology Compass, 11(3), article e12308. 10.1111/spc3.12308 DOI

Righart, R., & de Gelder, B. (2008). Rapid influence of emotional scenes on encoding of facial expressions: An ERP study. Social Cognitive and Affective Neuroscience, 3(3), 270–278. 10.1093/scan/nsn021 PubMed DOI PMC

Russell, J. A., & Fehr, B. (1987). Relativity in the perception of emotion in facial expressions. Journal of Experimental Psychology: General, 116(3), 223–237. 10.1037/0096-3445.116.3.223 DOI

Russell, J. A., Suzuki, N., & Ishida, N. (1993). Canadian, Greek, and Japanese freely produced emotion labels for facial expressions. Motivation and Emotion, 17(4), 337–351. 10.1007/BF00992324 DOI

Salovey, P., & Mayer, J. D. (1989–1990). Emotional intelligence. Imagination, Cognition and Personality, 9(3), 185–211. 10.2190/DUGG-P24E-52WK-6CDG DOI

Shiota, M. N., Campos, B., & Keltner, D. (2003). The faces of positive emotion: Prototype displays of awe, amusement, and pride. Annals of the New York Academy of Sciences, 1000(1), 296–299. 10.1196/annals.1280.029 PubMed DOI

Toner, H. L., & Gates, G. R. (1985). Emotional traits and recognition of facial expression of emotion. Journal of Nonverbal Behavior, 9(1), 48–66. 10.1007/BF00987558 DOI

Watson, D., & Stanton, K. (2017). Emotion blends and mixed emotions in the hierarchical structure of Affect. Emotion Review, 9(2), 99–104. 10.1177/1754073916639659 DOI

West, T. V., & Kenny, D. A. (2011). The truth and bias model of judgment. Psychological Review, 118(2), 357–378. 10.1037/a0022936 PubMed DOI

Yrizarry, N., Matsumoto, D., & Wilson-Cohn, C. (1998). American-Japanese differences in multiscalar intensity ratings of universal facial expressions of emotion. Motivation and Emotion, 22(4), 315–327. 10.1023/A:1021304407227 DOI

Zaki, J. (2013). Cue integration: A common framework for social cognition and physical perception. Perspectives on Psychological Science, 8(3), 296–312. 10.1177/1745691613475454 PubMed DOI

Zaki, J., & Ochsner, K. (2011a). Reintegrating the study of accuracy into social cognition research. Psychological Inquiry, 22(3), 159–182. 10.1080/1047840X.2011.551743 DOI

Zaki, J., & Ochsner, K. (2011b). You, me, and my brain: Self and other representations in social cognitive neuroscience. In Todorov A., Fiske S. T., & Prentice D. A. (Eds.), Social neuroscience: Toward understanding the underpinnings of the social mind (pp. 14–39). Oxford University Press. 10.1093/acprof:oso/9780195316872.003.0002 DOI

Zayas, V., Shoda, Y., & Ayduk, O. N. (2002). Personality in context: An interpersonal systems perspective. Journal of Personality, 70(6), 851–900. 10.1111/1467-6494.05026 PubMed DOI

Higher social class is associated with higher contextualized emotion recognition accuracy across cultures

Reconceptualizing Emotion Recognition Ability

Infusing Context Into Emotion Perception Impacts Emotion Decoding Accuracy