BACKGROUND: Measuring implicit attitudes is difficult due to social desirability (SD). A new method, the Emotion Based Approach (EBA), can solve this by using emotions from a display of faces as response categories. We applied this on an EBA Spirituality tool (EBA-SPT) and an Actual Situation tool (EBA-AST). Our aim was to assess the structure, reliability and validity of the tools and to compare two EBA assessment approaches, i.e., an explicit one (only assessing final replies to items) and an implicit one (assessing also the selection process). METHODS: We obtained data on a sample of Czech adults (n = 522, age 30.3±12.58; 27.0% men) via an online survey; cortisol was assessed in 46 participants. We assessed the structure and psychometric properties (internal consistency and test-retest reliability; convergent, discriminant, and criterion validity) of the EBA, and examined the differences between explicit vs. implicit EBA approaches. RESULTS: We found an acceptable-good internal consistency reliability of the EBA tools, acceptable discriminant validity between them and low (neutral expression) to good (joy) test-retest reliability for concrete emotions assessed by the tools. An implicit EBA approach showed stronger correlations between emotions and weaker convergent validity, but higher criterion validity, than an explicit approach and standard questionnaires. CONCLUSION: Compared to standard questionnaires, EBA is a more reliable approach for measuring attitudes, with an implicit approach that reflects the selection process yielding the best results.

Czech Academy of Sciences Institute of Psychology Prague Czech Republic

Department of Community and Occupational Medicine University of Groningen University Medical Center Groningen Groningen The Netherlands

Department of Medicine and Psychiatry Duke University Medical Center Durham North Carolina United States of America

Department of Medicine King Abdulaziz University Jeddah Saudi Arabia

Graduate School Kosice Institute for Society and Health P J Safarik University in Kosice Kosice Slovak Republic

Palacký University Olomouc Olomouc University Social Health Institute Olomouc Czech Republic

See more in PubMed

Sedikides C, Gebauer JE. Religiosity as Self-Enhancement: A Meta-Analysis of the Relation Between Socially Desirable Responding and Religiosity. Pers Soc Psychol Rev. 2010;14(1):17–36. 10.1177/1088868309351002 PubMed DOI

Campbell J, Ehlert U. Acute psychosocial stress: Does the emotional stress response correspond with physiological responses? Psychoneuroendocrino. 2012;37(8):1111–34. 10.1016/j.psyneuen.2011.12.010 PubMed DOI

Reyes-Ortiz CA, Berges IM, Raji MA, Koenig HG, Kuo YF, Markides KS. Church Attendance Mediates the Association Between Depressive Symptoms and Cognitive Functioning Among Older Mexican Americans. J Gerontol A Biol Sci Med Sci, 2008. 63(5): p. 480–486. 10.1093/gerona/63.5.480 PubMed DOI PMC

King MF, Bruner GC. Social desirability bias: A neglected aspect of validity testing. Psychol Market. 2000;17(2):79–103. 10.1002/(sici)1520-6793(200002)17:2<79::Aid-mar2>3.0.Co;2-0 DOI

Zerbe WJ, Paulhus DL. Socially Desirable Responding in Organizational Behavior: A Reconception. Acad Manage Rev. 1987;12(2):250–64. 10.2307/258533 DOI

Boothkewley S, Edwards JE, Rosenfeld P. Impression Management, Social Desirability, and Computer Administration of Attitude Questionnaires: Does the Computer Make a Difference? J Appl Psychol. 1992;77(4):562–6. 10.1037/0021-9010.77.4.562 DOI

Shedler J, Mayman M, Manis M. The Illusion of Mental-Health. Am Psychol. 1993;48(11):1117–31. 10.1037//0003-066x.48.11.1117 PubMed DOI

Pirutinsky S, Siev J, Rosmarin DH. Scrupulosity and implicit and explicit beliefs about God. J Obsess-Compuls Rel. 2015;6:33–8. 10.1016/j.jocrd.2015.05.002 DOI

Greenwald AG, McGhee DE, Schwartz JLK. Measuring individual differences in implicit cognition: The implicit association test. J Pers Soc Psychol. 1998;74(6):1464–80. 10.1037//0022-3514.74.6.1464 PubMed DOI

Fazio RH, Olson MA. Implicit measures in social cognition research: Their meaning and use. Annu Rev Psychol. 2003;54:297–327. 10.1146/annurev.psych.54.101601.145225 PubMed DOI

Armonjones C. Prescription, Explication and the Social Construction of Emotion. J Theor Soc Beh. 1985;15(1):1–22. 10.1111/j.1468-5914.1985.tb00042.x DOI

Kunin T. The construction of a new type of attitude measure 1. Pers psychol, 1955. 8(1): p. 65–77.

Andrews F, Withey B. Social indicators of well-being: Americans’ perceptions of life quality. Springer Science & Business Media. 2012.

Dunham R.B. and Herman J.B., Development of a female faces scale for measures job-satisfaction. J Appl Psychol, 1975; 60(5): 629–631.

Bradley MM, Lang PJ. Measuring emotion: The self-assessment manikin and the semantic differential. J Behav Ther Exp Psy. 1994;25(1):49–59. 10.1016/0005-7916(94)90063-9 PubMed DOI

Bonett DG, Wright TA. Sample size requirements for estimating Pearson, Kendall and Spearman correlations. Psychometrika, 2000; 65(1): 23–28

Vanger P, Hoenlinger R., Haken H. Computer aided generation of prototypical facial expressions of emotion. Methods of Psychological Research Online. 1998;3:25–8.

Derogatis LR, Melisaratos N. The Brief Symptom Inventory: An Introductory Report. Psychol Med. 1983;13(3):595–605. 10.1017/s0033291700048017 PubMed DOI

Kabat J, Kascakova N, Furstova J, Bartuskova L, Glogar P, Solcova IP, et al.. Psychometric characteristics of the Czech version of the Brief Symptom inventory (BSI-53). Cesk Psychol. 2018;62(Supplement 1):19–39.

Underwood L. Ordinary Spiritual Experience: Qualitative Research, Interpretive Guidelines, and Population Distribution for the Daily Spiritual Experience Scale. Arch Psychol Relig. 2006;28(1):181–218. 10.1163/008467206777832562 DOI

Malinakova K, Trnka R, Sarnikova G, Smekal V, Furstova J, Tavel P. Psychometric evaluation of the Daily Spiritual Experience Scale (DSES) in the Czech environment. Cesk Psychol. 2018;62(Supplement 1):100–13.

Ruisel I, Müllner J. Dopen: osobnostny dotaznik na meranie psychotizmu, extra-introverzie, neurotizmu: prirucka. Bratislava: Psychodiagnosticke a didakticke testy; 1982.

Pruessner JC, Wolf OT, Hellhammer DH, Buske-Kirschbaum A, von Auer K, Jobst S, et al.. Free cortisol levels after awakening: A reliable biological marker for the assessment of adrenocortical activity. Life Sci. 1997;61(26):2539–49. 10.1016/s0024-3205(97)01008-4 PubMed DOI

Harmon-Jones C, Bastian B, Harmon-Jones E. The Discrete Emotions Questionnaire: A New Tool for Measuring State Self-Reported Emotions. Plos One. 2016;11(8). 10.1371/journal.pone.0159915 PubMed DOI PMC

Holtgraves T. Social Desirability and the Interpretation of Uncertainty Terms in Self-Report Questions. Appl Cognitive Psych. 2017;31(6):623–31. 10.1002/acp.3364 DOI

Pons L, Baudet M. Latency and reproduction of a response in a successive word-association test. Psych Rep, 1979; 45(1): 299–308.

Field TM, Woodson R, Greenberg R, Cohen D. Discrimination and Imitation of Facial Expressions by Neonatales. Science, 1982; 218(4568): 179–181. 10.1126/science.7123230 PubMed DOI

Nichols SR, Svetlova M, Brownell CA. Toddlers’ Understanding of Peers’ Emotions. J Genet Psychol, 2010; 171(1): 35–53. 10.1080/00221320903300346 PubMed DOI PMC