A synthesis of evidence for policy from behavioural science during COVID-19
Language English Country Great Britain, England Media print-electronic
Document type Journal Article
PubMed
38093007
PubMed Central
PMC10764287
DOI
10.1038/s41586-023-06840-9
PII: 10.1038/s41586-023-06840-9
Knihovny.cz E-resources
- MeSH
- Behavioral Sciences * methods trends MeSH
- COVID-19 * epidemiology ethnology prevention & control MeSH
- Communication MeSH
- Culture MeSH
- Evidence-Based Practice * methods MeSH
- Humans MeSH
- Pandemics * prevention & control MeSH
- Social Norms MeSH
- Public Health methods trends MeSH
- Leadership MeSH
- Policy Making * MeSH
- Health Policy * MeSH
- Check Tag
- Humans MeSH
- Publication type
- Journal Article MeSH
Scientific evidence regularly guides policy decisions1, with behavioural science increasingly part of this process2. In April 2020, an influential paper3 proposed 19 policy recommendations ('claims') detailing how evidence from behavioural science could contribute to efforts to reduce impacts and end the COVID-19 pandemic. Here we assess 747 pandemic-related research articles that empirically investigated those claims. We report the scale of evidence and whether evidence supports them to indicate applicability for policymaking. Two independent teams, involving 72 reviewers, found evidence for 18 of 19 claims, with both teams finding evidence supporting 16 (89%) of those 18 claims. The strongest evidence supported claims that anticipated culture, polarization and misinformation would be associated with policy effectiveness. Claims suggesting trusted leaders and positive social norms increased adherence to behavioural interventions also had strong empirical support, as did appealing to social consensus or bipartisan agreement. Targeted language in messaging yielded mixed effects and there were no effects for highlighting individual benefits or protecting others. No available evidence existed to assess any distinct differences in effects between using the terms 'physical distancing' and 'social distancing'. Analysis of 463 papers containing data showed generally large samples; 418 involved human participants with a mean of 16,848 (median of 1,699). That statistical power underscored improved suitability of behavioural science research for informing policy decisions. Furthermore, by implementing a standardized approach to evidence selection and synthesis, we amplify broader implications for advancing scientific evidence in policy formulation and prioritization.
274th ASOS US Air Force New York Air National Guard Syracuse NY United States
Center for Adaptive Rationality Max Planck Institute for Human Development Berlin Germany
Center for Social Norms and Behavioral Dynamics University of Pennsylvania Philadelphia PA USA
Centre for Applied Epistemology Educational Research Institute Ljubljana Slovenia
Charles University Prague Czech Republic
City University of London London UK
Computation and Neural Systems Program California Institute of Technology Pasadena CA USA
Consejo Nacional de Investigaciones Científicas y Técnicas Buenos Aires Argentina
Cornell University Ithaca NY USA
Department of Agricultural and Resource Economics University of Maryland College Park MD USA
Department of Experimental Psychology University of Oxford Oxford UK
Department of Humanities and Social Sciences California Institute of Technology Pasadena CA USA
Department of Politics and Center for Social Media and Politics New York University New York NY USA
Department of Psychological and Behavioural Science London School of Economics London UK
Department of Psychology and Center for Neural Science New York University New York NY USA
Department of Psychology Carleton University Ottawa Ontario Canada
Department of Psychology Faculty of Arts University of Ljubljana Ljubljana Slovenia
Department of Psychology Humboldt University of Berlin Berlin Germany
Department of Psychology Loyola University Chicago Chicago IL USA
Department of Psychology Northwestern University Evanston IL USA
Department of Psychology Ohio State University Columbus OH USA
Department of Psychology Stanford University Stanford CA USA
Department of Psychology The Chinese University of Hong Kong Hong Kong SAR China
Department of Psychology University of British Columbia Vancouver British Columbia Canada
Department of Psychology University of Cambridge Cambridge UK
Department of Psychology University of Cologne Cologne Germany
Department of Psychology University of Zurich Zurich Switzerland
Department of Psychology York University Toronto Ontario Canada
Department of Social Policy and Evaluation University of Oxford Oxford UK
Department of Sociology Stanford University Stanford CA USA
Duke Kunshan University Kunshan China
Escuela de Negocios Universidad Torcuato Di Tella Buenos Aires Argentina
Faculty of Arts and Science Kyushu University Fukuoka Japan
Global Faculty Social and Economic Behavior University of Cologne Cologne Germany
Gordon Institute of Business Science University of Pretoria Johannesburg South Africa
Haas School of Business University of California Berkeley Berkeley CA USA
Harvard University Cambridge MA USA
Institute of Psychology Faculty of Philosophy University of Belgrade Belgrade Serbia
Jacobs Center for Productive Youth Development University of Zurich Zurich Switzerland
Junior Researcher Programme Cambridge UK
Kellogg School of Management Northwestern University Evanston IL USA
Laboratorio de Neurociencia Universidad Torcuato Di Tella Buenos Aires Argentina
Lehigh University Bethlehem PA USA
Mackenzie Presbyterian University São Paulo Brazil
Mannheim Centre for European Social Research University of Mannheim Mannheim Germany
Massachusetts Institute of Technology Cambridge MA USA
MRC Cognition and Brain Sciences Unit University of Cambridge Cambridge UK
National University of Singapore Singapore Singapore
Northwestern University Evanston IL USA
Organisation for Economic Co operation and Development Paris France
Psychology Department Faculty of Health and Life Sciences University of Exeter Exeter UK
Psychology Department University of Oregon Eugene OR USA
Rotman Research Institute Baycrest Academy for Research and Education Toronto Ontario Canada
Stanford University Stanford CA USA
Sungkyunkwan University Seoul Republic of Korea
The Wharton School of the University of Pennsylvania Philadelphia PA USA
The World Bank Washington DC USA
Trinity College Institute of Neuroscience Trinity College Dublin Dublin Ireland
University College Dublin Dublin Ireland
University of Amsterdam Amsterdam Netherlands
University of Chicago Chicago IL USA
University of Groningen Groningen Netherlands
University of Illinois Chicago Chicago IL USA
University of Kent Canterbury UK
University of Michigan Ann Arbor MI USA
University of Milan Bicocca Milan Italy
University of Oxford Oxford UK
University of Queensland St Lucia Queensland Australia
University of Tehran Tehran Iran
See more in PubMed
National Academies Press. Using Science as Evidence in Public Policy (National Academies Press, 2012).
Fact sheet: new progress on using behavioral science insights to better serve the American people. whitehouse.govhttps://obamawhitehouse.archives.gov/the-press-office/2016/09/15/fact-sheet-new-progress-using-behavioral-science-insights-better-serve (2016).
Van Bavel JJ, et al. Using social and behavioural science to support COVID-19 pandemic response. Nat. Hum. Behav. 2020;4:460–471. doi: 10.1038/s41562-020-0884-z. PubMed DOI
Hodges R, Caperchione E, van Helden J, Reichard C, Sorrentino D. The role of scientific expertise in COVID-19 policy-making: evidence from four European countries. Public Org. Rev. 2022;22:249–267. doi: 10.1007/s11115-022-00614-z. DOI
Dowd JB, et al. Demographic science aids in understanding the spread and fatality rates of COVID-19. Proc. Natl Acad. Sci. USA. 2020;117:9696–9698. doi: 10.1073/pnas.2004911117. PubMed DOI PMC
Parkhurst JO, Abeysinghe S. What constitutes “good” evidence for public health and social policy-making? From hierarchies to appropriateness. Soc. Epistemol. 2016;30:665–679. doi: 10.1080/02691728.2016.1172365. DOI
Sienkiewicz, M. & Mair, D. in Science for Policy Handbook (eds Šucha, V. & Sienkiewicz, M.) 2–13 (Elsevier, 2020).
Manski CF. Communicating uncertainty in policy analysis. Proc. Natl Acad. Sci. USA. 2019;116:7634–7641. doi: 10.1073/pnas.1722389115. PubMed DOI PMC
Moatti J-P. The French response to COVID-19: intrinsic difficulties at the interface of science, public health, and policy. Lancet Public Health. 2020;5:e255. doi: 10.1016/S2468-2667(20)30087-6. PubMed DOI PMC
Tyler C, et al. AI tools as science policy advisers? The potential and the pitfalls. Nature. 2023;622:27–30. doi: 10.1038/d41586-023-02999-3. PubMed DOI
Policy citations for ‘using social and behavioural science to support COVID-19 pandemic response’ Altmetric (accessed 22 November 2023) https://nature.altmetric.com/details/80902343/policy-documents.
Cheng C, Barceló J, Hartnett AS, Kubinec R, Messerschmidt L. COVID-19 government response event dataset (CoronaNet v.1.0) Nat. Hum. Behav. 2020;4:756–768. doi: 10.1038/s41562-020-0909-7. PubMed DOI
World Health Organization. Regional Office for Europe. Pandemic fatigue: reinvigorating the public to prevent COVID-19: policy framework for supporting pandemic prevention and management: revised version November 2020. WHOhttps://apps.who.int/iris/handle/10665/337574 (2020).
European Commission, Directorate-General for Research and Innovation, European Group on Ethics in Science and New Technologies & Group of Chief Scientific Advisors. Improving pandemic preparedness and management: lessons learned and ways forward: independent expert report. Publications Office of the European Unionhttp://op.europa.eu/en/publication-detail/-/publication/a1016d77-2562-11eb-9d7e-01aa75ed71a1/language-en/format-PDF (2020).
Biddle, N. Behavioural economics and the COVID-induced education crisis. OECDhttps://www.oecd-ilibrary.org/education/behavioural-economics-and-the-covid-induced-education-crisis_eba2b867-en (2021).
Principles for managing SARS-CoV-2 transmission associated with further education, 3 September 2020. GOV.UKhttps://www.gov.uk/government/publications/principles-for-managing-sars-cov-2-transmission-associated-with-further-education-3-september-2020 (2020).
Diminishing returns: nudging COVID-19 prevention among Colombian young adults. IDBhttps://publications.iadb.org/en/diminishing-returns-nudging-covid-19-prevention-among-colombian-young-adults (2021). PubMed PMC
Duckett, S., Mackey, W., Stobart, A. & Swerissen, H. Coming out of COVID-19 lockdown: the next steps for Australian health care. APOhttps://apo.org.au/node/306385 (2020).
Social scientists scramble to study pandemic, in real time. Sciencehttps://www.science.org/content/article/social-scientists-scramble-study-pandemic-real-time (2020).
What are behavioral scientists doing about COVID-19? The Policy Lab (accessed 22 November 2023) https://thepolicylab.brown.edu/projects/covid-behavioral-tracker.
Van Lange, P. A. M., & Rand, D. G. Human cooperation and the crises of climate change, COVID-19, and misinformation. Annu. Rev. Psychol.73, 379–402 (2022). PubMed
Byrne-Davis LMT, et al. Using behavioural science in public health settings during the COVID-19 pandemic: the experience of public health practitioners and behavioural scientists. Acta Psychol. 2022;224:103527. doi: 10.1016/j.actpsy.2022.103527. PubMed DOI PMC
Ioannidis JPA, Salholz-Hillel M, Boyack KW, Baas J. The rapid, massive growth of COVID-19 authors in the scientific literature. R. Soc. Open Sci. 2021;8:210389. doi: 10.1098/rsos.210389. PubMed DOI PMC
IJzerman H, et al. Use caution when applying behavioural science to policy. Nat. Hum. Behav. 2020;4:1092–1094. doi: 10.1038/s41562-020-00990-w. PubMed DOI
Bryan CJ, Tipton E, Yeager DS. Behavioural science is unlikely to change the world without a heterogeneity revolution. Nat. Hum. Behav. 2021;5:980–989. doi: 10.1038/s41562-021-01143-3. PubMed DOI PMC
Lewis NA, Wai J. Communicating what we know and what isn’t so: science communication in psychology. Perspect. Psychol. Sci. 2021;16:1242–1254. doi: 10.1177/1745691620964062. PubMed DOI
Puthillam, A. Too WEIRD, too fast: preprints about COVID-19 in the psychological sciences. Collabra Psychol.10.1525/collabra.74331 (2023).
Galluccio, M. in Science and Diplomacy: Negotiating Essential Alliances (ed. Galluccio, M.) 65–74 (Springer International Publishing, 2021).
Cairney P, Oliver K. Evidence-based policymaking is not like evidence-based medicine, so how far should you go to bridge the divide between evidence and policy? Health Res. Policy Syst. 2017;15:35. doi: 10.1186/s12961-017-0192-x. PubMed DOI PMC
Ellemers N. Science as collaborative knowledge generation. Br. J. Soc. Psychol. 2021;60:1–28. doi: 10.1111/bjso.12430. PubMed DOI PMC
Ruppel Shell, E. Act now, wait for perfect evidence later, says ‘high priestess’ of U.K. COVID-19 masking campaign. Science10.1126/science.abf2811 (2020).
Pei S, Kandula S, Shaman J. Differential effects of intervention timing on COVID-19 spread in the United States. Sci. Adv. 2020;6:eabd6370. doi: 10.1126/sciadv.abd6370. PubMed DOI PMC
Schwartz JL. Evaluating and deploying Covid-19 vaccines — the importance of transparency, scientific integrity, and public trust. N. Engl. J. Med. 2020;383:1703–1705. doi: 10.1056/NEJMp2026393. PubMed DOI
Philipp-Muller A, Lee SWS, Petty RE. Why are people antiscience, and what can we do about it? Proc. Natl Acad. Sci. USA. 2022;119:e2120755119. doi: 10.1073/pnas.2120755119. PubMed DOI PMC
Wingen T, Berkessel JB, Englich B. No replication, no trust? How low replicability influences trust in psychology. Soc. Psychol. Pers. Sci. 2020;11:454–463. doi: 10.1177/1948550619877412. DOI
Kojan L, Burbach L, Ziefle M, Calero Valdez A. Perceptions of behaviour efficacy, not perceptions of threat, are drivers of COVID-19 protective behaviour in Germany. Humanit. Soc. Sci. Commun. 2022;9:1–15. doi: 10.1057/s41599-022-01098-4. DOI
Santana AP, Korn L, Betsch C, Böhm R. Lessons learned about willingness to adopt various protective measures during the early COVID-19 pandemic in three countries. PLoS ONE. 2022;17:e0265892. doi: 10.1371/journal.pone.0265892. PubMed DOI PMC
Garcia-Garzon, E., Angulo-Brunet, A., Lecuona, O., Barrada, J. R. & Corradi, G. Exploring COVID-19 research credibility among Spanish scientists. Curr. Psychol.10.1007/s12144-022-02797-6 (2022). PubMed PMC
Centers for Disease Control and Prevention. How to build COVID-19 vaccine confidence. CDChttps://www.cdc.gov/vaccines/covid-19/vaccinate-with-confidence/building-trust.html (2022).
Nosek BA, et al. Replicability, robustness, and reproducibility in psychological science. Annu. Rev. Psychol. 2022;73:719–748. doi: 10.1146/annurev-psych-020821-114157. PubMed DOI
Serra-Garcia M, Gneezy U. Mistakes, overconfidence, and the effect of sharing on detecting lies. Am. Econ. Rev. 2021;111:3160–3183. doi: 10.1257/aer.20191295. DOI
Haber NA, Wieten SE, Smith ER, Nunan D. Much ado about something: a response to “COVID-19: underpowered randomised trials, or no randomised trials?”. Trials. 2021;22:780. doi: 10.1186/s13063-021-05755-y. PubMed DOI PMC
‘It’s misinformation at worst.’ Weak health studies can do more harm than good, scientists say. Sciencehttps://www.science.org/content/article/it-s-misinformation-worst-weak-health-studies-can-do-more-harm-good-scientists-say (2021).
Luttrell A, Petty RE. Evaluations of self-focused versus other-focused arguments for social distancing: an extension of moral matching effects. Soc. Psychol. Pers. Sci. 2021;12:946–954. doi: 10.1177/1948550620947853. DOI
Korn L, Böhm R, Betsch C. Reply to Rabb et al.: why promoting COVID-19 vaccines with community immunity is not a good strategy (yet) Proc. Natl Acad. Sci. USA. 2021;118:e2102054118. doi: 10.1073/pnas.2102054118. PubMed DOI PMC
Van Bavel JJ, et al. National identity predicts public health support during a global pandemic. Nat. Commun. 2022;13:517. doi: 10.1038/s41467-021-27668-9. PubMed DOI PMC
Frenzel SB, et al. How national leaders keep ‘us’ safe: a longitudinal, four-nation study exploring the role of identity leadership as a predictor of adherence to COVID-19 non-pharmaceutical interventions. BMJ Open. 2022;12:e054980. doi: 10.1136/bmjopen-2021-054980. PubMed DOI PMC
Lu JG, Jin P, English AS. Collectivism predicts mask use during COVID-19. Proc. Natl Acad. Sci. USA. 2021;118:e2021793118. doi: 10.1073/pnas.2021793118. PubMed DOI PMC
Stevenson C, Wakefield JRH, Felsner I, Drury J, Costa S. Collectively coping with coronavirus: local community identification predicts giving support and lockdown adherence during the COVID-19 pandemic. Br. J. Soc. Psychol. 2021;60:1403–1418. doi: 10.1111/bjso.12457. PubMed DOI PMC
Bentley, S. V. et al. GROUPS 2 CONNECT: an online activity to maintain social connection and well-being during COVID-19. Appl. Psychol. Health Well Being10.1111/aphw.12330 (2022). PubMed
Bicchieri C, et al. In science we (should) trust: expectations and compliance across nine countries during the COVID-19 pandemic. PLoS ONE. 2021;16:e0252892. doi: 10.1371/journal.pone.0252892. PubMed DOI PMC
Hensel L, et al. Global behaviors, perceptions, and the emergence of social norms at the onset of the COVID-19 pandemic. J. Econ. Behav. Org. 2022;193:473–496. doi: 10.1016/j.jebo.2021.11.015. PubMed DOI PMC
Chadwick A, et al. Online social endorsement and Covid-19 vaccine hesitancy in the United Kingdom. Soc. Media Soc. 2021;7:20563051211008816.
Rabb N, Bowers J, Glick D, Wilson KH, Yokum D. The influence of social norms varies with “others” groups: evidence from COVID-19 vaccination intentions. Proc. Natl Acad. Sci. USA. 2022;119:e2118770119. doi: 10.1073/pnas.2118770119. PubMed DOI PMC
Stuart J, O’Donnell K, O’Donnell A, Scott R, Barber B. Online social connection as a buffer of health anxiety and isolation during COVID-19. Cyberpsychol. Behav. Soc. Netw. 2021;24:521–525. doi: 10.1089/cyber.2020.0645. PubMed DOI
Marinucci M, Pancani L, Aureli N, Riva P. Online social connections as surrogates of face-to-face interactions: a longitudinal study under Covid-19 isolation. Comp. Hum. Behav. 2022;128:107102. doi: 10.1016/j.chb.2021.107102. DOI
Sun, R., Rieble, C., Liu, Y. & Sauter, D. Connected despite lockdown: the role of social interactions and social media use in wellbeing. Collabra: Psychol.8, 37061 (2022).
Tunçgenç B, et al. Social influence matters: We follow pandemic guidelines most when our close circle does. Br. J. Psychol. 2021;112:763–780. doi: 10.1111/bjop.12491. PubMed DOI PMC
van Baal, S. T., Walasek, L. & Hohwy, J. Modelling pandemic behaviour using an economic multiplayer game. Sci. Rep.12, 13466 (2022). PubMed PMC
Zhu P, et al. The efficacy of a brief, altruism-eliciting video intervention in enhancing COVID-19 vaccination intentions among a population-based sample of younger adults: randomized controlled trial. JMIR Public Health Surveill. 2022;8:e37328. doi: 10.2196/37328. PubMed DOI PMC
Abu-Akel A, Spitz A, West R. The effect of spokesperson attribution on public health message sharing during the COVID-19 pandemic. PLoS ONE. 2021;16:e0245100. doi: 10.1371/journal.pone.0245100. PubMed DOI PMC
Arroyos-Calvera, D., Drouvelis, M., Lohse, J. & McDonald, R. Improving compliance with COVID-19 guidance: a workplace field experiment. SSRN10.2139/ssrn.3760562 (2021).
Bos B, Drupp MA, Meya JN, Quaas MF. Moral suasion and the private provision of public goods: evidence from the COVID-19 pandemic. Environ. Res. Econ. 2020;76:1117–1138. doi: 10.1007/s10640-020-00477-2. PubMed DOI PMC
Chu J, Pink SL, Willer R. Religious identity cues increase vaccination intentions and trust in medical experts among American Christians. Proc. Natl Acad. Sci. USA. 2021;118:e2106481118. doi: 10.1073/pnas.2106481118. PubMed DOI PMC
Larsen, B. et al. Counter-stereotypical messaging and partisan cues: moving the needle on vaccines in a polarized U.S. http://www.nber.org/papers/w29896.pdf (NBER, 2022). PubMed PMC
Moehring, A. et al. Surfacing norms to increase vaccine acceptance. SSRN10.2139/ssrn.3782082 (2021).
Rabb N, et al. Evidence from a statewide vaccination RCT shows the limits of nudges. Nature. 2022;604:E1–E7. doi: 10.1038/s41586-022-04526-2. PubMed DOI
Teeny JD, Siev JJ, Briñol P, Petty RE. A review and conceptual framework for understanding personalized matching effects in persuasion. J. Consum. Psychol. 2021;31:382–414. doi: 10.1002/jcpy.1198. DOI
Flores A, et al. Politicians polarize and experts depolarize public support for COVID-19 management policies across countries. Proc. Natl Acad. Sci. USA. 2022;119:e2117543119. doi: 10.1073/pnas.2117543119. PubMed DOI PMC
Long A, et al. Co-created messaging for influenza vaccination in a high-risk Hispanic community provides groundwork for COVID-19 vaccine. Health Equity. 2021;5:345–352. doi: 10.1089/heq.2020.0132. PubMed DOI PMC
de Saint Laurent C, Murphy G, Hegarty K, Greene CM. Measuring the effects of misinformation exposure and beliefs on behavioural intentions: a COVID-19 vaccination study. Cogn. Res. Princ. Implic. 2022;7:87. doi: 10.1186/s41235-022-00437-y. PubMed DOI PMC
Su Z, et al. Mental health consequences of COVID-19 media coverage: the need for effective crisis communication practices. Global. Health. 2021;17:4. doi: 10.1186/s12992-020-00654-4. PubMed DOI PMC
Loomba S, de Figueiredo A, Piatek SJ, de Graaf K, Larson HJ. Measuring the impact of COVID-19 vaccine misinformation on vaccination intent in the UK and USA. Nat. Hum. Behav. 2021;5:337–348. doi: 10.1038/s41562-021-01056-1. PubMed DOI
Druckman JN, Klar S, Krupnikov Y, Levendusky M, Ryan JB. Affective polarization, local contexts and public opinion in America. Nat. Hum. Behav. 2021;5:28–38. doi: 10.1038/s41562-020-01012-5. PubMed DOI
Farhart CE, Douglas-Durham E, Lunz Trujillo K, Vitriol JA. Vax attacks: how conspiracy theory belief undermines vaccine support. Prog. Mol. Biol. Transl. Sci. 2022;188:135–169. doi: 10.1016/bs.pmbts.2021.11.001. PubMed DOI PMC
Freeman, D. et al. COVID-19 vaccine hesitancy in the UK: the Oxford coronavirus explanations, attitudes, and narratives survey (Oceans) II. Psychol. Med.10.1017/S0033291720005188 (2020). PubMed PMC
Gelfand, M. J. et al. The relationship between cultural tightness–looseness and COVID-19 cases and deaths: a global analysis. Lancet Planet. Health10.1016/S2542-5196(20)30301-6 (2021). PubMed PMC
Gollwitzer, A., Martel, C., Brady, W. J., Knowles, E. D. & Van Bavel, J. Partisan differences in physical distancing predict infections and mortality during the coronavirus pandemic. SSRN10.2139/ssrn.3609392 (2020).
Kitayama S, Camp NP, Salvador CE. Culture and the COVID-19 pandemic: multiple mechanisms and policy implications. Soc. Issues Policy Rev. 2022;16:164–211. doi: 10.1111/sipr.12080. DOI
Kreps S, Dasgupta N, Brownstein JS, Hswen Y, Kriner DL. Public attitudes toward COVID-19 vaccination: the role of vaccine attributes, incentives, and misinformation. npj Vaccines. 2021;6:73. doi: 10.1038/s41541-021-00335-2. PubMed DOI PMC
Marchlewska M, Hamer K, Baran M, Górska P, Kaniasty K. COVID-19: why do people refuse vaccination? The role of social identities and conspiracy beliefs: evidence from nationwide samples of Polish adults. Vaccines. 2022;10:268. doi: 10.3390/vaccines10020268. PubMed DOI PMC
Painter, M. & Qiu, T. Political beliefs affect compliance with government mandates. J. Econ. Behav. Org.10.1016/j.jebo.2021.03.019 (2021). PubMed PMC
Porter, E., Wood, T. J. & Velez, Y. Correcting COVID-19 vaccine misinformation in ten countries. R. Soc. Open Sci.10, 221097 (2023). PubMed PMC
Rodriguez, C. G., Gadarian, S. K., Goodman, S. W. & Pepinsky, T. B. Morbid polarization: exposure to COVID-19 and partisan disagreement about pandemic response. Polit. Psychol.10.1111/pops.12810 (2022). PubMed PMC
Roozenbeek J, et al. Susceptibility to misinformation about COVID-19 around the world. R. Soc. Open Sci. 2020;7:201199. doi: 10.1098/rsos.201199. PubMed DOI PMC
Basol M, et al. Towards psychological herd immunity: cross-cultural evidence for two prebunking interventions against COVID-19 misinformation. Big Data Soc. 2021;8:20539517211013868. doi: 10.1177/20539517211013868. DOI
Pennycook G, Rand DG. Accuracy prompts are a replicable and generalizable approach for reducing the spread of misinformation. Nat. Commun. 2022;13:2333. doi: 10.1038/s41467-022-30073-5. PubMed DOI PMC
Capraro, V. & Celadin, T. “I think this news is accurate”: endorsing accuracy decreases the sharing of fake news and increases the sharing of real news. Pers. Soc. Psychol. Bull.10.1177/01461672221117691 (2022). PubMed PMC
Elgar FJ, Stefaniak A, Wohl MJA. The trouble with trust: time-series analysis of social capital, income inequality, and COVID-19 deaths in 84 countries. Soc. Sci. Med. 2020;263:113365. doi: 10.1016/j.socscimed.2020.113365. PubMed DOI PMC
Khazanchi, R., Marcelin, J., Abdul-Mutakabbir, J. & Essien, U. Race, racism, civil rights law, and the equitable allocation of scarce COVID-19 treatments. Health Aff. Forefront10.1377/forefront.20220208.453850 (2022).
Scheitle CP, Corcoran KE. COVID-19 skepticism in relation to other forms of science skepticism. Socius. 2021;7:23780231211049840. doi: 10.1177/23780231211049841. DOI
Milkman, K. L. et al. A citywide experiment testing the impact of geographically targeted, high-pay-off vaccine lotteries. Nat. Hum. Behav.10.1038/s41562-022-01437-0 (2022). PubMed
Campos-Mercade P, et al. Monetary incentives increase COVID-19 vaccinations. Science. 2021;374:879–882. doi: 10.1126/science.abm0475. PubMed DOI PMC
Thirumurthy H, Milkman KL, Volpp KG, Buttenheim AM, Pope DG. Association between statewide financial incentive programs and COVID-19 vaccination rates. PLoS ONE. 2022;17:e0263425. doi: 10.1371/journal.pone.0263425. PubMed DOI PMC
Gulati K, Busari J. Vaccinating a billion people against COVID-19: India’s quest for systems leadership in exceptional times. Leadersh. Health Serv. 2021;35:137–148. doi: 10.1108/LHS-05-2021-0045. PubMed DOI
Cheema S, Ameduri M, Abraham A, Doraiswamy S, Mamtani R. The COVID-19 pandemic: the public health reality. Epidemiol. Infect. 2020;148:e223. doi: 10.1017/S0950268820002216. PubMed DOI PMC
European Observatory on Health Systems and Policies et al. Public health leadership and the COVID-19 pandemic in Europe. Eurohealth. 2021;27:4–9.
Nkengasong J, et al. The global response to the COVID-19 pandemic. Med. 2020;1:3–8. doi: 10.1016/j.medj.2020.12.003. PubMed DOI PMC
Schwalb A, Seas C. The COVID-19 pandemic in Peru: what went wrong? Am. J. Trop. Med. Hyg. 2021;104:1176–1178. doi: 10.4269/ajtmh.20-1323. PubMed DOI PMC
Ortega F, Orsini M. Governing COVID-19 without government in Brazil: ignorance, neoliberal authoritarianism, and the collapse of public health leadership. Glob. Public Health. 2020;15:1257–1277. doi: 10.1080/17441692.2020.1795223. PubMed DOI
Brownstein, J., Cantor, J. H., Rader, B., Simon, K. I. & Whaley, C. M. If you build it, will they vaccinate? The impact of COVID-19 vaccine sites on vaccination rates and outcomes. 10.3386/w30429 (NBER, 2022).
Thunström L, Ashworth M, Shogren JF, Newbold S, Finnoff D. Testing for COVID-19: willful ignorance or selfless behavior? Behav. Public Policy. 2021;5:135–152. doi: 10.1017/bpp.2020.15. DOI
Leonhardt JM, Ridinger G, Rong Y, Talaei-Khoe A. Invincibility threatens vaccination intentions during a pandemic. PLoS ONE. 2021;16:e0258432. doi: 10.1371/journal.pone.0258432. PubMed DOI PMC
Dai H, et al. Behavioural nudges increase COVID-19 vaccinations. Nature. 2021;597:404–409. doi: 10.1038/s41586-021-03843-2. PubMed DOI PMC
Reñosa MDC, et al. Nudging toward vaccination: a systematic review. BMJ Glob. Health. 2021;6:e006237. doi: 10.1136/bmjgh-2021-006237. PubMed DOI PMC
Epstein, Z. et al. Developing an accuracy-prompt toolkit to reduce COVID-19 misinformation online. Harvard Kennedy School Misinformation Rev.10.37016/mr-2020-71 (2021).
Roozenbeek J, Freeman ALJ, van der Linden S. How accurate are accuracy-nudge interventions? A preregistered direct replication of Pennycook et al. (2020) Psychol. Sci. 2021;32:1169–1178. doi: 10.1177/09567976211024535. PubMed DOI PMC
Maier M, et al. No evidence for nudging after adjusting for publication bias. Proc. Natl Acad. Sci. USA. 2022;119:e2200300119. doi: 10.1073/pnas.2200300119. PubMed DOI PMC
DellaVigna S, Linos E. RCTs to scale: comprehensive evidence from two nudge units. Econometrica. 2022;90:81–116. doi: 10.3982/ECTA18709. DOI
Aguilar-Latorre A, et al. The impact of the COVID-19 lockdown on depression sufferers: a qualitative study from the province of Zaragoza, Spain. BMC Public Health. 2022;22:780. doi: 10.1186/s12889-022-13083-2. PubMed DOI PMC
Loades ME, et al. Rapid systematic review: the impact of social isolation and loneliness on the mental health of children and adolescents in the context of COVID-19. J. Am. Acad. Child Adolesc. Psychiatry. 2020;59:1218–1239.e3. doi: 10.1016/j.jaac.2020.05.009. PubMed DOI PMC
Pancani L, Marinucci M, Aureli, N, Riva P. Forced social isolation and mental health: a study on 1,006 Italians under COVID-19 lockdown. Front. Psychol. 2021;12:663799. doi: 10.3389/fpsyg.2021.663799. PubMed DOI PMC
World Health Organization. Mental health and COVID-19: early evidence of the pandemic’s impact: scientific brief, 2 March 2022. WHOwww.who.int/publications-detail-redirect/WHO-2019-nCoV-Sci_Brief-Mental_health-2022.1 (2022).
Sels L, et al. Intimate relationships in times of COVID-19: a descriptive study of Belgian partners and their perceived well-being. Psychol. Belg. 2022;62:1–16. doi: 10.5334/pb.1088. PubMed DOI PMC
Boserup B, McKenney M, Elkbuli A. Alarming trends in US domestic violence during the COVID-19 pandemic. Am. J. Emerg. Med. 2020;38:2753–2755. doi: 10.1016/j.ajem.2020.04.077. PubMed DOI PMC
Measuring the Shadow Pandemic Violence Against Women During COVID-19 (United Nations, 2021).
Zion SR, et al. Making sense of a pandemic: mindsets influence emotions, behaviors, health, and wellbeing during the COVID-19 pandemic. Soc. Sci. Med. 2022;301:114889. doi: 10.1016/j.socscimed.2022.114889. PubMed DOI PMC
Ruggeri K, Garcia-Garzon E, Maguire Á, Matz S, Huppert FA. Well-being is more than happiness and life satisfaction: a multidimensional analysis of 21 countries. Health Qual. Life Outcomes. 2020;18:192. doi: 10.1186/s12955-020-01423-y. PubMed DOI PMC
Fieselmann J, Annac K, Erdsiek F, Yilmaz-Aslan Y, Brzoska P. What are the reasons for refusing a COVID-19 vaccine? A qualitative analysis of social media in Germany. BMC Public Health. 2022;22:846. doi: 10.1186/s12889-022-13265-y. PubMed DOI PMC
Bullock J, Lane JE, Shults FL. What causes COVID-19 vaccine hesitancy? Ignorance and the lack of bliss in the United Kingdom. Humanit. Soc. Sci. Commun. 2022;9:1–7. doi: 10.1057/s41599-022-01092-w. DOI
Schumpe BM, et al. Predictors of adherence to public health behaviors for fighting COVID-19 derived from longitudinal data. Sci. Rep. 2022;12:3824. doi: 10.1038/s41598-021-04703-9. PubMed DOI PMC
Myerson J, Strube MJ, Green L, Hale S. Individual differences in COVID-19 mitigation behaviors: the roles of age, gender, psychological state, and financial status. PLoS ONE. 2021;16:e0257658. doi: 10.1371/journal.pone.0257658. PubMed DOI PMC
Belchior, A. M. & Teixeira, C. P. Determinants of political trust during the early months of the COVID-19 pandemic: putting policy performance into evidence. Polit. Stud. Rev.10.1177/14789299211056193 (2021). PubMed PMC
Viner R, et al. School closures during social lockdown and mental health, health behaviors, and well-being among children and adolescents during the first COVID-19 wave: a systematic review. JAMA Pediatr. 2022;176:400–409. doi: 10.1001/jamapediatrics.2021.5840. PubMed DOI
Baumann M. COVID-19 and mental health in children and adolescents: a diagnostic panel to map psycho-social consequences in the pandemic context. Discov. Ment. Health. 2021;1:2. doi: 10.1007/s44192-021-00002-x. PubMed DOI PMC
Gómez-Durán EL, et al. COVID-19 pandemic psychological impact and volunteering experience perceptions of medical students after 2 years. Int. J. Environ. Res. Public Health. 2022;19:7532. doi: 10.3390/ijerph19127532. PubMed DOI PMC
Jiang X, Hwang J, Shah DV, Ghosh S, Brauer M. News attention and social-distancing behavior amid COVID-19: how media trust and social norms moderate a mediated relationship. Health Commun. 2022;37:768–777. doi: 10.1080/10410236.2020.1868064. PubMed DOI PMC
Fields, J. et al. Community–academic partnerships to address Covid-19 inequities: lessons from the San Francisco Bay Area. NEJM Catalyst10.1056/CAT.21.0135 (2021).
Mullin M. Learning from local government research partnerships in a fragmented political setting. Public Adm. Rev. 2021;81:978–982. doi: 10.1111/puar.13395. DOI
DeBoer S, et al. Building successful and sustainable academic health science partnerships: exploring perspectives of hospital leaders. Can. Med. Educ. J. 2019;10:e56–e67. doi: 10.36834/cmej.53013. PubMed DOI PMC
Baker, S. R., Farrokhnia, R. A., Meyer, S., Pagel, M. & Yannelis, C. Income, liquidity, and the consumption response to the 2020 Economic Stimulus Payments. NBERhttps://www.nber.org/papers/w27097 (2020).
D'Agostino, E. M. et al. School–academic partnerships in support of safe return to schools during the COVID-19 pandemic. Pediatrics10.1542/peds.2021-054268C (2022). PubMed PMC
Ruggeri K, et al. Role of military forces in the New York State response to COVID-19. JAMA Health Forum. 2022;3:e222136. doi: 10.1001/jamahealthforum.2022.2136. PubMed DOI
Subbaraman N. Science misinformation alarms Francis Collins as he leaves top NIH job. Nature. 2021;600:372–373. doi: 10.1038/d41586-021-03611-2. PubMed DOI
Habersaat KB, et al. Ten considerations for effectively managing the COVID-19 transition. Nat. Hum. Behav. 2020;4:677–687. doi: 10.1038/s41562-020-0906-x. PubMed DOI
Haug N, et al. Ranking the effectiveness of worldwide COVID-19 government interventions. Nat. Hum. Behav. 2020;4:1303–1312. doi: 10.1038/s41562-020-01009-0. PubMed DOI
Wang Z, Nayfeh T, Tetzlaff J, O’Blenis P, Murad MH. Error rates of human reviewers during abstract screening in systematic reviews. PLoS ONE. 2020;15:e0227742. doi: 10.1371/journal.pone.0227742. PubMed DOI PMC
Guterman EL, Braunstein LZ. Preprints during the COVID-19 pandemic: public health emergencies and medical literature. J. Hosp. Med. 2020;15:634–636. doi: 10.12788/jhm.3491. PubMed DOI PMC
Wingen, T., Berkessel, J. B. & Dohle, S. Caution, preprint! Brief explanations allow nonscientists to differentiate between preprints and peer-reviewed journal articles. Adv. Methods Pract. Psychol. Sci.10.1177/25152459211070559 (2022).
Ruggeri, K. Psychology and Behavioral Economics: Applications for Public Policy (Routledge, 2022).
Ruggeri, K. (ed.). Behavioral Insights for Public Policy: Concepts and Cases (Routledge, 2019).
Ruggeri, K., Benzerga, A., Verra, S. & Folke, T. A behavioral approach to personalizing public health. Behav. Public Policy10.1017/bpp.2020.31 (2020).
Ruggeri K, et al. Replicating patterns of prospect theory for decision under risk. Nat. Hum. Behav. 2020;4:622–633. doi: 10.1038/s41562-020-0886-x. PubMed DOI
Ruggeri, K. et al. The general fault in our fault lines. Nat. Hum. Behav.10.1038/s41562-021-01092-x (2021). PubMed
Ruggeri, K. et al. The globalizability of temporal discounting. Nat. Hum. Behav.10.1038/s41562-022-01392-w (2022). PubMed PMC
Ruggeri, K. et al. Standards for evidence in policy decision-making. Social Sciencessocialsciences.nature.com/users/399005-kai-ruggeri/posts/standards-for-evidence-in-policy-decision-making (2020).
Leek JT, Peng RD. Statistics: P values are just the tip of the iceberg. Nature. 2015;520:612. doi: 10.1038/520612a. PubMed DOI
Altman N, Krzywinski M. Interpreting P values. Nat. Methods. 2017;14:213–214. doi: 10.1038/nmeth.4210. DOI
Van Bavel JJ, Mende-Siedlecki P, Brady WJ, Reinero DA. Contextual sensitivity in scientific reproducibility. Proc. Natl Acad. Sci. USA. 2016;113:6454–6459. doi: 10.1073/pnas.1521897113. PubMed DOI PMC