Teaching open and reproducible scholarship: a critical review of the evidence base for current pedagogical methods and their outcomes
Status PubMed-not-MEDLINE Jazyk angličtina Země Velká Británie, Anglie Médium electronic-ecollection
Typ dokumentu časopisecké články, přehledy
PubMed
37206965
PubMed Central
PMC10189598
DOI
10.1098/rsos.221255
PII: rsos221255
Knihovny.cz E-zdroje
- Klíčová slova
- higher education, open research, open scholarship, open science, pedagogy, teaching,
- Publikační typ
- časopisecké články MeSH
- přehledy MeSH
In recent years, the scientific community has called for improvements in the credibility, robustness and reproducibility of research, characterized by increased interest and promotion of open and transparent research practices. While progress has been positive, there is a lack of consideration about how this approach can be embedded into undergraduate and postgraduate research training. Specifically, a critical overview of the literature which investigates how integrating open and reproducible science may influence student outcomes is needed. In this paper, we provide the first critical review of literature surrounding the integration of open and reproducible scholarship into teaching and learning and its associated outcomes in students. Our review highlighted how embedding open and reproducible scholarship appears to be associated with (i) students' scientific literacies (i.e. students' understanding of open research, consumption of science and the development of transferable skills); (ii) student engagement (i.e. motivation and engagement with learning, collaboration and engagement in open research) and (iii) students' attitudes towards science (i.e. trust in science and confidence in research findings). However, our review also identified a need for more robust and rigorous methods within pedagogical research, including more interventional and experimental evaluations of teaching practice. We discuss implications for teaching and learning scholarship.
Department for Cognition Emotion and Methods in Psychology University of Vienna Vienna 1010 Austria
Department of Biological and Experimental Psychology Queen Mary University of London E1 4NS UK
Department of Experimental Psychology University of Oxford Oxford OX1 4BH18 UK
Department of Mathematics College of Polytechnics Jihlava 1556 16 586 01 Czech Republic
Department of Neuroimaging IoPPN King's College London UK
Department of Neuroscience Psychology and Behaviour University of Leicester UK
Department of Philosophy Macquarie University NSW 2109 Australia
Department of Psychiatry and Psychotherapy Philipps University Marburg D 35039 Marburg Germany
Department of Psychology 3 University of Würzburg 97070 Würzburg Germany
Department of Psychology Ashland University OH 44805 USA
Department of Psychology Bournemouth University Poole BH12 5BB UK
Department of Psychology Leiden University 2311 EZ Leiden The Netherlands
Department of Psychology Linfield University Linfield 503 883 2200 USA
Department of Psychology Liverpool Hope University Liverpool L16 9JD UK
Department of Psychology Saarland University 66123 Saarbrücken Germany
Department of Psychology School of Social Science University of Westminster London W1B 2HW UK
Department of Psychology University of Bath Bath BA2 7AY UK
Department of Psychology University of Cambridge CB2 3EB UK
Department of Psychology University of Groningen 9712 CP Groningen the Netherlands
Department of Psychology University of Limerick V94 T9PX Ireland
Department of Psychology University of Montreal Canada
Department of Psychology University of York York YO10 5DD USA
Department of Psychology Witten Herdecke University Germany
Department of Social Sciences University of the West of England Bristol BS16 1QY UK
Department of Sport and Recreation Management Temple University PA 19122 USA
Departments of Psychiatry and Experimental Psychology University of Oxford UK
Division of Neuroscience and Experimental Psychology University of Manchester Manchester M13 9PL UK
Division of Psychology De Montfort University Leicester LE1 9BH UK
Faculty of Education University of Cambridge Cambridge CB2 1TN UK
Faculty of Life Sciences Food Nutrition and Health University of Bayreuth 95447 Bayreuth Germany
Graduate School of Business Stanford University CA 94305 USA
Institute for Educational Research and Teacher Education University of Graz Graz 8010 Graz Austria
Institute of Psychology University of Graz 8010 Graz Austria
Iscte Universty Institute of Lisbon CIS IUL 1649 026 Lisboa Portugal
Macedonian Academy of Sciences and Arts North Macedonia XCWR GJM 1000
School of Education Johns Hopkins University MD 21218 USA
School of Human Sciences University of Greenwich London SE10 9LS UK
School of Humanities and Social Science University of Brighton BN2 0JY UK
School of Psychology and Counselling the Open University Milton Keynes MK7 6AA UK
School of Psychology and Neuroscience University of Glasgow Glasgow G12 8QQ UK
School of Psychology Aston University Birmingham B4 7ET UK
School of Psychology Cardiff University Cardiff CF10 3AT UK
School of Psychology Keele University Newcastle ST5 5BG UK
School of Psychology Queen's University Belfast Belfast BT7 1NN UK
School of Psychology University College Dublin Dublin 4 DO4 V1WD Ireland
School of Psychology University of Auckland Auckland 1142 New Zealand
School of Psychology University of Birmingham B15 2TT UK
School of Psychology University of Chester Chester CH1 4BJ UK
School of Psychology University of Leeds Leeds LS2 9JT UK
School of Psychology University of Nottingham Nottingham NG7 2RD UK
School of Psychology University of Sussex Brighton BN1 9RH UK
School of Public Health University College Cork Cork T12 K8AF Ireland
School of Social and Political Sciences University of Glasgow Glasgow G12 8QQ UK
Zobrazit více v PubMed
Azevedo F, Liu M, Pennington CR, Pownall M, Evans TR, Parsons S, Elsherif M, Micheli L, Westwood SJ and FORRT. 2022. Towards a culture of open scholarship: the role of pedagogical communities. BMC Res. Notes 15, 75. ( 10.1186/s13104-022-05944-1) PubMed DOI PMC
Azevedo F, Middleton S, Phan JM, Kapp S, Gourdon-Kanhukamwe A, Iley B, Elsherif M, Shaw JJ. 2022. Navigating academia as neurodivergent researchers: promoting neurodiversity within Open Scholarship. APS Observer 35. See https://www.psychologicalscience.org/observer/gs-navigating-academia-as-neurodivergent-researchers.
Azevedo F, et al. 2019. Introducing a Framework for Open and Reproducible Research Training (FORRT). PsyArXiv. ( 10.31219/osf.io/bnh7p) DOI
Parsons S, et al. 2022. A community-sourced glossary of open scholarship terms. Nat. Hum. Behav. 6, 312-318. ( 10.1038/s41562-02101269-4) PubMed DOI
Manalili MA, et al. 2023. From puzzle to progress: how engaging with neurodiversity can improve cognitive science. Cogn. Sci. 47, e13255. ( 10.1111/cogs.13255) PubMed DOI PMC
Chambers CD, Tzavella L. 2022. The past, present and future of registered reports. Nat. Hum. Behav. 6, 29-42. ( 10.1038/s41562-021-01193-7) PubMed DOI
Lindsay DS, Simons DJ, Lilienfeld SO. 2016. Research preregistration 101. Observer 29. See https://www.psychologicalscience.org/observer/researchpreregistration-101.
Nosek BA, et al. 2015. Promoting an open research culture. Science 348, 1422-1425. ( 10.1126/science.aab2374) PubMed DOI PMC
Houtkoop BL, Chambers C, Macleod M, Bishop DV, Nichols TE, Wagenmakers EJ. 2018. Data sharing in psychology: a survey on barriers and preconditions. Adv. Methods Pract. Psychol. Sci. 1, 70-85. ( 10.1177/2515245917751886) DOI
Nosek BA, Bar-Anan Y. 2012. Scientific utopia: I. Opening scientific communication. Psychol. Inquiry 23, 217-243. ( 10.1080/1047840X.2012.692215) DOI
Delios A, et al. 2022. Examining the generalizability of research findings from archival data. Proc. Natl Acad. Sci. USA 119, e2120377119. ( 10.1073/pnas.2120377119) PubMed DOI PMC
Open Science Collaboration. 2015. Estimating the reproducibility of psychological science. Science 349, 1-10. ( 10.1126/science.aac4716) PubMed DOI
Tierney W, et al. 2020. Creative destruction in science. Org. Behav. Hum. Dec. Process. 161, 291-309. ( 10.1016/j.obhdp.2020.07.002) DOI
Tierney W, et al. 2021. A creative destruction approach to replication: Implicit work and sex morality across cultures. J. Exp. Soc. Psychol. 93, 104060. ( 10.1016/j.jesp.2020.104060) DOI
Farrar BG, Boeckle M, Clayton NS. 2020. Replications in comparative cognition: what should we expect and how can we improve? Anim. Behav. Cogn. 7, 1-22. ( 10.26451/abc.07.01.02.2020) PubMed DOI PMC
Farrar BG, et al. 2022. Reporting and interpreting non-significant results in animal cognition research. PubMed DOI PMC
Errington TM, Mathur M, Soderberg CK, Denis A, Perfito N, Iorns E, Nosek BA. 2021. Investigating the replicability of preclinical cancer biology. eLife 10, e71601. ( 10.7554/eLife.71601) PubMed DOI PMC
Camerer CF, et al. 2016. Evaluating replicability of laboratory experiments in economics. Science 351, 1433-1436. ( 10.1126/science.aaf0918) PubMed DOI
Baum M, Hart A, Elsherif M, Ilchovska ZG, Moreau D, Dokovova M, LaPlume AA, Krautter K, Staal J. 2022. Research without borders: how to identify and overcome potential pitfalls in international large-team online research projects. SAGE Res. Methods Cases. ( 10.4135/9781529602074) DOI
Munafò MR, Chambers C, Collins A, Fortunato L, Macleod M. 2022. The reproducibility debate is an opportunity, not a crisis. BMC Res. Notes 15, 1-3. ( 10.1186/s13104-022-05942-3) PubMed DOI PMC
Stewart SLK, Pennington CR, da Silva GR, Ballou N, Butler J, Dienes Z, Jay C, Rossit S, Samara A and U. K. Reproducibility Network (UKRN) Local Network Leads. 2022. Reforms to improve reproducibility and quality must be coordinated across the research ecosystem: the view from the UKRN Local Network Leads. BMC Res. Notes 15, 58. ( 10.1186/s13104-022-05949-w) PubMed DOI PMC
Devezer B, Navarro DJ, Vandekerckhove J, Ozge Buzbas E. 2021. The case for formal methodology in scientific reform. R. Soc. Open Sci. 8, 200805. ( 10.1098/rsos.200805) PubMed DOI PMC
Ledgerwood A, et al. 2022. The pandemic as a portal: reimaging psychological science as truly open and inclusive. Perspect. Psychol. Sci. 17, 937-959. ( 10.1177/17456916211036654) PubMed DOI
Whitaker K, Guest O. 2020. #bropenscience is broken science. The Psychologist 33, 34-37.
Pownall M, et al. 2021. Embedding open and reproducible science into teaching: a bank of lesson plans and resources. Scholarship Teach. Learn. Adv. Online Publication. ( 10.1037/stl0000307) DOI
Chambers CD. 2019. The seven deadly sins of psychology. Princeton, NJ: Princeton University Press.
Hales AH, Wesselmann ED, Hilgard J. 2019. Improving psychological science through transparency and openness: an overview. Perspect. Behav. Sci. 42, 13-31. ( 10.1007/s40614-018-00186-8) PubMed DOI PMC
Vazire S. 2018. Implications of the credibility revolution for productivity, creativity, and progress. Perspect. Psychol. Sci. 13, 411-417. ( 10.1177/1745691617751884) PubMed DOI
Willinsky J. 2006. The access principle: the case for open access to research and scholarship. Cambridge, MA: MIT Press.
*Anglin SM, Edlund JE. 2020. Perceived need for reform in field-wide methods and the teaching of replication, interpretation, and transparency. Psychol. Learn. Teaching 19, 60-76. ( 10.1177/1475725719859453) DOI
Button K. 2018. Reboot undergraduate courses for reproducibility. Nature 561, 287-288. ( 10.1038/d41586-018-06692-8) PubMed DOI
Nosek, et al. 2022. Replicability, robustness, and reproducibility in psychological science. PubMed DOI
Puthillam A, Montilla Doble LJ, Delos Santos JI, Elsherif MM, Steltenpohl CN, Moreau D, Pownall M, Kapoor H. 2022. Guidelines to Improve Internationalization in Psychological Science. DOI
Topor M, et al. 2020. An integrative framework for planning and conducting non-intervention, reproducible, and open systematic reviews (NIRO-SR). DOI
Methley AM, Campbell S, Chew-Graham C, McNally R, Cheraghi-Sohi S. 2014. PICO, PICOS and SPIDER: a comparison study of specificity and sensitivity in three search tools for qualitative systematic reviews. BMC Health Serv. Res. 14, 1. ( 10.1186/s12913-014-0579-0) PubMed DOI PMC
Forscher PS, Wagenmakers E, Coles NA, Silan MA, Dutra NB, Basnight-Brown D, IJzerman H. 2020. The benefits, barriers, and risks of Big Team Science. PubMed DOI
*Afolabi F. 2017. First year learning experiences of university undergraduates in the use of open educational resources in online learning. Int. Rev. Res. Open Distrib. Learn. 18, 1-14. ( 10.19173/irrodl.v18i7.3167) DOI
*Al Abri MH, Dabbagh N. 2019. Testing the intervention of OER renewable assignments in a college course. Open Praxis 11, 195-209. ( 10.5944/openpraxis.11.2.916) DOI
*Altunoglu A. 2017. Initial perceptions of open higher education students with learner management systems. Turkish Online J. Dist. Educ. 18, 96-104. ( 10.17718/tojde.328939) DOI
*Andone D, Mihaescu V, Vert S, Ternauciuc A, Vasiu R. 2020. Students as OERs (Open Educational Resources) co-creators. In 2020 IEEE 20th Int. Conf. on Advanced Learning Technologies (ICALT), pp. 34-–38: IEEE.
*Baran E, AlZoubi D. 2020. Affordances, challenges, and impact of open pedagogy: examining students' voices. Dist. Educ. 41, 230-244. ( 10.1080/01587919.2020.1757409) DOI
*Becker M. 2020. Qualitative replication as a pedagogical approach to teaching research methods. Polit. Sci. Polit. 53, 802-806. ( 10.1017/S1049096520000864) DOI
*Bloom M. 2019. Assessing the impact of ‘Open Pedagogy’ on student skills mastery in first-year composition. Open Praxis 11, 343-353. ( 10.5944/openpraxis.11.4.1025) DOI
*Button KS, Chambers, CD, Lawrence N, Munafò MR. 2020. Grassroots training for reproducible science: a consortium-based approach to the empirical dissertation. Psychol. Learn. Teach. 19, 77-90. ( 10.1177/1475725719857659) DOI
*Çetinkaya-Rundel M, Ellison V. 2021. A fresh look at introductory data science. J. Stat. Data Sci. Educ. 29(sup1), S16-S26. ( 10.1080/10691898.2020.1804497) DOI
*Chopik WJ, Bremner RH, Defever AM, Keller VN. 2018. How (and whether) to teach undergraduates about the replication crisis in psychological science. Teach. Psychol. 45, 158-163. ( 10.1177/0098628318762900) DOI
*Davis C, Parmenter L. 2021. Student-staff partnerships at work: epistemic confidence, research-engaged teaching and vocational learning in the transition to higher education. Educ. Action Res. 29, 292-309. ( 10.1080/09650792.2020.1792958) DOI
*Hare S, Frye JM, Samuelson BL. 2020. Open pedagogy as an approach to introducing doctoral students to open educational resources and information literacy concepts. Library Trends 69, 435-468. ( 10.1353/lib.2020.0041) DOI
*Jekel M, Fiedler S, Allstadt Torras R, Mischkowski D, Dorrough AR, Glöckner A. 2020. How to teach open science principles in the undergraduate curriculum—The Hagen cumulative science project. Psychol. Learn. Teach. 19, 91-106. ( 10.1177/1475725719868149) DOI
*Krishna A, Peter SM. 2018. Questionable research practices in student final theses – Prevalence, attitudes, and the role of the supervisor's perceived attitudes. PLoS ONE 13, e0203470. ( 10.1371/journal.pone.0203470) PubMed DOI PMC
*Lin H. 2019. Teaching and learning without a textbook: undergraduate student perceptions of Open Educational Resources. Int. Rev. Res. Open Distrib. Learn. 20. 10.19173/irrodl.v20i4.4224 DOI
*Marwick B, Wang LY, Robinson R, Loiselle H. 2020. How to use replication assignments for teaching integrity in empirical archaeology. Adv. Archaeol. Pract. 8, 78-86. ( 10.1017/aap.2019.38) DOI
*Marshall EC, Underwood A. 2019. Writing in the discipline and reproducible methods: a process-oriented approach to teaching empirical undergraduate economics research. J. Econ. Educ. 50, 17-32. ( 10.1080/00220485.2018.1551100) DOI
*McCright AM. 2012. Enhancing students' scientific and quantitative literacies through an inquiry-based learning project on climate change. J. Scholarship Teach. Learn. 12, 86-101.
*Pan SJA. 2021. Taiwanese and American graduate students' misconceptions regarding responsible conduct of research: a cross-national comparison using a two-tier test approach. Sci. Eng. Ethics 27, 1-23. ( 10.1007/s11948-021-00297-7) PubMed DOI
*Paviotti G, D'Angelo I, Giaconi C, Cavicchi A. 2020. Open pedagogy practices: a case study in undergraduate education. J. e-Learn. Knowledge Soc. 16, 1-10. ( 10.20368/1971-8829/1135321) DOI
*Poronnik P, Moni RW. 2006. The opinion editorial: teaching physiology outside the box. Adv. Physiol. Educ. 30, 73-82. ( 10.1152/advan.00075.2005) PubMed DOI
*Pyott L. 2021. Tennis anyone? Teaching experimental design by designing and executing a tennis ball experiment. J. Stat. Data Sci. Educ. 29, 22-26. ( 10.1080/10691898.2020.1854638) DOI
*Ryan C. 2020. Students learning as researchers of curriculum in an undergraduate programme. Innovat. Educ. Teach. Int. 57, 644-654. ( 10.1080/14703297.2019.167320) DOI
*Sacco DF, Brown M. 2019. Assessing the efficacy of a training intervention to reduce acceptance of questionable research practices in psychology graduate students. J. Emp. Res. Hum. Res. Ethics 14, 209-218. ( 10.1177/1556264619840525) PubMed DOI
*Sanchez S, Carter DE, Morey T, Fedorek B. 2021. Student perceptions of an open educational resource for an introduction to criminal justice course. J. Crim. Justice Educ. 1-16. ( 10.1080/10511253.2021.1986084) DOI
*Sarafoglou A, Hoogeveen S, Matzke D, Wagenmakers EJ. 2019. Teaching good research practices: protocol of a research master course. Psychol. Learn. Teach. 19, 46-59. ( 10.1177/1475725719858807) DOI
*Sawchuk D. 2018. The birthday card exercise: replicating research as active learning. Gerontol. Geriatr. Educ. 39, 481-490. ( 10.1080/02701960.2016.1247071) PubMed DOI
*Smith LM, Yu F, Schmid KK. 2021. Role of replication research in biostatistics graduate education. J. Stat. Data Sci. Educ. 29, 95-104. ( 10.1080/10691898.2020.1844105) DOI
*Steinhardt I. 2020. Learning open science by doing open science. A reflection of a qualitative research project-based seminar. Educ. Inform. 36, 263-279. ( 10.3233/EFI-190308) DOI
*Stiemsma LT, Davis SD, Brewster JL. 2020. Analysis of microbial water contamination, soil microbial community structure, and soil respiration in a collaborative first-year students as scholars program (SAS). Front. Microbiol. 11, 3133. ( 10.3389/fmicb.2020.590035) PubMed DOI PMC
*Tillinghast B, Fialkowski MK, Draper J. 2020. Exploring aspects of Open Educational Resources through OER-enabled pedagogy. Front. Educ. 5, 1-14. ( 10.3389/feduc.2020.00076) DOI
*Toelch U, Ostwald D. 2018. Digital open science—Teaching digital tools for reproducible and transparent research. PLoS Biol. 16, e2006022. ( 10.1371/journal.pbio.2006022) PubMed DOI PMC
*Wang HH, Hong ZR, She HC, Smith TJ, Fielding J, Lin HS. 2022. The role of structured inquiry, open inquiry, and epistemological beliefs in developing secondary students’ scientific and mathematical literacies. Int. J. STEM Educ. 9, 411-417. ( 10.1186/s40594-022-00329-z) DOI
*Watson CE, Domizi DP, Clouser SA. 2017. Student and faculty perceptions of OpenStax in high enrollment courses. Int. Rev. Res. Open Distrib. Learn. 18, 1-18. ( 10.19173/irrodl.v18i5.2462) DOI
*Werth E, Williams K. 2021. Exploring student perceptions as co-authors of course material. Open Praxis 13, 53-67. ( 10.5944/openpraxis.13.1.1187) DOI
OECD. 2006. Measuring student knowledge and skills: the PISA 2000 assessment of Reading, mathematical and scientific literacy. Berlin, Germany: OECD Publishing. See https://www.oecd.org/education/school/programmeforinternationalstudentassessmentpi.
OECD. 2017. PISA 2015 assessment and analytical framework: science, reading, mathematic, financial literacy and collaborative problem solving, revised edition. Berlin, Germany: OECD Publishing.
Tang KS, Williams PJ. 2019. STEM literacy or literacies? Examining the empirical basis of these constructs. Rev. Educ. 7, 675-697. ( 10.1002/rev3.3162) DOI
Hubbard K. 2021. Disciplinary literacies in STEM: what do undergraduates read, how do they read it, and can we teach scientific reading more effectively? Higher Educ. Pedagogies 6, 41-65. ( 10.1080/23752696.2021.1882326) DOI
American Psychological Association. 2013. APA guidelines for the undergraduate psychology major: version 2.0. Washington, DC: American Psychological Association. PubMed
American Psychological Association. 2018. Guidelines on core learning goals for master's degree graduates in psychology. Washington, DC: APA. See https://www.apa.org/about/policy/masters-goals-guidelines.pdf.
Blincoe S, Buchert S. 2020. Research preregistration as a teaching and learning tool in undergraduate psychology courses. Psychol. Learn. Teach. 19, 107-115. ( 10.1177/1475725719875844) DOI
Pownall M. 2020. Pre-registration in the undergraduate dissertation: a critical discussion. Psychol. Teach. Rev. 26, 71-76. ( 10.31234/osf.io/egbcv) DOI
Janz N. 2019. Teaching replication. In Project TIER 2021 Spring Symposium: Instruction in Reproducible Research,
Feldman G. 2022. Replications and extensions of classic findings in judgment and decision making. Open Sci. Framework. ( 10.17605/OSF.IO/5Z4A8) DOI
Brick C, Fillon A, Yeung SK, Wang M, Lyu H, Ho JYJ, Wong SC, Feldman G. 2021. Self-interest is overestimated: two successful pre-registered replications and extensions of Miller and Ratner (1998). Collabra: Psychology 7, 23443. ( 10.1525/collabra.23443) DOI
Chandrashekar SP, Weber J, Chan SY, Cho WY, Chu TCC, Cheng BL, Feldman G. 2021. Accentuation and compatibility: replication and extensions of Shafir (1993) to rethink Choosing versus Rejecting paradigms. Judg. Decision Making 16, 36-56.
Ziano I, Mok PY, Feldman G. 2021. Replication and extension of Alicke (1985) better-than-average effect for desirable and controllable traits. Soc. Psychol. Pers. Sci. 12, 1005-1017. ( 10.1177/1948550620948973) DOI
Feldman G. 2021. Collection of teaching evaluations. ( 10.17605/OSF.IO/24FJS) DOI
Jarke H, et al. 2022. A roadmap to large-scale multi-country replications in psychology. Collabra: Psychology 8, 57538. ( 10.1525/collabra.57538) DOI
Field AP. 2014. Skills in mathematics and statistics in psychology and tackling transition.
Bonwell CC, Eison JA. 1991. Active Learning: Creating Excitement in the Classroom.
Wagge JR, Brandt MJ, Lazarevic LB, Legate N, Christopherson C, Wiggins B, Grahe JE. 2019. Publishing research with undergraduate students via replication work: the collaborative replications and education project. Front. Psychol. 10, 1-4. ( 10.3389/fpsyg.2019.00247) PubMed DOI PMC
IJzerman HR. 2019. Research tools in social cognition [unpublished course syllabus]. See https://www.dropbox.com/s/z8njk19szkw4u1y/IJzerman%20-%20Research%20Tools%20in%20Social%20Cognition%20Final%202019.docx?dl=0.
Haas HA, Rouse SV. 2022. Learning from mistakes: teaching students about errata, corrigenda, and nonretraction corrections to the research literature. Scholarship Teach. Learn. Psychol. 8, 58-69. ( 10.1037/stl0000216) DOI
Frank MC, Saxe R. 2012. Teaching replication. Perspect. Psychol. Sci. 7, 600-604. ( 10.1177/1745691612460686) PubMed DOI
Kathawalla UK, Silverstein P, Syed M. 2021. Easing into open science: a guide for graduate students and their advisors. Collabra: Psychology 7, 18684. ( 10.1525/collabra.18684) DOI
Nurse AM, Staiger T. 2019. Teaching data reproducibility through service learning. Teach. Sociol. 47, 350-357. ( 10.1177/0092055X19860577) DOI
Kahu ER, Stephens C, Leach L, Zepke N. 2013. The engagement of mature distance students. Higher Educ. Res. Dev. 32, 791-804. ( 10.1080/07294360.2013.777036) DOI
Groccia JE. 2018. What is student engagement? New Dir. Teach. Learn. 2018, 11-20. ( 10.1002/tl.20287) DOI
McAleer P. 2021. Creating a curriculum centered on reproducible research for the psychologists of the future. In Project TIER 2021 Spring Symp.: Instruction in Reproducible Research, Online, 5 March–21 May 2021. Project TIER. See https://www.projecttier.org/events/Phil-McAleer-Creating-a-curriculum-centered/.
Barr D. 2016. No more excuses: R is better than SPSS for psychology undergrads, and students agree. DataHowler. See https://datahowler.wordpress.com/2016/09/10/no-moreexcuses-r-is-better-than-spss-for-psychology-undergrads-and-students-agree/.
Bangera G, Brownell SE. 2014. Course-based undergraduate research experiences can make scientific research more inclusive. CBE—Life Sci. Educ. 13, 602-606. ( 10.1187/cbe.14-06-0099) PubMed DOI PMC
Clark, et al. 2020. Development, implementation and importance of an undergraduate peer research consultant program at the University of North Dakota’s Chester Fritz Library.
Pennington CR, Jones AJ, Tzavella L, Chambers CD, Button KS. 2022. Beyond online participant crowdsourcing: the benefits and opportunities of big team addiction science. Exp. Clin. Psychopharmacol. Adv. Online Publication. ( 10.1037/pha0000541) PubMed DOI
Button, et al. 2018. Reboot undergraduate courses for reproducibility. PubMed
Lindshield BL, Adhikari K. 2013. Online and campus college students like using an open educational resource instead of a traditional textbook. J. Online Learn. Teach. 9, 26-38.
Zapata GC. 2020. Sprinting to the finish line: the benefits and challenges of book sprints in OER faculty-graduate student collaborations. Int. Rev. Res. Open Distrib. Learn. 21, 1-17. ( 10.19173/irrodl.v21i2.4607) DOI
Ajzen I, Fishbein M. 2005. The influence of attitudes on behavior. In The handbook of attitudes (eds Albarracin D, Johnson BT, Zanna MP), pp. 173-221. New York, NY: Erlbaum.
Hardwicke TE, Thibault RT, Kosie JE, Wallach JD, Kidwell MC, Ioannidis JP. 2022. Estimating the prevalence of transparency and reproducibility-related research practices in psychology (2014–2017). Perspect. Psychol. Sci. 17, 239-251. ( 10.1177/1745691620979806) PubMed DOI PMC
Serghiou S, Contopoulos-Ioannidis DG, Boyack KW, Riedel N, Wallach JD, Ioannidis JP. 2021. Assessment of transparency indicators across the biomedical literature: how open is open? PLoS Biol. 19, 1-26. ( 10.1371/journal.pbio.3001107) PubMed DOI PMC
Hanna S, Pither J, Vis-Dunbar M. 2021. Implementation of an open science instruction program for undergraduates. Data Intelligence 3, 150-161. ( 10.1162/dint_a_00086) DOI
Truan N, Dressel D. 2021. Doing open science in a research-based seminar: students positioning towards openness in higher education. HAL SHS Hum. Soc. Sci. 23, 1-19. See https://halshs.archives-ouvertes.fr/halshs-03395171.
Olsen J, Mosen J, Voracek M, Kirchler E. 2019. Research practices and statistical reporting quality in 250 economic psychology master's theses: a meta-research investigation. R. Soc. Open Sci. 6, 190738. ( 10.1098/rsos.190738) PubMed DOI PMC
Giuliano T, Skorinko JLM, Fallon M. 2019. Engaging undergraduates in publishable research: best practices. Front. Psychol. 1878, 1-6. ( 10.3389/fpsyg.2019.01878) PubMed DOI PMC
Rosenthal R. 1979. The file drawer problem and tolerance for null results. Psychol. Bull. 86, 638-641. ( 10.1037/0033-2909.86.3.638) DOI
Poldrack RA, et al. 2017. Scanning the horizon: towards transparent and reproducible neuroimaging research. Nat. Rev. Neurosci. 18, 115-126. ( 10.1038/nrn.2016.167) PubMed DOI PMC
Simonsohn U, Nelson LD, Simmons JP. 2014. p-Curve and effect size: correcting for publication bias using only significant results. Perspect. Psychol. Sci. 9, 666-681. ( 10.1177/1745691614553988) PubMed DOI
Burgstahler SE, Cory RC. 2010. Universal design in higher education: from principles to practice. Cambridge, MA: Harvard Education Press.
Gourdon-Kanhukamwe A, et al. 2023. Promoting participatory research for neurodiverse populations through Open Scholarship practice. BPS Cogn. Psychol. Bullet. 8, 23. ( 10.53841/bpscog.2023.1.8.23) DOI
Elsherif MM, et al. 2022. Bridging Neurodiversity and Open Scholarship: How Shared Values Can Guide Best Practices for Research Integrity, Social Justice, and Principled Education. DOI
Nordmann E, Clark A, Spaeth E, MacKay JR. 2021. Lights, camera, active! Appreciation of active learning predicts positive attitudes towards lecture capture. Higher Educ. 83, 481-502. ( 10.1007/s10734-020-00674-4) PubMed DOI PMC
Nightingale KP, Anderson V, Onens S, Fazil Q, Davies H. 2019. Developing the inclusive curriculum: is supplementary lecture recording an effective approach in supporting students with Specific Learning Difficulties (SpLDs)? Comput. Educ. 130, 13-25. ( 10.1016/j.compedu.2018.11.006) DOI
Kowalczyk OS, Lautarescu A, Blok E, Dall'Aglio L, Westwood SJ. 2022. What senior academics can do to support reproducible and open research: a short, three-step guide. BMC Res. Notes 15, Article 116. ( 10.1186/s13104-02205999-0) PubMed DOI PMC
Jarke H, Jakob L, Bojanić L, Garcia-Garzon E, Mareva S, Mutak A, Gjorgjiovska J. 2022. Registered report: how open do you want your science? An international investigation into knowledge and attitudes of psychology students. PLoS ONE 17, e0261260. ( 10.1371/journal.pone.0261260) PubMed DOI PMC
Pownall M, Pennington CR, Norris E, Clark K. 2021. Evaluating the pedagogical effectiveness of study preregistration in the undergraduate dissertation: a registered report. Open Sci. Framework. See https://osf.io/5qshg/.
Pownall M, et al. 2023. Teaching open and reproducible scholarship: a critical review of the evidence base for current pedagogical methods and their outcomes. Figshare. ( 10.6084/m9.figshare.c.6641489) PubMed DOI PMC
figshare
10.6084/m9.figshare.c.6641489