Teaching open and reproducible scholarship: a critical review of the evidence base for current pedagogical methods and their outcomes

. 2023 May ; 10 (5) : 221255. [epub] 20230517

Status PubMed-not-MEDLINE Jazyk angličtina Země Velká Británie, Anglie Médium electronic-ecollection

Typ dokumentu časopisecké články, přehledy

Perzistentní odkaz   https://www.medvik.cz/link/pmid37206965

In recent years, the scientific community has called for improvements in the credibility, robustness and reproducibility of research, characterized by increased interest and promotion of open and transparent research practices. While progress has been positive, there is a lack of consideration about how this approach can be embedded into undergraduate and postgraduate research training. Specifically, a critical overview of the literature which investigates how integrating open and reproducible science may influence student outcomes is needed. In this paper, we provide the first critical review of literature surrounding the integration of open and reproducible scholarship into teaching and learning and its associated outcomes in students. Our review highlighted how embedding open and reproducible scholarship appears to be associated with (i) students' scientific literacies (i.e. students' understanding of open research, consumption of science and the development of transferable skills); (ii) student engagement (i.e. motivation and engagement with learning, collaboration and engagement in open research) and (iii) students' attitudes towards science (i.e. trust in science and confidence in research findings). However, our review also identified a need for more robust and rigorous methods within pedagogical research, including more interventional and experimental evaluations of teaching practice. We discuss implications for teaching and learning scholarship.

Centre for Workforce Development Institute for Lifecourse Development University of Greenwich London SE10 9LS UK

Department for Cognition Emotion and Methods in Psychology University of Vienna Vienna 1010 Austria

Department of Biological and Experimental Psychology Queen Mary University of London E1 4NS UK

Department of Experimental Psychology University of Oxford Oxford OX1 4BH18 UK

Department of Mathematics College of Polytechnics Jihlava 1556 16 586 01 Czech Republic

Department of Neuroimaging IoPPN King's College London UK

Department of Neuroscience Psychology and Behaviour University of Leicester UK

Department of Philosophy Macquarie University NSW 2109 Australia

Department of Psychiatry and Psychotherapy Philipps University Marburg D 35039 Marburg Germany

Department of Psychological and Behavioural Science London School of Economics and Political Science UK

Department of Psychology 3 University of Würzburg 97070 Würzburg Germany

Department of Psychology Ashland University OH 44805 USA

Department of Psychology Bournemouth University Poole BH12 5BB UK

Department of Psychology Education and Child Studies Erasmus University Rotterdam Rotterdam 3000 The Netherlands

Department of Psychology Faculty of Management Law and Social Sciences University of Bradford Bradford BD7 1DP UK

Department of Psychology Leiden University 2311 EZ Leiden The Netherlands

Department of Psychology Linfield University Linfield 503 883 2200 USA

Department of Psychology Liverpool Hope University Liverpool L16 9JD UK

Department of Psychology Saarland University 66123 Saarbrücken Germany

Department of Psychology School of Social Science University of Westminster London W1B 2HW UK

Department of Psychology the Chinese University of Hong Kong Hong Kong SAR 100871 People's Republic of China

Department of Psychology University of Bath Bath BA2 7AY UK

Department of Psychology University of Cambridge CB2 3EB UK

Department of Psychology University of Groningen 9712 CP Groningen the Netherlands

Department of Psychology University of Limerick V94 T9PX Ireland

Department of Psychology University of Montreal Canada

Department of Psychology University of York York YO10 5DD USA

Department of Psychology Witten Herdecke University Germany

Department of Social Sciences University of the West of England Bristol BS16 1QY UK

Department of Sport and Recreation Management Temple University PA 19122 USA

Departments of Psychiatry and Experimental Psychology University of Oxford UK

Division of Neuroscience and Experimental Psychology University of Manchester Manchester M13 9PL UK

Division of Psychology De Montfort University Leicester LE1 9BH UK

Faculty for Geo Information Science and Earth Observation University of Twente 7522 NB The Netherlands

Faculty of Education University of Cambridge Cambridge CB2 1TN UK

Faculty of Life Sciences Food Nutrition and Health University of Bayreuth 95447 Bayreuth Germany

Faculty of Psychology in Wrocław SWPS University of Social Sciences and Humanities Wrocław 03 81536 Al Jubail 35819 Poland

Faculty of Teacher Education and Languages Department of Education ICT and Learning Ostfold University College 1757 Halden Norway

Graduate School of Business Stanford University CA 94305 USA

IGDORE London UK

Institute for Educational Research and Teacher Education University of Graz Graz 8010 Graz Austria

Institute of General Practice and Family Medicine University Hospital Bonn University of Bonn 53127 Bonn Germany

Institute of Psychology University of Graz 8010 Graz Austria

Iscte Universty Institute of Lisbon CIS IUL 1649 026 Lisboa Portugal

Jubail English Language and Preparatory Year Institute Royal Commission for Jubail and Yanbu Saudi Arabia

Macedonian Academy of Sciences and Arts North Macedonia XCWR GJM 1000

School of Education Johns Hopkins University MD 21218 USA

School of Human Sciences University of Greenwich London SE10 9LS UK

School of Humanities and Social Science University of Brighton BN2 0JY UK

School of Psychology and Counselling the Open University Milton Keynes MK7 6AA UK

School of Psychology and Neuroscience University of Glasgow Glasgow G12 8QQ UK

School of Psychology Aston University Birmingham B4 7ET UK

School of Psychology Cardiff University Cardiff CF10 3AT UK

School of Psychology Keele University Newcastle ST5 5BG UK

School of Psychology Queen's University Belfast Belfast BT7 1NN UK

School of Psychology University College Dublin Dublin 4 DO4 V1WD Ireland

School of Psychology University of Auckland Auckland 1142 New Zealand

School of Psychology University of Birmingham B15 2TT UK

School of Psychology University of Chester Chester CH1 4BJ UK

School of Psychology University of Leeds Leeds LS2 9JT UK

School of Psychology University of Nottingham Nottingham NG7 2RD UK

School of Psychology University of Sussex Brighton BN1 9RH UK

School of Public Health University College Cork Cork T12 K8AF Ireland

School of Social and Political Sciences University of Glasgow Glasgow G12 8QQ UK

South East European Research Centre Thessaloniki Greece

University Library University of Oslo 0313 Oslo Norway

Zobrazit více v PubMed

Azevedo F, Liu M, Pennington CR, Pownall M, Evans TR, Parsons S, Elsherif M, Micheli L, Westwood SJ and FORRT. 2022. Towards a culture of open scholarship: the role of pedagogical communities. BMC Res. Notes 15, 75. ( 10.1186/s13104-022-05944-1) PubMed DOI PMC

Azevedo F, Middleton S, Phan JM, Kapp S, Gourdon-Kanhukamwe A, Iley B, Elsherif M, Shaw JJ. 2022. Navigating academia as neurodivergent researchers: promoting neurodiversity within Open Scholarship. APS Observer 35. See https://www.psychologicalscience.org/observer/gs-navigating-academia-as-neurodivergent-researchers.

Azevedo F, et al. 2019. Introducing a Framework for Open and Reproducible Research Training (FORRT). PsyArXiv. ( 10.31219/osf.io/bnh7p) DOI

Parsons S, et al. 2022. A community-sourced glossary of open scholarship terms. Nat. Hum. Behav. 6, 312-318. ( 10.1038/s41562-02101269-4) PubMed DOI

Manalili MA, et al. 2023. From puzzle to progress: how engaging with neurodiversity can improve cognitive science. Cogn. Sci. 47, e13255. ( 10.1111/cogs.13255) PubMed DOI PMC

Chambers CD, Tzavella L. 2022. The past, present and future of registered reports. Nat. Hum. Behav. 6, 29-42. ( 10.1038/s41562-021-01193-7) PubMed DOI

Lindsay DS, Simons DJ, Lilienfeld SO. 2016. Research preregistration 101. Observer 29. See https://www.psychologicalscience.org/observer/researchpreregistration-101.

Nosek BA, et al. 2015. Promoting an open research culture. Science 348, 1422-1425. ( 10.1126/science.aab2374) PubMed DOI PMC

Houtkoop BL, Chambers C, Macleod M, Bishop DV, Nichols TE, Wagenmakers EJ. 2018. Data sharing in psychology: a survey on barriers and preconditions. Adv. Methods Pract. Psychol. Sci. 1, 70-85. ( 10.1177/2515245917751886) DOI

Nosek BA, Bar-Anan Y. 2012. Scientific utopia: I. Opening scientific communication. Psychol. Inquiry 23, 217-243. ( 10.1080/1047840X.2012.692215) DOI

Delios A, et al. 2022. Examining the generalizability of research findings from archival data. Proc. Natl Acad. Sci. USA 119, e2120377119. ( 10.1073/pnas.2120377119) PubMed DOI PMC

Open Science Collaboration. 2015. Estimating the reproducibility of psychological science. Science 349, 1-10. ( 10.1126/science.aac4716) PubMed DOI

Tierney W, et al. 2020. Creative destruction in science. Org. Behav. Hum. Dec. Process. 161, 291-309. ( 10.1016/j.obhdp.2020.07.002) DOI

Tierney W, et al. 2021. A creative destruction approach to replication: Implicit work and sex morality across cultures. J. Exp. Soc. Psychol. 93, 104060. ( 10.1016/j.jesp.2020.104060) DOI

Farrar BG, Boeckle M, Clayton NS. 2020. Replications in comparative cognition: what should we expect and how can we improve? Anim. Behav. Cogn. 7, 1-22. ( 10.26451/abc.07.01.02.2020) PubMed DOI PMC

Farrar BG, et al. 2022. Reporting and interpreting non-significant results in animal cognition research. PubMed DOI PMC

Errington TM, Mathur M, Soderberg CK, Denis A, Perfito N, Iorns E, Nosek BA. 2021. Investigating the replicability of preclinical cancer biology. eLife 10, e71601. ( 10.7554/eLife.71601) PubMed DOI PMC

Camerer CF, et al. 2016. Evaluating replicability of laboratory experiments in economics. Science 351, 1433-1436. ( 10.1126/science.aaf0918) PubMed DOI

Baum M, Hart A, Elsherif M, Ilchovska ZG, Moreau D, Dokovova M, LaPlume AA, Krautter K, Staal J. 2022. Research without borders: how to identify and overcome potential pitfalls in international large-team online research projects. SAGE Res. Methods Cases. ( 10.4135/9781529602074) DOI

Munafò MR, Chambers C, Collins A, Fortunato L, Macleod M. 2022. The reproducibility debate is an opportunity, not a crisis. BMC Res. Notes 15, 1-3. ( 10.1186/s13104-022-05942-3) PubMed DOI PMC

Stewart SLK, Pennington CR, da Silva GR, Ballou N, Butler J, Dienes Z, Jay C, Rossit S, Samara A and U. K. Reproducibility Network (UKRN) Local Network Leads. 2022. Reforms to improve reproducibility and quality must be coordinated across the research ecosystem: the view from the UKRN Local Network Leads. BMC Res. Notes 15, 58. ( 10.1186/s13104-022-05949-w) PubMed DOI PMC

Devezer B, Navarro DJ, Vandekerckhove J, Ozge Buzbas E. 2021. The case for formal methodology in scientific reform. R. Soc. Open Sci. 8, 200805. ( 10.1098/rsos.200805) PubMed DOI PMC

Ledgerwood A, et al. 2022. The pandemic as a portal: reimaging psychological science as truly open and inclusive. Perspect. Psychol. Sci. 17, 937-959. ( 10.1177/17456916211036654) PubMed DOI

Whitaker K, Guest O. 2020. #bropenscience is broken science. The Psychologist 33, 34-37.

Pownall M, et al. 2021. Embedding open and reproducible science into teaching: a bank of lesson plans and resources. Scholarship Teach. Learn. Adv. Online Publication. ( 10.1037/stl0000307) DOI

Chambers CD. 2019. The seven deadly sins of psychology. Princeton, NJ: Princeton University Press.

Hales AH, Wesselmann ED, Hilgard J. 2019. Improving psychological science through transparency and openness: an overview. Perspect. Behav. Sci. 42, 13-31. ( 10.1007/s40614-018-00186-8) PubMed DOI PMC

Vazire S. 2018. Implications of the credibility revolution for productivity, creativity, and progress. Perspect. Psychol. Sci. 13, 411-417. ( 10.1177/1745691617751884) PubMed DOI

Willinsky J. 2006. The access principle: the case for open access to research and scholarship. Cambridge, MA: MIT Press.

*Anglin SM, Edlund JE. 2020. Perceived need for reform in field-wide methods and the teaching of replication, interpretation, and transparency. Psychol. Learn. Teaching 19, 60-76. ( 10.1177/1475725719859453) DOI

Button K. 2018. Reboot undergraduate courses for reproducibility. Nature 561, 287-288. ( 10.1038/d41586-018-06692-8) PubMed DOI

Nosek, et al. 2022. Replicability, robustness, and reproducibility in psychological science. PubMed DOI

Puthillam A, Montilla Doble LJ, Delos Santos JI, Elsherif MM, Steltenpohl CN, Moreau D, Pownall M, Kapoor H. 2022. Guidelines to Improve Internationalization in Psychological Science. DOI

Topor M, et al. 2020. An integrative framework for planning and conducting non-intervention, reproducible, and open systematic reviews (NIRO-SR). DOI

Methley AM, Campbell S, Chew-Graham C, McNally R, Cheraghi-Sohi S. 2014. PICO, PICOS and SPIDER: a comparison study of specificity and sensitivity in three search tools for qualitative systematic reviews. BMC Health Serv. Res. 14, 1. ( 10.1186/s12913-014-0579-0) PubMed DOI PMC

Forscher PS, Wagenmakers E, Coles NA, Silan MA, Dutra NB, Basnight-Brown D, IJzerman H. 2020. The benefits, barriers, and risks of Big Team Science. PubMed DOI

*Afolabi F. 2017. First year learning experiences of university undergraduates in the use of open educational resources in online learning. Int. Rev. Res. Open Distrib. Learn. 18, 1-14. ( 10.19173/irrodl.v18i7.3167) DOI

*Al Abri MH, Dabbagh N. 2019. Testing the intervention of OER renewable assignments in a college course. Open Praxis 11, 195-209. ( 10.5944/openpraxis.11.2.916) DOI

*Altunoglu A. 2017. Initial perceptions of open higher education students with learner management systems. Turkish Online J. Dist. Educ. 18, 96-104. ( 10.17718/tojde.328939) DOI

*Andone D, Mihaescu V, Vert S, Ternauciuc A, Vasiu R. 2020. Students as OERs (Open Educational Resources) co-creators. In 2020 IEEE 20th Int. Conf. on Advanced Learning Technologies (ICALT), pp. 34-–38: IEEE.

*Baran E, AlZoubi D. 2020. Affordances, challenges, and impact of open pedagogy: examining students' voices. Dist. Educ. 41, 230-244. ( 10.1080/01587919.2020.1757409) DOI

*Becker M. 2020. Qualitative replication as a pedagogical approach to teaching research methods. Polit. Sci. Polit. 53, 802-806. ( 10.1017/S1049096520000864) DOI

*Bloom M. 2019. Assessing the impact of ‘Open Pedagogy’ on student skills mastery in first-year composition. Open Praxis 11, 343-353. ( 10.5944/openpraxis.11.4.1025) DOI

*Button KS, Chambers, CD, Lawrence N, Munafò MR. 2020. Grassroots training for reproducible science: a consortium-based approach to the empirical dissertation. Psychol. Learn. Teach. 19, 77-90. ( 10.1177/1475725719857659) DOI

*Çetinkaya-Rundel M, Ellison V. 2021. A fresh look at introductory data science. J. Stat. Data Sci. Educ. 29(sup1), S16-S26. ( 10.1080/10691898.2020.1804497) DOI

*Chopik WJ, Bremner RH, Defever AM, Keller VN. 2018. How (and whether) to teach undergraduates about the replication crisis in psychological science. Teach. Psychol. 45, 158-163. ( 10.1177/0098628318762900) DOI

*Davis C, Parmenter L. 2021. Student-staff partnerships at work: epistemic confidence, research-engaged teaching and vocational learning in the transition to higher education. Educ. Action Res. 29, 292-309. ( 10.1080/09650792.2020.1792958) DOI

*Hare S, Frye JM, Samuelson BL. 2020. Open pedagogy as an approach to introducing doctoral students to open educational resources and information literacy concepts. Library Trends 69, 435-468. ( 10.1353/lib.2020.0041) DOI

*Jekel M, Fiedler S, Allstadt Torras R, Mischkowski D, Dorrough AR, Glöckner A. 2020. How to teach open science principles in the undergraduate curriculum—The Hagen cumulative science project. Psychol. Learn. Teach. 19, 91-106. ( 10.1177/1475725719868149) DOI

*Krishna A, Peter SM. 2018. Questionable research practices in student final theses – Prevalence, attitudes, and the role of the supervisor's perceived attitudes. PLoS ONE 13, e0203470. ( 10.1371/journal.pone.0203470) PubMed DOI PMC

*Lin H. 2019. Teaching and learning without a textbook: undergraduate student perceptions of Open Educational Resources. Int. Rev. Res. Open Distrib. Learn. 20. 10.19173/irrodl.v20i4.4224 DOI

*Marwick B, Wang LY, Robinson R, Loiselle H. 2020. How to use replication assignments for teaching integrity in empirical archaeology. Adv. Archaeol. Pract. 8, 78-86. ( 10.1017/aap.2019.38) DOI

*Marshall EC, Underwood A. 2019. Writing in the discipline and reproducible methods: a process-oriented approach to teaching empirical undergraduate economics research. J. Econ. Educ. 50, 17-32. ( 10.1080/00220485.2018.1551100) DOI

*McCright AM. 2012. Enhancing students' scientific and quantitative literacies through an inquiry-based learning project on climate change. J. Scholarship Teach. Learn. 12, 86-101.

*Pan SJA. 2021. Taiwanese and American graduate students' misconceptions regarding responsible conduct of research: a cross-national comparison using a two-tier test approach. Sci. Eng. Ethics 27, 1-23. ( 10.1007/s11948-021-00297-7) PubMed DOI

*Paviotti G, D'Angelo I, Giaconi C, Cavicchi A. 2020. Open pedagogy practices: a case study in undergraduate education. J. e-Learn. Knowledge Soc. 16, 1-10. ( 10.20368/1971-8829/1135321) DOI

*Poronnik P, Moni RW. 2006. The opinion editorial: teaching physiology outside the box. Adv. Physiol. Educ. 30, 73-82. ( 10.1152/advan.00075.2005) PubMed DOI

*Pyott L. 2021. Tennis anyone? Teaching experimental design by designing and executing a tennis ball experiment. J. Stat. Data Sci. Educ. 29, 22-26. ( 10.1080/10691898.2020.1854638) DOI

*Ryan C. 2020. Students learning as researchers of curriculum in an undergraduate programme. Innovat. Educ. Teach. Int. 57, 644-654. ( 10.1080/14703297.2019.167320) DOI

*Sacco DF, Brown M. 2019. Assessing the efficacy of a training intervention to reduce acceptance of questionable research practices in psychology graduate students. J. Emp. Res. Hum. Res. Ethics 14, 209-218. ( 10.1177/1556264619840525) PubMed DOI

*Sanchez S, Carter DE, Morey T, Fedorek B. 2021. Student perceptions of an open educational resource for an introduction to criminal justice course. J. Crim. Justice Educ. 1-16. ( 10.1080/10511253.2021.1986084) DOI

*Sarafoglou A, Hoogeveen S, Matzke D, Wagenmakers EJ. 2019. Teaching good research practices: protocol of a research master course. Psychol. Learn. Teach. 19, 46-59. ( 10.1177/1475725719858807) DOI

*Sawchuk D. 2018. The birthday card exercise: replicating research as active learning. Gerontol. Geriatr. Educ. 39, 481-490. ( 10.1080/02701960.2016.1247071) PubMed DOI

*Smith LM, Yu F, Schmid KK. 2021. Role of replication research in biostatistics graduate education. J. Stat. Data Sci. Educ. 29, 95-104. ( 10.1080/10691898.2020.1844105) DOI

*Steinhardt I. 2020. Learning open science by doing open science. A reflection of a qualitative research project-based seminar. Educ. Inform. 36, 263-279. ( 10.3233/EFI-190308) DOI

*Stiemsma LT, Davis SD, Brewster JL. 2020. Analysis of microbial water contamination, soil microbial community structure, and soil respiration in a collaborative first-year students as scholars program (SAS). Front. Microbiol. 11, 3133. ( 10.3389/fmicb.2020.590035) PubMed DOI PMC

*Tillinghast B, Fialkowski MK, Draper J. 2020. Exploring aspects of Open Educational Resources through OER-enabled pedagogy. Front. Educ. 5, 1-14. ( 10.3389/feduc.2020.00076) DOI

*Toelch U, Ostwald D. 2018. Digital open science—Teaching digital tools for reproducible and transparent research. PLoS Biol. 16, e2006022. ( 10.1371/journal.pbio.2006022) PubMed DOI PMC

*Wang HH, Hong ZR, She HC, Smith TJ, Fielding J, Lin HS. 2022. The role of structured inquiry, open inquiry, and epistemological beliefs in developing secondary students’ scientific and mathematical literacies. Int. J. STEM Educ. 9, 411-417. ( 10.1186/s40594-022-00329-z) DOI

*Watson CE, Domizi DP, Clouser SA. 2017. Student and faculty perceptions of OpenStax in high enrollment courses. Int. Rev. Res. Open Distrib. Learn. 18, 1-18. ( 10.19173/irrodl.v18i5.2462) DOI

*Werth E, Williams K. 2021. Exploring student perceptions as co-authors of course material. Open Praxis 13, 53-67. ( 10.5944/openpraxis.13.1.1187) DOI

OECD. 2006. Measuring student knowledge and skills: the PISA 2000 assessment of Reading, mathematical and scientific literacy. Berlin, Germany: OECD Publishing. See https://www.oecd.org/education/school/programmeforinternationalstudentassessmentpi.

OECD. 2017. PISA 2015 assessment and analytical framework: science, reading, mathematic, financial literacy and collaborative problem solving, revised edition. Berlin, Germany: OECD Publishing.

Tang KS, Williams PJ. 2019. STEM literacy or literacies? Examining the empirical basis of these constructs. Rev. Educ. 7, 675-697. ( 10.1002/rev3.3162) DOI

Hubbard K. 2021. Disciplinary literacies in STEM: what do undergraduates read, how do they read it, and can we teach scientific reading more effectively? Higher Educ. Pedagogies 6, 41-65. ( 10.1080/23752696.2021.1882326) DOI

American Psychological Association. 2013. APA guidelines for the undergraduate psychology major: version 2.0. Washington, DC: American Psychological Association. PubMed

American Psychological Association. 2018. Guidelines on core learning goals for master's degree graduates in psychology. Washington, DC: APA. See https://www.apa.org/about/policy/masters-goals-guidelines.pdf.

Blincoe S, Buchert S. 2020. Research preregistration as a teaching and learning tool in undergraduate psychology courses. Psychol. Learn. Teach. 19, 107-115. ( 10.1177/1475725719875844) DOI

Pownall M. 2020. Pre-registration in the undergraduate dissertation: a critical discussion. Psychol. Teach. Rev. 26, 71-76. ( 10.31234/osf.io/egbcv) DOI

Janz N. 2019. Teaching replication. In Project TIER 2021 Spring Symposium: Instruction in Reproducible Research,

Feldman G. 2022. Replications and extensions of classic findings in judgment and decision making. Open Sci. Framework. ( 10.17605/OSF.IO/5Z4A8) DOI

Brick C, Fillon A, Yeung SK, Wang M, Lyu H, Ho JYJ, Wong SC, Feldman G. 2021. Self-interest is overestimated: two successful pre-registered replications and extensions of Miller and Ratner (1998). Collabra: Psychology 7, 23443. ( 10.1525/collabra.23443) DOI

Chandrashekar SP, Weber J, Chan SY, Cho WY, Chu TCC, Cheng BL, Feldman G. 2021. Accentuation and compatibility: replication and extensions of Shafir (1993) to rethink Choosing versus Rejecting paradigms. Judg. Decision Making 16, 36-56.

Ziano I, Mok PY, Feldman G. 2021. Replication and extension of Alicke (1985) better-than-average effect for desirable and controllable traits. Soc. Psychol. Pers. Sci. 12, 1005-1017. ( 10.1177/1948550620948973) DOI

Feldman G. 2021. Collection of teaching evaluations. ( 10.17605/OSF.IO/24FJS) DOI

Jarke H, et al. 2022. A roadmap to large-scale multi-country replications in psychology. Collabra: Psychology 8, 57538. ( 10.1525/collabra.57538) DOI

Field AP. 2014. Skills in mathematics and statistics in psychology and tackling transition.

Bonwell CC, Eison JA. 1991. Active Learning: Creating Excitement in the Classroom.

Wagge JR, Brandt MJ, Lazarevic LB, Legate N, Christopherson C, Wiggins B, Grahe JE. 2019. Publishing research with undergraduate students via replication work: the collaborative replications and education project. Front. Psychol. 10, 1-4. ( 10.3389/fpsyg.2019.00247) PubMed DOI PMC

IJzerman HR. 2019. Research tools in social cognition [unpublished course syllabus]. See https://www.dropbox.com/s/z8njk19szkw4u1y/IJzerman%20-%20Research%20Tools%20in%20Social%20Cognition%20Final%202019.docx?dl=0.

Haas HA, Rouse SV. 2022. Learning from mistakes: teaching students about errata, corrigenda, and nonretraction corrections to the research literature. Scholarship Teach. Learn. Psychol. 8, 58-69. ( 10.1037/stl0000216) DOI

Frank MC, Saxe R. 2012. Teaching replication. Perspect. Psychol. Sci. 7, 600-604. ( 10.1177/1745691612460686) PubMed DOI

Kathawalla UK, Silverstein P, Syed M. 2021. Easing into open science: a guide for graduate students and their advisors. Collabra: Psychology 7, 18684. ( 10.1525/collabra.18684) DOI

Nurse AM, Staiger T. 2019. Teaching data reproducibility through service learning. Teach. Sociol. 47, 350-357. ( 10.1177/0092055X19860577) DOI

Kahu ER, Stephens C, Leach L, Zepke N. 2013. The engagement of mature distance students. Higher Educ. Res. Dev. 32, 791-804. ( 10.1080/07294360.2013.777036) DOI

Groccia JE. 2018. What is student engagement? New Dir. Teach. Learn. 2018, 11-20. ( 10.1002/tl.20287) DOI

McAleer P. 2021. Creating a curriculum centered on reproducible research for the psychologists of the future. In Project TIER 2021 Spring Symp.: Instruction in Reproducible Research, Online, 5 March–21 May 2021. Project TIER. See https://www.projecttier.org/events/Phil-McAleer-Creating-a-curriculum-centered/.

Barr D. 2016. No more excuses: R is better than SPSS for psychology undergrads, and students agree. DataHowler. See https://datahowler.wordpress.com/2016/09/10/no-moreexcuses-r-is-better-than-spss-for-psychology-undergrads-and-students-agree/.

Bangera G, Brownell SE. 2014. Course-based undergraduate research experiences can make scientific research more inclusive. CBE—Life Sci. Educ. 13, 602-606. ( 10.1187/cbe.14-06-0099) PubMed DOI PMC

Clark, et al. 2020. Development, implementation and importance of an undergraduate peer research consultant program at the University of North Dakota’s Chester Fritz Library.

Pennington CR, Jones AJ, Tzavella L, Chambers CD, Button KS. 2022. Beyond online participant crowdsourcing: the benefits and opportunities of big team addiction science. Exp. Clin. Psychopharmacol. Adv. Online Publication. ( 10.1037/pha0000541) PubMed DOI

Button, et al. 2018. Reboot undergraduate courses for reproducibility. PubMed

Lindshield BL, Adhikari K. 2013. Online and campus college students like using an open educational resource instead of a traditional textbook. J. Online Learn. Teach. 9, 26-38.

Zapata GC. 2020. Sprinting to the finish line: the benefits and challenges of book sprints in OER faculty-graduate student collaborations. Int. Rev. Res. Open Distrib. Learn. 21, 1-17. ( 10.19173/irrodl.v21i2.4607) DOI

Ajzen I, Fishbein M. 2005. The influence of attitudes on behavior. In The handbook of attitudes (eds Albarracin D, Johnson BT, Zanna MP), pp. 173-221. New York, NY: Erlbaum.

Hardwicke TE, Thibault RT, Kosie JE, Wallach JD, Kidwell MC, Ioannidis JP. 2022. Estimating the prevalence of transparency and reproducibility-related research practices in psychology (2014–2017). Perspect. Psychol. Sci. 17, 239-251. ( 10.1177/1745691620979806) PubMed DOI PMC

Serghiou S, Contopoulos-Ioannidis DG, Boyack KW, Riedel N, Wallach JD, Ioannidis JP. 2021. Assessment of transparency indicators across the biomedical literature: how open is open? PLoS Biol. 19, 1-26. ( 10.1371/journal.pbio.3001107) PubMed DOI PMC

Hanna S, Pither J, Vis-Dunbar M. 2021. Implementation of an open science instruction program for undergraduates. Data Intelligence 3, 150-161. ( 10.1162/dint_a_00086) DOI

Truan N, Dressel D. 2021. Doing open science in a research-based seminar: students positioning towards openness in higher education. HAL SHS Hum. Soc. Sci. 23, 1-19. See https://halshs.archives-ouvertes.fr/halshs-03395171.

Olsen J, Mosen J, Voracek M, Kirchler E. 2019. Research practices and statistical reporting quality in 250 economic psychology master's theses: a meta-research investigation. R. Soc. Open Sci. 6, 190738. ( 10.1098/rsos.190738) PubMed DOI PMC

Giuliano T, Skorinko JLM, Fallon M. 2019. Engaging undergraduates in publishable research: best practices. Front. Psychol. 1878, 1-6. ( 10.3389/fpsyg.2019.01878) PubMed DOI PMC

Rosenthal R. 1979. The file drawer problem and tolerance for null results. Psychol. Bull. 86, 638-641. ( 10.1037/0033-2909.86.3.638) DOI

Poldrack RA, et al. 2017. Scanning the horizon: towards transparent and reproducible neuroimaging research. Nat. Rev. Neurosci. 18, 115-126. ( 10.1038/nrn.2016.167) PubMed DOI PMC

Simonsohn U, Nelson LD, Simmons JP. 2014. p-Curve and effect size: correcting for publication bias using only significant results. Perspect. Psychol. Sci. 9, 666-681. ( 10.1177/1745691614553988) PubMed DOI

Burgstahler SE, Cory RC. 2010. Universal design in higher education: from principles to practice. Cambridge, MA: Harvard Education Press.

Gourdon-Kanhukamwe A, et al. 2023. Promoting participatory research for neurodiverse populations through Open Scholarship practice. BPS Cogn. Psychol. Bullet. 8, 23. ( 10.53841/bpscog.2023.1.8.23) DOI

Elsherif MM, et al. 2022. Bridging Neurodiversity and Open Scholarship: How Shared Values Can Guide Best Practices for Research Integrity, Social Justice, and Principled Education. DOI

Nordmann E, Clark A, Spaeth E, MacKay JR. 2021. Lights, camera, active! Appreciation of active learning predicts positive attitudes towards lecture capture. Higher Educ. 83, 481-502. ( 10.1007/s10734-020-00674-4) PubMed DOI PMC

Nightingale KP, Anderson V, Onens S, Fazil Q, Davies H. 2019. Developing the inclusive curriculum: is supplementary lecture recording an effective approach in supporting students with Specific Learning Difficulties (SpLDs)? Comput. Educ. 130, 13-25. ( 10.1016/j.compedu.2018.11.006) DOI

Kowalczyk OS, Lautarescu A, Blok E, Dall'Aglio L, Westwood SJ. 2022. What senior academics can do to support reproducible and open research: a short, three-step guide. BMC Res. Notes 15, Article 116. ( 10.1186/s13104-02205999-0) PubMed DOI PMC

Jarke H, Jakob L, Bojanić L, Garcia-Garzon E, Mareva S, Mutak A, Gjorgjiovska J. 2022. Registered report: how open do you want your science? An international investigation into knowledge and attitudes of psychology students. PLoS ONE 17, e0261260. ( 10.1371/journal.pone.0261260) PubMed DOI PMC

Pownall M, Pennington CR, Norris E, Clark K. 2021. Evaluating the pedagogical effectiveness of study preregistration in the undergraduate dissertation: a registered report. Open Sci. Framework. See https://osf.io/5qshg/.

Pownall M, et al. 2023. Teaching open and reproducible scholarship: a critical review of the evidence base for current pedagogical methods and their outcomes. Figshare. ( 10.6084/m9.figshare.c.6641489) PubMed DOI PMC

Zobrazit více v PubMed

figshare
10.6084/m9.figshare.c.6641489

Najít záznam

Citační ukazatele

Pouze přihlášení uživatelé

Možnosti archivace

Nahrávání dat ...