• Something wrong with this record ?

Teaching open and reproducible scholarship: a critical review of the evidence base for current pedagogical methods and their outcomes

M. Pownall, F. Azevedo, LM. König, HR. Slack, TR. Evans, Z. Flack, S. Grinschgl, MM. Elsherif, KA. Gilligan-Lee, CMF. de Oliveira, B. Gjoneska, T. Kalandadze, K. Button, S. Ashcroft-Jones, J. Terry, N. Albayrak-Aydemir, F. Děchtěrenko, S....

. 2023 ; 10 (5) : 221255. [pub] 20230517

Status not-indexed Language English Country England, Great Britain

Document type Journal Article, Review

In recent years, the scientific community has called for improvements in the credibility, robustness and reproducibility of research, characterized by increased interest and promotion of open and transparent research practices. While progress has been positive, there is a lack of consideration about how this approach can be embedded into undergraduate and postgraduate research training. Specifically, a critical overview of the literature which investigates how integrating open and reproducible science may influence student outcomes is needed. In this paper, we provide the first critical review of literature surrounding the integration of open and reproducible scholarship into teaching and learning and its associated outcomes in students. Our review highlighted how embedding open and reproducible scholarship appears to be associated with (i) students' scientific literacies (i.e. students' understanding of open research, consumption of science and the development of transferable skills); (ii) student engagement (i.e. motivation and engagement with learning, collaboration and engagement in open research) and (iii) students' attitudes towards science (i.e. trust in science and confidence in research findings). However, our review also identified a need for more robust and rigorous methods within pedagogical research, including more interventional and experimental evaluations of teaching practice. We discuss implications for teaching and learning scholarship.

Centre for Workforce Development Institute for Lifecourse Development University of Greenwich London SE10 9LS UK

Department for Cognition Emotion and Methods in Psychology University of Vienna Vienna 1010 Austria

Department of Biological and Experimental Psychology Queen Mary University of London E1 4NS UK

Department of Experimental Psychology University of Oxford Oxford OX1 4BH18 UK

Department of Mathematics College of Polytechnics Jihlava 1556 16 586 01 Czech Republic

Department of Neuroimaging IoPPN King's College London UK

Department of Neuroscience Psychology and Behaviour University of Leicester UK

Department of Philosophy Macquarie University NSW 2109 Australia

Department of Psychiatry and Psychotherapy Philipps University Marburg D 35039 Marburg Germany

Department of Psychological and Behavioural Science London School of Economics and Political Science UK

Department of Psychology 3 University of Würzburg 97070 Würzburg Germany

Department of Psychology Ashland University OH 44805 USA

Department of Psychology Bournemouth University Poole BH12 5BB UK

Department of Psychology Education and Child Studies Erasmus University Rotterdam Rotterdam 3000 The Netherlands

Department of Psychology Faculty of Management Law and Social Sciences University of Bradford Bradford BD7 1DP UK

Department of Psychology Leiden University 2311 EZ Leiden The Netherlands

Department of Psychology Linfield University Linfield 503 883 2200 USA

Department of Psychology Liverpool Hope University Liverpool L16 9JD UK

Department of Psychology Saarland University 66123 Saarbrücken Germany

Department of Psychology School of Social Science University of Westminster London W1B 2HW UK

Department of Psychology the Chinese University of Hong Kong Hong Kong SAR 100871 People's Republic of China

Department of Psychology University of Bath Bath BA2 7AY UK

Department of Psychology University of Cambridge CB2 3EB UK

Department of Psychology University of Groningen 9712 CP Groningen the Netherlands

Department of Psychology University of Limerick V94 T9PX Ireland

Department of Psychology University of Montreal Canada

Department of Psychology University of York York YO10 5DD USA

Department of Psychology Witten Herdecke University Germany

Department of Social Sciences University of the West of England Bristol BS16 1QY UK

Department of Sport and Recreation Management Temple University PA 19122 USA

Departments of Psychiatry and Experimental Psychology University of Oxford UK

Division of Neuroscience and Experimental Psychology University of Manchester Manchester M13 9PL UK

Division of Psychology De Montfort University Leicester LE1 9BH UK

Faculty for Geo Information Science and Earth Observation University of Twente 7522 NB The Netherlands

Faculty of Education University of Cambridge Cambridge CB2 1TN UK

Faculty of Life Sciences Food Nutrition and Health University of Bayreuth 95447 Bayreuth Germany

Faculty of Psychology in Wrocław SWPS University of Social Sciences and Humanities Wrocław 03 81536 Al Jubail 35819 Poland

Faculty of Teacher Education and Languages Department of Education ICT and Learning Ostfold University College 1757 Halden Norway

Graduate School of Business Stanford University CA 94305 USA

IGDORE London UK

Institute for Educational Research and Teacher Education University of Graz Graz 8010 Graz Austria

Institute of General Practice and Family Medicine University Hospital Bonn University of Bonn 53127 Bonn Germany

Institute of Psychology University of Graz 8010 Graz Austria

Iscte Universty Institute of Lisbon CIS IUL 1649 026 Lisboa Portugal

Jubail English Language and Preparatory Year Institute Royal Commission for Jubail and Yanbu Saudi Arabia

Macedonian Academy of Sciences and Arts North Macedonia XCWR GJM 1000

School of Education Johns Hopkins University MD 21218 USA

School of Human Sciences University of Greenwich London SE10 9LS UK

School of Humanities and Social Science University of Brighton BN2 0JY UK

School of Psychology and Counselling the Open University Milton Keynes MK7 6AA UK

School of Psychology and Neuroscience University of Glasgow Glasgow G12 8QQ UK

School of Psychology Aston University Birmingham B4 7ET UK

School of Psychology Cardiff University Cardiff CF10 3AT UK

School of Psychology Keele University Newcastle ST5 5BG UK

School of Psychology Queen's University Belfast Belfast BT7 1NN UK

School of Psychology University College Dublin Dublin 4 DO4 V1WD Ireland

School of Psychology University of Auckland Auckland 1142 New Zealand

School of Psychology University of Birmingham B15 2TT UK

School of Psychology University of Chester Chester CH1 4BJ UK

School of Psychology University of Leeds Leeds LS2 9JT UK

School of Psychology University of Nottingham Nottingham NG7 2RD UK

School of Psychology University of Sussex Brighton BN1 9RH UK

School of Public Health University College Cork Cork T12 K8AF Ireland

School of Social and Political Sciences University of Glasgow Glasgow G12 8QQ UK

South East European Research Centre Thessaloniki Greece

University Library University of Oslo 0313 Oslo Norway

References provided by Crossref.org

000      
00000naa a2200000 a 4500
001      
bmc23009751
003      
CZ-PrNML
005      
20230721095455.0
007      
ta
008      
230707s2023 enk f 000 0|eng||
009      
AR
024    7_
$a 10.1098/rsos.221255 $2 doi
035    __
$a (PubMed)37206965
040    __
$a ABA008 $b cze $d ABA008 $e AACR2
041    0_
$a eng
044    __
$a enk
100    1_
$a Pownall, Madeleine $u School of Psychology, University of Leeds, Leeds LS2 9JT, UK $1 https://orcid.org/0000000237348006
245    10
$a Teaching open and reproducible scholarship: a critical review of the evidence base for current pedagogical methods and their outcomes / $c M. Pownall, F. Azevedo, LM. König, HR. Slack, TR. Evans, Z. Flack, S. Grinschgl, MM. Elsherif, KA. Gilligan-Lee, CMF. de Oliveira, B. Gjoneska, T. Kalandadze, K. Button, S. Ashcroft-Jones, J. Terry, N. Albayrak-Aydemir, F. Děchtěrenko, S. Alzahawi, BJ. Baker, MM. Pittelkow, L. Riedl, K. Schmidt, CR. Pennington, JJ. Shaw, T. Lüke, MC. Makel, H. Hartmann, M. Zaneva, D. Walker, S. Verheyen, D. Cox, J. Mattschey, T. Gallagher-Mitchell, P. Branney, Y. Weisberg, K. Izydorczak, AH. Al-Hoorie, AM. Creaven, SLK. Stewart, K. Krautter, K. Matvienko-Sikar, SJ. Westwood, P. Arriaga, M. Liu, MA. Baum, T. Wingen, RM. Ross, A. O'Mahony, A. Bochynska, M. Jamieson, MV. Tromp, SK. Yeung, MR. Vasilev, A. Gourdon-Kanhukamwe, L. Micheli, M. Konkol, D. Moreau, JE. Bartlett, K. Clark, G. Brekelmans, T. Gkinopoulos, SL. Tyler, JP. Röer, ZG. Ilchovska, CR. Madan, O. Robertson, BJ. Iley, S. Guay, M. Sladekova, S. Sadhwani, FORRT
520    9_
$a In recent years, the scientific community has called for improvements in the credibility, robustness and reproducibility of research, characterized by increased interest and promotion of open and transparent research practices. While progress has been positive, there is a lack of consideration about how this approach can be embedded into undergraduate and postgraduate research training. Specifically, a critical overview of the literature which investigates how integrating open and reproducible science may influence student outcomes is needed. In this paper, we provide the first critical review of literature surrounding the integration of open and reproducible scholarship into teaching and learning and its associated outcomes in students. Our review highlighted how embedding open and reproducible scholarship appears to be associated with (i) students' scientific literacies (i.e. students' understanding of open research, consumption of science and the development of transferable skills); (ii) student engagement (i.e. motivation and engagement with learning, collaboration and engagement in open research) and (iii) students' attitudes towards science (i.e. trust in science and confidence in research findings). However, our review also identified a need for more robust and rigorous methods within pedagogical research, including more interventional and experimental evaluations of teaching practice. We discuss implications for teaching and learning scholarship.
590    __
$a NEINDEXOVÁNO
655    _2
$a časopisecké články $7 D016428
655    _2
$a přehledy $7 D016454
700    1_
$a Azevedo, Flávio $u Department of Psychology, University of Cambridge, CB2 3EB, UK $1 https://orcid.org/0000000190008513
700    1_
$a König, Laura M $u Faculty of Life Sciences: Food, Nutrition and Health, University of Bayreuth, 95447 Bayreuth, Germany
700    1_
$a Slack, Hannah R $u School of Psychology, University of Nottingham, Nottingham NG7 2RD, UK $1 https://orcid.org/0000000325228717
700    1_
$a Evans, Thomas Rhys $u School of Human Sciences, University of Greenwich, London SE10 9LS, UK $u Centre for Workforce Development, Institute for Lifecourse Development, University of Greenwich, London SE10 9LS, UK
700    1_
$a Flack, Zoe $u School of Humanities and Social Science, University of Brighton, BN2 0JY, UK
700    1_
$a Grinschgl, Sandra $u Institute of Psychology, University of Graz, 8010 Graz, Austria
700    1_
$a Elsherif, Mahmoud M $u School of Psychology, University of Birmingham, B15 2TT, UK $1 https://orcid.org/0000000205403998
700    1_
$a Gilligan-Lee, Katie A $u School of Psychology, University College Dublin, Dublin 4, DO4 V1WD, Ireland $1 https://orcid.org/0000000254062149
700    1_
$a de Oliveira, Catia M F $u Department of Psychology, University of York, York YO10 5DD, USA $1 https://orcid.org/0000000229763330
700    1_
$a Gjoneska, Biljana $u Macedonian Academy of Sciences and Arts, North Macedonia, XCWR+GJM, 1000 $1 https://orcid.org/0000000312006672
700    1_
$a Kalandadze, Tamara $u Faculty of Teacher Education and Languages, Department of Education, ICT and Learning, Ostfold University College, 1757 Halden, Norway
700    1_
$a Button, Katherine $u Department of Psychology, University of Bath, Bath BA2 7AY, UK
700    1_
$a Ashcroft-Jones, Sarah $u Department of Experimental Psychology, University of Oxford, Oxford OX1 4BH18, UK
700    1_
$a Terry, Jenny $u School of Psychology, University of Sussex, Brighton BN1 9RH, UK $1 https://orcid.org/0000000268437116
700    1_
$a Albayrak-Aydemir, Nihan $u School of Psychology and Counselling, the Open University, Milton Keynes MK7 6AA, UK $u Department of Psychological and Behavioural Science, London School of Economics and Political Science, UK $1 https://orcid.org/0000000334124311
700    1_
$a Děchtěrenko, Filip $u Department of Mathematics, College of Polytechnics Jihlava, 1556/16, 586 01, Czech Republic
700    1_
$a Alzahawi, Shilaan $u Graduate School of Business, Stanford University, CA 94305, USA
700    1_
$a Baker, Bradley J $u Department of Sport and Recreation Management, Temple University, PA 19122, USA $1 https://orcid.org/0000000216974198
700    1_
$a Pittelkow, Merle-Marie $u Department of Psychology, University of Groningen, 9712 CP, Groningen, the Netherlands $1 https://orcid.org/0000000274877898
700    1_
$a Riedl, Lydia $u Department of Psychiatry and Psychotherapy, Philipps-University Marburg, D-35039 Marburg, Germany
700    1_
$a Schmidt, Kathleen $u Department of Psychology, Ashland University, OH 44805, USA $1 https://orcid.org/0000000299465953
700    1_
$a Pennington, Charlotte R $u School of Psychology, Aston University, Birmingham B4 7ET, UK $1 https://orcid.org/000000025259642X
700    1_
$a Shaw, John J $u Division of Psychology, De Montfort University, Leicester LE1 9BH, UK $1 https://orcid.org/0000000331906772
700    1_
$a Lüke, Timo $u Institute for Educational Research and Teacher Education, University of Graz, Graz, 8010 Graz, Austria
700    1_
$a Makel, Matthew C $u School of Education, Johns Hopkins University, MD 21218, USA
700    1_
$a Hartmann, Helena $u Department for Cognition, Emotion, and Methods in Psychology, University of Vienna, Vienna 1010, Austria $1 https://orcid.org/0000000213316683
700    1_
$a Zaneva, Mirela $u Department of Experimental Psychology, University of Oxford, Oxford OX1 4BH18, UK $1 https://orcid.org/000000033569931X
700    1_
$a Walker, Daniel $u Department of Psychology, Faculty of Management, Law and Social Sciences, University of Bradford, Bradford BD7 1DP, UK $1 https://orcid.org/0000000293696953
700    1_
$a Verheyen, Steven $u Department of Psychology, Education and Child Studies, Erasmus University Rotterdam, Rotterdam 3000, The Netherlands
700    1_
$a Cox, Daniel $u Division of Neuroscience and Experimental Psychology, University of Manchester, Manchester M13 9PL, UK
700    1_
$a Mattschey, Jennifer $u School of Psychology and Counselling, the Open University, Milton Keynes MK7 6AA, UK
700    1_
$a Gallagher-Mitchell, Tom $u Department of Psychology, Liverpool Hope University, Liverpool L16 9JD, UK
700    1_
$a Branney, Peter $u Department of Psychology, Faculty of Management, Law and Social Sciences, University of Bradford, Bradford BD7 1DP, UK
700    1_
$a Weisberg, Yanna $u Department of Psychology, Linfield University, Linfield, 503-883-2200, USA $1 https://orcid.org/0000000242196625
700    1_
$a Izydorczak, Kamil $u Faculty of Psychology in Wrocław, SWPS University of Social Sciences and Humanities, Wrocław 03-81536, Al Jubail 35819, Poland $1 https://orcid.org/0000000298703825
700    1_
$a Al-Hoorie, Ali H $u Jubail English Language and Preparatory Year Institute, Royal Commission for Jubail and Yanbu, Saudi Arabia
700    1_
$a Creaven, Ann-Marie $u Department of Psychology, University of Limerick, V94 T9PX, Ireland
700    1_
$a Stewart, Suzanne L K $u School of Psychology, University of Chester, Chester CH1 4BJ, UK
700    1_
$a Krautter, Kai $u Department of Psychology, Saarland University, 66123 Saarbrücken, Germany
700    1_
$a Matvienko-Sikar, Karen $u School of Public Health, University College Cork, Cork, T12 K8AF, Ireland
700    1_
$a Westwood, Samuel J $u Department of Psychology, School of Social Science, University of Westminster, London W1B 2HW, UK
700    1_
$a Arriaga, Patrícia $u Iscte-Universty Institute of Lisbon, CIS-IUL, 1649-026 Lisboa, Portugal $1 https://orcid.org/0000000157660489
700    1_
$a Liu, Meng $u Faculty of Education, University of Cambridge, Cambridge CB2 1TN, UK
700    1_
$a Baum, Myriam A $u Department of Psychology, Saarland University, 66123 Saarbrücken, Germany
700    1_
$a Wingen, Tobias $u Institute of General Practice and Family Medicine, University Hospital Bonn, University of Bonn, 53127 Bonn, Germany
700    1_
$a Ross, Robert M $u Department of Philosophy, Macquarie University, NSW 2109, Australia
700    1_
$a O'Mahony, Aoife $u School of Psychology, Cardiff University, Cardiff CF10 3AT, UK
700    1_
$a Bochynska, Agata $u University Library, University of Oslo, 0313 Oslo, Norway $1 https://orcid.org/0000000162118600
700    1_
$a Jamieson, Michelle $u School of Social and Political Sciences, University of Glasgow, Glasgow G12 8QQ, UK
700    1_
$a Tromp, Myrthe Vel $u Department of Psychology, Leiden University, 2311 EZ Leiden, The Netherlands
700    1_
$a Yeung, Siu Kit $u Department of Psychology, the Chinese University of Hong Kong, Hong Kong, SAR 100871, People's Republic of China
700    1_
$a Vasilev, Martin R $u Department of Psychology, Bournemouth University, Poole BH12 5BB, UK
700    1_
$a Gourdon-Kanhukamwe, Amélie $u Department of Neuroimaging, IoPPN, King's College London, UK $u IGDORE, London, UK
700    1_
$a Micheli, Leticia $u Department of Psychology III, University of Würzburg, 97070 Würzburg, Germany $1 https://orcid.org/0000000300668222
700    1_
$a Konkol, Markus $u Faculty for Geo-Information Science and Earth Observation, University of Twente, 7522 NB, The Netherlands
700    1_
$a Moreau, David $u School of Psychology, University of Auckland, Auckland 1142, New Zealand
700    1_
$a Bartlett, James E $u School of Psychology and Neuroscience, University of Glasgow, Glasgow G12 8QQ, UK
700    1_
$a Clark, Kait $u Department of Social Sciences, University of the West of England, Bristol BS16 1QY, UK
700    1_
$a Brekelmans, Gwen $u Department of Biological and Experimental Psychology, Queen Mary University of London, E1 4NS, UK
700    1_
$a Gkinopoulos, Theofilos $u South-East European Research Centre, Thessaloniki, Greece
700    1_
$a Tyler, Samantha L $u Department of Neuroscience, Psychology and Behaviour, University of Leicester, UK $1 https://orcid.org/0000000196025015
700    1_
$a Röer, Jan Philipp $u Department of Psychology, Witten/Herdecke University, Germany
700    1_
$a Ilchovska, Zlatomira G $u School of Psychology, University of Birmingham, B15 2TT, UK
700    1_
$a Madan, Christopher R $u School of Psychology, University of Nottingham, Nottingham NG7 2RD, UK
700    1_
$a Robertson, Olly $u Departments of Psychiatry and Experimental Psychology, University of Oxford, UK $u School of Psychology, Keele University, Newcastle ST5 5BG, UK
700    1_
$a Iley, Bethan J $u School of Psychology, Queen's University Belfast, Belfast BT7 1NN, UK $1 https://orcid.org/0000000258133303
700    1_
$a Guay, Samuel $u Department of Psychology, University of Montreal, Canada
700    1_
$a Sladekova, Martina $u School of Psychology, University of Sussex, Brighton BN1 9RH, UK $u School of Humanities and Social Science, University of Brighton, BN2 0JY, UK $1 https://orcid.org/0000000150596576
700    1_
$a Sadhwani, Shanu $u School of Humanities and Social Science, University of Brighton, BN2 0JY, UK
710    2_
$a FORRT
773    0_
$w MED00188140 $t Royal Society open science $x 2054-5703 $g Roč. 10, č. 5 (2023), s. 221255
856    41
$u https://pubmed.ncbi.nlm.nih.gov/37206965 $y Pubmed
910    __
$a ABA008 $b sig $c sign $y p $z 0
990    __
$a 20230707 $b ABA008
991    __
$a 20230721095448 $b ABA008
999    __
$a ok $b bmc $g 1958488 $s 1196015
BAS    __
$a 3
BAS    __
$a PreBMC-PubMed-not-MEDLINE
BMC    __
$a 2023 $b 10 $c 5 $d 221255 $e 20230517 $i 2054-5703 $m Royal Society open science $n R Soc Open Sci $x MED00188140
LZP    __
$a Pubmed-20230707

Find record

Citation metrics

Loading data ...

Archiving options

Loading data ...