-
Something wrong with this record ?
The process of replication target selection in psychology: what to consider
MM. Pittelkow, SM. Field, PM. Isager, AE. Van't Veer, T. Anderson, SN. Cole, T. Dominik, R. Giner-Sorolla, S. Gok, T. Heyman, M. Jekel, TJ. Luke, DB. Mitchell, R. Peels, R. Pendrous, S. Sarrazin, JM. Schauer, E. Specker, US. Tran, MA. Vranka, JM....
Status not-indexed Language English Country England, Great Britain
Document type Journal Article
NLK
Directory of Open Access Journals
from 2014
PubMed Central
from 2014
Europe PubMed Central
from 2014
Open Access Digital Library
from 2014-01-01
Open Access Digital Library
from 2014-01-01
ROAD: Directory of Open Access Scholarly Resources
from 2014
PubMed
36756069
DOI
10.1098/rsos.210586
Knihovny.cz E-resources
- Publication type
- Journal Article MeSH
Increased execution of replication studies contributes to the effort to restore credibility of empirical research. However, a second generation of problems arises: the number of potential replication targets is at a serious mismatch with available resources. Given limited resources, replication target selection should be well-justified, systematic and transparently communicated. At present the discussion on what to consider when selecting a replication target is limited to theoretical discussion, self-reported justifications and a few formalized suggestions. In this Registered Report, we proposed a study involving the scientific community to create a list of considerations for consultation when selecting a replication target in psychology. We employed a modified Delphi approach. First, we constructed a preliminary list of considerations. Second, we surveyed psychologists who previously selected a replication target with regards to their considerations. Third, we incorporated the results into the preliminary list of considerations and sent the updated list to a group of individuals knowledgeable about concerns regarding replication target selection. Over the course of several rounds, we established consensus regarding what to consider when selecting a replication target. The resulting checklist can be used for transparently communicating the rationale for selecting studies for replication.
Centre for Contextual Behavioural Science School of Psychology University of Chester Chester UK
Centre of Science and Technology Studies Leiden University Leiden the Netherlands
Department of Methodology and Statistics Tilburg University Tilburg The Netherlands
Department of Psychology University of Gothenburg Gothenburg Sweden
Department of Psychology University of Toronto Toronto Canada
Department of Psychometrics and Statistics Rijksuniversiteit Groningen Groningen The Netherlands
Faculty of Social Sciences Charles University Prague Czech Republic
Institute for Interdisciplinary Brain and Behavioral Sciences Chapman University Orange CA USA
Institute of Applied Health Research University of Birmingham Birmingham UK
Maison de santé pluridisciplinaire Pasteur Chevilly Larue France
Methodology and Statistics Unit Institute of Psychology Leiden University Leiden the Netherlands
Oslo New University College Oslo Norway
Research Organization of Open Innovation and Collaboration Ritsumeikan University Osaka Japan
School of Education Language and Psychology York St John University York UK
School of Psychology University of Kent Canterbury UK
Social Psychology University of Cologne Cologne Germany
WellStar College of Health and Human Services Kennesaw State University Kennesaw GA USA
References provided by Crossref.org
- 000
- 00000naa a2200000 a 4500
- 001
- bmc23003037
- 003
- CZ-PrNML
- 005
- 20230421100034.0
- 007
- ta
- 008
- 230413s2023 enk f 000 0|eng||
- 009
- AR
- 024 7_
- $a 10.1098/rsos.210586 $2 doi
- 035 __
- $a (PubMed)36756069
- 040 __
- $a ABA008 $b cze $d ABA008 $e AACR2
- 041 0_
- $a eng
- 044 __
- $a enk
- 100 1_
- $a Pittelkow, Merle-Marie $u Department of Psychometrics and Statistics, Rijksuniversiteit Groningen, Groningen, The Netherlands $1 https://orcid.org/0000000274877898
- 245 14
- $a The process of replication target selection in psychology: what to consider / $c MM. Pittelkow, SM. Field, PM. Isager, AE. Van't Veer, T. Anderson, SN. Cole, T. Dominik, R. Giner-Sorolla, S. Gok, T. Heyman, M. Jekel, TJ. Luke, DB. Mitchell, R. Peels, R. Pendrous, S. Sarrazin, JM. Schauer, E. Specker, US. Tran, MA. Vranka, JM. Wicherts, N. Yoshimura, RA. Zwaan, D. van Ravenzwaaij
- 520 9_
- $a Increased execution of replication studies contributes to the effort to restore credibility of empirical research. However, a second generation of problems arises: the number of potential replication targets is at a serious mismatch with available resources. Given limited resources, replication target selection should be well-justified, systematic and transparently communicated. At present the discussion on what to consider when selecting a replication target is limited to theoretical discussion, self-reported justifications and a few formalized suggestions. In this Registered Report, we proposed a study involving the scientific community to create a list of considerations for consultation when selecting a replication target in psychology. We employed a modified Delphi approach. First, we constructed a preliminary list of considerations. Second, we surveyed psychologists who previously selected a replication target with regards to their considerations. Third, we incorporated the results into the preliminary list of considerations and sent the updated list to a group of individuals knowledgeable about concerns regarding replication target selection. Over the course of several rounds, we established consensus regarding what to consider when selecting a replication target. The resulting checklist can be used for transparently communicating the rationale for selecting studies for replication.
- 590 __
- $a NEINDEXOVÁNO
- 655 _2
- $a časopisecké články $7 D016428
- 700 1_
- $a Field, Sarahanne M $u Centre of Science and Technology Studies, Leiden University, Leiden, the Netherlands $1 https://orcid.org/0000000178741261
- 700 1_
- $a Isager, Peder M $u Oslo New University College, Oslo, Norway $1 https://orcid.org/0000000269223590
- 700 1_
- $a Van't Veer, Anna E $u Methodology and Statistics Unit, Institute of Psychology, Leiden University, Leiden, the Netherlands $1 https://orcid.org/0000000227331841
- 700 1_
- $a Anderson, Thomas $u Department of Psychology, University of Toronto, Toronto, Canada $1 https://orcid.org/0000000223875219
- 700 1_
- $a Cole, Scott N $u School of Education, Language and Psychology, York St John University, York, UK
- 700 1_
- $a Dominik, Tomáš $u Institute for Interdisciplinary Brain and Behavioral Sciences, Chapman University, Orange, CA, USA $1 https://orcid.org/0000000330048710 $7 xx0230746
- 700 1_
- $a Giner-Sorolla, Roger $u School of Psychology, University of Kent, Canterbury, UK $1 https://orcid.org/0000000266908842
- 700 1_
- $a Gok, Sebahat $u Program in Cognitive Science, Department of Instructional Systems Technology, Indiana University, Bloomington, IN, USA
- 700 1_
- $a Heyman, Tom $u Methodology and Statistics Unit, Institute of Psychology, Leiden University, Leiden, the Netherlands $1 https://orcid.org/000000030565441X
- 700 1_
- $a Jekel, Marc $u Social Psychology, University of Cologne, Cologne, Germany $1 https://orcid.org/0000000291460306
- 700 1_
- $a Luke, Timothy J $u Department of Psychology, University of Gothenburg, Gothenburg, Sweden $1 https://orcid.org/0000000255136605
- 700 1_
- $a Mitchell, David B $u WellStar College of Health and Human Services, Kennesaw State University, Kennesaw, GA, USA
- 700 1_
- $a Peels, Rik $u Philosophy Department and the Faculty of Religion and Theology, Vrije Universiteit, Amsterdam, The Netherlands $1 https://orcid.org/0000000181075992 $7 xx0237147
- 700 1_
- $a Pendrous, Rosina $u Centre for Contextual Behavioural Science, School of Psychology, University of Chester, Chester, UK $u Institute of Applied Health Research, University of Birmingham, Birmingham, UK $1 https://orcid.org/0000000290859876
- 700 1_
- $a Sarrazin, Samuel $u Maison de santé pluridisciplinaire Pasteur, Chevilly-Larue, France
- 700 1_
- $a Schauer, Jacob M $u Department of Preventive Medicine - Division of Biostatistics, Feinberg School of Medicine, Northwestern University, Chicago, IL, USA $1 https://orcid.org/0000000290417082
- 700 1_
- $a Specker, Eva $u Department of Cognition, Emotion, and Methods in Psychology, Faculty of Psychology, University of Vienna, Vienna, Austria $1 https://orcid.org/000000030836045X
- 700 1_
- $a Tran, Ulrich S $u Department of Cognition, Emotion, and Methods in Psychology, Faculty of Psychology, University of Vienna, Vienna, Austria $1 https://orcid.org/0000000265893167
- 700 1_
- $a Vranka, Marek A $u Faculty of Social Sciences, Charles University, Prague, Czech Republic $1 https://orcid.org/0000000334139062 $7 hka2017945226
- 700 1_
- $a Wicherts, Jelte M $u Department of Methodology and Statistics, Tilburg University, Tilburg, The Netherlands $1 https://orcid.org/0000000324152933
- 700 1_
- $a Yoshimura, Naoto $u Research Organization of Open Innovation and Collaboration, Ritsumeikan University, Osaka, Japan $u Research Fellow of the Japan Society for the Promotion of Science, Erasmus University Rotterdam, Rotterdam, The Netherlands $1 https://orcid.org/0000000226564432
- 700 1_
- $a Zwaan, Rolf A $u Department of Psychology, Education, and Child Studies, Erasmus University Rotterdam, Rotterdam, The Netherlands $1 https://orcid.org/0000000199677879
- 700 1_
- $a van Ravenzwaaij, Don $u Department of Psychometrics and Statistics, Rijksuniversiteit Groningen, Groningen, The Netherlands $1 https://orcid.org/0000000250304091
- 773 0_
- $w MED00188140 $t Royal Society open science $x 2054-5703 $g Roč. 10, č. 2 (2023), s. 210586
- 856 41
- $u https://pubmed.ncbi.nlm.nih.gov/36756069 $y Pubmed
- 910 __
- $a ABA008 $b sig $c sign $y p $z 0
- 990 __
- $a 20230413 $b ABA008
- 991 __
- $a 20230421100027 $b ABA008
- 999 __
- $a ok $b bmc $g 1922754 $s 1189244
- BAS __
- $a 3
- BAS __
- $a PreBMC-PubMed-not-MEDLINE
- BMC __
- $a 2023 $b 10 $c 2 $d 210586 $e 20230201 $i 2054-5703 $m Royal Society open science $n R Soc Open Sci $x MED00188140
- LZP __
- $a Pubmed-20230413
