An Open, Large-Scale, Collaborative Effort to Estimate the Reproducibility of Psychological Science
Why is this work in the frame?
A frame that forgets how it found something cannot be audited. These are the routes that admitted this work.
No Canadian affiliation. An affiliation-only frame — the usual design — would never have seen this work. It is one of the works that make the case for inverting the frame.
Machine scores (provisional)
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
- Teacher spread
- 0.101 · how far apart the two teachers sit on this one work
- Validation status
score_only:v0-immature-baseline· verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it
Abstract
Reproducibility is a defining feature of science. However, because of strong incentives for innovation and weak incentives for confirmation, direct replication is rarely practiced or published. The Reproducibility Project is an open, large-scale, collaborative effort to systematically examine the rate and predictors of reproducibility in psychological science. So far, 72 volunteer researchers from 41 institutions have organized to openly and transparently replicate studies published in three prominent psychological journals in 2008. Multiple methods will be used to evaluate the findings, calculate an empirical rate of replication, and investigate factors that predict reproducibility. Whatever the result, a better understanding of reproducibility will ultimately improve confidence in scientific methodology and findings.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
The record
- Venue
- Perspectives on Psychological Science
- Topic
- Meta-analysis and systematic reviews
- Field
- Decision Sciences
- Canadian institutions
- —
- Funders
- California State University, NorthridgeUniversity of California, San FranciscoDirectorate for Biological SciencesDalhousie UniversityUniversität zu KölnKeele UniversityMichigan State UniversityRheinische Friedrich-Wilhelms-Universität BonnCollege of Engineering, Michigan State UniversityPrinceton UniversityUniversity of WashingtonUniversidad Nacional de AsunciónUniversità degli Studi di PadovaUniversität ErfurtTechnische Universiteit EindhovenUniversity of Texas at San AntonioUniversità degli Studi di Milano-BicoccaUniversity of South AlabamaUniversiteit van TilburgVirginia Commonwealth UniversityUniversity of Southern CaliforniaReed CollegeBard CollegeUniversity of BristolCarnegie Mellon UniversityUniversität GreifswaldWestern Washington UniversityMassachusetts Institute of Technology
- Keywords
- ReproducibilityReplication (statistics)ReplicateOpen scienceIncentiveScale (ratio)PsychologyApplied psychologyComputer scienceStatistics
- Has abstract in OpenAlex
- yes