MétaCan
Menu
Back to cohort
Record W3091293017 · doi:10.1016/j.obhdp.2020.07.002

Creative destruction in science

2020· article· en· W3091293017 on OpenAlex

Why this work is in the frame

A frame that forgets how it found something cannot be audited. These are the routes that admitted this work.

fundA Canadian funder is recorded on the work.
no affNo Canadian affiliation: this work is invisible to an affiliation-only frame.
No Canadian affiliation. An affiliation-only frame, the usual design, would never have seen this work. It is one of the works that make the case for inverting the frame.

Bibliographic record

VenueOrganizational Behavior and Human Decision Processes · 2020
Typearticle
Languageen
FieldSocial Sciences
TopicClimate Change Communication and Perception
Canadian institutionsnot available
FundersCalifornia State University, FresnoHarvard Kennedy SchoolUniversity of California, Santa BarbaraTechnische Universität DortmundSingapore Management UniversityUniversität KasselUniversität KonstanzStockholms UniversitetSchool of Psychology, Cardiff UniversityUniversidade Federal de SergipeUniversiteit van TilburgSyddansk UniversitetMemorial University of NewfoundlandUniversità degli Studi dell'InsubriaMax-Planck-Institut für Kognitions- und NeurowissenschaftenBen-Gurion University of the NegevKnut och Alice Wallenbergs StiftelseUniversitetet i BergenLinköpings UniversitetKU LeuvenUniversiteit MaastrichtUniversité de GenèveVrije Universiteit AmsterdamRadboud UniversiteitRijksuniversiteit GroningenUniversity of WarwickTrinity College DublinUniversity of OtagoNorthern Illinois UniversityUniversity of LimerickTechnische Universiteit EindhovenUniversity of AucklandUniversidad de AlicanteCardiff UniversityAriel UniversityDe Montfort UniversityUniversity of TorontoMacquarie UniversityUniversity of AlbertaUniversiteit van AmsterdamUniversity of ChittagongTechnion-Israel Institute of TechnologyUniversidad de La LagunaTrinity Western UniversityUniversität WienAmerican University of SharjahSlovenská Akadémia ViedToulouse School of EconomicsCentral Queensland UniversityUniverzita Karlova v PrazeUniversity College DublinUniversity of EssexCarnegie Mellon UniversityWestern Kentucky UniversityKingston UniversityUniversity of ReginaKing's College LondonIndian Institute of Technology DelhiUniversiteit GentGeorgia Southern UniversityLouisiana State UniversityLunds UniversitetPennsylvania State UniversityUniversity of CincinnatiKarolinska InstitutetYale UniversityUniversity of QueenslandEmory UniversityTulane UniversityNational University of SingaporeJulius-Maximilians-Universität WürzburgUniversity of Texas at AustinLoyola University ChicagoInternational Research and Exchanges BoardUniwersytet Śląski w KatowicachUniversity of WashingtonLoughborough UniversityUniwersytet WrocławskiTechnische Universität DresdenUniversity of PennsylvaniaNational Research University Higher School of EconomicsUmeå UniversitetUniversity of DenverFordham UniversityUniversity of OxfordJan Wallanders och Tom Hedelius Stiftelse samt Tore Browaldhs StiftelseFlorida State UniversityYork UniversityUniversity of Missouri
KeywordsPsychologySocial psychology

Abstract

fetched live from OpenAlex

Drawing on the concept of a gale of creative destruction in a capitalistic economy, we argue that initiatives to assess the robustness of findings in the organizational literature should aim to simultaneously test competing ideas operating in the same theoretical space. In other words, replication efforts should seek not just to support or question the original findings, but also to replace them with revised, stronger theories with greater explanatory power. Achieving this will typically require adding new measures, conditions, and subject populations to research designs, in order to carry out conceptual tests of multiple theories in addition to directly replicating the original findings. To illustrate the value of the creative destruction approach for theory pruning in organizational scholarship, we describe recent replication initiatives re-examining culture and work morality, working parents’ reasoning about day care options, and gender discrimination in hiring decisions. It is becoming increasingly clear that many, if not most, published research findings across scientific fields are not readily replicable when the same method is repeated. Although extremely valuable, failed replications risk leaving a theoretical void— reducing confidence the original theoretical prediction is true, but not replacing it with positive evidence in favor of an alternative theory. We introduce the creative destruction approach to replication, which combines theory pruning methods from the field of management with emerging best practices from the open science movement, with the aim of making replications as generative as possible. In effect, we advocate for a Replication 2.0 movement in which the goal shifts from checking on the reliability of past findings to actively engaging in competitive theory testing and theory building. The materials, code, and data for this article are posted publicly on the Open Science Framework, with links provided in the article.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

Full frame distilled prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.

metaresearch head score (Codex)0.000
metaresearch head score (Gemma)0.001
Version: codex-gemma-dda1882f352aValidation status: machine_predicted_unvalidated
Candidate categoriesInsufficient payload (model declined to judge)
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Observational · Consensus signal: Observational
GenreCandidate signal: Empirical · Consensus signal: Empirical
Teacher disagreement score0.168
Threshold uncertainty score0.999

Codex and Gemma teacher scores by category

CategoryCodexGemma
Metaresearch0.0000.001
Meta-epidemiology (narrow)0.0000.000
Meta-epidemiology (broad)0.0000.000
Bibliometrics0.0000.001
Science and technology studies0.0010.000
Scholarly communication0.0000.000
Open science0.0000.000
Research integrity0.0000.000
Insufficient payload (model declined to judge)0.0020.000

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.294
GPT teacher head0.453
Teacher spread0.159 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it