International Registered Reports Identifiers (IRRIDs): 7 Years of Experiences
Notice bibliographique
Résumé
Gunther Eysenbach<sup>1</sup> <h4>Objective</h4> Registered Reports (RRs) refer to the publication of a study that is published in 2 stages: a protocol (RR stage 1 or RR1) and a results paper (RR2). Some journals have adopted the RR system and guarantee acceptance of subsequent results articles published in the same journal after the protocol is peer reviewed. However, in a distributed open science ecosystem, protocols may already be peer reviewed and published elsewhere, but no standardized system exists to link protocols to subsequent results articles and vice versa. We implemented RRs across the publisher portfolio, with 1 dedicated journal to peer review and publish protocols, and the publisher guaranteeing acceptance of RR2s in 1 of its other journals independently based on whether the results were negative or positive. We propose a machine- and human-readable mechanism to link RR2s with RR1s to assist in peer review and to enhance transparency, accountability, and reproducibility. <h4>Design</h4> In 2018, we proposed and implemented a cross-journal, DOI-based, persistent identifier called an International Registered Report Identifier (IRRID) published in article abstracts. An RR2 references an RR1 using an identifier that is based on the DOI of the protocol. For example, RR2-10.2196/24264 indicates that the publication is a results article for a protocol that was previously published under the DOI 10.2196/24264.<sup>1</sup> Protocols that are peer reviewed contain the IRRIDs in the format [DE|P]RR1-[DOI], where [DOI] is the DOI of the protocol itself, and DE or P qualifiers indicate whether the protocol was written before [P] or after [DE] data collection. On submission of a protocol, authors were asked if the protocol was submitted before or after data were collected. Authors were incentivized to register their protocol by being offered a 20% discount on the Article Processing Charge on subsequent results articles. <h4>Results</h4> A total of 3995 articles were published with IRRIDs between 2018 and February 13, 2025, of which 3240 (81%) were protocols (RR1). Among the protocols, 2151 (66%) were published when data already existed (DERR1), and 917 (28%) were published before data were collected (PRR1). A total of 732 results articles had an RR2 identifier indicating previous protocol publication, although these protocols were not always peer reviewed (eg, OSF or <i>BMJ Open</i>). A third-party audit found that outcome switching and undeclared deviations from the protocol still remain a problem.<sup>2</sup> <h4>Conclusions</h4> We propose that other journals adopt IRRIDs to help identify protocol and results article pairs that together form RRs across journals (<a href="https://irridregistry.org/"><span class="Hyperlink CharOverride-6">https://irridregistry.org/</span></a>). <h4>References</h4> 1. What is an International Registered Report Identifier (IRRID)? JMIR Publications Knowledge Base and Help Center. Accessed February 13, 2025. <a href="https://support.jmir.org/hc/en-us/articles/360003797672-What-is-an-International-Registered-Report-Identifier-IRRID"><span class="Hyperlink CharOverride-6">https://support.jmir.org/hc/en-us/articles/360003797672-What-is-an-International-Registered-Report-Identifier-IRRID</span></a> 2. Anthony N, Tisseaux A, Naudet F. Published registered reports are rare, limited to one journal group, and inadequate for randomized controlled trials in the clinical field. <i>J Clin Epidemiol</i>. 2023;160:61-70. doi:10.1016/j.jclinepi.2023.05.016 <sup>1</sup>JMIR Publications, Toronto ON, Canada, geysenba@gmail.com. <h4>Conflict of Interest Disclosure </h4> Gunther Eysenbach has an equity stake in and receives a salary from JMIR Publications.
Récupéré en direct depuis OpenAlex et désinversé. Les résumés ne sont pas conservés dans cette base de données : les index inversés représentent 8,6 Go des 9,3 Go de texte de la base, et le serveur dispose de 13 Go libres.
Comment cette classification a été obtenuedéplier
Prédiction distillée sur la base complète
Imitation des enseignantsNi prévalence calibrée, ni vérité terrain. Validation humaine à venir. Apprise à partir de 10 348 étiquettes directes de Codex et de 10 348 étiquettes directes de Gemma. Le mode candidate est l'union des têtes enseignantes seuillées; le consensus est leur intersection. Ces sorties portent le statut machine_predicted_unvalidated et ne sont ni des étiquettes humaines ni des étiquettes directes de modèles de pointe.
Scores Codex et Gemma par catégorie
| Catégorie | Codex | Gemma |
|---|---|---|
| Métarecherche | 0,006 | 0,004 |
| Méta-épidémiologie (sens strict) | 0,001 | 0,001 |
| Méta-épidémiologie (sens large) | 0,001 | 0,000 |
| Bibliométrie | 0,005 | 0,005 |
| Études des sciences et des technologies | 0,000 | 0,016 |
| Communication savante | 0,001 | 0,001 |
| Science ouverte | 0,006 | 0,002 |
| Intégrité de la recherche | 0,001 | 0,001 |
| Charge utile insuffisante (le modèle a refusé de juger) | 0,018 | 0,001 |
Scores machine (provisoires)
Les deux têtes enseignantes du modèle étudiant, lues sur ce travail. Un score ordonne la base pour la relecture; il n'affirme jamais une catégorie, et le statut de validation accompagne chaque rangée tel quel.
Scores de référence d'un modèle non mature (critères de maturité non atteints, 7 itérations). Un score ordonne; il n'affirme jamais une catégorie.
score_only:v0-immature-baseline · tel quel depuis la passe de notation : score_only signifie que le nombre peut ordonner les travaux, et qu'aucune étiquette de catégorie n'en découleClassification
machine, non validéePrédiction automatique; les deux têtes enseignantes s’accordent sur ce qui est montré ici.
Le détail, modèle par modèle et score par score, se trouve en fin de page sous « Comment cette classification a été obtenue ».