MétaCan
Menu
Retour à la cohorte
Enregistrement W2124388387 · doi:10.15537/1658-3175.3561

Ensuring the quality of peer-review process

2006· article· en· W2124388387 sur OpenAlex
Mustafa Afifi

Pourquoi ce travail est dans la base

Une base qui oublie comment elle a trouvé un travail ne peut pas être vérifiée. Voici les voies qui ont admis celui-ci.

aboutLe titre ou le résumé porte un signal canadien du lexique géographique.
no affAucune affiliation canadienne : ce travail est invisible pour une base fondée sur la seule affiliation.
Aucune affiliation canadienne. Une base fondée sur la seule affiliation (le devis habituel) n'aurait jamais vu ce travail. C'est l'un des travaux qui justifient l'inversion de la base.

Notice bibliographique

RevueSaudi Medical Journal · 2006
Typearticle
Langueen
DomaineArts and Humanities
ThématiqueAcademic Writing and Publishing
Établissements canadiensnon disponible
Organismes subventionnairesnon disponible
Mots-clésMedicineProtocol (science)Ask pricePeer reviewQuality (philosophy)Psychological interventionMedical educationProcess (computing)Value (mathematics)Internet privacyAlternative medicineNursingComputer sciencePathology

Résumé

récupéré en direct d'OpenAlex

I have recently noticed that the Saudi Medical Journal adopted “ask first” protocol to recruit referees. “Asking first” by query potential reviewers before sending manuscriptsis an alternative protocol to “just send” where reviewers are allowed to opt out. Actually, that motivated me to search for the studies, which have evaluated interventions that try to improve peer review. Smith1 stated that “the problem of peer review is that we have a good evidence on its deficiencies and poor evidence on its benefits”. Hereafter, I am spotting the light on some studies, and proposing some ideas to ensure the quality of the peer review process in the journal we all value highly. Pitkin and Burmeister2 concluded in their study that “ask first” led to a higher rate of referee turndown than did “just send” (15%, 8%, respectively). However, assenting “ask first” referees completed reviews faster, albeit the overall time for the review process did not differ between the two protocols. Hence, the authors concluded that they found no indication that soliciting in advance affected review quality.2 The effects of short training packages on quality of peer review was studied by Schroter et al.3 The one full day of face to face training package had only a slight impact on the quality of peer review in terms of quality of reviews and detection of deliberate major errors. However, the training did influence reviewers’ recommendations to editors. The authors recommended that the value of longer interventions need to be assisted.3 Others studied the feasibility of using a fictitious manuscript to evaluate peer reviewers performance. Smith1 mentioned that editors of the BMJ took a paper about to be published in the BMJ, inserted 8 deliberate errors, and sent the paper to 420 potential reviewers: 221 (53%) responded. The median number of errors spotted was 2, nobody spotted more than 5, and 16% did not spot any.1 In a similar study by Baxt et al4 in the Annals of Emergency Medicine (Ann Emerg Med) peer reviewers in this study failed to identify two thirds of the major errors in a fictitious manuscript. Therefore, they concluded that the use of a preconceived manuscript into which purposeful errors are placed might be a viable approach to evaluate reviewer performance.4 Errors in references in manuscripts submitted for publication are common. Browne et al5 showed that over half of all references included in manuscripts submitted to radiology journals contain at least one error.5 Therefore, another approach to study the reviewers’ performance is through testing the agreement between reviewers and editors in detecting errors in references in a sample of manuscripts accepted for publication. As in all quality talks, we could not neglect satisfaction. Weber et al6 studied the differences in satisfaction between authors whose manuscripts were accepted, reviewed and rejected by the Ann Emerg Med. Contributor satisfaction with peer review was modest. Authors of rejected manuscripts were dissatisfied with the time to decision and communication from the editor. Author satisfaction is associated with acceptance but not with review quality. Authors with more publication experience expressed less satisfaction with the peer review process.6 Also, the Saudi Medical Journal could analyze a representative sample of peer review material to compare the characteristics and the different types of comments amongst accepted and rejected manuscripts. Turcotte et al7 conducted a similar study for the Canadian Journal of Anesthesia (CJA). The authors concluded the most important aspects that influence acceptance or rejection of manuscripts submitted to CJA, namely the originality of the study, appropriate study design, and the relationship between experimental designs, results and conclusions.7 Improving authors’ as well as reviewers’ awareness of these aspects definitely ensure the quality of submitted articles and the quality of peer review process.

Récupéré en direct depuis OpenAlex et désinversé. Les résumés ne sont pas conservés dans cette base de données : les index inversés représentent 8,6 Go des 9,3 Go de texte de la base, et le serveur dispose de 13 Go libres.

Prédiction distillée sur la base complète

Imitation des enseignants

Ni prévalence calibrée, ni vérité terrain. Validation humaine à venir. Apprise à partir de 10 348 étiquettes directes de Codex et de 10 348 étiquettes directes de Gemma. Le mode candidate est l'union des têtes enseignantes seuillées; le consensus est leur intersection. Ces sorties portent le statut machine_predicted_unvalidated et ne sont ni des étiquettes humaines ni des étiquettes directes de modèles de pointe.

score de la tête « metaresearch » (Codex)0,007
score de la tête « metaresearch » (Gemma)0,003
Version: codex-gemma-dda1882f352aStatut de validation: machine_predicted_unvalidated
Catégories candidatesCharge utile insuffisante (le modèle a refusé de juger)
Catégories consensuellesaucune
DomaineSignal candidat: aucune · Signal consensuel: aucune
Devis d'étudeSignal candidat: Sans objet · Signal consensuel: Sans objet
GenreSignal candidat: Empirique · Signal consensuel: aucune
Score de désaccord entre enseignants0,796
Score d'incertitude au seuil0,998

Scores Codex et Gemma par catégorie

CatégorieCodexGemma
Métarecherche0,0070,003
Méta-épidémiologie (sens strict)0,0000,000
Méta-épidémiologie (sens large)0,0000,000
Bibliométrie0,0000,000
Études des sciences et des technologies0,0000,000
Communication savante0,0000,000
Science ouverte0,0000,000
Intégrité de la recherche0,0000,001
Charge utile insuffisante (le modèle a refusé de juger)0,0030,000

Scores machine (provisoires)

Les deux têtes enseignantes du modèle étudiant, lues sur ce travail. Un score ordonne la base pour la relecture; il n'affirme jamais une catégorie, et le statut de validation accompagne chaque rangée tel quel.

Scores de référence d'un modèle non mature (critères de maturité non atteints, 7 itérations). Un score ordonne; il n'affirme jamais une catégorie.

Tête enseignante Opus0,070
Tête enseignante GPT0,348
Écart entre enseignants0,278 · la distance entre les deux têtes enseignantes sur ce seul travail
Statut de validationscore_only:v0-immature-baseline · tel quel depuis la passe de notation : score_only signifie que le nombre peut ordonner les travaux, et qu'aucune étiquette de catégorie n'en découle