MétaCan
Menu
Back to cohort
Record W3201393952 · doi:10.3897/ese.2021.e71728

Compliance with best practice guidelines on publication ethics: Where does Pharmactuel stand? A case study

2021· article· en· W3201393952 on OpenAlexaff
Christine Hamel, Julie Méthot, Louise Mallet

Bibliographic record

VenueEuropean Science Editing · 2021
Typearticle
Languageen
FieldMedicine
TopicEthics in Clinical Research
Canadian institutionsUniversité LavalInstitut universitaire de cardiologie et de pneumologie de QuébecUniversité de MontréalCentre Hospitalier Universitaire de SherbrookeMcGill University Health Centre
Fundersnot available
KeywordsMedical journalCompliance (psychology)Ethics committeeEditorial boardMedicinePolitical scienceLibrary scienceFamily medicinePsychologyPublic administrationComputer science

Abstract

fetched live from OpenAlex

Background: The Committee on Publication Ethics (COPE) and the International Committee of Medical Journal Editors (ICMJE) are two internationally recognised organisations in the field of publication ethics. Guidelines from these two organisations were updated in 2018. Obj ectives: To assess the extent to which the journal P h a r ma ctuel is compliant with the guidelines on publication ethics updated by ICMJE and COPE in 2018 and, where the journal is found  wanting, to take the necessary steps to make it compliant. Methods:   A list of updated criteria – 56 by ICMJE and 22 by COPE – was compiled. In January 2020, compliance with each of these criteria was evaluated by the editor-in-chief and validated by all six associate editors. The evaluation was followed by an action plan to improve compliance, and the evaluation was repeated in November 2020. Results: Of the 56 ICMJE criteria, P h a r ma ctuel was fully compliant with 31 and partly compliant with 10 criteria (a compliance rate of 73%, taking the two together). The corresponding figures for the 22 COPE criteria were 17, 3, and 91%. By modifying its editorial policies, training its associate editors, and creating appropriate guidelines for its editorial board and editors, P h a r ma ctuel achieved almost 100% compliance by the end of 2020. Conclusions: P h a r ma ctuel has been fully compliant with ICMJE and COPE recommendations since January 2021. Minor modifications to P h a r ma ctuel ’s publication process have enabled the editorial team to ensure that the journal continues to be almost totally compliant with COPE and ICMJE guidelines and to uphold its high ethical standards.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Direct model labels (unvalidated)

Per-model category and study-design labels from the labeling rounds. They are machine output, unvalidated, and the disagreement between models ships as data. No study design here is MEDLINE-validated yet.

Model armCategoriesStudy designConfidence
gemmaMetaresearchResearch integrity
Domain: Evaluation · Genre: Empirical
About the Canadian research system: no · About a Canadian topic: no
Qualitativelow
gptResearch integrity
Domain: not available · Genre: Empirical
About the Canadian research system: no · About a Canadian topic: no
Observationalhigh
models splitAgreement compares identical category sets and study designs across arms.

Full frame distilled prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.

metaresearch head score (Codex)0.049
metaresearch head score (Gemma)0.396
Version: codex-gemma-dda1882f352aValidation status: machine_predicted_unvalidated
Candidate categoriesMetaresearch, Science and technology studies, Research integrity
Consensus categoriesMetaresearch
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Not applicable · Consensus signal: none
GenreCandidate signal: Empirical · Consensus signal: Empirical
Teacher disagreement score0.480
Threshold uncertainty score1.000

Codex and Gemma teacher scores by category

CategoryCodexGemma
Metaresearch0.0490.396
Meta-epidemiology (narrow)0.0000.000
Meta-epidemiology (broad)0.0000.000
Bibliometrics0.0000.002
Science and technology studies0.0010.002
Scholarly communication0.0010.001
Open science0.0010.001
Research integrity0.0000.004
Insufficient payload (model declined to judge)0.0000.000

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.762
GPT teacher head0.660
Teacher spread0.102 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Labeled directly by 2 models reading the full record.

MetaresearchResearch integrity

The models disagree on parts of this classification; every voice is preserved in the section at the end of the page.

Study designQualitative · Observational
DomainEvaluation
GenreEmpirical

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations2
Published2021
Admission routes1
Has abstractyes

Explore more

Same venueEuropean Science EditingSame topicEthics in Clinical ResearchCategoryMetaresearchFrench-language works237,207