MétaCan
Menu
Back to cohort
Record W2937205465 · doi:10.1136/vetreco-2018-000322

Incomplete reporting of experimental studies and items associated with risk of bias in veterinary research

2019· article· en· W2937205465 on OpenAlexafffund
Maxime Rufiange, Frédérik Rousseau‐Blass, Daniel Pang

Bibliographic record

VenueVeterinary Record Open · 2019
Typearticle
Languageen
FieldDecision Sciences
TopicMeta-analysis and systematic reviews
Canadian institutionsUniversity of CalgaryUniversité de Montréal
FundersNatural Sciences and Engineering Research Council of CanadaUniversité de Montréal
KeywordsBlindingMedicineObservational studySample size determinationPublication biasFamily medicineVeterinary medicineConfidence intervalStatisticsClinical trialMathematicsPathologyInternal medicine

Abstract

fetched live from OpenAlex

In in vivo research, the reporting of core items of study design is persistently poor, limiting assessment of study quality and study reproducibility. This observational cohort study evaluated reporting levels in the veterinary literature across a range of species, journals and research fields. Four items (randomisation, sample size estimation, blinding and data exclusion) were assessed as well as availability of study data in publicly accessible repositories. From five general and five subject-specific journals, 120 consecutively published papers (12 per journal) describing in vivo experimental studies were selected. Item reporting was scored using a published scale (items ranked as fully, partially or not reported) according to completeness of reporting. Papers in subject-specific journals had higher median reporting levels (50.0 per cent vs 33.3 per cent, P=0.007). In subject-specific journals, randomisation (75.0 per cent vs 41.7 per cent, P=0.0002) and sample size estimation (35.0 per cent vs 16.7 per cent, P=0.025) reporting was approximately double that of general journals. Blinding (general 48.3 per cent, subject-specific 50.0 per cent, P=0.86) and data exclusion (general 53.3 per cent, subject-specific 63.3 per cent, P=0.27) were similarly reported. A single paper made study data readily accessible. Incomplete reporting remains prevalent in the veterinary literature irrespective of journal type, research subject or species. This impedes evaluation of study quality and reproducibility, raising concerns regarding wasted financial and animal resources.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame distilled prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.

metaresearch head score (Codex)0.166
metaresearch head score (Gemma)0.036
Version: codex-gemma-dda1882f352aValidation status: machine_predicted_unvalidated
Candidate categoriesMetaresearch
Consensus categoriesMetaresearch
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Observational · Consensus signal: Observational
GenreCandidate signal: Empirical · Consensus signal: Empirical
Teacher disagreement score0.130
Threshold uncertainty score0.972

Codex and Gemma teacher scores by category

CategoryCodexGemma
Metaresearch0.1660.036
Meta-epidemiology (narrow)0.0000.000
Meta-epidemiology (broad)0.0040.000
Bibliometrics0.0010.001
Science and technology studies0.0000.000
Scholarly communication0.0000.000
Open science0.0010.002
Research integrity0.0000.000
Insufficient payload (model declined to judge)0.0010.000

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.946
GPT teacher head0.644
Teacher spread0.302 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; both teacher heads agree on what is shown here.

Study designObservational
Domainnot available
GenreEmpirical

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations23
Published2019
Admission routes2
Has abstractyes

Explore more

Same venueVeterinary Record OpenSame topicMeta-analysis and systematic reviewsFrench-language works237,207