MétaCan
Menu
Back to cohort
Record W2947766279 · doi:10.1186/s41073-019-0068-4

Measuring the data gap: inclusion of sex and gender reporting in diabetes research

2019· article· en· W2947766279 on OpenAlexafffund
Suzanne Day, Wei Wu, Robín Masón, Paula A. Rochon

Bibliographic record

VenueResearch Integrity and Peer Review · 2019
Typearticle
Languageen
FieldMedicine
TopicSex and Gender in Healthcare
Canadian institutionsCanada Research ChairsToronto Public HealthPublic Health OntarioWomen's College Hospital
FundersDiabetes Action CanadaUniversity of TorontoOntario Ministry of Health and Long-Term CareDiabetes Action Research and Education Foundation
KeywordsObservational studyDiabetes mellitusMedicineType 2 diabetesInclusion (mineral)Research designRandomized controlled trialSex characteristicsFamily medicinePsychologySocial psychologyInternal medicineSocial scienceEndocrinology

Abstract

fetched live from OpenAlex

BACKGROUND: Important sex and gender differences have been found in research on diabetes complications and treatment. Reporting on whether and how sex and gender impact research findings is crucial for developing tailored diabetes care strategies. To analyze the extent to which this information is available in current diabetes research, we examined original investigations on diabetes for the integration of sex and gender in study reporting. METHODS: We examined original investigations on diabetes published between January 1 and December 31, 2015, in the top five general medicine journals and top five diabetes-specific journals (by 2015 impact factor). Data were extracted on sex and gender integration across seven article sections: title, abstract, introduction, methods, results, discussion, and limitations. RESULTS: We identified 155 original investigations on diabetes, including 115 randomized controlled trials (RCTs) and 40 observational studies. Sex and gender were rarely incorporated in article titles, abstracts and introductions. Most methods sections did not describe plans for sex/gender analyses; 47 (30.3%) articles described plans to control for sex/gender in the analysis and 12 (7.7%) described plans to stratify results by sex/gender. While most articles (151, 97.4%) reported the sex/gender of study participants, only 10 (6.5%) of all articles reported all study outcomes separately by sex/gender. Discussion of sex-related issues was incorporated into 21 (13.5%) original investigations; however, just 1 (0.6%) discussed gender-related issues. Comparison by journal type (general medicine vs. diabetes specific) yielded only minor differences from the overall integration results. In contrast, RCTs performed more poorly on multiple sex/gender assessment metrics compared to observational studies. CONCLUSIONS: Sex and gender are poorly integrated in current diabetes original investigations, suggesting that substantial improvements in sex and gender data reporting are needed to inform the evidence to support sex- and gender-specific diabetes care.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Direct model labels (unvalidated)

Per-model category and study-design labels from the labeling rounds. They are machine output, unvalidated, and the disagreement between models ships as data. No study design here is MEDLINE-validated yet.

Model armCategoriesStudy designConfidence
gemmaMetaresearch
Domain: Reporting · Genre: Empirical
About the Canadian research system: no · About a Canadian topic: no
Observationallow
gptMetaresearch
Domain: Reporting · Genre: Empirical
About the Canadian research system: no · About a Canadian topic: no
Observationalhigh
models agreeAgreement compares identical category sets and study designs across arms.

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.619
metaresearch head score (Gemma)0.866
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesMetaresearch, Research integrity
Consensus categoriesMetaresearch
DomainCandidate signal: Reporting · Consensus signal: none
Study designCandidate signal: Observational · Consensus signal: none
GenreCandidate signal: Empirical · Consensus signal: none
Teacher disagreement score0.996
Threshold uncertainty score0.469

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.6190.866
Meta-epidemiology (narrow)0.0020.002
Meta-epidemiology (broad)0.0040.006
Bibliometrics0.0210.021
Science and technology studies0.0040.008
Scholarly communication0.0110.021
Open science0.0050.014
Research integrity0.0040.004
Insufficient payload (model declined to judge)0.0060.001

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.820
GPT teacher head0.592
Teacher spread0.228 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Labeled directly by 2 models reading the full record.

Study designObservational
DomainReporting
GenreEmpirical

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations28
Published2019
Admission routes2
Has abstractyes

Explore more

Same venueResearch Integrity and Peer ReviewSame topicSex and Gender in HealthcareCategoryMetaresearchFrench-language works237,207