MétaCan
Menu
Back to cohort
Record W3174389136 · doi:10.1186/s12874-021-01330-w

How to analyze work productivity loss due to health problems in randomized controlled trials? A simulation study

2021· article· en· W3174389136 on OpenAlexafffund
Wei Zhang, Huiying Sun

Bibliographic record

VenueBMC Medical Research Methodology · 2021
Typearticle
Languageen
FieldHealth Professions
TopicWorkplace Health and Well-being
Canadian institutionsCentre for Advancing Health OutcomesUniversity of British Columbia
FundersMichael Smith Health Research BC
KeywordsCovariateProductivityStatisticsMathematicsRandomized controlled trialEconometricsMedicineSurgeryEconomics

Abstract

fetched live from OpenAlex

Abstract Background An increasing number of randomized controlled trials (RCTs) have measured the impact of interventions on work productivity loss. Productivity loss outcome is inflated at zero and max loss values. Our study was to compare the performance of five commonly used methods in analysis of productivity loss outcomes in RCTs. Methods We conducted a simulation study to compare Ordinary Least Squares (OLS), Negative Binominal (NB), two-part models (the non-zero part following truncated NB distribution or gamma distribution) and three-part model (the middle part between zero and max values following Beta distribution). The main number of observations each arm, N obs , that we considered were 50, 100 and 200. Baseline productivity loss was included as a covariate. Results All models performed similarly well when baseline productivity loss was set at the mean value. When baseline productivity loss was set at other values and N obs = 50 with ≤5 subjects having max loss, two-part models performed best if the proportion of zero loss> 50% in at least one arm and otherwise, OLS performed best. When N obs = 100 or 200, the three-part model performed best if the two arms had equal scale parameters for their productivity loss outcome distributions between zero and max values. Conclusions Our findings suggest that when treatment effect at any given values of one single covariate is of interest, the model selection depends on the sample size, the proportions of zero loss and max loss, and the scale parameter for the productivity loss outcome distribution between zero and max loss in each arm of RCTs.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Direct model labels (unvalidated)

Per-model category and study-design labels from the labeling rounds. They are machine output, unvalidated, and the disagreement between models ships as data. No study design here is MEDLINE-validated yet.

Model armCategoriesStudy designConfidence
gemmaMetaresearch
Domain: Methods · Genre: Empirical
About the Canadian research system: no · About a Canadian topic: no
Simulation or modelinghigh
gptMetaresearch
Domain: Methods · Genre: Methods
About the Canadian research system: no · About a Canadian topic: no
Simulation or modelinghigh
models agreeAgreement compares identical category sets and study designs across arms.

Full frame distilled prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.

metaresearch head score (Codex)0.612
metaresearch head score (Gemma)0.891
Version: codex-gemma-dda1882f352aValidation status: machine_predicted_unvalidated
Candidate categoriesMetaresearch, Research integrity, Insufficient payload (model declined to judge)
Consensus categoriesMetaresearch
DomainCandidate signal: Methods · Consensus signal: Methods
Study designCandidate signal: Randomized trial · Consensus signal: Randomized trial
GenreCandidate signal: Empirical · Consensus signal: none
Teacher disagreement score0.629
Threshold uncertainty score1.000

Codex and Gemma teacher scores by category

CategoryCodexGemma
Metaresearch0.6120.891
Meta-epidemiology (narrow)0.0000.000
Meta-epidemiology (broad)0.0090.000
Bibliometrics0.0010.004
Science and technology studies0.0010.000
Scholarly communication0.0000.000
Open science0.0010.001
Research integrity0.0010.004
Insufficient payload (model declined to judge)0.0010.000

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.535
GPT teacher head0.640
Teacher spread0.104 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Labeled directly by 2 models reading the full record.

Study designSimulation or modeling
DomainMethods
GenreEmpirical · Methods

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations14
Published2021
Admission routes2
Has abstractyes

Explore more

Same venueBMC Medical Research MethodologySame topicWorkplace Health and Well-beingCategoryMetaresearchFrench-language works237,207