Concordance of Occupational Exposure Assessment between the Canadian Job-Exposure Matrix (CANJEM) and Expert Assessment of Jobs Held by Women
Bibliographic record
Abstract
OBJECTIVES: To compare the exposure data generated by using the Canadian job-exposure matrix (CANJEM) with data generated by expert assessment, for jobs held by women. METHODS: We selected 69 occupational agents that had been assessed by experts for each of 3403 jobs held by 998 women in a population-based case-control study of lung cancer. We then assessed the same agents among the same jobs by linking their occupation codes to CANJEM and thereby derived probability of exposure to each of the agents in each job. To create binary exposure variables, we dichotomized probability of exposure using two cutpoints: 25 and 50% (referred to as CANJEM-25% and CANJEM-50%). Using jobs as units of observation, we estimated the prevalence of exposure to each selected agent using CANJEM-25% and CANJEM-50%, and using expert assessment. Further, using expert assessment as the gold standard, for each agent, we estimated CANJEM's sensitivity, specificity, and kappa. RESULTS: CANJEM-based prevalence estimates correlated well with the prevalences assessed by the experts. When comparing CANJEM-based exposure estimates with expert-based exposure estimates, sensitivity, specificity, and kappa varied greatly among agents, and between CANJEM-25% and CANJEM-50% probability of exposure. With CANJEM-25%, the median sensitivity, specificity, and kappa values were 0.49, 0.99, and 0.46, respectively. Analogously, with CANJEM-50%, the corresponding values were 0.26, 1.00, and 0.35, respectively. For the following agents, we observed high concordance between CANJEM- and expert-based assessments (sensitivity ≥0.70 and specificity ≥0.99): fabric dust, cotton dust, synthetic fibres, cooking fumes, soldering fumes, calcium carbonate, and tin compounds. We present concordance estimates for each of 69 agents. CONCLUSIONS: Concordance between CANJEM and expert assessment varied greatly by agents. Our results indicate which agents provide data that mimic best those obtained with expert assessment.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame distilled prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.
Codex and Gemma teacher scores by category
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.001 | 0.000 |
| Meta-epidemiology (narrow) | 0.000 | 0.000 |
| Meta-epidemiology (broad) | 0.000 | 0.000 |
| Bibliometrics | 0.000 | 0.000 |
| Science and technology studies | 0.000 | 0.000 |
| Scholarly communication | 0.000 | 0.000 |
| Open science | 0.000 | 0.000 |
| Research integrity | 0.000 | 0.000 |
| Insufficient payload (model declined to judge) | 0.000 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one teacher head, not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".