Estimating the completeness of physician billing claims: an application of three-source capture-recapture methods
Bibliographic record
Abstract
Background: Physician billing claims data contain information about services provided to patients. Fee-for-service (FFS) and non-fee-for-service (NFFS) physicians both submit claims; however, physician billing claims data may not comprehensively capture patient contacts from NFFS physicians who do not submit parallel claims (i.e., shadow bill). Capture-recapture (CR) methods, which were first developed in ecology research to estimate animal population size, have been proposed to estimate the number of missed claims. Our objective was to use three-source CR methods to estimate the completeness of physician billing claims data in Manitoba. Methods: Log-linear regression (LLR) and multinomial logistic regression (MLR) models for three-source CR methods were investigated. Using computer simulation, the LLR and MLR models were compared using percent bias (PB) and 95% confidence interval (CI) coverage for correctly specified and misspecified models in the presence of heterogeneity of capture probability and data source dependence. The methods were applied to Manitoba’s administrative health data to estimate the number of cancer cases diagnosed by FFS and NFFS physicians. The Manitoba Cancer Registry was used to validate the estimates. Results: Both the LLR and MLR models had low PB and acceptable 95% CI coverage for the correctly specified model under all simulation scenarios. However, the MLR model had less bias and better coverage when there was dependence among sources and covariates. The numeric example, the study cohort was comprised of 3,331 individuals. A total of 1,747 (52.4%) individuals were seen by a FFS physician and 1,584 (47.6%) individuals seen by a NFFS physician. The best-fit model for the LLR model estimated FFS physicians missed 819 (31.9%) cases while the model estimated NFFS physicians missed 1,086 (40.4%) cases. The best-fit MLR model estimated FFS physician missed 798 (31.5%) cases and estimated NFFS physicians missed 976 (39.7%) cases. Conclusion: There remains uncertainty as to whether physician billing claims data is complete due to missed capture of claims from NFFS physicians, which can have consequences for disease surveillance. This research demonstrated the feasibility of using three-source CR methods and observed that NFFS physicians were estimated to miss more cancer cases than FFS physicians in administrative data.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame distilled prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.
Codex and Gemma teacher scores by category
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.001 | 0.000 |
| Meta-epidemiology (narrow) | 0.000 | 0.000 |
| Meta-epidemiology (broad) | 0.001 | 0.000 |
| Bibliometrics | 0.000 | 0.000 |
| Science and technology studies | 0.000 | 0.000 |
| Scholarly communication | 0.000 | 0.000 |
| Open science | 0.001 | 0.000 |
| Research integrity | 0.000 | 0.000 |
| Insufficient payload (model declined to judge) | 0.000 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one teacher head, not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".