Development and validation of an algorithm using health administrative data to define patient attachment to primary care providers
Bibliographic record
Abstract
PURPOSE: The authors developed and validated an algorithm using health administrative data to identify patients who are attached or uncertainly attached to a primary care provider (PCP) using patient responses to a survey conducted in Ontario, Canada. DESIGN/METHODOLOGY/APPROACH: The authors conducted a validation study using as a reference standard respondents to a community-based survey who indicated they did or did not have a PCP. The authors developed and tested health administrative algorithms against this reference standard. The authors calculated the sensitivity, specificity positive predictive value (PPV) and negative predictive value (NPV) on the final patient attachment algorithm. The authors then applied the attachment algorithm to the 2017 Ontario population. FINDINGS: The patient attachment algorithm had an excellent sensitivity (90.5%) and PPV (96.8%), though modest specificity (46.1%) and a low NPV (21.3%). This means that the algorithm assigned survey respondents as being attached to a PCP and when in fact they said they had a PCP, yet a significant proportion of those found to be uncertainly attached had indicated they did have a PCP. In 2017, most people in Ontario, Canada (85.4%) were attached to a PCP but 14.6% were uncertainly attached. RESEARCH LIMITATIONS/IMPLICATIONS: Administrative data for nurse practitioner's encounters and other interprofessional care providers are not currently available. The authors also cannot separately identify primary care visits conducted in walk in clinics using our health administrative data. Finally, the definition of hospital-based healthcare use did not include outpatient specialty care. PRACTICAL IMPLICATIONS: Uncertain attachment to a primary health care provider is a recurrent problem that results in inequitable access in health services delivery. Providing annual reports on uncertainly attached patients can help evaluate primary care system changes developed to improve access. This algorithm can be used by health care planners and policy makers to examine the geographic variability and time trends of the uncertainly attached population to inform the development of programs to improve primary care access. SOCIAL IMPLICATIONS: As primary care is an essential component of a person's medical home, identifying regions or high need populations that have higher levels of uncertainly attached patients will help target programs to support their primary care access and needs. Furthermore, this approach will be useful in future research to determine the health impacts of uncertain attachment to primary care, especially in view of a growing body of the literature highlighting the importance of primary care continuity. ORIGINALITY/VALUE: This patient attachment algorithm is the first to use existing health administrative data validated with responses from a patient survey. Using patient surveys alone to assess attachment levels is expensive and time consuming to complete. They can also be subject to poor response rates and recall bias. Utilizing existing health administrative data provides more accurate, timely estimates of patient attachment for everyone in the population.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame distilled prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.
Codex and Gemma teacher scores by category
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.001 | 0.000 |
| Meta-epidemiology (narrow) | 0.000 | 0.000 |
| Meta-epidemiology (broad) | 0.000 | 0.000 |
| Bibliometrics | 0.000 | 0.000 |
| Science and technology studies | 0.001 | 0.000 |
| Scholarly communication | 0.000 | 0.000 |
| Open science | 0.000 | 0.000 |
| Research integrity | 0.000 | 0.000 |
| Insufficient payload (model declined to judge) | 0.000 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one teacher head, not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".