Using electronic consultation (eConsult) to identify frailty in provider-to-provider communication: a feasibility and validation study
Bibliographic record
Abstract
BACKGROUND: Frailty is a complex age-related clinical condition that increases vulnerability to stressors. Early recognition of frailty is challenging. While primary care providers (PCPs) serve as the first point of contact for most older adults, convenient tools for identifying frailty in primary care are lacking. Electronic consultation (eConsult), a platform connecting PCPs to specialists, is a rich source of provider-to-provider communication data. Text-based patient descriptions on eConsult may provide opportunities for earlier identification of frailty. We sought to explore the feasibility and validity of identifying frailty status using eConsult data. METHODS: eConsult cases closed in 2019 and submitted on behalf of long-term care (LTC) residents or community-dwelling older adults were sampled. A list of frailty-related terms was compiled through a review of the literature and consultation with experts. To identify frailty, eConsult text was parsed to measure the frequency of frailty-related terms. Feasibility of this approach was assessed by examining the availability of frailty-related terms in eConsult communication logs, and by asking clinicians to indicate whether they can assess likelihood of frailty by reviewing the cases. Construct validity was assessed by comparing the number of frailty-related terms in cases about LTC residents with those about community-dwelling older adults. Criterion validity was assessed by comparing clinicians' ratings of frailty to the frequency of frailty-related terms. RESULTS: One hundred thirteen LTC and 112 community cases were included. Frailty-related terms identified per case averaged 4.55 ± 3.95 in LTC and 1.96 ± 2.68 in the community (p < .001). Clinicians consistently rated cases with ≥ 5 frailty-related terms as highly likely of living with frailty. CONCLUSIONS: The availability of frailty-related terms establishes the feasibility of using provider-to-provider communication on eConsult to identify patients with high likelihood of living with this condition. The higher average of frailty-related terms in LTC (versus community) cases, and agreement between clinician-provided frailty ratings and the frequency of frailty-related terms, support the validity of an eConsult-based approach to identifying frailty. There is potential for eConsult to be used as a case-finding tool in primary care for early recognition and proactive initiation of care processes for older patients living with frailty.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame machine prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.
Distilled classifier scores by category (both heads)
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.040 | 0.085 |
| Meta-epidemiology (narrow) | 0.001 | 0.001 |
| Meta-epidemiology (broad) | 0.001 | 0.002 |
| Bibliometrics | 0.003 | 0.002 |
| Science and technology studies | 0.001 | 0.002 |
| Scholarly communication | 0.002 | 0.003 |
| Open science | 0.002 | 0.003 |
| Research integrity | 0.002 | 0.002 |
| Insufficient payload (model declined to judge) | 0.003 | 0.001 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".