Supporting the Implementation of Connected Care Technologies in the Veterans Health Administration: Cross-Sectional Survey Findings from the Veterans Engagement with Technology Collaborative (VET-C) Cohort
Bibliographic record
Abstract
BACKGROUND: Widespread adoption, use, and integration of patient-facing technologies into the workflow of health care systems has been slow, thus limiting the realization of their potential. A growing body of work has focused on how best to promote adoption and use of these technologies and measure their impacts on processes of care and outcomes. This body of work currently suffers from limitations (eg, cross-sectional analyses, limited patient-generated data linked with clinical records) and would benefit from institutional infrastructure to enhance available data and integrate the voice of the patient into implementation and evaluation efforts. OBJECTIVE: The Veterans Health Administration (VHA) has launched an initiative called the Veterans Engagement with Technology Collaborative cohort to directly address these challenges. This paper reports the process by which the cohort was developed and describes the baseline data being collected from cohort members. The overarching goal of the Veterans Engagement with Technology Collaborative cohort is to directly engage veterans in the evaluation of new VHA patient-facing technologies and in so doing, to create new infrastructure to support related quality improvement and evaluation activities. METHODS: Inclusion criteria for veterans to be eligible for membership in the cohort included being an active user of VHA health care services, having a mobile phone, and being an established user of existing VHA patient-facing technologies as represented by use of the secure messaging feature of VHA's patient portal. Between 2017 and 2018, we recruited veterans who met these criteria and administered a survey to them over the telephone. RESULTS: The majority of participants (N=2727) were male (2268/2727, 83.2%), White (2226/2727, 81.6%), living in their own apartment or house (2519/2696, 93.4%), and had completed some college (1176/2701, 43.5%) or an advanced degree (1178/2701, 43.6%). Cohort members were 59.9 years old, on average. The majority self-reported their health status as being good (1055/2725, 38.7%) or very good (524/2725, 19.2%). Most cohort members owned a personal computer (2609/2725, 95.7%), tablet computer (1616/2716, 59.5%), and/or smartphone (2438/2722, 89.6%). CONCLUSIONS: The Veterans Engagement with Technology Collaborative cohort is an example of a VHA learning health care system initiative designed to support the data-driven implementation of patient-facing technologies into practice and measurement of their impacts. With this initiative, VHA is building capacity for future, rapid, rigorous evaluation and quality improvement efforts to enhance understanding of the adoption, use, and impact of patient-facing technologies.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame machine prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.
Distilled classifier scores by category (both heads)
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.004 | 0.011 |
| Meta-epidemiology (narrow) | 0.000 | 0.000 |
| Meta-epidemiology (broad) | 0.000 | 0.000 |
| Bibliometrics | 0.001 | 0.001 |
| Science and technology studies | 0.002 | 0.001 |
| Scholarly communication | 0.002 | 0.002 |
| Open science | 0.001 | 0.002 |
| Research integrity | 0.001 | 0.002 |
| Insufficient payload (model declined to judge) | 0.002 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".