MétaCan
Menu
← Back to cohort
Record W4411452382 · doi:10.2196/70472

Comparing the Accuracy of Different Wearable Activity Monitors in Patients With Lung Cancer and Providing Initial Recommendations: Protocol for a Pilot Validation Study

2025· article· en· W4411452382 on OpenAlexvenueno aff
Roberto M. Benzo, R. B. Singh, Carolyn J. Presley, Macy K Tetrick, Zachary L. Chaplow, Chloe M. Hery, Jane Yu, Peter Washington, Frank J. Penedo, Electra D. Paskett, Vipul Lugade, Emma Fortune

Bibliographic record

VenueJMIR Research Protocols · 2025
Typearticle
Languageen
FieldMedicine
TopicCancer survivorship and care
Canadian institutionsnot available
Fundersnot available
KeywordsWearable computerProtocol (science)MedicineWearable technologyPhysical medicine and rehabilitationActivity monitorPhysical therapyPhysical activityComputer scienceEmbedded system

Abstract

fetched live from OpenAlex

BACKGROUND: Wearable activity monitors (WAMs) provide insights into physical activity (PA) and are widely used in behavioral interventions and cancer survivorship research. However, validation studies of wearable devices in populations with cancer are scarce, and existing studies using activity monitors in patients with cancer lack standardization. This gap is particularly significant in patients with lung cancer (LC), who often experience unique mobility challenges and gait impairments that may affect device accuracy. This study addresses this gap by validating the Fitbit Charge 6, ActiGraph LEAP, and activPAL3 micro in patients with LC in both laboratory and free-living conditions and developing a standardized framework for assessing wearable devices in populations with cancer and impaired mobility. OBJECTIVE: This study aims to validate and compare the accuracy of consumer-grade (Fitbit Charge 6) and research-grade (activPAL3 micro and ActiGraph LEAP) WAMs in patients with LC under both laboratory and free-living conditions. Moreover, this protocol aims to establish standardized procedures that can be adapted for validating current and future generations of wearable devices while accounting for disease-specific factors that may impact measurement accuracy. METHODS: In total, 15 adults diagnosed with LC (stages 1-4) will participate in laboratory and free-living protocols, wearing Fitbit Charge 6, activPAL3 micro, and ActiGraph LEAP devices simultaneously. The laboratory protocol will consist of a series of structured activities, including variable-time walking trials, sitting and standing tests, posture changes, and gait speed assessments. Activities will be video recorded for validation. In the free-living protocol, participants will wear the devices continuously for 7 days except during water-based activities. WAM-based outcome measures will include step count; time spent at light, moderate, and vigorous PA intensity levels; posture; and posture changes (only the activPAL3 micro measured posture). Validated survey instruments will be administered both before and after WAM data collection to control for potential confounding factors that may influence movement patterns and device accuracy. Laboratory-based validity measures will compare WAM data to video-recorded observations. Sensitivity, specificity, positive predictive value, and agreement will also be determined. Free-living agreement between devices will be assessed using Bland-Altman plots, intraclass correlation analysis, and 95% limits of agreement. RESULTS: Data collection is ongoing, with 11 participants enrolled and 7 (64%) having completed both in-laboratory and free-living protocols. On average, enrolled participants are aged 63.0 (SD 7.8; range 50.0-73.0) years, with 8 (73%) participants being women. Participant enrollment is expected to conclude in mid-2025, and initial findings are expected to be disseminated by the end of 2025. CONCLUSIONS: This is the first study that validates WAM accuracy for populations with LC while providing comprehensive recommendations for future validation studies. This study will provide critical insights into the accuracy and reliability of WAMs for assessing PA in LC survivors, which are essential for interpreting clinical research and informing future interventions. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): DERR1-10.2196/70472.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.051
metaresearch head score (Gemma)0.062
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesnone
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Not applicable · Consensus signal: none
GenreCandidate signal: Protocol · Consensus signal: Protocol
Teacher disagreement score0.051
Threshold uncertainty score0.269

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.0510.062
Meta-epidemiology (narrow)0.0030.002
Meta-epidemiology (broad)0.0040.005
Bibliometrics0.0020.002
Science and technology studies0.0030.002
Scholarly communication0.0020.002
Open science0.0030.003
Research integrity0.0040.004
Insufficient payload (model declined to judge)0.0210.006

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.289
GPT teacher head0.578
Teacher spread0.289 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.

The models applied no category: nothing in the taxonomy fit this work.
Study designNot applicable
Domainnot available
GenreProtocol

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations4
Published2025
Admission routes1
Has abstractyes

Explore more

Same venueJMIR Research Protocols→Same topicCancer survivorship and care→French-language works237,207→