A feasibility study to explore the use of real‐time caregiver reports for people living with dementia at home to label multi‐modal sensor data
Bibliographic record
Abstract
Abstract Background Multi‐modal sensor systems, consisting of sensors throughout the home, are able to collect data on the person living with dementia’s (PlwD’s) activities. However, caregivers may have challenges interpreting the data, leading to a lack of actionable information. It’s important to get real‐time reports from caregivers to label the sensor data to build relevant machine learning algorithms; yet, this has not been done with PlwD. The aim of this feasibility study was to explore if the use of a multi‐modal sensor system in conjunction with real‐time caregiver reports can provide valuable insights into the daily lives of PlwD. Method We developed the MAISON (Multimodal AI‐based Sensor platform for Older Individuals) system and deployed it into the homes of dyads (PlwD and their family caregiver) for 8‐weeks. MAISON includes: a smartphone, a smartwatch to continuously collect heart rate, step, and accelerometer data to infer walking, and running, as well as a smart mattress that can collect sleep time and quality. A digital diary was added to the MAISON system that automatically sends the caregiver 2‐3 pre‐set questions every day about their loved one. Caregivers could also report any significant occurrences throughout the day, as they see fit, through the app. Result Two dyads were recruited to date. Only about 15% of data was missing from the sensor system by the end of the study. Caregivers were providing their reports with high adherence. The caregivers’ reports were used to label the sensor data successfully, and upon analysis, we found that caregivers’ reports were reflected in the sensor data and the labels derived from their reports were accurate. Results indicate this study methodology is an innovative approach to utilize the family caregiver’s reports. Conclusion This is the first longitudinal study to demonstrate the feasibility of a multi‐modal sensor system used by caregivers and PwlD. Findings show that caregivers' reports can be useful sources of data for labeling sensor data. The conjunction of caregiver reports and sensor data will provide valuable information to build accurate machine learning models about behaviors of PlwD which is a foundational step to support dyads at home using technology.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame machine prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.
Distilled classifier scores by category (both heads)
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.016 | 0.022 |
| Meta-epidemiology (narrow) | 0.001 | 0.001 |
| Meta-epidemiology (broad) | 0.001 | 0.001 |
| Bibliometrics | 0.001 | 0.000 |
| Science and technology studies | 0.001 | 0.001 |
| Scholarly communication | 0.001 | 0.002 |
| Open science | 0.001 | 0.002 |
| Research integrity | 0.001 | 0.001 |
| Insufficient payload (model declined to judge) | 0.005 | 0.001 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".