MétaCan
Menu
← Back to cohort
Record W4405424685 · doi:10.2196/66049

Using Video Cameras to Assess Physical Activity and Other Well-Being Behaviors in Urban Environments: Feasibility, Reliability, and Participant Reactivity Studies

2024· article· en· W4405424685 on OpenAlexvenueno aff
Jack S. Benton, James Evans, Jamie Anderson, David French

Bibliographic record

VenueJMIR Public Health and Surveillance · 2024
Typearticle
Languageen
FieldMedicine
TopicPhysical Activity and Health
Canadian institutionsnot available
FundersEngineering and Physical Sciences Research CouncilUniversity of ManchesterWellcome Trust
KeywordsIntraclass correlationInter-rater reliabilityReliability (semiconductor)PsychologyApplied psychologyComputer sciencePsychometricsClinical psychologyDevelopmental psychologyRating scale

Abstract

fetched live from OpenAlex

BACKGROUND: Unobtrusive observation is a promising method for assessing physical activity and other well-being behaviors (eg, social interactions) in urban environments, without participant burden and biases associated with self-report. However, current methods require multiple in-person observers. Using video cameras instead could allow for more accurate observations at lower cost and with greater flexibility in scheduling. OBJECTIVE: This research aimed to test the feasibility of using stationary wireless video cameras to observe physical activity and other well-being behaviors, and to assess its reliability and potential participant reactivity. METHODS: Across 3 cross-sectional studies, 148 hours of video recordings were collected from 6 outdoor public spaces in Manchester, United Kingdom. The videos were coded by 3 researchers using MOHAWk (Method for Observing Physical Activity and Wellbeing)-a validated in-person observation tool for assessing physical activity, social interactions, and people taking notice of the environment. Inter- and intrarater reliabilities were assessed using intraclass correlation coefficients (ICCs). Intercept surveys were conducted to assess public awareness of the cameras and whether they altered their behavior due to the presence of cameras. RESULTS: The 148 hours of video recordings were coded in 85 hours. Interrater reliability between independent coders was mostly "excellent" (ICCs>0.90; n=36), with a small number of "good" (ICCs>0.75; n=2), "moderate" (ICCs=0.5-0.75; n=3), or "poor" (ICCs<0.5; n=1) ICC values. Reliability decreased at night, particularly for coding ethnic group and social interactions, but remained mostly "excellent" or "good." Intrarater reliability within a single coder after a 2-week interval was "excellent" for all but 1 code, with 1 "good" ICC value for assessing vigorous physical activity, indicating that the coder could reproduce similar results over time. Intrarater reliability was generally similar during the day and night, apart from ICC values for coding ethnic group, which reduced from "excellent" to "good" at night. Intercept surveys with 86 public space users found that only 5 (5.8%) participants noticed the cameras used for this study. Importantly, all 5 said that they did not alter their behavior as a result of noticing these cameras, therefore, indicating no evidence of reactivity. CONCLUSIONS: Camera-based observation methods are more reliable than in-person observations and do not produce participant reactivity often associated with self-report methods. This method requires less time for data collection and coding, while allowing for safe nighttime observation without the risk to research staff. This research is a significant first step in demonstrating the potential for camera-based methods to improve natural experimental studies of real-world environmental interventions. It also provides a rigorous foundation for developing more scalable automated computer vision algorithms for assessing human behaviors.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.020
metaresearch head score (Gemma)0.038
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesnone
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Observational · Consensus signal: Observational
GenreCandidate signal: Empirical · Consensus signal: Empirical
Teacher disagreement score0.020
Threshold uncertainty score0.106

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.0200.038
Meta-epidemiology (narrow)0.0010.000
Meta-epidemiology (broad)0.0000.001
Bibliometrics0.0010.001
Science and technology studies0.0000.001
Scholarly communication0.0010.001
Open science0.0010.001
Research integrity0.0010.000
Insufficient payload (model declined to judge)0.0010.000

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.202
GPT teacher head0.446
Teacher spread0.245 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.

The models applied no category: nothing in the taxonomy fit this work.
Study designObservational
Domainnot available
GenreEmpirical

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations4
Published2024
Admission routes1
Has abstractyes

Explore more

Same venueJMIR Public Health and Surveillance→Same topicPhysical Activity and Health→French-language works237,207→