MétaCan
Menu
Back to cohort
Record W4320919785 · doi:10.1177/16094069231157695

Screenshotting What’s Important in Video Data: An Experiment in Collaborative, Subjective Analysis of Artifactual, Cultural Research with Children

2023· article· en· W4320919785 on OpenAlexafffund
Diane R. Collier, Simranjeet Kaur, Melissa McKinney‐Lepp, Zachary J.A. Rondinelli

Bibliographic record

VenueInternational Journal of Qualitative Methods · 2023
Typearticle
Languageen
FieldSocial Sciences
TopicParticipatory Visual Research Methods
Canadian institutionsBrock University
FundersBrock University
KeywordsConversationSet (abstract data type)Class (philosophy)Interpretation (philosophy)Computer scienceRelation (database)Data scienceMultimediaPsychologyArtificial intelligenceCommunication

Abstract

fetched live from OpenAlex

When using video and visual methods in qualitative and post-qualitative research, the size and scale of the data set can be overwhelming, particularly for new researchers. Collaborative research teams often work with a code book to systematize and unify their analyses. Interpretive researchers pursuing multi-layered and multi-voiced visual analysis often find it difficult to move away from desires for a single ‘best’ interpretation of what happened. This paper illustrates and interrogates an open and flexible method for ‘thinning’ (screenshotting) video data that we call the ‘Five Images Method’. We offer one unfolding of interpretive processes and tensions and examine how four researchers worked across positionalities to analyse video data. We start with our positionalities in relation to a research study of children creating photographic and written stories of cultural artifacts, carried out over one year. The primary data from the study was generated through online video-conference sessions connecting a university researcher with an elementary class. A second level of data was created through a process of screenshotting, followed by recursive cycles of conversation about the choices of each researcher, and how they were guided by background, geography, roles in relation to child participants, technologies, personal experiences, and so on. Two key incidents that illustrate the potential of the method and the interpretations produced are described. We argue that reducing video data in this way can be both generative and limiting, while also serving as a catalyst for enhanced analysis. The collaborations and relationships built in research teams through slow processes of analysis (and writing!) working across difference also promote evocative and layered learning. Looking at interpretations as multiple can be hampered by longstanding histories of research as intended to produce authentic and singular truths.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame distilled prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.

metaresearch head score (Codex)0.130
metaresearch head score (Gemma)0.025
Version: codex-gemma-dda1882f352aValidation status: machine_predicted_unvalidated
Candidate categoriesMetaresearch
Consensus categoriesMetaresearch
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Qualitative · Consensus signal: Qualitative
GenreCandidate signal: Empirical · Consensus signal: Empirical
Teacher disagreement score0.111
Threshold uncertainty score0.984

Codex and Gemma teacher scores by category

CategoryCodexGemma
Metaresearch0.1300.025
Meta-epidemiology (narrow)0.0000.000
Meta-epidemiology (broad)0.0010.000
Bibliometrics0.0030.007
Science and technology studies0.0000.001
Scholarly communication0.0000.003
Open science0.0010.000
Research integrity0.0000.001
Insufficient payload (model declined to judge)0.0000.000

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.946
GPT teacher head0.814
Teacher spread0.132 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; both teacher heads agree on what is shown here.

Study designQualitative
Domainnot available
GenreEmpirical

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations2
Published2023
Admission routes2
Has abstractyes

Explore more

Same venueInternational Journal of Qualitative MethodsSame topicParticipatory Visual Research MethodsFrench-language works237,207