MétaCan
Menu
Back to cohort
Record W7071929433

Unpacking 'the Next Black Box': Investigating the Cognitive and Affective Underpinnings of Student Self-Assessment

2021· dissertation· en· W7071929433 on OpenAlexaff

Bibliographic record

VenueQSpace (Queen's University Library) · 2021
Typedissertation
Languageen
FieldSocial Sciences
TopicStudent Assessment and Feedback
Canadian institutionsQueen's University
Fundersnot available
KeywordsUnpackingSession (web analytics)CognitionCentralityClass (philosophy)TRACE (psycholinguistics)Process (computing)Empirical researchProtocol analysis
DOInot available

Abstract

fetched live from OpenAlex

Despite theoretical and empirical arguments for its essential role in learning, and its consequent centrality in classroom assessment frameworks and policy globally, little is known about student self-assessment’s internal cognitive and affective processes. Left without a theory to inform teachers in supporting productive student self-assessment (SSA), many students will never learn to be sources of their own feedback, the foundation for independent, lifelong learning. This research responds to calls to examine how students in K-12 contexts think and feel while engaged in SSA tasks that are supported by literature – the next black box of classroom assessment research. First, I synthesized relevant self-assessment literature within a highly granular self-regulated learning (SRL) model. Drawing on this theoretical foundation, I employed a collective case study using digital trace data to infer the ways in which a class of Year 12 students (n=16) in a UK secondary school thought and felt during an evidence informed self-assessment activity. Matomo, a web analytics platform, collected session recording and heatmap data which elucidated participants’ cognitive and affective operations as they completed a writing task, self-assessed their work using exemplars and rubrics, and revised their writing accordingly. I analyzed log files of trace data to a) infer which SRL subprocesses participants activate, b) generate self-assessment process graphs and profiles for each participant, and c) investigate how participants engaged in each process based on the content of their work. Findings highlight the recursive and weakly sequenced nature of SSA processes, as well key cognitive and affective trends. Moreover, SSA profiles for each participant demonstrate how trace data and learning analytics can support advances in student learning through SSA. Forming the basis for an initial theory of SSA cognition and affect, this research advances SSA theory, a core component of classroom assessment.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame distilled prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.

metaresearch head score (Codex)0.000
metaresearch head score (Gemma)0.000
Version: codex-gemma-dda1882f352aValidation status: machine_predicted_unvalidated
Candidate categoriesMeta-epidemiology (narrow), Science and technology studies
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Qualitative · Consensus signal: Qualitative
GenreCandidate signal: Empirical · Consensus signal: Empirical
Teacher disagreement score0.193
Threshold uncertainty score1.000

Codex and Gemma teacher scores by category

CategoryCodexGemma
Metaresearch0.0000.000
Meta-epidemiology (narrow)0.0000.000
Meta-epidemiology (broad)0.0000.000
Bibliometrics0.0000.001
Science and technology studies0.0010.001
Scholarly communication0.0000.001
Open science0.0010.000
Research integrity0.0000.001
Insufficient payload (model declined to judge)0.0000.000

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.017
GPT teacher head0.284
Teacher spread0.266 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; a candidate call from one teacher head, not a consensus.

Study designQualitative
Domainnot available
GenreEmpirical

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations0
Published2021
Admission routes1
Has abstractyes

Explore more

Same venueQSpace (Queen's University Library)Same topicStudent Assessment and FeedbackFrench-language works237,207