MétaCan
Menu
Back to cohort
Record W3132803447 · doi:10.1119/10.0003465

Selective Assessment in Introductory Physics Labatorials

2021· article· en· W3132803447 on OpenAlex
Mandana Sobhanzadeh, Peter Zizler

Why this work is in the frame

A frame that forgets how it found something cannot be audited. These are the routes that admitted this work.

affAt least one author lists a Canadian institution in the pinned OpenAlex snapshot.

Bibliographic record

VenueThe Physics Teacher · 2021
Typearticle
Languageen
FieldPsychology
TopicInnovative Teaching and Learning Methods
Canadian institutionsMount Royal University
Fundersnot available
KeywordsMathematics educationPhysics educationReading (process)Medical educationAnxietyPsychologyPhysicsMedicine

Abstract

fetched live from OpenAlex

In this paper, we present a selection methodology in the physics laboratory that lowers student anxiety and is beneficial to the instructors as well. At Mount Royal University, the traditional laboratory experimental exercises were replaced by a new style of laboratory called labatorials. In our previous research work, we found that labatorials integrate communications and discussions in a friendly environment. They decrease students’ anxiety and improve self-confidence. However, there have been some challenges associated with physics labs that are not specific to labatorials such as the final lab grades of students who miss a lab. Phys1201 and Phys1202 courses at MRU are 13-week courses with around 200 first-year students each semester. There are two training sessions for the lab instructors during the first two weeks of the semester to familiarize them with labatorial goals and strategies. Due to the training sessions and to make sure that the topics of the experiments have been covered in the classroom, introductory physics laboratories start the third week of the semester. There is no lab during the reading break at MRU and we are left with 10 weeks to cover 10 labs. A lab instructor cannot control student absences, and students should not be punished for missing a lab due to illness or a family situation. Each introductory physics course is divided into three to four lecture sections and around 15 lab sections each semester. One solution was to provide opportunities for students to go to another lab section when they miss a lab. However, this solution created new challenges for both students and instructors. It was not easy to find a lab section that matches the schedule of the students missing a lab. On the other hand, at MRU there is only one lab instructor for each 16-student lab section. Some feedback we have received from students is that they would prefer groups of two or three members as most of the time not every member of every group participates. Having one more student making up a lab resulted in having a group of five and made the group activity more difficult. We had received much negative feedback from students working with a new member in groups of five. Some lab instructors excused the missing lab grade and some provided a make-up lab opportunity during a time that worked for them and the students. There are many sessional lab instructors working in our department that cannot provide opportunities for students to make up labs during a time that they do not teach. On the other hand, they are not paid for the extra two-hour make-up labs as well. Not having a consistent solution for the students missing a lab in different sections increased the number of complaints. To address this challenge and use a consistent solution applicable in all lab sections, we decided to use a common practice in the Department of Mathematics and Computing at MRU that allows students to choose the best k quiz/activity grades from the n quizzes/activities written, a policy they call selective assessment.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

Full frame distilled prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.

metaresearch head score (Codex)0.003
metaresearch head score (Gemma)0.000
Version: codex-gemma-dda1882f352aValidation status: machine_predicted_unvalidated
Candidate categoriesnone
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Theoretical or conceptual · Consensus signal: none
GenreCandidate signal: Empirical · Consensus signal: Empirical
Teacher disagreement score0.590
Threshold uncertainty score0.656

Codex and Gemma teacher scores by category

CategoryCodexGemma
Metaresearch0.0030.000
Meta-epidemiology (narrow)0.0000.000
Meta-epidemiology (broad)0.0000.000
Bibliometrics0.0000.001
Science and technology studies0.0000.000
Scholarly communication0.0000.000
Open science0.0000.000
Research integrity0.0000.002
Insufficient payload (model declined to judge)0.0000.000

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.056
GPT teacher head0.416
Teacher spread0.360 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it