MétaCan
Menu
Back to cohort
Record W4390669898 · doi:10.1007/s44217-023-00085-4

A course-based approach to conducting program review

2024· article· en· W4390669898 on OpenAlex

Why this work is in the frame

A frame that forgets how it found something cannot be audited. These are the routes that admitted this work.

affAt least one author lists a Canadian institution in the pinned OpenAlex snapshot.

Bibliographic record

VenueDiscover Education · 2024
Typearticle
Languageen
FieldEngineering
TopicEngineering Education and Curriculum Development
Canadian institutionsLambton CollegeThompson Rivers University
Fundersnot available
KeywordsCLARITYConsistency (knowledge bases)Medical educationComputer scienceDisciplineEngineering managementKnowledge managementProcess managementEngineeringPolitical scienceMedicine

Abstract

fetched live from OpenAlex

Abstract External program review is often considered the “gold standard” approach to evaluating academic programs in higher education. Despite the importance of program review, skepticism persists regarding its ability to meaningfully engage faculty and have sustaining impact on program improvement. This paper builds on the academic Program Review Learning Community conceptual model and presents a process for applying a project management facilitation technique that leverages a course structure. The Program Review Course allows for multiple programs to be reviewed concurrently as part of an interdisciplinary cohort. Within the cohort, faculty teams gain access to templates, information sessions, workshops, and discussion forums, with opportunities for engagement both within and across multiple disciplines. Using learning modules, this approach is designed to create efficiency and collaboration in delivering program review tools and customized supports. Utilizing a course structure for program review fits well with a new way to think about program review because successful learning communities are often embedded within institutional structures. Use of this approach is expected to increase clarity and consistency, improve administrative feasibility, provide guidance for those new to program review, promote collegiality within and across programs, and involve team members in the creation of action planning. The authors propose that a course-based approach for conducting program review, with teams of disciplinary faculty joining an interdisciplinary cohort and supported by quality assurance practitioners and educational developers is a novel way to provide structure and academic development while meeting legislative requirements.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

Full frame distilled prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.

metaresearch head score (Codex)0.000
metaresearch head score (Gemma)0.000
Version: codex-gemma-dda1882f352aValidation status: machine_predicted_unvalidated
Candidate categoriesnone
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Not applicable · Consensus signal: Not applicable
GenreCandidate signal: Empirical · Consensus signal: none
Teacher disagreement score0.803
Threshold uncertainty score0.448

Codex and Gemma teacher scores by category

CategoryCodexGemma
Metaresearch0.0000.000
Meta-epidemiology (narrow)0.0000.000
Meta-epidemiology (broad)0.0000.000
Bibliometrics0.0000.000
Science and technology studies0.0000.000
Scholarly communication0.0000.000
Open science0.0000.000
Research integrity0.0000.000
Insufficient payload (model declined to judge)0.0000.000

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.020
GPT teacher head0.315
Teacher spread0.295 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it