MétaCan
Menu
Back to cohort

Cyclical Program Reviews at Smaller Post-Secondary Institutions: Can the Time and Effort be Justified?

2023· article· en· W4389314118 on OpenAlexaffvenueabout
Colin P. Neufeldt, Elizabeth Smythe, John Jayachandran, Oliver Franke

Bibliographic record

VenueThe Canadian Journal for the Scholarship of Teaching and Learning · 2023
Typearticle
Languageen
FieldSocial Sciences
TopicHigher Education Practises and Engagement
Canadian institutionsConcordia University of Edmonton
Fundersnot available
KeywordsCredentialingMedical educationCoronavirus disease 2019 (COVID-19)Political scienceMedicine

Abstract

fetched live from OpenAlex

Cyclical program reviews (CPRs), also called periodic or academic reviews at institutions of higher education, are undertaken to ensure that academic programs meet a variety of objectives related to teaching and learning, as well as professional credentialing, quality assurance, and institutional requirements. Preparing, reviewing, and implementing a CPR requires significant time and effort for those assigned to this task, especially if the program has never previously been through a CPR. Much has been written on how to undertake a CPR (Bresciani, 2006), what measures are useful in assessing programs (Jayachandran et al., 2019), and some of the problems that external reviewers encounter with CPRs (Halonen & Dunn, 2017). This article, however, provides new insights concerning important considerations that should be addressed when preparing to undertake a CPR—from the perspectives of both administrators and faculty at smaller institutions where the number of faculty may be small and resources for the CPR process are often limited. Drawing on a case study of CPRs in several social sciences programs and a broader survey of those involved in CPRs from 2015-2020 at a small Western Canadian university, the authors identify key issues in preparing a CPR, such as the timing of the review, the advantages and disadvantages of an individual approach versus a team approach in preparing the CPR, the role of administrators in the CPR process, the importance of institutional templates in preparing the CPR, and the need for clearly identified program learning outcomes to guide the CPR process. This article also examines how a pandemic can impact the CPR process.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame distilled prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.

metaresearch head score (Codex)0.016
metaresearch head score (Gemma)0.004
Version: codex-gemma-dda1882f352aValidation status: machine_predicted_unvalidated
Candidate categoriesScience and technology studies
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Not applicable · Consensus signal: none
GenreCandidate signal: Empirical · Consensus signal: Empirical
Teacher disagreement score0.943
Threshold uncertainty score0.986

Codex and Gemma teacher scores by category

CategoryCodexGemma
Metaresearch0.0160.004
Meta-epidemiology (narrow)0.0000.000
Meta-epidemiology (broad)0.0000.000
Bibliometrics0.0000.000
Science and technology studies0.0170.000
Scholarly communication0.0010.000
Open science0.0000.000
Research integrity0.0000.002
Insufficient payload (model declined to judge)0.0000.000

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.140
GPT teacher head0.400
Teacher spread0.261 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; a candidate call from one teacher head, not a consensus.

Study designNot applicable
Domainnot available
GenreEmpirical

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations2
Published2023
Admission routes3
Has abstractyes

Explore more

Same venueThe Canadian Journal for the Scholarship of Teaching and LearningSame topicHigher Education Practises and EngagementFrench-language works237,207