MétaCan
Menu
Back to cohort
Record W7028464768

Exploring the Impact of Performance-Based Funding Policy Reform: The Role of Institutional Research in Supporting Data-Driven Decision-Making

2021· article· en· W7028464768 on OpenAlexaffabout

Bibliographic record

VenueScholarship@Western (Western University) · 2021
Typearticle
Languageen
FieldDecision Sciences
TopicEducational Assessment and Improvement
Canadian institutionsWestern University
Fundersnot available
KeywordsAccountabilityMandateStrategic planningCorporate governanceStakeholderHigher educationSustainabilityPlan (archaeology)Institutional research
DOInot available

Abstract

fetched live from OpenAlex

The institutional pressures placed on the Ontario college system, exercised through funding model reform, brought forward organizational challenges difficult for even the most fiscally savvy to navigate. The enrollment corridor mechanism and the expansion of the proportions of the differentiation envelope to create a performance-based grant, implemented via the 2020-25 Strategic Mandate Agreement (SMA3), demonstrate the Provincial Government’s calls for efficiencies and accountability and the alignment of institutional and provincial priorities. Remaining financially sustainable while moving from performance reporting to performance funding and weathering the impacts of the Covid-19 pandemic requires a solid understanding of not only enrollment challenges and opportunities but also data and information used to inform decisions. Institutional Research (IR) units are responsible for providing leaders with data and information for this work. However, access to data and information does not imply their effective use (Marsh et al., 2006), pointing to a gap in data literacy skills amongst higher education leaders (Mathies, 2018). The problem of practice that will be examined is the role of IR in supporting effective data-driven decision-making related to achievement of the College X enrollment and SMA3 priorities. This Organizational Improvement Plan proposes that an existing Strategic Enrollment Management governance structure be leveraged for development and implementation of a group-level capacity building strategy. The planned change is used to inform enhancements to existing data tools and resources responsive to stakeholder needs and mindful of organizational context. The Change Path Model (Cawsey et al., 2016) provides the framework to implement this solution using distributed and adaptive leadership approaches.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.088
metaresearch head score (Gemma)0.121
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesMetaresearch
Consensus categoriesnone
DomainCandidate signal: Incentives · Consensus signal: none
Study designCandidate signal: Observational · Consensus signal: none
GenreCandidate signal: Empirical · Consensus signal: none
Teacher disagreement score0.925
Threshold uncertainty score0.569

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.0880.121
Meta-epidemiology (narrow)0.0010.001
Meta-epidemiology (broad)0.0010.001
Bibliometrics0.0030.004
Science and technology studies0.0100.025
Scholarly communication0.0370.021
Open science0.0040.012
Research integrity0.0040.006
Insufficient payload (model declined to judge)0.0090.001

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.603
GPT teacher head0.526
Teacher spread0.077 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.

Study designObservational
DomainIncentives
GenreEmpirical

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations0
Published2021
Admission routes2
Has abstractyes

Explore more

Same venueScholarship@Western (Western University)Same topicEducational Assessment and ImprovementFrench-language works237,207