MétaCan
Menu
Back to cohort
Record W3209688041 · doi:10.5539/jel.v10n6p82

Creating Core Competencies and Workload-Based Key Outcome Indicators of University Lecturers’ Performance Assessment: Functional Analysis

2021· article· en· W3209688041 on OpenAlex

Why this work is in the frame

A frame that forgets how it found something cannot be audited. These are the routes that admitted this work.

venuePublished in a venue whose home country is Canada.
no affNo Canadian affiliation: this work is invisible to an affiliation-only frame.
No Canadian affiliation. An affiliation-only frame, the usual design, would never have seen this work. It is one of the works that make the case for inverting the frame.

Bibliographic record

VenueJournal of Education and Learning · 2021
Typearticle
Languageen
FieldPsychology
TopicCompetency Development and Evaluation
Canadian institutionsnot available
Fundersnot available
KeywordsWorkloadContext (archaeology)Core competencyPsychologyMedical educationPerformance appraisalIndex (typography)Computer scienceMedicineManagement

Abstract

fetched live from OpenAlex

This research aims to create and validate the quality of performance assessment using functional analysis. The researchers employed a design-based research method to create core competencies and their workload-based key outcome indicators as a preliminary study encompassing two phases, before formulating a standards-setting appraisal model to assess university lecturers in a public university, Thailand. The researchers began with documentary research to identify core competencies of university lecturers from three clusters of educational programs, namely science and technology, health science, and humanities and social sciences. An innovative prototype of university lecturers’ core competencies was developed based on the obtained results from the first phase. A total of five experts and 17 users participated to validate the quality of the innovative prototype. The preliminary results reveal that there are four core competencies of university lecturers, namely teaching, research, academic service, and preserving arts and culture. Moreover, there are 13 workload-based key outcome indicators and 27 elements that resulted from the four core competencies related to the specific research university in the Thai context. Moreover, the quantitative results of the content validity index from the rating scales of the five experts indicate that the conformity index is 0.78 or higher. However, the qualitative interview results regarding the 17 users from four focus groups imply that there is a gap regarding the accuracy of current performance appraisal between lecturers’ core competencies and their actual workload. Therefore, the dean should make the necessary adjustments based on the context.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

Full frame distilled prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.

metaresearch head score (Codex)0.001
metaresearch head score (Gemma)0.000
Version: codex-gemma-dda1882f352aValidation status: machine_predicted_unvalidated
Candidate categoriesInsufficient payload (model declined to judge)
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Observational · Consensus signal: Observational
GenreCandidate signal: Empirical · Consensus signal: Empirical
Teacher disagreement score0.010
Threshold uncertainty score1.000

Codex and Gemma teacher scores by category

CategoryCodexGemma
Metaresearch0.0010.000
Meta-epidemiology (narrow)0.0000.000
Meta-epidemiology (broad)0.0000.000
Bibliometrics0.0000.001
Science and technology studies0.0000.000
Scholarly communication0.0000.000
Open science0.0000.000
Research integrity0.0000.000
Insufficient payload (model declined to judge)0.0010.000

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.036
GPT teacher head0.328
Teacher spread0.291 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it