MétaCan
Menu
Back to cohort
Record W2916578856 · doi:10.5430/ijhe.v8n1p171

How do Academic Faculty Members Perceive the Effect of Teaching Surveys Completed by Students on Appointment and Promotion Processes at Academic Institutions? A Case Study

2019· article· en· W2916578856 on OpenAlexvenueno aff
Eyal Eckhaus, Nitza Davidovitch

Bibliographic record

VenueInternational Journal of Higher Education · 2019
Typearticle
Languageen
FieldSocial Sciences
TopicEvaluation of Teaching Practices
Canadian institutionsnot available
Fundersnot available
KeywordsPromotion (chess)HarmMedical educationPsychologyMedicinePolitical scienceSocial psychology

Abstract

fetched live from OpenAlex

It is commonly thought that the promotion of faculty members is affected by their research performance. The current study is unique in examining how academic faculty members perceive the harm or damage to academic appointment and promotion processes, as a direct effect of student evaluations as manifested in teaching surveys. One hundred eighty two questionnaires were collected from senior faculty members at academic institutions. Most respondents were from three institutions: Ariel University, Ben Gurion University, and the Jezreel Valley College. Qualitative and statistical research tools were utilized, with the goal of forming a model reflecting the effect of the harm to academic appointment and promotion processes, as perceived by faculty members. The research findings show that the lecturers find an association that causes harm to their promotion processes as a result of student evaluations. Assuming that students' voices and their opinion of teaching are important – the question is how should these evaluations be treated within promotion and appointment processes: what and whom do they indicate? Do they constitute a reliable managerial tool with which it is possible to work as a foundation for promotion and appointment processes – or should other tools be developed, unrelated to students' opinions?

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.022
metaresearch head score (Gemma)0.054
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesMetaresearch
Consensus categoriesnone
DomainCandidate signal: Evaluation · Consensus signal: none
Study designCandidate signal: Qualitative · Consensus signal: Qualitative
GenreCandidate signal: Empirical · Consensus signal: Empirical
Teacher disagreement score0.978
Threshold uncertainty score0.116

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.0220.054
Meta-epidemiology (narrow)0.0000.001
Meta-epidemiology (broad)0.0010.001
Bibliometrics0.0020.001
Science and technology studies0.0050.003
Scholarly communication0.0030.002
Open science0.0010.002
Research integrity0.0020.002
Insufficient payload (model declined to judge)0.0010.000

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.124
GPT teacher head0.514
Teacher spread0.390 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.

Study designQualitative
DomainEvaluation
GenreEmpirical

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations32
Published2019
Admission routes1
Has abstractyes

Explore more

Same venueInternational Journal of Higher EducationSame topicEvaluation of Teaching PracticesFrench-language works237,207