Teaching Students to Think - Faculty Recommendations for Teaching Evaluations Employing Automated Content Analysis
Bibliographic record
Abstract
Many studies have been conducted on teaching evaluations completed by students and on myths and facts concerning these evaluations performed by students at academic institutions. The current study is unique in examining the meaning of teaching evaluations as perceived by academic faculty members in Israel through direct questions, with an emphasis on faculty's recommendations for improving the evaluations to make students' comments meaningful for enhancing and advancing their teaching. The perception of evaluations is unique too. Evaluations are part of faculty's learning outputs in their courses, with the aim being for graduates of academic systems to have the ability to provide objective and fair assessments.One hundred seventy seven questionnaires were gathered from senior faculty at several academic institutions. Qualitative and statistical research tools were used in order to form a model that expresses the negative implications as seen by faculty members and alternatives for measuring the performance of faculty in academic teaching. The research findings indicate that lecturers note "professional" alternatives and see teaching evaluations as a populist rather than a professional tool. Moreover, although the lecturers gauge the damage caused to them as a result of student evaluations, where the enormous damage caused to them is disproportionate to the number of respondents, and although faculty members believe that student evaluations are untrustworthy, students' opinions on the courses are important. Their recommendation is that the evaluation should be a tool for teaching how to perform evaluations and convey criticism – and in this field not much has been done in academic institutions, if at all. Academia sees evaluations as a technical matter, a means of satisfying students by letting them express their opinions and of giving students a feeling that the system is attentive to their voice, to their views.Indeed, students' voice is important to the lecturers – their opinions of teaching are important – and that is precisely why action should be taken to render these evaluations fair. Students should understand the power of the words that express their evaluation of the lecturers. This point of view is a first of its kind, where academic faculty members support students' opinions and provide recommendations aimed at their improvement.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame machine prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.
Distilled classifier scores by category (both heads)
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.028 | 0.119 |
| Meta-epidemiology (narrow) | 0.001 | 0.001 |
| Meta-epidemiology (broad) | 0.001 | 0.001 |
| Bibliometrics | 0.010 | 0.005 |
| Science and technology studies | 0.002 | 0.002 |
| Scholarly communication | 0.009 | 0.006 |
| Open science | 0.002 | 0.002 |
| Research integrity | 0.001 | 0.002 |
| Insufficient payload (model declined to judge) | 0.007 | 0.005 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".