Exams and Student Feedback: An experiment in Marking Efficiencies
Notice bibliographique
Résumé
Providing summative feedback to studentsin a timely fashion, and managing the associated markingin larger classes has been a perpetual challenge in aneducation environment, and is even more so in a resourcechallenged environment. This paper discusses the resultsof an experiment in evaluation in an engineering courseby implementing a modified evaluation and gradingapproach. The objectives were to i) provide timelyfeedback to students, ii) improve engagement and reduceoverall course loading for students, and iii) reducemarking effort for instructors, all without negativelyaffecting student grade performance. The results showthat improvements over traditional methods can be madein two of the three areas.The course in question, (redacted), covers basicelectrical concepts and devices for non-electricalengineering students. The course had been offered in fourprevious years using a traditional evaluative approach:weekly assignments (submitted, marked and returned),laboratory exercises (comprehensive reporting orexercises submitted, marked and returned), midterm(s)(graded and returned), and a final examination. Themodified approach was implemented over the past twoyears and included the same learning strategies, but witha potentially lower resource commitment for students andinstructors. Modifications to the strategy wereimplemented the first and second years. The experimentintroduced procedural and administrative modificationsin assignments, laboratories and examinations, and theaddition of short weekly quizzes to improve engagementin an active learning environment.Approximately ten assignments were offered to helpstudents test and improve their understanding andknowledge. In the first year, assignments and solutionswere posted simultaneously; no submission was requiredand there was no grade contribution offered. Therationale for this strategy was that students would receivevirtually instant feedback by having solutions immediatelyavailable, and the freedom to judge the quantity and levelof completion required to meet their individual learningneeds. In the second year, assignments wereadministered through an online assignment system formark credit. This was intended to reinstate the incentiveof mark credit to improve student engagement while stillproviding instantaneous feedback on correctness.The course has always included a critical “hands-on”laboratory component which was traditionally timeintensive for both students and instructors. While thelaboratory submissions were still required for markcredit, the reporting requirement was reduced to aminimal, specified sampling of results to provide evidencethat the practical work was addressed. Expectedoutcomes were again provided for students to providerelevant and timely feedback. In the second year, a 3-bingrading system was adopted to improve the granularity ofthe marks while still requiring considerably less markingeffort.Examinations were also modified to improve timelinessof feedback and reduce marking effort. In the first year,three “midterm” examinations were distributed throughthe term to monitor student learning and verify studentparticipation in the self-directed parts of the course.Each of these exams consisted of 12 questions and weresimply graded on a correct response (no “partial marks)to reduce marking effort. In the second year, two midtermexaminations were deemed sufficient, but were gradedusing a 3-bin approach, thus allowing for “partialmarks”. Exams were returned to students in the nextlecture period in both cases. The Final examination inthe first year was designed using a 3-bin scheme to allowfor partial marks while still reducing marking effort. Inthe second year, this was increased to a 4-bin scheme toimproved granularity. The increase in granularity hadvery little effect on marking effort for both the midtermand final.One additional modification was made in the secondyear with the addition of brief weekly quizzes, for markcredit, to encourage students to complete assigned prereadingexercises and keep up with course work. Thequizzes consisted of two brief questions: one on assignedreading for the coming week and one on the previousweek’s material. These quizzes were administered andgraded using a classroom response system and automatically integrated with the learning managementsystem.Analysis consisted of comparison of grades withprevious years, anecdotal evidence and observations onstudent effort, course evaluation data and survey results.Preliminary results indicate student load and instructormarking effort were significantly reduced. While graderesults were approximately the same. A direct objectivecomparison with previous years is not significant due tovariations in course content and cohort.
Récupéré en direct depuis OpenAlex et désinversé. Les résumés ne sont pas conservés dans cette base de données : les index inversés représentent 8,6 Go des 9,3 Go de texte de la base, et le serveur dispose de 13 Go libres.
Comment cette classification a été obtenuedéplier
Prédiction distillée sur la base complète
Imitation des enseignantsNi prévalence calibrée, ni vérité terrain. Validation humaine à venir. Apprise à partir de 10 348 étiquettes directes de Codex et de 10 348 étiquettes directes de Gemma. Le mode candidate est l'union des têtes enseignantes seuillées; le consensus est leur intersection. Ces sorties portent le statut machine_predicted_unvalidated et ne sont ni des étiquettes humaines ni des étiquettes directes de modèles de pointe.
Scores Codex et Gemma par catégorie
| Catégorie | Codex | Gemma |
|---|---|---|
| Métarecherche | 0,000 | 0,000 |
| Méta-épidémiologie (sens strict) | 0,000 | 0,000 |
| Méta-épidémiologie (sens large) | 0,000 | 0,000 |
| Bibliométrie | 0,000 | 0,000 |
| Études des sciences et des technologies | 0,000 | 0,000 |
| Communication savante | 0,000 | 0,000 |
| Science ouverte | 0,000 | 0,000 |
| Intégrité de la recherche | 0,000 | 0,000 |
| Charge utile insuffisante (le modèle a refusé de juger) | 0,000 | 0,000 |
Scores machine (provisoires)
Les deux têtes enseignantes du modèle étudiant, lues sur ce travail. Un score ordonne la base pour la relecture; il n'affirme jamais une catégorie, et le statut de validation accompagne chaque rangée tel quel.
Scores de référence d'un modèle non mature (critères de maturité non atteints, 7 itérations). Un score ordonne; il n'affirme jamais une catégorie.
score_only:v0-immature-baseline · tel quel depuis la passe de notation : score_only signifie que le nombre peut ordonner les travaux, et qu'aucune étiquette de catégorie n'en découleClassification
machine, non validéePrédiction automatique; un appel candidat d’une seule tête enseignante, pas un consensus.
Le détail, modèle par modèle et score par score, se trouve en fin de page sous « Comment cette classification a été obtenue ».