Graduate Attributes Assessment Program
Notice bibliographique
Résumé
Purpose In this paper, the challenging and thorny issue of assessing graduate attributes (GAs) is addressed. An interdisciplinary team at The University of Alberta ----developed a formative model of assessment centered on students and instructor interaction with course content. Design/methodology/approach The paper starts by laying the theoretical groundwork on which this novel GA assessment tool is based, that is, competency-based education, assessment theory and GA assessment. It follows with a description of the online assessment tool for GAs that was developed in the course of this project. Findings The online assessment tool for GAs targets three types of stakeholders: (1) students, who self-assess in terms of GAs, (2) instructors, who use the tool to define the extent to which each GA should be inculcated in their course and (3) administrators, who receive aggregate reports based on the data gathered by the system for high-level analysis and decision-making. Collected data by students and professors advance formative assessment of these transversal skills and assist administration in ensuring the GAs are addressed in academic programs. Graduate attributes assessment program (GAAP) is also a space for students to build a personal portfolio that would be beneficial to highlight their skills for potential employers. Research limitations/implications This research has strong implications for the universities, since it can help institutions, academics and students achieve better results in their practices. This is done by demonstrating strong links between theory and practice. Although this tool has only been used within the university setting by students, instructors and administrators (for self-, course and teaching and program improvement), it could increase its social and practical impact by involving potential employers and increase our understanding of student employability. Moreover, because the tool collects data on a continuous basis, it lends itself to many possible applications in educational data mining, Practical implications The GAAP can be used and adapted to various educational contexts. The plugin can be added to any Learning Management System (LMS), and students can have access to their data and results throughout their education. Social implications The GAAP allows institutions to provide a longitudinal formative assessment of students’ graduate attributes acquisition. It provides solid and valid evidence of students’ progress in a way that would advance society and citizenship. Originality/value To date, the GAAP is the first online interactive platform that has been developed to longitudinally assess the acquisition of GAs during a complete academic cycle/cohort. It provides a unique space where students and instructors interact with assessment scales and with concrete data for a complete university experience profile.
Récupéré en direct depuis OpenAlex et désinversé. Les résumés ne sont pas conservés dans cette base de données : les index inversés représentent 8,6 Go des 9,3 Go de texte de la base, et le serveur dispose de 13 Go libres.
Comment cette classification a été obtenuedéplier
Prédiction machine sur la base complète
Imitation des enseignantsNi prévalence calibrée, ni vérité terrain. Validation humaine à venir. Le volet Gemma est une étiquette directe du modèle pour chaque travail de la base, lue sur la notice réduite au titre. Le volet Codex est un classifieur appris des 10 348 étiquettes directes de Codex et calibré sur les taux pondérés de l'échantillon; les champs sans appui suffisant ne portent aucun appel Codex. Le mode candidate est l'union des deux volets; le consensus est leur intersection. Ces sorties portent le statut machine_predicted_unvalidated et ne sont pas des étiquettes humaines.
Scores du classifieur distillé par catégorie (deux têtes)
| Catégorie | Codex | Gemma |
|---|---|---|
| Métarecherche | 0,009 | 0,028 |
| Méta-épidémiologie (sens strict) | 0,001 | 0,000 |
| Méta-épidémiologie (sens large) | 0,001 | 0,001 |
| Bibliométrie | 0,004 | 0,004 |
| Études des sciences et des technologies | 0,002 | 0,001 |
| Communication savante | 0,004 | 0,002 |
| Science ouverte | 0,003 | 0,004 |
| Intégrité de la recherche | 0,001 | 0,002 |
| Charge utile insuffisante (le modèle a refusé de juger) | 0,058 | 0,032 |
Scores machine (provisoires)
Les deux têtes enseignantes du modèle étudiant, lues sur ce travail. Un score ordonne la base pour la relecture; il n'affirme jamais une catégorie, et le statut de validation accompagne chaque rangée tel quel.
Scores de référence d'un modèle non mature (critères de maturité non atteints, 7 itérations). Un score ordonne; il n'affirme jamais une catégorie.
score_only:v0-immature-baseline · tel quel depuis la passe de notation : score_only signifie que le nombre peut ordonner les travaux, et qu'aucune étiquette de catégorie n'en découleClassification
machine, non validéePrédiction automatique; un appel candidat d’une seule source (Gemma direct ou Codex distillé), pas un consensus.
Le détail, modèle par modèle et score par score, se trouve en fin de page sous « Comment cette classification a été obtenue ».