MétaCan
Menu
Back to cohort
Record W2128255813 · doi:10.24908/pceea.v0i0.4833

THE ASSESSMENT OF LEADERSHIP OUTCOMES IN CAPSTONE PROJECTS USING ANONYMOUS PEER FEEDBACK

2013· article· en· W2128255813 on OpenAlex

Why this work is in the frame

A frame that forgets how it found something cannot be audited. These are the routes that admitted this work.

affAt least one author lists a Canadian institution in the pinned OpenAlex snapshot.
fundA Canadian funder is recorded on the work.
venuePublished in a venue whose home country is Canada.

Bibliographic record

VenueProceedings of the Canadian Engineering Education Association (CEEA) · 2013
Typearticle
Languageen
FieldEngineering
TopicEngineering Education and Curriculum Development
Canadian institutionsUniversity of Waterloo
FundersUniversity of Waterloo
KeywordsCapstonePsychologyTask (project management)Shared leadershipTransformational leadershipLeadership styleLeadershipAccreditationTransactional leadershipMedical educationComputer scienceEngineeringSocial psychologyMedicine

Abstract

fetched live from OpenAlex

Assessing the leadership abilities of engineering students for the purposes of accreditation and outcomes assessment is a particularly challenging task. For a few students, clear evidence of leadership will exist. These students naturally take on leadership roles within their teams. They have the complete confidence and support of their teammates. The team functions as a cohesive unit. In such a situation, an instructor can easily recognize the quality of leadership provided but may struggle with quantitatively assessing the leadership abilities exhibited. In other cases, students arguably possess leadership abilities yet fail to demonstrate their abilities in a way that can be assessed by an instructor. Such students might demonstrate leadership within their team by taking on an undesirable task or by taking on a disproportionate share of the workload. If a student perceives that leadership is not required, a student might demonstrate great leadership by not taking on an obvious leadership role. Peer feedback can help an instructor identify such examples of leadership.To enable proper assessment of leadership abilities,a suitable environment must be created such that all students have a natural opportunity to demonstrate their leadership skills in their own way. Such an environment is often created by a capstone project. Given the scope of a capstone project, all team members typically have several opportunities to take on a leadership role and/or demonstrate leadership.The challenge is to assess leadership quantitatively without forcing a change in the behaviour ofthe students. This paper examines the design and implementation of an anonymous peer feedback survey for the purpose of quantitatively assessing different measures of teamwork and leadership abilities in engineering students. This paper describes the challenges that are associated with such an assessment process. This paper also discusses the advantages and disadvantages of the proposed assessment technique.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

Full frame distilled prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.

metaresearch head score (Codex)0.000
metaresearch head score (Gemma)0.001
Version: codex-gemma-dda1882f352aValidation status: machine_predicted_unvalidated
Candidate categoriesnone
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Observational · Consensus signal: Observational
GenreCandidate signal: Empirical · Consensus signal: Empirical
Teacher disagreement score0.111
Threshold uncertainty score0.801

Codex and Gemma teacher scores by category

CategoryCodexGemma
Metaresearch0.0000.001
Meta-epidemiology (narrow)0.0000.000
Meta-epidemiology (broad)0.0000.000
Bibliometrics0.0000.001
Science and technology studies0.0000.000
Scholarly communication0.0000.000
Open science0.0000.000
Research integrity0.0000.000
Insufficient payload (model declined to judge)0.0000.000

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.016
GPT teacher head0.232
Teacher spread0.216 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it