MétaCan
Menu
Back to cohort
Record W2981551119 · doi:10.1080/10494820.2019.1680391

Using learning analytics to support students’ engineering design: the angle of prediction

2019· article· en· W2981551119 on OpenAlex

Why this work is in the frame

A frame that forgets how it found something cannot be audited. These are the routes that admitted this work.

affAt least one author lists a Canadian institution in the pinned OpenAlex snapshot.

Bibliographic record

VenueInteractive Learning Environments · 2019
Typearticle
Languageen
FieldComputer Science
TopicOnline Learning and Analytics
Canadian institutionsMcGill University
FundersNational Science Foundation of Sri Lanka
KeywordsComputer scienceFeature engineeringTask (project management)Machine learningArtificial intelligenceLearning analyticsAnalyticsRanking (information retrieval)Process (computing)Curse of dimensionalityFeature selectionFeature (linguistics)Rank (graph theory)Data scienceDeep learningEngineering

Abstract

fetched live from OpenAlex

Engineering design plays an important role in education. However, due to its open nature and complexity, providing timely support to students has been challenging using the traditional assessment methods. This study takes an initial step to employ learning analytics to build performance prediction models to help struggling students. It allows instructors to offer in-time intervention and support for these at-risk students. Specifically, we develop a task model to characterize the engineering design process so that the data features can be associated with the abstract engineering design phases. A two-stage feature selection method is proposed to address the data sparsity and high dimensionality problems. Then, instead of relying on probability-based algorithms such as Bayesian Networks to represent the task model, this study used the Radial Basis Function based Support Vector Machines for prediction to identify the struggling students. Next, we employ an extra-tree classification method to rank the importance of these features. Teachers can integrate the feature importance ranking with the abstract task model to diagnose students’ problems for scaffolding design. The results show that the proposed approach can outperform the baseline models as well as providing actionable insights for teachers to provide personalized and timely feedback to students. Implications of this study for research and practice are then discussed.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

Full frame distilled prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.

metaresearch head score (Codex)0.001
metaresearch head score (Gemma)0.000
Version: codex-gemma-dda1882f352aValidation status: machine_predicted_unvalidated
Candidate categoriesnone
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Simulation or modeling · Consensus signal: Simulation or modeling
GenreCandidate signal: Empirical · Consensus signal: none
Teacher disagreement score0.525
Threshold uncertainty score0.609

Codex and Gemma teacher scores by category

CategoryCodexGemma
Metaresearch0.0010.000
Meta-epidemiology (narrow)0.0000.000
Meta-epidemiology (broad)0.0000.000
Bibliometrics0.0000.000
Science and technology studies0.0000.000
Scholarly communication0.0000.000
Open science0.0010.000
Research integrity0.0000.001
Insufficient payload (model declined to judge)0.0000.000

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.022
GPT teacher head0.288
Teacher spread0.266 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it