AI Assistant Framework on Competency-Based Learning for Digital Competency Development
Bibliographic record
Abstract
The accelerating adoption of AI in education highlights the need for an assistant that is explicitly grounded in competency-based learning to develop learners’ digital competencies. This study proposes the AI Assistant Framework on Competency-Based Learning for Digital Competency Development (AICoLED) and evaluates its appropriateness through expert judgment. We synthesized contemporary literature to derive a framework that integrates four inputs (AI technology infrastructure, competency framework, educational content, user interface design), five processes (competency assessment, personalized learning, interactive assistance, competency development, feedback/evaluation), and four outputs (digital competency enhancement, learning achievement, behavioural change, system performance). A structured instrument comprising 44 items across eight domains was rated by eight experts (n = 8) on a 5-point scale. We summarized item- and domain-level means and SDs and mapped means to appropriateness levels. The overall mean across items was 4.69 (SD = 0.49), corresponding to the rating of “Most appropriate.” The section means ranged from 4.63 to 4.75. The highest-rated domain was Innovation and Creativity (Mean = 4.75, SD = 0.44); the lowest was Output Components (Mean = 4.63, SD = 0.62). Top-rated items included content competency alignment (1.1.3), systematic linkage of inputs (1.1.5), accuracy and coverage of competency assessment (1.2.1), framework novelty (4.1), and currency of NLP use (6.1.1) (all Means = 4.88, SD = 0.35). Items with greater dispersion concerned system indicators and competency standards (1.3.2-1.3.4; 6.3.2-6.3.3), with SD up to 0.76. Expert appraisal indicates that AICoLED is conceptually straightforward, pedagogically coherent, and technically feasible; however, the measurement components (output indicators and competency standards) require tighter operationalization before pilot deployment. Future work should pilot the framework in authentic contexts, validate measurement models, and assess effectiveness and scalability.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame machine prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.
Distilled classifier scores by category (both heads)
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.015 | 0.016 |
| Meta-epidemiology (narrow) | 0.001 | 0.000 |
| Meta-epidemiology (broad) | 0.000 | 0.001 |
| Bibliometrics | 0.006 | 0.002 |
| Science and technology studies | 0.001 | 0.009 |
| Scholarly communication | 0.004 | 0.004 |
| Open science | 0.001 | 0.004 |
| Research integrity | 0.001 | 0.002 |
| Insufficient payload (model declined to judge) | 0.002 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".