MétaCan
Menu
Back to cohort
Record W4313388101 · doi:10.23917/ijolae.v4i3.19432

Education Application Testing Perspective to Empower Students' Higher Order Thinking Skills Related to The Concept of Adaptive Learning Media

2022· article· en· W4313388101 on OpenAlex

Why this work is in the frame

A frame that forgets how it found something cannot be audited. These are the routes that admitted this work.

affAt least one author lists a Canadian institution in the pinned OpenAlex snapshot.

Bibliographic record

VenueIndonesian Journal on Learning and Advanced Education (IJOLAE) · 2022
Typearticle
Languageen
FieldSocial Sciences
TopicTechnology-Enhanced Education Studies
Canadian institutionsMcGill University
Fundersnot available
KeywordsUsabilityLikert scaleTest (biology)Computerized adaptive testingSample (material)Computer scienceQuality (philosophy)Set (abstract data type)Perspective (graphical)Adaptation (eye)Scale (ratio)Mathematics educationMultimediaHuman–computer interactionArtificial intelligencePsychology

Abstract

fetched live from OpenAlex

This article aims at arguing for the importance of the testing step when designing an educational application by taking a case study from the development of adaptive learning media. The media contains a set of in-struments that are specifically built to empower students' critical thinking skills. Three aspects that are con-sidered in testing this educational application are application validity at each stage of system development, measurement of the final system feasibility test for user needs, and system implementation by running learning media on the test sample. Implementation of testing on application products is carried out accord-ing to system requirements and models. The existence of the characteristics of adaptive media and the diver-sity of menus in the application implies the importance of doing a lot of improvisation when carrying out tests, such as determining the right test cases, choosing the appropriate test model and method, determining a suitable test environment, and considering several other aspects aimed at optimizing test results. obtained in order to ensure the quality of learning media products. This study analyzed the test data using Likert scale as an interpretation of the results of the validation assessment from the experts by referring to certain perceived standards of assessment. Meanwhile, the analysis of the data from the feasibility test results from a sample of 20 students using the system usability scale (SUS) instrument. The technique to test the effec-tiveness was using a pretest-posttest control group design with a sample of 98 students. Parametric/non-parametric data analysis was then applied to analyze the data on the results of testing the effectiveness or efficacy of adaptive media products in improving students' higher order thinking skills (HOTS). Based on the testing steps applied to the application of adaptive learning media, the results obtained that the product was considered feasible and effective in empowering students' HOTS. The study concludes that the educa-tional application testing that has been carried out is able to provide an objective and independent view of the application of adaptive learning media which will be useful in operational functions to understand the level of effectiveness in its implementation before being widely used in learning.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

Full frame distilled prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.

metaresearch head score (Codex)0.002
metaresearch head score (Gemma)0.003
Version: codex-gemma-dda1882f352aValidation status: machine_predicted_unvalidated
Candidate categoriesScience and technology studies
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Qualitative · Consensus signal: Qualitative
GenreCandidate signal: Empirical · Consensus signal: Empirical
Teacher disagreement score0.368
Threshold uncertainty score0.998

Codex and Gemma teacher scores by category

CategoryCodexGemma
Metaresearch0.0020.003
Meta-epidemiology (narrow)0.0000.000
Meta-epidemiology (broad)0.0000.000
Bibliometrics0.0000.002
Science and technology studies0.0040.000
Scholarly communication0.0000.000
Open science0.0000.000
Research integrity0.0000.001
Insufficient payload (model declined to judge)0.0000.000

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.009
GPT teacher head0.344
Teacher spread0.335 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it