MétaCan
Menu
Back to cohort
Record W4417142765 · doi:10.56971/jwi.v9i2.323

ANALISIS KLASIFIKASI SARAN PESERTA PELATIHAN MENGGUNAKAN PENDEKATAN MACHINE LEARNING

2024· article· W4417142765 on OpenAlex

Why this work is in the frame

A frame that forgets how it found something cannot be audited. These are the routes that admitted this work.

affAt least one author lists a Canadian institution in the pinned OpenAlex snapshot.

Bibliographic record

VenueJurnal Kewidyaiswaraan/Jurnal kewidyaiswaraan · 2024
Typearticle
Language
FieldComputer Science
TopicData Mining and Machine Learning Applications
Canadian institutionsWiLAN (Canada)
Fundersnot available
KeywordsNaive Bayes classifierAdaBoost

Abstract

fetched live from OpenAlex

Saran peserta pelatihan tergolong jarang mendapatkan perhatian dan dianalisis lebih lanjut. Analisis terhadap saran peserta pelatihan dapat bermanfaat dalam mengidentifikasi faktor-faktor yang perlu diperhatikan dalam manajemen penyelenggaraan pelatihan. Text mining dan machine learning merupakan pendekatan terkini yang dapat digunakan untuk memperoleh pola tertentu pada data tidak terstruktur berupa teks. Artikel ini membangun model klasifikasi menggunakan algoritma naïve bayes berdasarkan dataset saran peserta pelatihan. Model tersebut digunakan untuk memprediksi kategori saran peserta yang dapat memudahkan penyelenggara pelatihan mengidentifikasi aspek-aspek prioritas yang perlu dievaliuasi. Hasil pemodelan memiliki akurasi 60,81% dan dapat digunakan untuk memprediksi label kategori saran peserta. Namun demikian, Kinerja model dapat ditingkatkan dengan melatih model menggunakan data baru, menggunakan model klasifikasi lain, atau modifikasi terhadap algoritma. Hasil klasifikasi saran tahun 2024 menunjukkan aspek sarana dsn prasarana, serta tata laksana pelatihan menjadi dua aspek yang harus ditindaklanjuti oleh penyelenggara pelatihan.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

Full frame distilled prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.

metaresearch head score (Codex)0.006
metaresearch head score (Gemma)0.002
Version: codex-gemma-dda1882f352aValidation status: machine_predicted_unvalidated
Candidate categoriesMeta-epidemiology (narrow), Science and technology studies, Scholarly communication, Open science, Research integrity, Insufficient payload (model declined to judge)
Consensus categoriesMeta-epidemiology (narrow), Research integrity, Insufficient payload (model declined to judge)
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Other design · Consensus signal: none
GenreCandidate signal: Empirical · Consensus signal: none
Teacher disagreement score0.702
Threshold uncertainty score1.000

Codex and Gemma teacher scores by category

CategoryCodexGemma
Metaresearch0.0060.002
Meta-epidemiology (narrow)0.0040.004
Meta-epidemiology (broad)0.0030.003
Bibliometrics0.0040.009
Science and technology studies0.0050.001
Scholarly communication0.0110.007
Open science0.0090.003
Research integrity0.0020.008
Insufficient payload (model declined to judge)0.0020.005

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.020
GPT teacher head0.284
Teacher spread0.264 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it