Reviewer Experience vs. Expertise: Which Matters More for Good Course Reviews in Online Learning?
Bibliographic record
Abstract
With a surging number of online courses on MOOC (Massive Open Online Course) platforms, online learners face increasing difficulties in choosing which courses to take. Online course reviews posted by previous learners provide valuable information for prospective learners to make informed course selections. This research investigates the effects of reviewer experience and expertise on reviewer competence in contributing high-quality and helpful reviews for online courses. The empirical study of 39,114 online reviews from 3276 online courses on a leading MOOC platform in China reveals that both reviewer experience and expertise positively affect reviewer competence in contributing helpful reviews. In particular, the effect of reviewer expertise on reviewer competence in contributing helpful reviews is much more prominent than that of reviewer experience. Reviewer experience and expertise do not interact in enhancing reviewer competence. The analysis also reveals distinct groups of reviewers. Specifically, reviewers with low expertise and low experience contribute the majority of the reviews; reviewers with high expertise and high experience are rare, accounting for a small portion of the reviews; the rest of the reviews are from reviewers with high expertise, but low experience, or those with low expertise, but high experience. Our work offers a new analytical approach to online learning and online review literature by considering reviewer experience and expertise as reviewer competence dimensions. The results suggest the necessity of focusing on reviewer expertise, instead of reviewer experience, in choosing and recommending reviewers for online courses.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame distilled prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.
Codex and Gemma teacher scores by category
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.001 | 0.011 |
| Meta-epidemiology (narrow) | 0.000 | 0.000 |
| Meta-epidemiology (broad) | 0.001 | 0.000 |
| Bibliometrics | 0.000 | 0.001 |
| Science and technology studies | 0.000 | 0.000 |
| Scholarly communication | 0.000 | 0.000 |
| Open science | 0.001 | 0.000 |
| Research integrity | 0.000 | 0.000 |
| Insufficient payload (model declined to judge) | 0.000 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one teacher head, not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".