MétaCan
Menu
Back to cohort
Record W4414119506 · doi:10.35542/osf.io/xfcek_v2

Generative AI’s Influence in Computer Science Classrooms: A Rapid Review Methodology

2025· review· en· W4414119506 on OpenAlexfundno aff
Michael Pin-Chuan Lin, Gaganpreet Jhajj, Fuhua Lin, Eric Poitras, Daniel Chang, Jeeho Ryoo

Bibliographic record

Venuenot available
Typereview
Languageen
FieldComputer Science
TopicOnline Learning and Analytics
Canadian institutionsnot available
FundersSocial Sciences and Humanities Research Council of Canada
KeywordsAffordanceGenerative grammarDebuggingInclusion (mineral)Empirical evidenceEmpirical researchCognitionCoding (social sciences)

Abstract

fetched live from OpenAlex

Generative AI tools such as ChatGPT are rapidly being adopted in Computer Science Education (CSE), offering novel ways to support student learning, particularly in programming, computational thinking, and foundational mathematics. Despite growing interest in these tools, empirical evidence examining their educational impact remains limited. This rapid review synthesizes current research to explore (1) how generative AI tools are being used in CSE classrooms, (2) how students, educators, and professionals perceive their use, and (3) what challenges and opportunities exist for their future integration. Using PRISMA guidelines adapted for rapid review methodology, we conducted a comprehensive search in June 2024 through EBSCO databases, focusing on peer-reviewed empirical studies published since 2022. Of the 64 identified studies, only three met the inclusion criteria, reflecting the emerging nature of this research area. The selected studies show that ChatGPT is primarily used to provide immediate feedback during coding exercises, support debugging processes, and facilitate iterative learning. Students report positive experiences, citing AI’s usefulness in clarifying complex tasks, improving efficiency, and offering 24/7 assistance. However, educators and professionals raise concerns about potential over-reliance on AI, diminished critical thinking, and the erosion of academic integrity. These concerns show the importance of developing pedagogical strategies that balance AI support with human cognitive engagement. Frameworks such as CHAT-ACTS encourage students to self-regulate their interactions with AI tools, while instructional designs like Harvard’s CS50 Duck demonstrate how AI can be integrated to support learning without providing direct answers. Although this review is based on a limited sample, it provides early insights into the affordances and risks of generative AI in CSE. It calls for future research on instructional design, ethical policy development, and longitudinal studies that examine how AI tools shape learning behaviours, skill acquisition, and disciplinary practices over time. Responsible integration of AI in CSE will require thoughtful alignment with educational goals that prioritize higher-order thinking and learner agency.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.040
metaresearch head score (Gemma)0.137
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesnone
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Not applicable · Consensus signal: none
GenreCandidate signal: Review · Consensus signal: Review
Teacher disagreement score0.047
Threshold uncertainty score0.214

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.0400.137
Meta-epidemiology (narrow)0.0020.002
Meta-epidemiology (broad)0.0070.007
Bibliometrics0.0470.031
Science and technology studies0.0020.002
Scholarly communication0.0070.007
Open science0.0030.005
Research integrity0.0030.002
Insufficient payload (model declined to judge)0.0070.001

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.102
GPT teacher head0.435
Teacher spread0.333 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.

The models applied no category: nothing in the taxonomy fit this work.
Study designNot applicable
Domainnot available
GenreReview

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations0
Published2025
Admission routes1
Has abstractyes

Explore more

Same topicOnline Learning and AnalyticsFrench-language works237,207