MétaCan
Menu
Back to cohort
Record W2368697974 · doi:10.14288/1.0054600

A comparison of curriculum-based and norm-referenced measures in the identification of reading difficulty

2008· article· en· W2368697974 on OpenAlex

Why this work is in the frame

A frame that forgets how it found something cannot be audited. These are the routes that admitted this work.

aboutThe title or abstract carries a Canadian signal from the geographic lexicon.
no affNo Canadian affiliation: this work is invisible to an affiliation-only frame.
No Canadian affiliation. An affiliation-only frame, the usual design, would never have seen this work. It is one of the works that make the case for inverting the frame.

Bibliographic record

VenuecIRcle (University of British Columbia) · 2008
Typearticle
Languageen
FieldComputer Science
TopicEducational Methods and Media Use
Canadian institutionsnot available
Fundersnot available
KeywordsReading (process)Norm (philosophy)Identification (biology)Norm-referenced testCurriculumComputer scienceMathematicsMathematics educationArtificial intelligenceNatural language processingPsychologyLinguisticsPedagogyCriterion-referenced testEpistemologyStandardized testPhilosophy

Abstract

fetched live from OpenAlex

The purpose of this study is to investigate the technical adequacy of two reading Curriculum—Based Measures (CBM5), to examine the relationships of the CBM5 to normreferenced tests, and to compare the strength of relationship of both kinds of measures to school—based indices of reading performance. The two CBMs (a word list sampled from several reading series and a passage reading test composed of ten Ginn 720 passages) were taken from the literature; comprehensive information about their technical adequacy had not been previously available. A review of the literature indicates that CBM, particularly reading CBM, is gaining increased attention in education because of claims regarding its utility in monitoring pupil progress, its ease of administration, and its relationship to local curricula as well as to learning gains. This study examined how reading CBMs and two subtests from the Kaufman Test of Educational Achievement (Kaufman & Kaufman, 1985) relate to each other and to three school—based indices of reading performance: a school district reading test, program placement status (learning disabled or regular education), and a teacher rating scale of reading skill. Grade four students from one metropolitan Vancouver school district served as subjects (n=105). Of these, 35 were classified as learning disabled and 70 were classified as regular education. Learning disabled status was determined by judgments of a school district screening committee and by examining previous psychoeducational assessments. Reliability indices calculated on the CBMs supported claims for technical adequacy. These estimates were as follows: internal consistency of the word list was .97, internal consistency of the reading passages was .98 and .94 for reading speed and accuracy, test—retest reliability of the reading passages was .89 and .79 for reading speed and accuracy, and inter—rater reliability of the reading passages was .99 and .96 for reading speed and accuracy. Results indicated that the CBMs used in this study have high reliabilities. CBM5, especially the speed score from the- reading passages, demonstrated strong relationships to the two norm—referenced subtests. The pattern of correlations between the measures differed between the learning disabled and normal sample; analyses of variance demonstrated that all measures used in the study discriminated between the learning disabled and the regular education groups. Stepwise multiple regression and canonical analysis indicated that the two norm—referenced subtests, the speed score from the Curriculum—Based Reading Passages, and the accuracy score from the Curriculum—Based Word List were most efficient in “predicting” the three school-based indices of reading performance. Evidence for concurrent validity of curriculum—based and norm—referenced measures was found in this study. When administration time, instructional utility, and technical properties are considered, results indicated that the Kaufman Test of Educational Achievement Reading Decoding subtest and the Curriculum—Based Reading Passages speed score are the most efficient of the predictor measures investigated in identifying and programming for Year Four children with significant reading difficulty. Implications for further research and the potential of CBM to accommodate instructional and measurement needs is discussed.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

Full frame distilled prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.

metaresearch head score (Codex)0.000
metaresearch head score (Gemma)0.000
Version: codex-gemma-dda1882f352aValidation status: machine_predicted_unvalidated
Candidate categoriesnone
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Observational · Consensus signal: Observational
GenreCandidate signal: Empirical · Consensus signal: Empirical
Teacher disagreement score0.437
Threshold uncertainty score0.997

Codex and Gemma teacher scores by category

CategoryCodexGemma
Metaresearch0.0000.000
Meta-epidemiology (narrow)0.0000.000
Meta-epidemiology (broad)0.0000.000
Bibliometrics0.0000.000
Science and technology studies0.0000.000
Scholarly communication0.0000.000
Open science0.0000.000
Research integrity0.0000.000
Insufficient payload (model declined to judge)0.0000.000

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.037
GPT teacher head0.260
Teacher spread0.222 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it