Bibliographic record
Abstract
Abstract Since the early 1990s, there has been a growing awareness that combining quantitative and qualitative data from diverse sources could add value to several ongoing issues in language assessment/testing (LT) research. This entry describes an instrument development project for assessment and evaluation purposes using an MMR design. Language barriers can arise when members of linguistic minorities and their health professionals do not speak the same first language. This entry reports on the first part of an L2 assessment development project where construct definition was the focus. The purpose was to identify and validate a set of speech tasks relating to nurse interactions with patients and to derive the L2 ability required for nurses to carry out those tasks. The research design had two sequential phases. The first phase (qualitative) included a literature review leading to an initial list of speech tasks, and validation of this list with a nurse focus group, followed by verbal protocol with a nurse expert. The retained speech tasks were then developed into a questionnaire and administered to 133 nurses who assessed each speech task for difficulty in an L2 context. The second phase (quantitative) included descriptive statistics, Rasch analysis, exploratory and confirmatory factor analyses, and alignment of resulting speech tasks with the Canadian Language Benchmarks. Results showed that speech tasks dealing with emotional aspects of caregiving and conveying health‐specific information were reported as being the most demanding in terms of L2 ability and the most strongly associated with L2 ability required for nurse–patient interactions.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame machine prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.
Distilled classifier scores by category (both heads)
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.476 | 0.486 |
| Meta-epidemiology (narrow) | 0.002 | 0.002 |
| Meta-epidemiology (broad) | 0.005 | 0.003 |
| Bibliometrics | 0.011 | 0.013 |
| Science and technology studies | 0.005 | 0.005 |
| Scholarly communication | 0.013 | 0.006 |
| Open science | 0.006 | 0.006 |
| Research integrity | 0.003 | 0.003 |
| Insufficient payload (model declined to judge) | 0.012 | 0.002 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".