Towards development of guidelines for virtual administration of paediatric standardized language and literacy assessments: Considerations for clinicians and researchers
Why this work is in the frame
A frame that forgets how it found something cannot be audited. These are the routes that admitted this work.
Bibliographic record
Abstract
OBJECTIVES: Previous virtual care literature within the field of speech-language pathology has primarily focused on validating the virtual use of intervention programmes. There are fewer articles addressing the validity of conducting virtual assessments, particularly standardized assessment of oral language and literacy abilities in children. In addition, there is a lack of practical, useful recommendations available to support clinicians and researchers on how to conduct these assessment measures virtually. Given the recent rapid rise in virtual care and research as a result of the Coronavirus-19 pandemic, clinicians and researchers require guidance on best practices for virtual administration of these tools imminently. This article seeks to fill this gap in the literature by providing such recommendations. METHODS: We (a) completed a narrative review of the extant literature, and (b) conducted semi-structured interviews with a group of 12 clinicians, students and researchers who had administered standardized language and literacy assessments with a variety of monolingual and multilingual school-aged children, with and without speech and language difficulties, in clinical and research settings. Six themes: candidacy for virtual assessment, communication and collaboration with caregivers, technology and equipment, virtual administration, ethics, consent and confidentiality, and considerations for bilingual populations were identified as a result of these two processes and were used to develop a set of recommendations to guide the use of standardized assessments in a virtual setting. In line with the Guidelines International Network, these recommendations were rated by group members, and reviewed by external stakeholders. A quasi-Delphi consensus procedure was used to reach agreement on ratings for recommendations. RESULTS: We have developed and outlined several recommendations for clinicians and researchers to guide their use of standardized language and literacy assessments in virtual care, across six key themes. CONCLUSIONS: This article is one of the first to share practical recommendations for virtual assessment in the domain of oral language and literacy assessment for clinicians and researchers. We hope the current recommendations will facilitate future clinical research in this area, and as the body of research in this field grows, this article will act as a basis for the development of formal Clinical Practice Guidelines.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
Full frame distilled prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.
Codex and Gemma teacher scores by category
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.002 | 0.005 |
| Meta-epidemiology (narrow) | 0.000 | 0.000 |
| Meta-epidemiology (broad) | 0.001 | 0.000 |
| Bibliometrics | 0.000 | 0.000 |
| Science and technology studies | 0.000 | 0.000 |
| Scholarly communication | 0.000 | 0.000 |
| Open science | 0.000 | 0.000 |
| Research integrity | 0.000 | 0.000 |
| Insufficient payload (model declined to judge) | 0.000 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it