Validation of Videoconference Administration of Picture Description From the Western Aphasia Battery–Revised in Neurotypical Canadian French Speakers
Bibliographic record
Abstract
Purpose: During the COVID-19 pandemic, clinicians and researchers have increasingly used remote online assessments to pursue their activities, but mostly with tests not validated for videoconference administration. This study aims to validate the remote online administration of picture description in Canadian French neurotypical speakers and to explore the thematic unit (TU) checklist recently developed. Method: Spoken discourse elicited through the picture description task of the Western Aphasia Battery–Revised (WAB-R) was collected from Canadian French neurotypical speakers from Québec aged between 50 and 79 years old. Forty-seven participants completed the task in person, and 49 participants completed the task by videoconference. Videos of each discourse sample were transcribed using CHAT conventions. Microstructural variables were extracted using the CLAN (Computerized Language ANalysis) program, whereas thematic informativeness was scored for each sample using TUs. Chi-square tests were conducted to compare both groups on each TU; t tests were also performed on the total score of TUs and microstructural variables. Results: Groups were matched on sex, age, and education variables. The t tests revealed no intergroup difference for the total TU score and for the microstructural variables (e.g., mean length of utterances and number of words per minute). Chi-square tests showed no significant intergroup difference for all 16 TUs. Conclusions: These findings support remote online assessment of the picnic scene of the WAB-R picture description in Canadian French neurotypical speakers. These results also validate the 16 TUs most consistently produced. The use of videoconference could promote and improve the recruitment of participants who are usually less accessible, such as people using assistive mobility technologies. Supplemental Material: https://doi.org/10.23641/asha.21476961
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame distilled prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.
Codex and Gemma teacher scores by category
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.001 | 0.000 |
| Meta-epidemiology (narrow) | 0.000 | 0.000 |
| Meta-epidemiology (broad) | 0.000 | 0.000 |
| Bibliometrics | 0.000 | 0.000 |
| Science and technology studies | 0.000 | 0.000 |
| Scholarly communication | 0.000 | 0.000 |
| Open science | 0.001 | 0.000 |
| Research integrity | 0.000 | 0.001 |
| Insufficient payload (model declined to judge) | 0.000 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one teacher head, not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".