MétaCan
Menu
Back to cohort
Record W3046841821 · doi:10.1177/1362361320944011

Identifying and measuring the common elements of naturalistic developmental behavioral interventions for autism spectrum disorder: Development of the <i>NDBI-Fi</i>

2020· article· en· W3046841821 on OpenAlex

Why this work is in the frame

A frame that forgets how it found something cannot be audited. These are the routes that admitted this work.

affAt least one author lists a Canadian institution in the pinned OpenAlex snapshot.
fundA Canadian funder is recorded on the work.

Bibliographic record

VenueAutism · 2020
Typearticle
Languageen
FieldNeuroscience
TopicAutism Spectrum Disorder Research
Canadian institutionsHolland Bloorview Kids Rehabilitation Hospital
FundersCongressionally Directed Medical Research ProgramsMaternal and Child Health BureauStollery Children’s Hospital FoundationNational Institute of Mental HealthNational Institute on Deafness and Other Communication DisordersClifford Craig FoundationU.S. Department of EducationAutism Speaks
KeywordsPsychological interventionAutismPsychologyAutism spectrum disorderIntervention (counseling)Naturalistic observationDevelopmental psychologyObservational studyDevelopmental disorderClinical psychologyPsychiatryMedicineSocial psychology

Abstract

fetched live from OpenAlex

Naturalistic developmental behavioral interventions for young children with autism spectrum disorder share key elements. However, the extent of similarity and overlap in techniques among naturalistic developmental behavioral intervention models has not been quantified, and there is no standardized measure for assessing the implementation of their common elements. This article presents a multi-stage process which began with the development of a taxonomy of elements of naturalistic developmental behavioral interventions. Next, intervention experts identified the common elements of naturalistic developmental behavioral interventions using quantitative methods. An observational rating scheme of those common elements, the eight-item NDBI-Fi, was developed. Finally, preliminary analyses of the reliability and the validity of the NDBI-Fi were conducted using archival data from randomized controlled trials of caregiver-implemented naturalistic developmental behavioral interventions, including 87 post-intervention caregiver–child interaction videos from five sites, as well as 29 pre–post video pairs from two sites. Evaluation of the eight-item NDBI-Fi measure revealed promising psychometric properties, including evidence supporting adequate reliability, sensitivity to change, as well as concurrent, convergent, and discriminant validity. Results lend support to the utility of the NDBI-Fi as a measure of caregiver implementation of common elements across naturalistic developmental behavioral intervention models. With additional validation, this unique measure has the potential to advance intervention science in autism spectrum disorder by providing a tool which cuts across a class of evidence-based interventions. Lay abstract Naturalistic developmental behavioral interventions for young children with autism spectrum disorder share key elements. However, the extent of similarity between programs within this class of evidence-based interventions is unknown. There is also currently no tool that can be used to measure the implementation of their common elements. This article presents a multi-stage process which began with defining all intervention elements of naturalistic developmental behavioral interventions. Next, intervention experts identified the common elements of naturalistic developmental behavioral interventions using a survey. An observational rating scheme of those common elements, the eight-item NDBI-Fi, was developed. We evaluated the quality of the NDBI-Fi using videos from completed trials of caregiver-implemented naturalistic developmental behavioral interventions. Results showed that the NDBI-Fi measure has promise; it was sensitive to change, related to other similar measures, and demonstrated adequate agreement between raters. This unique measure has the potential to advance intervention science in autism spectrum disorder by providing a tool to measure the implementation of common elements across naturalistic developmental behavioral intervention models. Given that naturalistic developmental behavioral interventions have numerous shared strategies, this may ease clinicians’ uncertainty about choosing the “right” intervention package. It also suggests that there may not be a need for extensive training in more than one naturalistic developmental behavioral intervention. Future research should determine whether these common elements are part of other treatment approaches to better understand the quality of services children and families receive as part of usual care.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

Full frame distilled prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.

metaresearch head score (Codex)0.000
metaresearch head score (Gemma)0.000
Version: codex-gemma-dda1882f352aValidation status: machine_predicted_unvalidated
Candidate categoriesnone
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Bench or experimental · Consensus signal: none
GenreCandidate signal: Empirical · Consensus signal: Empirical
Teacher disagreement score0.423
Threshold uncertainty score0.581

Codex and Gemma teacher scores by category

CategoryCodexGemma
Metaresearch0.0000.000
Meta-epidemiology (narrow)0.0000.000
Meta-epidemiology (broad)0.0000.000
Bibliometrics0.0000.000
Science and technology studies0.0010.000
Scholarly communication0.0000.000
Open science0.0010.001
Research integrity0.0000.000
Insufficient payload (model declined to judge)0.0000.000

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.130
GPT teacher head0.354
Teacher spread0.224 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it