MétaCan
Menu
Back to cohort

Behaviour change techniques taxonomy v1: Feedback to inform the development of an ontology

2023· preprint· en· W4317614913 on OpenAlex

Why this work is in the frame

A frame that forgets how it found something cannot be audited. These are the routes that admitted this work.

affAt least one author lists a Canadian institution in the pinned OpenAlex snapshot.

Bibliographic record

VenueWellcome Open Research · 2023
Typepreprint
Languageen
FieldPsychology
TopicBehavioral Health and Interventions
Canadian institutionsUniversity of New Brunswick
FundersWellcome Trust
KeywordsCLARITYComputer scienceTaxonomy (biology)Psychological interventionVariety (cybernetics)OntologyBehaviour changeData scienceKnowledge managementPsychologyArtificial intelligence

Abstract

fetched live from OpenAlex

<ns3:p> <ns3:bold>Background:</ns3:bold> To build cumulative evidence about what works in behaviour change interventions, efforts have been made to develop classification systems for specifying the content of interventions. The Behaviour Change Techniques (BCT) Taxonomy v1 (BCTTv1) is one of the most widely used classifications of behaviour change techniques across a variety of behaviours. The BCTTv1 was intentionally named version 1 to allow for further revisions to the taxonomy. This study aimed to gather data to improve the BCTTv1 and provide recommendations for developing it into a more elaborated knowledge structure, an ontology. </ns3:p> <ns3:p> <ns3:bold>Methods:</ns3:bold> Feedback from users of BCTTv1 about limitations and proposed improvements was collected through the BCT website, user survey, researchers and experts involved in the Human Behaviour-Change Project, and a consultation. In addition, relevant published research reports and other classification systems of BCTs were analysed. These data were synthesised to produce recommendations to inform the development of an ontology of BCTs. </ns3:p> <ns3:p> <ns3:bold>Results:</ns3:bold> A total of 282 comments from six sources were reviewed and synthesised into four categories of suggestions: additional BCTs, amendments to labels and definitions of specific BCTs, amendments to the groupings, and general improvements. Feedback suggested some lack of clarity regarding understanding and identifying techniques from labels, definitions, and examples; distinctions and relations between BCTs; and knowing what they would look like in practice. Three recommendations to improve the BCTTv1 resulted from this analysis: to review the label and definition of each BCT, the 16 groupings of BCTs, and the examples illustrating BCTs. </ns3:p> <ns3:p> <ns3:bold>Conclusions</ns3:bold> <ns3:italic>:</ns3:italic> This review of feedback about BCTTv1 identified the need to improve the precision and knowledge structure of the current taxonomy. A BCT ontology would enable the specification of relationships between BCTs, more precise definitions, and allow better interoperability with other ontologies. This ontology will be developed as part of the Human Behaviour-Change Project. </ns3:p>

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

Full frame distilled prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.

metaresearch head score (Codex)0.007
metaresearch head score (Gemma)0.000
Version: codex-gemma-dda1882f352aValidation status: machine_predicted_unvalidated
Candidate categoriesInsufficient payload (model declined to judge)
Consensus categoriesInsufficient payload (model declined to judge)
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Other design · Consensus signal: none
GenreCandidate signal: Empirical · Consensus signal: Empirical
Teacher disagreement score0.874
Threshold uncertainty score0.998

Codex and Gemma teacher scores by category

CategoryCodexGemma
Metaresearch0.0070.000
Meta-epidemiology (narrow)0.0000.000
Meta-epidemiology (broad)0.0010.000
Bibliometrics0.0010.001
Science and technology studies0.0010.000
Scholarly communication0.0000.000
Open science0.0050.007
Research integrity0.0010.002
Insufficient payload (model declined to judge)0.0040.003

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.707
GPT teacher head0.577
Teacher spread0.130 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it