MétaCan
Menu
Back to cohort
Record W3029930773 · doi:10.1177/0146167220916631

Meta-Analytic Use of Balanced Identity Theory to Validate the Implicit Association Test

2020· review· en· W3029930773 on OpenAlexaff
Dario Cvencek, Andrew N. Meltzoff, Craig D. Maddox, Brian A. Nosek, Laurie A. Rudman, Thierry Devos, Yarrow Dunham, Andrew Scott Baron, Melanie C. Steffens, Kristin A. Lane, Javier Horcajo, Leslie Ashburn‐Nardo, Amanda Quinby, Sameer B. Srivastava, Kathleen Schmidt, Eugene Aidman, Emilie Tang, Shelly Farnham, Deborah S. Mellott, Mahzarin R. Banaji, Anthony G. Greenwald

Bibliographic record

VenuePersonality and Social Psychology Bulletin · 2020
Typereview
Languageen
FieldSocial Sciences
TopicSocial and Intergroup Psychology
Canadian institutionsUniversity of British Columbia
FundersDirectorate for Social, Behavioral and Economic SciencesDirectorate for Education and Human ResourcesUniversity of WashingtonNational Science Foundation
KeywordsImplicit-association testPsychologySocial psychologyTest (biology)PreferenceMeta-analysisIdentity (music)Balance (ability)Set (abstract data type)Social identity theoryAssociation (psychology)Cognitive psychologyStatisticsComputer scienceSocial groupMathematics

Abstract

fetched live from OpenAlex

This meta-analysis evaluated theoretical predictions from balanced identity theory (BIT) and evaluated the validity of zero points of Implicit Association Test (IAT) and self-report measures used to test these predictions. Twenty-one researchers contributed individual subject data from 36 experiments (total N = 12,773) that used both explicit and implicit measures of the social–cognitive constructs. The meta-analysis confirmed predictions of BIT’s balance–congruity principle and simultaneously validated interpretation of the IAT’s zero point as indicating absence of preference between two attitude objects. Statistical power afforded by the sample size enabled the first confirmations of balance–congruity predictions with self-report measures. Beyond these empirical results, the meta-analysis introduced a within-study statistical test of the balance–congruity principle, finding that it had greater efficiency than the previous best method. The meta-analysis’s full data set has been publicly archived to enable further studies of interrelations among attitudes, stereotypes, and identities.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.067
metaresearch head score (Gemma)0.160
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesnone
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Meta-analysis · Consensus signal: Meta-analysis
GenreCandidate signal: Empirical · Consensus signal: none
Teacher disagreement score0.067
Threshold uncertainty score0.356

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.0670.160
Meta-epidemiology (narrow)0.0030.001
Meta-epidemiology (broad)0.0120.028
Bibliometrics0.0170.013
Science and technology studies0.0010.001
Scholarly communication0.0050.003
Open science0.0040.002
Research integrity0.0020.003
Insufficient payload (model declined to judge)0.0030.000

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.259
GPT teacher head0.455
Teacher spread0.196 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.

The models applied no category: nothing in the taxonomy fit this work.
Study designMeta-analysis
Domainnot available
GenreEmpirical

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations44
Published2020
Admission routes1
Has abstractyes

Explore more

Same venuePersonality and Social Psychology BulletinSame topicSocial and Intergroup PsychologyFrench-language works237,207