MétaCan
Menu
Back to cohort
Record W6962694274 · doi:10.17605/osf.io/7ejbu

Study 3 - non-verbal cues in sincere testimonies

2024· other· en· W6962694274 on OpenAlexaboutno aff

Bibliographic record

VenueOpen Science Framework · 2024
Typeother
Languageen
Field
Topic
Canadian institutionsnot available
Fundersnot available
KeywordsCredibilityWitnessDeceptionFeelingInterpretation (philosophy)PerceptionAffect (linguistics)SuggestibilityPriming (agriculture)

Abstract

fetched live from OpenAlex

Prior research has extensively examined witnesses’ non-verbal cues in legal contexts, primarily focusing on the association between these cues and deception. Yet, findings reveal only weak and small effects between such cues and deception (e.g., DePaulo et al., 2003; Hartwig & Bond, 2011; Vrij & Granhag, 2012). Luke (2019) further cautions that these correlations might be overstated due to publication bias and methodological limitations, underscoring the challenges in distinguishing true effects from statistical artifacts in deception studies. Despite these insights, a notable gap remains in understanding how non-verbal cues relate to accuracy in honestly reported witness testimonies, an area that has received less attention. Honestly testimonies refer to recollections from memory without the intent to deceive. Currently, the impact of non-verbal cues on the accuracy and credibility of witness statements remains poorly understood. Krahmer and Swerts (2005) demonstrated that visual cues, such as changes in facial expressions, are indicative of a speaker's Feeling of Knowing (FOK), thus signaling potential uncertainty. These findings suggest that such cues could affect perceptions of a witness’ credibility in legal contexts, as they complement verbal communication and influence the observer's interpretation and understanding of the testimony (Esteve-Gibert & Guellaï, 2018). However, using non-verbal cues for credibility assessments in legal settings is fraught with challenges. For example, Denault et al. (2023) reveal that Canadian judges do rely on such cues—like eye contact, gestures, and tone—for credibility judgments, despite no empirical evidence of the reliability of these cues. This reliance, amidst the scientific uncertainties about interpreting these cues, underscores the problematic nature of their use in critical legal decisions. Taken together, observable markers that could differentiate accurate from inaccurate statements in honest testimonies are of both theoretical and practical interest, yet such distinctions have not been investigated before. This study builds on the findings of Raver et al. (2023), which revealed that non-native speaking witnesses reported lower confidence and were perceived as less credible than native speakers, even though their testimonies were equally accurate. This complexity suggests a detailed examination is needed. Therefore, we will set out to investigate if (H1) non-verbal cues are associated with the accuracy of statements, investigating whether display of such cues can reliably predict whether statements are correct or incorrect, and if so (H2) whether this differs between native vs. non-native speaking witnesses. Also, we will examine (H3) the relation between non-verbal cues and witnesses’ self-reported confidence, assessing how these cues correlate with the confidence witnesses report in their own statements. Lastly, (H4) we will investigate how the display of non-verbal cues relate to the perceived credibility of the witness by independent observers.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.011
metaresearch head score (Gemma)0.101
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesnone
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Observational · Consensus signal: none
GenreCandidate signal: Other · Consensus signal: none
Teacher disagreement score0.012
Threshold uncertainty score0.056

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.0110.101
Meta-epidemiology (narrow)0.0010.001
Meta-epidemiology (broad)0.0010.001
Bibliometrics0.0010.001
Science and technology studies0.0030.002
Scholarly communication0.0050.007
Open science0.0010.006
Research integrity0.0040.005
Insufficient payload (model declined to judge)0.0120.002

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.043
GPT teacher head0.406
Teacher spread0.364 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.

The models applied no category: nothing in the taxonomy fit this work.
Study designObservational
Domainnot available
GenreOther

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations0
Published2024
Admission routes1
Has abstractyes

Explore more

Same venueOpen Science FrameworkFrench-language works237,207