MétaCan
Menu
Back to cohort
Record W4405371696 · doi:10.1093/jos/ffae016

Competence by default: do listeners assume that speakers are knowledgeable when computing conversational inferences?

2024· article· en· W4405371696 on OpenAlex

Why this work is in the frame

A frame that forgets how it found something cannot be audited. These are the routes that admitted this work.

affAt least one author lists a Canadian institution in the pinned OpenAlex snapshot.
fundA Canadian funder is recorded on the work.

Bibliographic record

VenueJournal of Semantics · 2024
Typearticle
Languageen
FieldArts and Humanities
TopicLanguage, Discourse, Communication Strategies
Canadian institutionsConcordia University
FundersSocial Sciences and Humanities Research Council of CanadaUniversity of California, San Diego
KeywordsCompetence (human resources)Computer scienceLinguisticsPsychologySocial psychologyPhilosophy

Abstract

fetched live from OpenAlex

Abstract When engaged in conversation, do listeners make default assumptions about the epistemic states of speakers? According to some accounts, when listeners hear a sentence like “Sarah solved some of the math problems,” they infer by default that speakers believe that the stronger statement involving “all” is false (i.e. that Sarah did not solve all of the problems). However, drawing on tests of reading time, eye tracking, and manipulations of cognitive load, multiple studies have argued that this form of inference (i.e. strong scalar implicature) is not computed by default. In this study, while acknowledging this claim, we explore whether important subprocesses of implicature might nevertheless involve default inferences. In particular, we tested whether listeners assume by default that speakers are knowledgeable about alternative utterances that are left unsaid—a critical precondition for computing strong scalar implicatures. To do this, we tested 60 English-speaking participants who heard utterances made by either knowledgeable speakers or ignorant speakers. In addition, half of these participants were placed under cognitive load using a dot-array memory task. We found that participants placed under load over-computed implicatures when speakers were ignorant, as though assuming that they were knowledgeable by default.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

Full frame distilled prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.

metaresearch head score (Codex)0.000
metaresearch head score (Gemma)0.000
Version: codex-gemma-dda1882f352aValidation status: machine_predicted_unvalidated
Candidate categoriesScholarly communication, Insufficient payload (model declined to judge)
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Not applicable · Consensus signal: none
GenreCandidate signal: Empirical · Consensus signal: Empirical
Teacher disagreement score0.471
Threshold uncertainty score1.000

Codex and Gemma teacher scores by category

CategoryCodexGemma
Metaresearch0.0000.000
Meta-epidemiology (narrow)0.0000.000
Meta-epidemiology (broad)0.0000.000
Bibliometrics0.0000.000
Science and technology studies0.0000.000
Scholarly communication0.0010.001
Open science0.0000.000
Research integrity0.0000.000
Insufficient payload (model declined to judge)0.0010.000

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.054
GPT teacher head0.286
Teacher spread0.233 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it