MétaCan
Menu
Back to cohort
Record W1981591494 · doi:10.1353/lan.2014.0077

How Field Linguists have been Investigating Linguistic Diversity: Commentary on Davis, Gillon, and Matthewson

2014· article· en· W1981591494 on OpenAlex

Why this work is in the frame

A frame that forgets how it found something cannot be audited. These are the routes that admitted this work.

aboutThe title or abstract carries a Canadian signal from the geographic lexicon.
no affNo Canadian affiliation: this work is invisible to an affiliation-only frame.
No Canadian affiliation. An affiliation-only frame, the usual design, would never have seen this work. It is one of the works that make the case for inverting the frame.

Bibliographic record

VenueLanguage · 2014
Typearticle
Languageen
FieldSocial Sciences
TopicMultilingual Education and Policy
Canadian institutionsnot available
Fundersnot available
KeywordsAssertionLinguisticsDiversity (politics)Statement (logic)PsychologyField (mathematics)PerceptionEpistemologySociologyPhilosophyComputer science

Abstract

fetched live from OpenAlex

How field linguists have been investigating linguistic diversity:Commentary on Davis, Gillon, and Matthewson Willem de Reuse I begin by congratulating Davis, Gillon, and Matthewson (DG&M; 2014) on this clear, eloquent, provocative, and insightful article. There are many points in this article on which the so-called ‘D-linguists’ and ‘C-linguists’ will wholeheartedly agree, regardless of their theoretical backgrounds. My comments focus on five areas where a more nuanced approach might have been helpful. I conclude with a substantial objection to the article. This objection has more to do with DG&M’s perception of fieldwork as conducted and defined by ‘D-linguists’ than with the investigation of linguistic diversity. I first consider the following statement in the ‘fieldwork methodologies’ section (p. e189): Of course, this [reliance on grammatical intuitions of native speakers—WdR] entails a methodological commitment to the validity of such intuitions. In our own experience, we have found that our consultants—many of whom do not read or write their first language, and almost none of whom have any formal training in linguistics—are remarkably consistent in their judgments of very complex structures, over literally years of elicitation. To evaluate this quote fairly, let me be clear that we agree on the validity of intuitions, and that intuitions are useful in semantic and syntactic elicitation, indeed in any sort of elicitation. What puzzles me in the quote above is the assertion that linguistically unsophisticated speakers are ‘remarkably consistent’ and are this way ‘over literally years of elicitation’. My own experience with speakers of two endangered languages of North America, Western Apache of Arizona (twenty years of fieldwork experience) and Hän Athabaskan of Alaska and Yukon Territory (seven years of fieldwork experience), is surprisingly different. Like the authors, I cultivate and value a close personal and collaborative relationship with the speakers of these languages, but I do not find this remarkable consistency at all. On the contrary, speakers change their minds over the years. Not only do they change their minds regarding judgments, but they even provide volunteered forms that directly contradict forms volunteered earlier. There is not only interspeaker variation, but intraspeaker variation as well. It is not unusual for the same speaker to volunteer a form and, a few weeks, months, or years later, reject it as something s/he would never say. So let me say that I am puzzled by DG&M’s report of the consistency of the Northwest Coast speakers. I must assume that the elders of this area are more native-language dominant and/or have much better language recall. It may be that the authors report more consistency because their focus is on syntactic and semantic elicitation, whereas most of my Athabaskan fieldwork involves morphological elicitation. But then again, I see no reason why syntactic or semantic complexity would be more amenable to consistency than morphological complexity. If anything, I would expect morphology to be more stable than syntax. In any case, our contradictory experiences are worthy of mention. Of course, the degree of language endangerment has something to do with it. Speakers of Western Apache, part of a community of c. 6,000 speakers, are not nearly as inconsistent [End Page e227] in their judgments as are the nine remaining speakers of Hän Athabaskan. It is well known that terminal speakers tend to increase morphological complexity and do so in inconsistent ways, as documented for a Scottish Gaelic variety by Dorian (1981). My second comment has to with §3.1, ‘Condition C meets Nuu-chah-nulth’. I have no reason to doubt the accuracy of the data or DG&M’s conclusion that condition C does not hold in the Nuu-chah-nulth language (or in other languages). What I am curious about is n. 13 (p. e191), reproduced in full here: As has been known at least since G. Evans 1980, these judgments can be affected by focus, or more broadly by a distinction between presupposed and asserted content. Focus has been controlled for in the Nuu-chah-nulth examples given here. But how does one reliably control for focus when eliciting data from elderly speakers of an endangered language? One has to find...

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

Full frame distilled prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.

metaresearch head score (Codex)0.000
metaresearch head score (Gemma)0.003
Version: codex-gemma-dda1882f352aValidation status: machine_predicted_unvalidated
Candidate categoriesnone
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Not applicable · Consensus signal: none
GenreCandidate signal: Empirical · Consensus signal: Empirical
Teacher disagreement score0.898
Threshold uncertainty score0.984

Codex and Gemma teacher scores by category

CategoryCodexGemma
Metaresearch0.0000.003
Meta-epidemiology (narrow)0.0000.000
Meta-epidemiology (broad)0.0000.000
Bibliometrics0.0000.000
Science and technology studies0.0010.000
Scholarly communication0.0000.000
Open science0.0000.000
Research integrity0.0000.000
Insufficient payload (model declined to judge)0.0000.000

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.041
GPT teacher head0.389
Teacher spread0.349 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it