MétaCan
Menu
Back to cohort
Record W4390591074 · doi:10.1111/tops.12721

Introduction to <i>topiCS</i> Volume 16, Issue 1

2024· article· en· W4390591074 on OpenAlex
Andrea Bender

Why this work is in the frame

A frame that forgets how it found something cannot be audited. These are the routes that admitted this work.

aboutThe title or abstract carries a Canadian signal from the geographic lexicon.
no affNo Canadian affiliation: this work is invisible to an affiliation-only frame.
No Canadian affiliation. An affiliation-only frame, the usual design, would never have seen this work. It is one of the works that make the case for inverting the frame.

Bibliographic record

VenueTopics in Cognitive Science · 2024
Typearticle
Languageen
FieldComputer Science
TopicCognitive Science and Mapping
Canadian institutionsnot available
Fundersnot available
KeywordsCognitionVariety (cybernetics)PsychologyCognitive scienceSociologyComputer scienceArtificial intelligenceNeuroscience

Abstract

fetched live from OpenAlex

The first of this year's Topics in Cognitive Science issues is entirely devoted to excellent and award-winning research. We kick off with the newest contribution to the (ongoing) topic aimed at introducing the Fellows of the Cognitive Science Society (outlined in Bender, 2022), so far featuring articles by Cleotilde “Coty” Gonzalez (Gonzalez, 2022), Steven Sloman (Sloman, 2022), Jenny R. Saffran (Ruba, Pollak, & Saffran, 2022), and Michael J. Spivey (Spivey, 2023). This exclusive group is now joined by Barbara Malt from Lehigh University (US), who was elected Fellow of the Cognitive Science Society in 2022. In her paper “Representing the world in language and thought,” Malt (2024) provides an overview of her lifelong research program. Leveraging a remarkable variety of methodological paradigms, settings, and samples, this research has investigated the relationship between the content of thoughts and the words expressing them, and explored to what extent the latter open a window into the former. As Barbara pointed out in a personal note to me, the invitation to write a Fellows paper came at the right time, just as she was preparing for retirement. My wish is for her to fully embrace this new freedom, allowing herself to devote more time to the activities she holds dear, while I also hope that, even in retirement, she will continue to be a source of inspiration for the field of cognitive science. Incidentally, the final topic in this issue, too, presents Best Papers, in this case from the 20th International Conference on Cognitive Modeling in 2022. For this topic, Terrence C. Stewart (National Research Council Canada) has assembled the revised and expanded versions of the four top-ranked papers across both the virtual and in-person events of that year's ICCM, which was the first fully hybrid version of the conference. As Stewart points out in his introduction, these papers leverage cognitive modeling to test novel computational theories, account for the generation of high-level phenomena from low-level components, and develop novel explanations of human performance in complex tasks. topiCS encourages letters and commentaries on all topics, as well as proposals for new topics. Letters are not longer than two published pages (ca. 400–1000 words). Commentaries (between 1000 and 2000 words) are often solicited by Topic Editors prior to the publication of their topic, but they may also be considered after publication. Letters and commentaries typically come without abstract and with few references, if any. The Executive Editor and the Senior Editorial Board (SEB) are constantly searching for new and exciting topics for topiCS. Feel free to open communications with a short note to the Executive Editor ([email protected]) or a member of the SEB (for a list, see the publisher's homepage for topiCS: http://onlinelibrary.wiley.com/journal/10.1111/(ISSN)1756-8765/homepage/EditorialBoard.html).

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

Full frame distilled prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.

metaresearch head score (Codex)0.001
metaresearch head score (Gemma)0.001
Version: codex-gemma-dda1882f352aValidation status: machine_predicted_unvalidated
Candidate categoriesInsufficient payload (model declined to judge)
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Other design · Consensus signal: none
GenreCandidate signal: Empirical · Consensus signal: none
Teacher disagreement score0.931
Threshold uncertainty score1.000

Codex and Gemma teacher scores by category

CategoryCodexGemma
Metaresearch0.0010.001
Meta-epidemiology (narrow)0.0000.000
Meta-epidemiology (broad)0.0000.000
Bibliometrics0.0010.005
Science and technology studies0.0000.000
Scholarly communication0.0010.002
Open science0.0010.001
Research integrity0.0000.000
Insufficient payload (model declined to judge)0.0000.001

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.024
GPT teacher head0.310
Teacher spread0.287 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it