MétaCan
Menu
Back to cohort
Record W4301372137 · doi:10.1111/tops.12627

Introduction to <i>topiCS</i> Volume 14, Issue 4

2022· editorial· en· W4301372137 on OpenAlex
Andrea Bender

Why this work is in the frame

A frame that forgets how it found something cannot be audited. These are the routes that admitted this work.

aboutThe title or abstract carries a Canadian signal from the geographic lexicon.
no affNo Canadian affiliation: this work is invisible to an affiliation-only frame.
No Canadian affiliation. An affiliation-only frame, the usual design, would never have seen this work. It is one of the works that make the case for inverting the frame.

Bibliographic record

VenueTopics in Cognitive Science · 2022
Typeeditorial
Languageen
FieldComputer Science
TopicCognitive Science and Mapping
Canadian institutionsnot available
Fundersnot available
KeywordsCognitive scienceCognitionCognitive architecturePsychologyArtificial intelligenceComputer science

Abstract

fetched live from OpenAlex

In the recent debate about the unity and integration of cognitive science (Núñez et al., 2019, 2020; see also commentaries in topiCS 11:4, introduced by Gray, 2019), one focus of the argument rested on the predominance of cognitive psychology and the displacement of smaller disciplines, such as anthropology and philosophy. Much less attention has been paid to the fact that another key player in the genesis of cognitive science has been withdrawing from the joint endeavor: artificial intelligence (AI) and computer science (Forbus, 2010; Goel, 2019). Although not framed in terms of the recent debate, the two topics in the current issue of topiCS are germane to this concern, as they both focus on cognitive modeling—arguably a signature approach of cognitive science and a natural link to AI. The call for rapprochement is clearest in the first topic, Cognition-Inspired Artificial Intelligence, edited by Daniel N. Cassenti (DEVCOM Army Research Laboratory), Vladislav D. Veksler (Caldwell University), and Frank E. Ritter (Pennsylvania State University). To showcase how cognitive science has not just benefitted from advances in AI, but can and should inspire AI development, Cassenti, Veksler, and Ritter bring together contributions from researchers actively using cognitive modeling to tackle a wide range of cognitive phenomena. Incidentally, the other topic in this issue seconds this call for greater attention to and consideration of cognitive models by presenting spearheading work in this very field. For their topic, Terrence C. Stewart (National Research Council Canada) and Joost de Jong (Maastricht University) have assembled revised and expanded versions of the five best papers presented at last year's 19th International Conference on Cognitive Modeling, a conference devoted to computational systems that are aimed at reflecting the internal processes of the mind. In their introduction, Stewart and de Jong point out how these papers, despite their diversity in content, still complement one another in terms of focus and approach: by refining and advancing computational models to better reflect empirical data, or by using such models to better explain data. Congratulations to their authors for their awards––we hope you continue the outstanding work you are doing! topiCS encourages letters and commentaries on all topics, as well as proposals for new topics. Letters are not longer than two published pages (ca. 400–1000 words). Commentaries (between 1000 and 2000 words) are often solicited by Topic Editors prior to the publication of their topic, but they may also be considered after publication. Letters and commentaries typically come without abstracts and with few references, if any. The Executive Editor and the Senior Editorial Board (SEB) are constantly searching for new and exciting topics for topiCS. Feel free to open communications with a short note to the Executive Editor ([email protected]) or a member of the SEB (for a list, see the publisher's homepage for topiCS: http://onlinelibrary.wiley.com/journal/10.1111/(ISSN)1756-8765/homepage/EditorialBoard.html).

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

Full frame distilled prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.

metaresearch head score (Codex)0.003
metaresearch head score (Gemma)0.008
Version: codex-gemma-dda1882f352aValidation status: machine_predicted_unvalidated
Candidate categoriesMetaresearch, Meta-epidemiology (narrow)
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Not applicable · Consensus signal: Not applicable
GenreCandidate signal: Editorial · Consensus signal: Editorial
Teacher disagreement score0.102
Threshold uncertainty score1.000

Codex and Gemma teacher scores by category

CategoryCodexGemma
Metaresearch0.0030.008
Meta-epidemiology (narrow)0.0000.000
Meta-epidemiology (broad)0.0000.000
Bibliometrics0.0010.006
Science and technology studies0.0010.001
Scholarly communication0.0010.002
Open science0.0040.003
Research integrity0.0000.002
Insufficient payload (model declined to judge)0.0010.000

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.017
GPT teacher head0.303
Teacher spread0.286 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it