Commentary: Investigating the concept of representation in the neural and psychological sciences
Bibliographic record
Abstract
Favela & Machery (2023) describe four experiments probing the role of the concept representation in the brain sciences. They show that, given short descriptions of brain activity, neuroscientists and psychologists are generally not confident whether it should be described as a representation or not. Favela & Machery interpret this to mean that the scientists are unsure what it takes for brain activity to be, or count as, a representation. And they conclude that the concept representation should either be eliminated from the brain sciences, or reformed.The experiments are revealing, and constitute an important methodological advance on existing approaches to the concept representation, which mostly use a priori reflection and case studies (Baker et al., 2022;Poldrack, 2020;Ramsey, 2007;Shea, 2018). But this commentary will argue that the study's design is not well-suited to its ultimate goal, and that Favela & Machery's conclusion relies on an implausible assumption about scientific concepts. Discarding that assumption will make room for important work building on Favela & Machery's contribution.Each experiment probed "scientists' willingness to use different kinds of descriptions" (3)1 of brain activity, focusing on ones that describe brain activity as "representing" its environment. After seeing a "cover story about a neuroscientific study recording brain response to various stimuli" (3), participants were asked whether they agreed with a statement asserting that the brain's response represented the stimuli, responding on a Likert scale from "strongly agree" to "strongly disagree." They were also asked about other descriptions, some involving representational notions (like "being about") and some causal ones (like "responding to").Three of the four experiments modulated a particular feature of the brain activity (its scale, relation to the stimulus, and function in the brain) to probe its effect on the acceptability of representational descriptions. The fourth investigated participants' willingness to describe brain activity as misrepresenting stimuli. In each case, participants were told of the brain's response to certain stimuli, and they were asked how willing they were to describe that response as (among other things) representational. In other words, they were asked to categorize the brain's responses, or taxonomize them, into representations and non-representations.For causal descriptions, like "the brain area responds to the stimulus," responses clustered around the ends of the Likert scale. But for representational descriptions, like "the brain area represents the stimulus," the answers cluster around the middle of the scale. The natural interpretation is that although scientists are confident in some (especially causal) categorizations of brain activity, they are not confident in their categorizations of brain activity as representing a stimulus or not. 2This is an interesting finding, and supports an interesting conclusion: whatever the concept representation contributes to the brain sciences, it doesn't contribute a clear taxonomy of brain activity into the categories representational and non-representational. But Favela & Machery conclude that the concept of representation needs to either be reformed, or simply eliminated from the brain sciences. How do you get that conclusion from those findings? Only by assuming that what the concept representation contributes could only be a taxonomy of neural activity into the categories representational and non-representational, or that whatever it contributes must depend on that taxonomy.This picture of a concept's scientific role will be dubious to anyone familiar with the psychology of concepts or the nuances of scientific practice. I'll summarize two reasons, before returning to the positive lessons of Favela & Machery's study. First, scientific practice shows us that taxonomy is not all scientific concepts do. When scientists conceive of misinformation as a virus, they do not assume that the concept virus sorts the world into two kinds of things, viruses and non-viruses, and that misinformation falls into the former category. Rather, they are using the concept to introduce modeling tools, assumptions, and conceptual frameworks to study disinformation (Kucharski, 2016). And when fluid mechanics is applied to model traffic, there is no assumption that traffic is a fluid, or that the correct description of traffic is as a fluid (Sun et al., 2011). 3 The idea is to introduce modeling resources that are applicable to traffic for reasons that, while interesting, do not involve traffic's being a fluid. A study that presented scientists with different traffic scenarios, asking them whether they agreed with statements like "the traffic is a fluid," would not capture the work that the concept fluid is doing for this area of science.Second, there is already work that applies psychological methods to study how concepts figure into explanation; this is closely related, for obvious reasons, to questions of how concepts figure into science. Consider Lombrozo & colleagues' paradigmatic work on the explanatory role of the concept function. Some of this work asks which things tend to be attributed functions by which populations (Lombrozo et al., 2007). But often, and more informatively, it asks what participants can do once they've characterized a target in terms of the concept function, e.g., what predictions or generalizations they can make given functional as opposed to mechanistic descriptions of a system (Lombrozo, 2009). Because the concept function might contribute something to explanations other than a taxonomy (into things that have functions and things that don't), this research has found ways to probe what functional descriptions are (or can be) used to do, rather than just what conditions elicit them.Favela & Machery provide evidence that representational concepts in cognitive science do not provide a clear taxonomy of neural activity into the categories representational and nonrepresentational. This is important, but it does not support the conclusion that the concept of representation does no useful work for cognitive science. I haven't aimed to defend the concept of representation here. Whether it serves an important scientific role or not, whether it should be retained, reformed, or eliminated, depends on what it does for science. And that can be
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame distilled prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.
Codex and Gemma teacher scores by category
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.001 | 0.000 |
| Meta-epidemiology (narrow) | 0.000 | 0.000 |
| Meta-epidemiology (broad) | 0.000 | 0.000 |
| Bibliometrics | 0.000 | 0.001 |
| Science and technology studies | 0.000 | 0.002 |
| Scholarly communication | 0.000 | 0.000 |
| Open science | 0.001 | 0.000 |
| Research integrity | 0.001 | 0.001 |
| Insufficient payload (model declined to judge) | 0.000 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one teacher head, not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".