MétaCan
Menu
Back to cohort
Record W4386247373 · doi:10.1167/jov.23.9.5580

Reconstructing mental images using Bubbles and electroencephalography

2023· article· en· W4386247373 on OpenAlexaff
Audrey Lamy-Proulx, Jasper van den Bosch, Catherine Landry, Peter Brotherwood, Vincent Taschereau‐Dumouchel, Frédéric Gosselin, Ian Charest

Bibliographic record

VenueJournal of Vision · 2023
Typearticle
Languageen
FieldNeuroscience
TopicEEG and Brain-Computer Interfaces
Canadian institutionsInstitut Universitaire en Santé Mentale de QuébecUniversité de Montréal
Fundersnot available
KeywordsMental imageElectroencephalographyPerceptionArtificial intelligencePsychologyTask (project management)Visual perceptionComputer visionComputer scienceCognitive psychologyCognitionNeuroscience

Abstract

fetched live from OpenAlex

The exact nature of the visual features that are brought to consciousness when one is engaging in mental imagery is still difficult to study empirically. The few studies that have attempted to reconstruct mental images obtained poor quality results due in part to the extremely sparse coverage of the “scene space” (Shen et al., 2019). Hence, the aim of the present study was to reconstruct better quality mental images by increasing the sampling resolution of the visual features within the scene space using the Bubbles method (Gosselin & Schyns, 2001) and electroencephalography (EEG). So far, we have recorded the brain activity of four participants during two alternating tasks divided into 6 one-hour sessions. In the perception task, participants were presented with two scene images through different sets of randomly located Gaussian apertures or “bubble masks” (1,500 trials per image in total). In the mental imagery task, subjects were shown the two stimuli successively and asked to imagine either the first, or second one (300 trials per image in total). For each participant and for each scene, we correlated the EEG activity patterns between mental imagery and visual perception. Specifically, we correlated the EEG activity in each trial of the visual imagery task with the EEG activity elicited from partial presentation of the scenes through bubbles. Correlation-weighted sums of the associated bubble masks were computed in order to produce, for the first time, “classification images” of mental images.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.000
metaresearch head score (Gemma)0.002
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesnone
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Observational · Consensus signal: none
GenreCandidate signal: Empirical · Consensus signal: Empirical
Teacher disagreement score0.001
Threshold uncertainty score0.003

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.0000.002
Meta-epidemiology (narrow)0.0000.000
Meta-epidemiology (broad)0.0000.000
Bibliometrics0.0000.000
Science and technology studies0.0000.000
Scholarly communication0.0000.001
Open science0.0000.000
Research integrity0.0000.000
Insufficient payload (model declined to judge)0.0010.000

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.029
GPT teacher head0.320
Teacher spread0.291 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.

The models applied no category: nothing in the taxonomy fit this work.
Study designObservational
Domainnot available
GenreEmpirical

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations0
Published2023
Admission routes1
Has abstractyes

Explore more

Same venueJournal of VisionSame topicEEG and Brain-Computer InterfacesFrench-language works237,207