MétaCan
Menu
Back to cohort
Record W2894029453 · doi:10.1167/18.10.206

Title: Convolutional Network Approach to Modelling Allocentric Landmark Impact on Target Localization

2018· article· en· W2894029453 on OpenAlex
Sohrab Salimian, Richard P. Wildes, J. Douglas Crawford

Why this work is in the frame

A frame that forgets how it found something cannot be audited. These are the routes that admitted this work.

affAt least one author lists a Canadian institution in the pinned OpenAlex snapshot.

Bibliographic record

VenueJournal of Vision · 2018
Typearticle
Languageen
FieldEngineering
TopicGeophysical Methods and Applications
Canadian institutionsYork University
Fundersnot available
KeywordsLandmarkArtificial intelligenceAffine transformationComputer visionComputer sciencePattern recognition (psychology)Transformation (genetics)Transformation matrixMathematicsGeometryPhysics

Abstract

fetched live from OpenAlex

A critical question in visual processing is the degree to which egocentric and allocentric reference frames are utilized during target localization. For example Li et al (2017) tested their contributions using the cue conflict task on macaque monkeys, where the monkeys were presented with a target and an allocentric landmark. The landmark was then masked and shifted (or not shifted). During the shift paradigm the monkeys' final gaze position was siginificantly shifted towards the virtually shifted location of the target in allocentric coordinates. In the current work we attempted to model these results by utilizing a convolutional network (ConvNet) with a spatial transformer module. This model inputs a binary image containing a target localized at a particular spatial location as well as an allocentric landmark represented as the intersection of vertical and horizontal lines. It outputs a vector anchored at the (0,0) position on the image matrix, corresponding to the position on the array where the target has been calculated to lie in. The network achieves this through multilayer processing that begins by estimating and applying an affine transformation that accounts for differences in the target vs landmark coordinates, followed by convolution and regression for target localization. The affine transformation is learned through the spatial transformer which takes the image and applies the reverse of the transformations and then feeds the output to the convolutional and regressional layers (Jaderberg et al 2015). The model's outputs is in agreement with the findings in Li et al (2017): As the landmark is shifted away from the target, the network's choice is also shifted away from the target position. Future work will look to increase robustness in terms of target localization with respect to mutliple allocentric landmarks and to modify the model's architecture to include hand-crafted components to increase precision. Meeting abstract presented at VSS 2018

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

Full frame distilled prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.

metaresearch head score (Codex)0.000
metaresearch head score (Gemma)0.000
Version: codex-gemma-dda1882f352aValidation status: machine_predicted_unvalidated
Candidate categoriesnone
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Simulation or modeling · Consensus signal: Simulation or modeling
GenreCandidate signal: Methods · Consensus signal: none
Teacher disagreement score0.927
Threshold uncertainty score0.123

Codex and Gemma teacher scores by category

CategoryCodexGemma
Metaresearch0.0000.000
Meta-epidemiology (narrow)0.0000.000
Meta-epidemiology (broad)0.0000.000
Bibliometrics0.0000.000
Science and technology studies0.0000.000
Scholarly communication0.0000.000
Open science0.0000.000
Research integrity0.0000.000
Insufficient payload (model declined to judge)0.0000.000

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.016
GPT teacher head0.285
Teacher spread0.270 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it