MétaCan
Menu
← all works

On instabilities of deep learning in image reconstruction and the potential costs of AI

2020· article· en· 759 citations· W2911290743 on OpenAlex· 10.1073/pnas.1907377117

Why is this work in the frame?

A frame that forgets how it found something cannot be audited. These are the routes that admitted this work.

Canadian affiliationAn author listed a Canadian institution. This is the only route the usual frame has.
Canadian funderA Canadian agency funded it. The work may carry no Canadian affiliation at all.

Full frame distilled prediction

Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.

Candidate categories
none
Consensus categories
none
Domain
Candidate signal: noneConsensus signal: none
Study design
Candidate signal: Bench or experimentalConsensus signal: Bench or experimental
Genre
Candidate signal: EmpiricalConsensus signal: Empirical
Teacher disagreement score
0.127
Threshold uncertainty score
0.649
Validation status
machine_predicted_unvalidated · codex-gemma-dda1882f352a

Codex and Gemma teacher scores by category

CategoryCodexGemma
Metaresearch0.0010.001
Meta-epidemiology (narrow)0.0000.000
Meta-epidemiology (broad)0.0000.000
Bibliometrics0.0000.000
Science and technology studies0.0000.002
Scholarly communication0.0000.000
Open science0.0000.000
Research integrity0.0000.000
Insufficient payload (model declined to judge)0.0000.000

Machine scores (provisional)

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Opus teacher head0.023
GPT teacher head0.312
Teacher spread
0.289 · how far apart the two teachers sit on this one work
Validation status
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Abstract

Deep learning, due to its unprecedented success in tasks such as image classification, has emerged as a new tool in image reconstruction with potential to change the field. In this paper, we demonstrate a crucial phenomenon: Deep learning typically yields unstable methods for image reconstruction. The instabilities usually occur in several forms: 1) Certain tiny, almost undetectable perturbations, both in the image and sampling domain, may result in severe artefacts in the reconstruction; 2) a small structural change, for example, a tumor, may not be captured in the reconstructed image; and 3) (a counterintuitive type of instability) more samples may yield poorer performance. Our stability test with algorithms and easy-to-use software detects the instability phenomena. The test is aimed at researchers, to test their networks for instabilities, and for government agencies, such as the Food and Drug Administration (FDA), to secure safe use of deep learning methods.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

The record

Venue
Proceedings of the National Academy of Sciences
Topic
Medical Imaging Techniques and Applications
Field
Medicine
Canadian institutions
Simon Fraser University
Funders
Fundação para a Ciência e a TecnologiaNatural Sciences and Engineering Research Council of CanadaEuropean CommissionResearch Councils UKRoyal SocietyEngineering and Physical Sciences Research CouncilCanadian Network for Research and Innovation in Machining Technology, Natural Sciences and Engineering Research Council of CanadaLeverhulme TrustNvidia
Keywords
CounterintuitiveDeep learningArtificial intelligenceComputer scienceImage (mathematics)InstabilityStability (learning theory)Iterative reconstructionField (mathematics)Sampling (signal processing)Computer visionMachine learningMathematicsPhysics
Has abstract in OpenAlex
yes