MétaCan
Menu
Back to cohort

Crafting 10 Years of Statistics Explanations: Points of Significance

2024· article· en· W4401724343 on OpenAlexaff
Naomi Altman, Martin Krzywinski

Bibliographic record

VenueAnnual Review of Statistics and Its Application · 2024
Typearticle
Languageen
FieldComputer Science
TopicData Analysis with R
Canadian institutionsCanada's Michael Smith Genome Sciences Centre
Fundersnot available
KeywordsHeuristicNarrativeCurse of dimensionalityComputer scienceRange (aeronautics)CurseStatistical theoryProbability and statisticsData scienceStatisticsArtificial intelligenceEconometricsMathematicsSociologyEngineering

Abstract

fetched live from OpenAlex

Points of Significance is an ongoing series of short articles about statistics in Nature Methods that started in 2013. Its aim is to provide clear explanations of essential concepts in statistics for a nonspecialist audience. The articles favor heuristic explanations and make extensive use of simulated examples and graphical explanations, while maintaining mathematical rigor. Topics range from basic, but often misunderstood, such as uncertainty and p -values, to relatively advanced, but often neglected, such as the error-in-variables problem and the curse of dimensionality. More recent articles have focused on timely topics such as modeling of epidemics, machine learning, and neural networks. In this article, we discuss the evolution of topics and details behind some of the story arcs, our approach to crafting statistical explanations and narratives, and our use of figures and numerical simulations as props for building understanding.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.047
metaresearch head score (Gemma)0.226
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesnone
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Not applicable · Consensus signal: none
GenreCandidate signal: Review · Consensus signal: none
Teacher disagreement score0.047
Threshold uncertainty score0.249

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.0470.226
Meta-epidemiology (narrow)0.0020.001
Meta-epidemiology (broad)0.0010.002
Bibliometrics0.0060.004
Science and technology studies0.0060.035
Scholarly communication0.0160.037
Open science0.0040.008
Research integrity0.0080.024
Insufficient payload (model declined to judge)0.0130.004

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.013
GPT teacher head0.300
Teacher spread0.287 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.

The models applied no category: nothing in the taxonomy fit this work.
Study designNot applicable
Domainnot available
GenreReview

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations0
Published2024
Admission routes1
Has abstractyes

Explore more

Same venueAnnual Review of Statistics and Its ApplicationSame topicData Analysis with RFrench-language works237,207