MétaCan
Menu
Back to cohort
Record W2241865608

The Variability of Pseudo R2s in Logistic Regression Models

2011· article· en· W2241865608 on OpenAlexaff
Wade R. Rose, Inder Jit Singh Mann

Bibliographic record

VenueSSRN Electronic Journal · 2011
Typearticle
Languageen
FieldMathematics
TopicAdvanced Statistical Methods and Models
Canadian institutionsCarleton University
Fundersnot available
KeywordsInterpretabilityLogistic regressionContrast (vision)EconometricsVariation (astronomy)StatisticsRegression analysisMathematicsComputer scienceArtificial intelligence
DOInot available

Abstract

fetched live from OpenAlex

Over the past few decades, the use of logistic regression has increased in social and medical sciences research involving binary response variables. With respect to logistic regression, there is at present no widely accepted measure of explained variation with which one could judge the fit of a given model. A number of pseudo R2s have been proposed for the purpose. A number of studies carried out to compare and contrast their strengths, weaknesses and applicability indicate that these pseudo R2s vary considerably in terms of interpretability and range. This paper brings out the propensity of the various pseudo R2s to have different absolute values, different percentages of change from one model to another, and in some cases even vary in terms of their direction of change (i.e., increase versus decrease). This paper contributes to the literature by highlighting the variability of pseudo R2 and the importance of knowing which pseudo R2 is being utilized and its particular characteristics.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.239
metaresearch head score (Gemma)0.613
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesMetaresearch
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Theoretical or conceptual · Consensus signal: none
GenreCandidate signal: Methods · Consensus signal: Methods
Teacher disagreement score0.239
Threshold uncertainty score0.939

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.2390.613
Meta-epidemiology (narrow)0.0030.002
Meta-epidemiology (broad)0.0030.004
Bibliometrics0.0080.011
Science and technology studies0.0020.009
Scholarly communication0.0080.008
Open science0.0050.006
Research integrity0.0030.007
Insufficient payload (model declined to judge)0.0020.002

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.144
GPT teacher head0.402
Teacher spread0.258 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.

Study designTheoretical or conceptual
Domainnot available
GenreMethods

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations2
Published2011
Admission routes1
Has abstractyes

Explore more

Same venueSSRN Electronic JournalSame topicAdvanced Statistical Methods and ModelsFrench-language works237,207