MétaCan
Menu
Back to cohort
Record W4386179076 · doi:10.22259/2638-5201.0301004

Rogers's RS und SC Malingering Scales Derived from the SIMS

2020· article· en· W4386179076 on OpenAlex

Why this work is in the frame

A frame that forgets how it found something cannot be audited. These are the routes that admitted this work.

affAt least one author lists a Canadian institution in the pinned OpenAlex snapshot.

Bibliographic record

VenueArchives of Psychiatry and Behavioral Sciences · 2020
Typearticle
Languageen
FieldComputer Science
TopicAdversarial Robustness in Machine Learning
Canadian institutionsWestern University
Fundersnot available
KeywordsMalingeringPsychologyClinical psychology

Abstract

fetched live from OpenAlex

Background: Recent studies have shown conclusively that the Structured Inventory of Malingered Symptomatology (SIMS) lacks in content validity and criterion validity.Rogers, Robinson, and Gillard (2014) used an innovative statistical procedure to extract those SIMS items that could still usefully differentiate legitimate psychiatric patients instructed to respond honestly from those instructed to exaggerate symptoms.Their procedure resulted in their Rare Symptoms (RS) scale and Symptom Combination (SC) scale.The present study applied the RS and SC scales to patients injured in high impact motor vehicle accidents (MVAs) and also critically evaluates the content of these scales.Method: An ANOVA was calculated to compare RS and SC data of 3 groups: (1) 23 survivors of high impact MVAs, (2) data collected by Rogers's team on their 54 psychiatric patients instructed to respond honestly, and (3) data collected by Rogers's team on their 53 psychiatric patients instructed to exaggerate symptoms. Results and Discussion:All except four of the 23 post-MVA patients, i.e., 82.6%, obtained scores below Rogers's cutoff of > 6, i.e., at a "non-malingering" level, on the RS scale and all except one of the 23, i.e., 95.7% scored below Rogers's cutoff of > 6, i.e., at a "non-malingering" level, on the SC scale.Damaging evidence against the RS scale comes from the ANOVA: the RS scores of post-MVA patients did not differ significantly from psychiatric patients instructed to exaggerate: both groups scored significantly higher than psychiatric patients responding honestly.The SC scores of post-MVA patients did not differ significantly in the ANOVA from psychiatric patients responding honestly: both groups scored significantly lower than psychiatric patients instructed to exaggerate.Clinical content analysis of RS scale suggests irremediable flaws.A third of the RS items are logical or algebraic reasoning tasks on which patients with severe post-concussive symptoms and fatigue from insomnia (such as caused by persistent pain) could perform less well.Patients with extensive microvascular injuries and axonal shearing from their accident are more likely to score higher on the RS and be misclassified as "malingerers" than less injured persons.Another third of RS scale items lists delusional symptoms or those of thought disorder: psychotic patients are more likely to be branded as "malingerers" and deprived of pharmacotherapy.The SC scale is based on a precarious assumption that correlations among its symptoms remain the same across varied groups of genuine medical patients, regardless of the type and intensity of their own symptoms.Patients more severely disabled by their symptoms might be less consistent in their responses and thus more often misclassified as "malingerers" by the SC.Furthermore, Rogers's psychiatric sample on which the RS and SC scales were developed was diagnostically mixed, too heterogeneous, mainly diagnosed with PTSD (>77%) and/or mood disorders (>32%): this makes generalizations of RS and SC cutoffs to other diagnostic groups of psychiatric patients uncertain.Generalizations to yet other medical patients would need to be tested carefully, separately for each diagnostic group and on larger samples to satisfy APA requirements.Conclusions: Too many items of the RS represent common rather than "Rare Symptoms."For many reasons, non-SIMS items would be a better choice for future RS scales.With respect to developing future SC scales, more extensive research would be needed to demonstrate if, or when, specific pairs of symptoms are indeed always mutually exclusive or uncorrelated.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

Full frame distilled prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.

metaresearch head score (Codex)0.000
metaresearch head score (Gemma)0.000
Version: codex-gemma-dda1882f352aValidation status: machine_predicted_unvalidated
Candidate categoriesnone
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Observational · Consensus signal: Observational
GenreCandidate signal: Empirical · Consensus signal: Empirical
Teacher disagreement score0.154
Threshold uncertainty score0.396

Codex and Gemma teacher scores by category

CategoryCodexGemma
Metaresearch0.0000.000
Meta-epidemiology (narrow)0.0000.000
Meta-epidemiology (broad)0.0000.000
Bibliometrics0.0000.000
Science and technology studies0.0010.001
Scholarly communication0.0000.000
Open science0.0010.001
Research integrity0.0000.000
Insufficient payload (model declined to judge)0.0000.000

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.036
GPT teacher head0.311
Teacher spread0.275 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it