Detecting malingering: a survey of experts? practices
Why this work is in the frame
A frame that forgets how it found something cannot be audited. These are the routes that admitted this work.
Bibliographic record
Abstract
A survey addressing practices of 'expert' neuropsychologists in handling financial compensation claim or personal injury litigation cases was carried out. Potential participants were identified by publication history. Responses were obtained from 24 out of the 39 neuropsychologists who were surveyed. Approximately 79% of the respondents reported using at least one specialized technique for detecting malingering in every litigant assessment. Half stated that they always give specialized tests at the beginning of the assessment. The Rey 15-Item test and the Test of Memory Malingering were the most frequently reported measures. Respondents also reported frequent use of 'malingering' indexes from standard neuropsychological tests. Reported base-rates varied, but the majority of respondents indicated that at least 10% of the litigants they assessed in the last year were definitely malingering. Respondents were split on the practice of routinely giving warnings at the outset of assessments that suboptimal performance may be detected. However, when the client's motivational status was suspect, more than half (58.3%) altered their assessment routine at least on some occasions, by encouraging good effort (70.8%) or administering additional SVTs. A minority directly confronted or warned clients (25%), terminated the examination earlier than planned (16.6%), or contacted the referring attorney immediately (29.2%). Respondents almost always stated some opinion regarding indicators of invalidity in written reports (95%). However, 41.7% rarely used the term 'malingering' and 12.5% never used the term. Most respondents (>80%) instead stated that the test results are invalid, inconsistent with the severity of the injury or indicative of exaggeration.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
Full frame distilled prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.
Codex and Gemma teacher scores by category
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.003 | 0.065 |
| Meta-epidemiology (narrow) | 0.000 | 0.000 |
| Meta-epidemiology (broad) | 0.001 | 0.000 |
| Bibliometrics | 0.000 | 0.000 |
| Science and technology studies | 0.000 | 0.001 |
| Scholarly communication | 0.000 | 0.000 |
| Open science | 0.000 | 0.000 |
| Research integrity | 0.000 | 0.001 |
| Insufficient payload (model declined to judge) | 0.000 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it