MétaCan
Menu
Back to cohort
Record W2895151463 · doi:10.1111/ijcp.13264

An interview with David L. Streiner: Truth teller of statistical concepts in medicine

2018· editorial· en· W2895151463 on OpenAlexaboutno aff
Leslie Citrome

Bibliographic record

VenueInternational Journal of Clinical Practice · 2018
Typeeditorial
Languageen
FieldDecision Sciences
TopicMeta-analysis and systematic reviews
Canadian institutionsnot available
Fundersnot available
KeywordsBachelorBiostatisticsMedicineThe artsPower (physics)Medical educationLibrary sciencePublic healthHistoryLaw

Abstract

fetched live from OpenAlex

There is too much pressure to publish. Lack of sufficient statistical power remains a significant methodological obstacle. LC: Tell us something about your background. How did you get started in statistics and what are you doing now? DS: I was born in the Bronx, New York and went to City College of New York, graduating in 1963 with a Bachelor of Arts and majoring in Psychology. I went on to study clinical psychology at Syracuse University, ultimately earning a Ph.D. in 1968. The political environment in the US at the time was troubled, and in 1968 we moved as a young family to Canada. I had the fortuitous opportunity to begin work at a nascent medical school in Hamilton, Ontario, and remained at McMaster University for 30 years, employed as professor for about 20 of those years (Department of Psychiatry & Behavioural Neurosciences, and Department of Clinical Epidemiology & Biostatistics), and then retired in 1998. Retirement was brief however, and I went on to join the faculty at the University of Toronto as Professor of Psychiatry and was the founding director of the Applied Research Unit at the Baycrest Centre for Geriatric Care where I was for about 10 years until retiring for the second time. Since then I am back at McMaster University (Professor Emeritus) one day a week and consult at the University of Toronto's Center for Addictions and Mental Health. Throughout my career I have been teaching, writing, and consulting; I have participated in many grant submissions and helped others with statistics and research methodology. I still do that even though I am “retired.” LC: How did you get started providing methodological advice to researchers? DS: I started doing that the after day after I arrived at McMaster. You need to understand that it was a brand new medical school. Because I had taken two graduate courses in statistics I was labelled as the “stats guru.” This began a multi-decade educational process to keep ahead of the questions and I have kept it up since. I started writing commentaries and tutorials for the Canadian Journal of Psychiatry in 1990, inspired by having done peer reviews of poorly-constructed submitted papers. Topics range from using meta-analysis in psychiatric research2 to path analysis.3 The editors of Community Oncology/Journal of Community and Supportive Oncology also invited me to contribute to a series on practical biostatistics, followed by requests from the editors of Chest and the Journal of Clinical Psychopharmacology. In my hands-on work in research I have worked with several disciplines including psychiatry, neurology, family medicine, and pediatrics. I was one of the founding editors of Evidence-Based Mental Health and worked on that journal for 10 years. LC: Of all the commentaries you have written, which are your favorites? DS: Well, the editors of Community Oncology/Journal of Community and Supportive Oncology gave me free rein to use any language as I see fit.4 Another article that comes to mind addresses a common practice (screening) that is done without thinking through the consequences or the issues involved.5 LC: What inspired you to write about P-hacking? DS: I am concerned about problems with lack of a priori hypotheses, multiplicity, and subsequent spurious findings. For example, brain imaging studies may involve only a handful of subjects and yet millions of voxels are being looked at for “findings.” Genome studies also are fraught with chance findings. The articles authored by John Ioannidis further describe some of the issues involved.6, 7 LC: Do you see any improvements in how research is being reported today compared to 10-20 years ago? DS: Sadly, no. There is too much pressure to publish. Lack of sufficient statistical power remains a significant methodological obstacle. I continue to see articles being submitted that have basic errors. LC: Sounds like we have quite a bit of work to be done! What did you think of the animation I sent you of a hapless researcher insisting his/her submission would be welcome because the “P-value is less than 0.05”? It was part of a prior editorial,8 and readers can find it at https://www.youtube.com/watch?v=KBALRk2hjMs. DS: Loved the animation. You must have been sitting in on some of my consultations with researchers! LC: What would readers not normally know about you? DS: About 40 years ago I got into wood working and I am currently the “Master Woodworker” at a train and trolley museum – these old trolley cars need constant repair. Sometimes I even drive them. LC: Thank you so much for your time in answering these questions. DS: It was delightful talking with you. No external funding or writing assistance was utilised in the production of this editorial. In the past 12 months, Leslie Citrome has served as a consultant to: Acadia, Alkermes, Allergan, Indivior, Intra-Cellular Therapeutics, Janssen, Lundbeck, Merck, Neurocrine, Noven, Otsuka, Pfizer, Shire, Sunovion, Takeda, Teva, Vanda. In the past 12 months, Leslie Citrome has served as a speaker for: Acadia, Alkermes, Allergan, Janssen, Lundbeck, Merck, Neurocrine, Otsuka, Pfizer, Shire, Sunovion, Takeda, Teva, Vanda. Other disclosures: stocks (small number of shares of common stock): Bristol-Myers Squibb, Eli Lilly, J & J, Merck, Pfizer purchased >10 years ago; royalties: Wiley (Editor-in-Chief, International Journal of Clinical Practice), UpToDate (reviewer), Springer Healthcare (book).

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame distilled prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.

metaresearch head score (Codex)0.281
metaresearch head score (Gemma)0.733
Version: codex-gemma-dda1882f352aValidation status: machine_predicted_unvalidated
Candidate categoriesMetaresearch, Open science, Insufficient payload (model declined to judge)
Consensus categoriesMetaresearch
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Not applicable · Consensus signal: Not applicable
GenreCandidate signal: Editorial · Consensus signal: Editorial
Teacher disagreement score0.452
Threshold uncertainty score1.000

Codex and Gemma teacher scores by category

CategoryCodexGemma
Metaresearch0.2810.733
Meta-epidemiology (narrow)0.0000.000
Meta-epidemiology (broad)0.0080.001
Bibliometrics0.0010.001
Science and technology studies0.0000.001
Scholarly communication0.0000.001
Open science0.0060.000
Research integrity0.0010.002
Insufficient payload (model declined to judge)0.0100.000

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.748
GPT teacher head0.708
Teacher spread0.040 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; both teacher heads agree on what is shown here.

Study designNot applicable
Domainnot available
GenreEditorial

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations0
Published2018
Admission routes1
Has abstractyes

Explore more

Same venueInternational Journal of Clinical PracticeSame topicMeta-analysis and systematic reviewsFrench-language works237,207