MétaCan
Menu
Back to cohort
Record W3168659129 · doi:10.1101/2021.06.09.21258450

What instructions are available to health researchers for writing lay summaries? A scoping review

2021· review· en· W3168659129 on OpenAlexaboutno aff
Karen M. Gainey, Mary O’Keeffe, Adrian C. Traeger, Danielle Marie Muscat, Christopher Williams, Kirsten McCaffrey, Steven J. Kamper

Bibliographic record

VenuemedRxiv · 2021
Typereview
Languageen
FieldMedicine
TopicEthics in Clinical Research
Canadian institutionsnot available
Fundersnot available
KeywordsReadabilityComputer scienceWorld Wide Web

Abstract

fetched live from OpenAlex

STRUCTURED ABSTRACT Objective To better understand the characteristics of, and requirements for, lay summaries by reviewing journals, global health organisations, professional medical associations and multi-disciplinary organisations, consumer advocacy groups and funding bodies. Design Using a scoping review methodology, we searched the websites of each identified data source to determine if they require, suggest, or refer to lay summaries. Two reviewers extracted lay summary writing instructions from eligible data sources from Australia, USA, UK, Canada and New Zealand. Data sources were linked to the top 10 non-communicable diseases. Main Outcome Measures Using an inductive approach, we identified characteristics of lay summaries and lay summary writing instructions and extracted data on these characteristics. These characteristics are lay summary formats, audience, requirements, authorship and labels, and elements of lay summary writing instructions (e.g. word count/length). We also noted who was expected to write the lay summaries, whether they were mandatory or optional, and the terms used for to denote them. Results The websites of 526 data sources were searched. Of these, 124 published or mentioned lay summaries and 108 provided writing instructions. For lay summaries, most were in journals, written by the author of the published paper, and only half were mandatory. Thirty-three distinct labels for a lay summary were identified, the most common being “graphical abstract”, “highlights” and “key points”. From the lay summary writing instructions, the most common elements for written lay summaries referred to: structure (86%), content (80%) and word count/length (74%). The least common elements were readability (3%), use of jargon, acronyms and abbreviations (24%), and wording (29%). The target audience was unclear in 68 of 108 (63.0%) of lay summary instructions. Discussion Although we identified over 100 sources provided instructions for writing lay summaries, very few provided instructions related to readability, use of jargon, acronyms and abbreviations, and wording. Some instructions provided structured formats via subheadings or questions to guide content, but not all. Only half mandated the use of lay summaries. Conclusion For lay summaries to be effective, writing instructions should consider the intended audience, ideally incorporating consumer input into their development. Presently, lay summaries are likely to be inaccessible to many consumers, written at a high reading level, with jargon, acronyms and abbreviations. Ideally, all research articles will have an accompanying lay summary. Mandatory lay summaries, however, are of limited value without clear and thorough instructions to guide authors. Public and patient involvement statement Patients or the public were not involved in the design, or conduct, or reporting, or dissemination plans of our research study. Protocol and registration We conducted a scoping review using methods outlined in the PRISMA extension for scoping reviews and information in the Joanna Briggs Institute Reviewers’ Manual for scoping reviews. A protocol for this study was completed prior to data analysis and is on Open Science Framework.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.298
metaresearch head score (Gemma)0.690
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesMetaresearch
Consensus categoriesMetaresearch
DomainCandidate signal: Reporting · Consensus signal: none
Study designCandidate signal: Systematic review · Consensus signal: Systematic review
GenreCandidate signal: Review · Consensus signal: Review
Teacher disagreement score0.702
Threshold uncertainty score0.865

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.2980.690
Meta-epidemiology (narrow)0.0030.004
Meta-epidemiology (broad)0.0070.007
Bibliometrics0.0460.031
Science and technology studies0.0040.005
Scholarly communication0.0120.019
Open science0.0040.008
Research integrity0.0060.006
Insufficient payload (model declined to judge)0.0120.006

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.847
GPT teacher head0.683
Teacher spread0.164 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; the direct Gemma label and the distilled Codex classifier agree on what is shown here.

Study designSystematic review
DomainReporting
GenreReview

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations4
Published2021
Admission routes1
Has abstractyes

Explore more

Same venuemedRxivSame topicEthics in Clinical ResearchFrench-language works237,207