Assessing reading levels of health information: uses and limitations of flesch formula
Why this work is in the frame
A frame that forgets how it found something cannot be audited. These are the routes that admitted this work.
Bibliographic record
Abstract
BACKGROUND: Written health information is commonly used by health-care professionals (HCPs) to inform and assess patients in clinical practice. With growing self-management of many health conditions and increased information seeking behavior among patients, there is a greater stress on HCPs and researchers to develop and implement readable and understandable health information. Readability formulas such as Flesch Reading Ease (FRE) and Flesch-Kincaid Reading Grade Level (FKRGL) are commonly used by researchers and HCPs to assess if health information is reading grade appropriate for patients. PURPOSE: In this article, we critically analyze the role and credibility of Flesch formula in assessing the reading level of written health information. DISCUSSION: FRE and FKRGL assign a grade level by measuring semantic and syntactic difficulty. They serve as a simple tool that provides some information about the potential literacy difficulty of written health information. However, health information documents often involve complex medical words and may incorporate pictures and tables to improve the legibility. In their assessments, FRE and FKRGL do not take into account (1) document factors (layout, pictures and charts, color, font, spacing, legibility, and grammar), (2) person factors (education level, comprehension, health literacy, motivation, prior knowledge, information needs, anxiety levels), and (3) style of writing (cultural sensitivity, comprehensiveness, and appropriateness), and thus, inadequately assess reading level. New readability measures incorporate pictures and use complex algorithms to assess reading level but are only moderately used in health-care research and not in clinical practice. Future research needs to develop generic and disease-specific readability measures to evaluate comprehension of a written document based on individuals' literacy levels, cultural background, and knowledge of disease.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
Full frame distilled prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.
Codex and Gemma teacher scores by category
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.005 | 0.004 |
| Meta-epidemiology (narrow) | 0.000 | 0.000 |
| Meta-epidemiology (broad) | 0.000 | 0.000 |
| Bibliometrics | 0.000 | 0.000 |
| Science and technology studies | 0.003 | 0.000 |
| Scholarly communication | 0.000 | 0.005 |
| Open science | 0.000 | 0.000 |
| Research integrity | 0.000 | 0.000 |
| Insufficient payload (model declined to judge) | 0.000 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it