MétaCan
Menu
Back to cohort

Health care and social media: What patients really understand

2017· preprint· en· W2587224918 on OpenAlexaff
Kyle Hoedebecke, Lindsey Beaman, Joy Mugambi, Sanam Shah, Marwa Mohasseb, Cheyanne Vetter, Kim Yu, Irini Gergianaki, Emily Couvillon

Bibliographic record

VenueF1000Research · 2017
Typepreprint
Languageen
FieldHealth Professions
TopicHealth Literacy and Information Accessibility
Canadian institutionsSaskatchewan Polytechnic
Fundersnot available
KeywordsReadabilityHealth literacyHealth careLiteracyComprehensionMedicineSocial mediaSample (material)PsychologyFamily medicineDemographyComputer scienceSociologyPolitical science

Abstract

fetched live from OpenAlex

<ns4:p> <ns4:italic>Background</ns4:italic> : Low health literacy is associated with decreased patient compliance and worse outcomes - with clinicians increasingly relying on printed materials to lower such risks. Yet, many of these documents exceed recommended comprehension levels. Furthermore, patients look increasingly to social media (SoMe) to answer healthcare questions. The character limits built into Twitter encourage users to publish small quantities of text, which are more accessible to patients with low health literacy. The present authors hypothesize that SoMe posts are written at lower grade levels than traditional medical sources, improving patient health literacy. <ns4:italic>Methods:</ns4:italic> The data sample consisted of the first 100 original tweets from three trending medical hashtags, leading to a total of 300 tweets. The Flesch-Kincaid Readability Formula (FKRF) was used to derive grade level of the tweets. Data was analyzed via descriptive and inferential statistics. <ns4:italic>Results:</ns4:italic> The readability scores for the data sample had a mean grade level of 9.45. A notable 47.6% of tweets were above ninth grade reading level. An independent-sample t-test comparing FKRF mean scores of different hashtags found differences between the means of the following: #hearthealth versus #diabetes (t = 3.15, p = 0.002); #hearthealth versus #migraine (t = 0.09, p = 0.9); and #diabetes versus #migraine (t = 3.4, p = 0.001). <ns4:italic>Conclusions:</ns4:italic> Tweets from this data sample were written at a mean grade level of 9.45, signifying a level between the ninth and tenth grades. This is higher than desired, yet still better than traditional sources, which have been previously analyzed. Ultimately, those responsible for health care SoMe posts must continue to improve efforts to reach the recommended reading level (between the sixth and eighth grade), so as to ensure optimal comprehension of patients. </ns4:p>

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame distilled prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.

metaresearch head score (Codex)0.005
metaresearch head score (Gemma)0.001
Version: codex-gemma-dda1882f352aValidation status: machine_predicted_unvalidated
Candidate categoriesMeta-epidemiology (narrow), Science and technology studies, Research integrity
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Observational · Consensus signal: none
GenreCandidate signal: Empirical · Consensus signal: Empirical
Teacher disagreement score0.452
Threshold uncertainty score1.000

Codex and Gemma teacher scores by category

CategoryCodexGemma
Metaresearch0.0050.001
Meta-epidemiology (narrow)0.0000.000
Meta-epidemiology (broad)0.0010.000
Bibliometrics0.0000.000
Science and technology studies0.0050.000
Scholarly communication0.0010.002
Open science0.0010.003
Research integrity0.0010.004
Insufficient payload (model declined to judge)0.0000.000

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.200
GPT teacher head0.549
Teacher spread0.349 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; a candidate call from one teacher head, not a consensus.

Study designObservational
Domainnot available
GenreEmpirical

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations18
Published2017
Admission routes1
Has abstractyes

Explore more

Same venueF1000ResearchSame topicHealth Literacy and Information AccessibilityFrench-language works237,207