MétaCan
Menu
Back to cohort
Record W2070354507 · doi:10.1080/10410236.2013.768325

Seeing Is Believing? A Mixed-Methods Study Exploring the Quality and Perceived Trustworthiness of Online Information About Chronic Conditions Aimed at Children and Young People

2013· article· en· W2070354507 on OpenAlexafffund
Amy C. McPherson, Miriam Gofine, Jennifer Stinson

Bibliographic record

VenueHealth Communication · 2013
Typearticle
Languageen
FieldHealth Professions
TopicHealth Literacy and Information Accessibility
Canadian institutionsUniversity of TorontoHospital for Sick ChildrenSickKids FoundationHolland Bloorview Kids Rehabilitation Hospital
FundersBloorview Research InstituteHolland Bloorview Kids Rehabilitation Hospital Foundation
KeywordsInter-rater reliabilityReliability (semiconductor)MedicineChronic conditionPsychologyQuality (philosophy)Health careFocus groupPerceptionThe InternetInformation qualityApplied psychologyInformation systemDevelopmental psychologyComputer science

Abstract

fetched live from OpenAlex

The numbers of children and young people with chronic conditions are increasing. While their information needs may vary, providing health care information can have considerable benefits, including better emotional health, less distress during treatments, and greater satisfaction with medical care. The Internet is increasingly being used to communicate health-related information to children about a range of chronic conditions. However, the quality of such websites is underexplored. Thus, the objectives of this study were to evaluate the reliability and quality of online information for children about chronic conditions using a standardized evaluation tool, and to explore children's and young people's perceptions of quality and trustworthiness regarding online health information. The study consisted of two phases. In Phase 1, websites about common pediatric chronic conditions aimed at children and containing treatment or management options were identified and the quality assessment tool DISCERN was completed. Test-retest and interrater reliability were calculated. In Phase 2, two focus groups with laptop computers were conducted with children and young people with a chronic condition to explore their perceptions of trustworthiness of online health information. In Phase 1, 165 websites were identified and 100 met the criteria and were assessed. The mean DISCERN score of all sites was 48.16 out of 75 (SD = 7.97, range 28-71, min 15 to max 75). Quality scores varied widely across the sample. The internal consistency and interrater reliability scores were both lower than previously reported in studies using the DISCERN to assess information for adults. In Phase 2, two focus groups with a total of six participants aged 11-23 years revealed a relative lack of concern about the quality and trustworthiness of online health information. Older participants reported judging the source and authorship of websites, but other participants did not question the source of the information they found online. Although personal websites were perceived to be less reliable than those from well-known medical institutions, they were still valued by many of the participants. Overall, there were relatively few websites about pediatric chronic conditions aimed at children, with variable quality and reliability. However, DISCERN's use with pediatric websites across a broad spectrum of developmental stages is limited. Children and young people demonstrated a need for more guidance around assessing trustworthiness of online information. A more appropriate quality assessment tool is warranted, which could usefully be employed by health care professionals, children, and parents.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.020
metaresearch head score (Gemma)0.028
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesnone
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Qualitative · Consensus signal: none
GenreCandidate signal: Empirical · Consensus signal: Empirical
Teacher disagreement score0.020
Threshold uncertainty score0.107

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.0200.028
Meta-epidemiology (narrow)0.0000.001
Meta-epidemiology (broad)0.0010.001
Bibliometrics0.0010.001
Science and technology studies0.0020.001
Scholarly communication0.0020.002
Open science0.0010.001
Research integrity0.0010.001
Insufficient payload (model declined to judge)0.0020.000

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.073
GPT teacher head0.491
Teacher spread0.418 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.

The models applied no category: nothing in the taxonomy fit this work.
Study designQualitative
Domainnot available
GenreEmpirical

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations28
Published2013
Admission routes2
Has abstractyes

Explore more

Same venueHealth CommunicationSame topicHealth Literacy and Information AccessibilityFrench-language works237,207