How Do Publicly Available Allergy-Specific Web-Based Training Programs Conform to the Established Criteria for the Reporting, Methods, and Content of Evidence-Based (Digital) Health Information and Education: Thematic Content Evaluation
Bibliographic record
Abstract
BACKGROUND: Allergic diseases, such as allergic asthma, rhinitis, and atopic eczema, are widespread, and they are a considerable burden on the health care system. For patients and health care professionals, Web-based training programs may be helpful to foster self-management and provide allergy-specific information, given, for instance, their good accessibility. OBJECTIVE: This study aimed to assess an exploratory sample of publicly available allergy-specific Web-based training programs-that is, interactive, feedback-oriented Web-based training platforms promoting health behavior change and improvement of personal skills-with regard to (1) general characteristics, aims, and target groups and (2) the extent to which these tools meet established criteria for the reporting, methods, and content of evidence-based (digital) health information and education. METHODS: Web-based training programs were identified via an initial Google search and a search of English and German language websites of medical and public health services, such as the European Centre for Allergy Research Foundation (German), Asthma UK, and Anaphylaxis Canada. We developed a checklist from (1) established guidelines for Web-based health information (eg, the Journal of the American Medical Association benchmarks, DISCERN criteria, and Health On the Net code) and (2) a database search of related studies. The checklist contained 44 items covering 11 domains in 3 areas: (1) content (completeness, transparency, and evidence), (2) structure (data safety and qualification of trainers and authors), and (3) impact (effectiveness, user perspective, and integration into health care). We rated the Web-based training programs as completely, partly, or not satisfying each checklist item and calculated overall and domain-specific scores for each Web-based training program using SPSS 23.0 (SPSS Inc). RESULTS: The 15 identified Web-based training programs covered an average of 37% of the items (score 33 out of 88). A total of 7 Web-based training programs covered more than 40% (35/88; maximum: 49%; 43/88). A total of 5 covered 30% (26/88) to 40% (35/88) of all rated items and the rest covered fewer (n=3; lowest score 24%; 21/88). Items relating to intervention (58%; 10/18), content (49%; 9/18), and data safety (60%; 1/2) were more often considered, as opposed to user safety (10%; 0.4/4), qualification of staff (10%; 0.8/8), effectiveness (16%; 0.4/2), and user perspective (45%; 5/12). In addition, in 13 of 15 Web-based training programs, a minimum of 3 domains were not covered at all. Regarding evidence-based content, 46% of all Web-based training programs (7/15) scored on use of scientific research, 53% on regular information update (8/15), and 33% on provision of references (5/15). None of 15 provided details on the quality of references or the strength of evidence. CONCLUSIONS: English and German language allergy-specific Web-based training programs, addressing lay audiences and health care professionals, conform only partly to established criteria for the reporting, methods, and content of evidence-based (digital) health information and education. Particularly, well-conducted studies on their effectiveness are missing.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame distilled prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.
Codex and Gemma teacher scores by category
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.031 | 0.048 |
| Meta-epidemiology (narrow) | 0.000 | 0.000 |
| Meta-epidemiology (broad) | 0.000 | 0.000 |
| Bibliometrics | 0.000 | 0.000 |
| Science and technology studies | 0.000 | 0.000 |
| Scholarly communication | 0.001 | 0.001 |
| Open science | 0.000 | 0.000 |
| Research integrity | 0.000 | 0.001 |
| Insufficient payload (model declined to judge) | 0.000 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; both teacher heads agree on what is shown here.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".