Characterizing Websites That Provide Information About Complementary and Integrative Health: Systematic Search and Evaluation of Five Domains
Bibliographic record
Abstract
BACKGROUND: In recent years, there has been an increase in the utilization of complementary and integrative health (CIH) care, and an increase in information-seeking behavior focused on CIH. Thus, understanding the quality of CIH information that is available on the internet is imperative. Although there have been a limited number of studies evaluating the quality of websites providing information about specific CIH-related topics, a broad evaluation of CIH websites has not been conducted. OBJECTIVE: This study was designed to fill that gap. We set out to assess website quality in 5 CIH domains: (1) acupuncture, (2) homeopathy, (3) massage, (4) reiki, and (5) yoga. This study aimed to 1) characterize the websites by type and quality; 2) evaluate website characteristics which may affect readers' perceptions, specifically message content, structural features, and presentation style, and 3) investigate the extent to which harms, benefits and purposes of use are stated on websites. METHODS: This study employed a systematic search strategy to identify websites in each of the target domains to be evaluated. The websites were then classified by type, and a set of checklists focusing on quality, message content, structural features, and presentation style was used to evaluate the websites. Lastly, we performed content analysis to identify harms, benefits, and perceived purposes of use. RESULTS: There were similarities across domains regarding their overall quality and their message content. Across all domains, a high proportion of websites received strong scores in terms of ownership, currency, interactivity and navigability. Scores were more variable concerning authorship, balanced presentation of information and the use of sources of information. However, there were differences regarding their structural features and presentation style. Acupuncture and reiki sites tended to include more external links, and yoga, fewer. There was variation across domains in the extent to which the websites contained domain-specific terminology. Websites tended to provide an extensive list of potential benefits, while reporting of harms was scarce. CONCLUSIONS: This is the first study to perform a multidimensional assessment of websites in multiple CIH domains. This review showed that while there are similarities among websites of different CIH domains, there are also differences. The diverse distribution of website types suggests that, regardless of CIH domain, the public encounters information through many different types of media, and it would be useful to consider how the presentation of this content may differ depending on the medium. The characteristics for which variability exist are areas that warrant greater attention from researchers, policy makers, clinicians and patients. There is also a need to better understand how individuals may interact with CIH websites, and to develop tools to assist people to interpret the CIH-related information that they encounter.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame distilled prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.
Codex and Gemma teacher scores by category
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.014 | 0.006 |
| Meta-epidemiology (narrow) | 0.000 | 0.000 |
| Meta-epidemiology (broad) | 0.001 | 0.000 |
| Bibliometrics | 0.001 | 0.000 |
| Science and technology studies | 0.000 | 0.001 |
| Scholarly communication | 0.000 | 0.001 |
| Open science | 0.000 | 0.000 |
| Research integrity | 0.000 | 0.001 |
| Insufficient payload (model declined to judge) | 0.001 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one teacher head, not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".