Quality of Pancreatic Neuroendocrine Tumor Videos Available on TikTok and Bilibili: Content Analysis
Bibliographic record
Abstract
Background: Disseminating disease knowledge through concise videos on various platforms is an innovative and efficient approach. However, it remains uncertain whether pancreatic neuroendocrine tumor (pNET)-related videos available on current short video platforms can effectively convey accurate and impactful information to the general public. Objective: Our study aims to extensively analyze the quality of pNET-related videos on TikTok and Bilibili, intending to enhance the development of pNET-related social media content to provide the general public with more comprehensive and suitable avenues for accessing pNET-related information. Methods: A total of 168 qualifying videos pertaining to pNETs were evaluated from the video-sharing platforms Bilibili and TikTok. Initially, the fundamental information conveyed in the videos was documented. Subsequently, we discerned the source and content type of each video. Following that, the Global Quality Scale (GQS) and modified DISCERN (mDISCERN) scale were employed to appraise the educational value and quality of each video. A comparative evaluation was conducted on the videos obtained from these two platforms. Results: The number of pNET-related videos saw a significant increase since 2020, with 9 videos in 2020, 19 videos in 2021, 29 videos in 2022, and 106 videos in 2023. There were no significant improvements in the mean GQS or mDISCERN scores from 2020 to 2023, which were 3.22 and 3.00 in 2020, 3.33 and 2.94 in 2021, 2.83 and 2.79 in 2022, and 2.78 and 2.94 in 2023, respectively. The average quality scores of the videos on Bilibili and Tiktok were comparable, with GQS and mDISCERN scores of 2.98 on Bilibili versus 2.77 on TikTok and 2.82 on Bilibili versus 3.05 on TikTok, respectively. The source and format of the videos remained independent factors affecting the two quality scores. Videos that were uploaded by professionals (hazard ratio=7.02, P=.002) and recorded in specialized popular science formats (hazard ratio=12.45, P<.001) tended to exhibit superior quality. Conclusions: This study demonstrates that the number of short videos on pNETs has increased in recent years, but video quality has not improved significantly. This comprehensive analysis shows that the source and format of videos are independent factors affecting video quality, which provides potential measures for improving the quality of short videos.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame distilled prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.
Codex and Gemma teacher scores by category
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.009 | 0.002 |
| Meta-epidemiology (narrow) | 0.000 | 0.000 |
| Meta-epidemiology (broad) | 0.001 | 0.000 |
| Bibliometrics | 0.001 | 0.002 |
| Science and technology studies | 0.001 | 0.000 |
| Scholarly communication | 0.000 | 0.001 |
| Open science | 0.000 | 0.000 |
| Research integrity | 0.000 | 0.001 |
| Insufficient payload (model declined to judge) | 0.002 | 0.001 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; both teacher heads agree on what is shown here.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".