Using Natural Language Processing to Explore Mental Health Insights From UK Tweets During the COVID-19 Pandemic: Infodemiology Study
Why this work is in the frame
A frame that forgets how it found something cannot be audited. These are the routes that admitted this work.
Bibliographic record
Abstract
Background: There is need to consider the value of soft intelligence, leveraged using accessible natural language processing (NLP) tools, as a source of analyzed evidence to support public health research outputs and decision-making. Objective: The aim of this study was to explore the value of soft intelligence analyzed using NLP. As a case study, we selected and used a commercially available NLP platform to identify, collect, and interrogate a large collection of UK tweets relating to mental health during the COVID-19 pandemic. Methods: A search strategy comprised of a list of terms related to mental health, COVID-19, and lockdown restrictions was developed to prospectively collate relevant tweets via Twitter's advanced search application programming interface over a 24-week period. We deployed a readily and commercially available NLP platform to explore tweet frequency and sentiment across the United Kingdom and identify key topics of discussion. A series of keyword filters were used to clean the initial data retrieved and also set up to track specific mental health problems. All collated tweets were anonymized. Results: We identified and analyzed 286,902 tweets posted from UK user accounts from July 23, 2020 to January 6, 2021. The average sentiment score was 50%, suggesting overall neutral sentiment across all tweets over the study period. Major fluctuations in volume (between 12,622 and 51,340) and sentiment (between 25% and 49%) appeared to coincide with key changes to any local and/or national social distancing measures. Tweets around mental health were polarizing, discussed with both positive and negative sentiment. Key topics of consistent discussion over the study period included the impact of the pandemic on people's mental health (both positively and negatively), fear and anxiety over lockdowns, and anger and mistrust toward the government. Conclusions: Using an NLP platform, we were able to rapidly mine and analyze emerging health-related insights from UK tweets into how the pandemic may be impacting people's mental health and well-being. This type of real-time analyzed evidence could act as a useful intelligence source that agencies, local leaders, and health care decision makers can potentially draw from, particularly during a health crisis.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
Full frame distilled prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.
Codex and Gemma teacher scores by category
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.002 | 0.000 |
| Meta-epidemiology (narrow) | 0.000 | 0.000 |
| Meta-epidemiology (broad) | 0.001 | 0.000 |
| Bibliometrics | 0.000 | 0.001 |
| Science and technology studies | 0.002 | 0.000 |
| Scholarly communication | 0.000 | 0.000 |
| Open science | 0.001 | 0.002 |
| Research integrity | 0.000 | 0.002 |
| Insufficient payload (model declined to judge) | 0.001 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it