Type 1 Diabetes Mellitus Virtual Patient Network as a Peer Support Community: Protocol for Social Network Analysis and Content Analysis (Preprint)
Bibliographic record
Abstract
BACKGROUND Type 1 Diabetes Mellitus Virtual Patient Network (T1DM-VPN) is a private Facebook group for youths with type 1 diabetes mellitus (T1DM) in Canada intended to facilitate peer-to-peer support. It was built on the finding that stigma is prevalent among youth with T1DM and impedes self-management. OBJECTIVE We aim to determine if T1DM-VPN provides support as intended and to ascertain what type of members provide support. Specifically, we will (1) identify text consistent with any one of 5 social support categories, (2) describe the network by visualizing its structure and reporting basic engagement statistics, and (3) determine whether being a designated peer leader is related to a member’s centrality (ie, importance in the network) and how frequently they offer social support. METHODS We will manually extract interaction data from the Facebook group (posts, comments, likes/reactions, seen) generated from June 21, 2017 (addition of first member), to March 1, 2020. Two researchers will independently code posts and comments according to an existing framework of 5 social support categories—informational, emotional, esteem, network, and tangible—with an additional framework for nonsocial support categories. We will calculate how frequently each code is used. We will also report basic engagement statistics (eg, number of posts made per person-month) and generate a visualization of the network. We will identify stable time intervals in the history of T1DM-VPN by modeling monthly membership growth as a Poisson process. Within each interval, each member’s centrality will be calculated and standardized to that of the most central member. We will use a centrality formula that considers both breadth and depth of connections (centrality = 0.8 × total No. of connections + 0.2 × total No. of interactions). Finally, we will construct multivariate linear regression models to assess whether peer leader status predicts member centrality and the frequency of offering social support. Other variables considered for inclusion in the models are gender and age at diagnosis. RESULTS T1DM-VPN was launched in June 2017. As of March 1, 2020, it has 196 patient-members. This research protocol received ethics approval from the McGill University Health Centre Research Ethics Board on May 20, 2020. Baseline information about each group member was collected upon addition into the group, and collection of interaction data is ongoing as of May 2020. CONCLUSIONS This content analysis and social network analysis study of a virtual patient network applies epidemiological methods to account for dynamic growth and activity. The results will allow for an understanding of the topics of importance to youth with T1DM and how a virtual patient network evolves over time. This work is intended to serve as a foundation for future action to help youth improve their experience of living with diabetes. INTERNATIONAL REGISTERED REPORT PRR1-10.2196/18714
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Direct model labels (unvalidated)
Per-model category and study-design labels from the labeling rounds. They are machine output, unvalidated, and the disagreement between models ships as data. No study design here is MEDLINE-validated yet.
| Model arm | Categories | Study design | Confidence |
|---|---|---|---|
| gemma | no category Domain: not available · Genre: Protocol About the Canadian research system: no · About a Canadian topic: no | Not applicable | low |
| gpt | no category Domain: not available · Genre: Protocol About the Canadian research system: no · About a Canadian topic: no | Qualitative | medium |
Full frame machine prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.
Distilled classifier scores by category (both heads)
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.057 | 0.130 |
| Meta-epidemiology (narrow) | 0.003 | 0.003 |
| Meta-epidemiology (broad) | 0.004 | 0.003 |
| Bibliometrics | 0.005 | 0.005 |
| Science and technology studies | 0.005 | 0.003 |
| Scholarly communication | 0.005 | 0.004 |
| Open science | 0.003 | 0.004 |
| Research integrity | 0.003 | 0.006 |
| Insufficient payload (model declined to judge) | 0.252 | 0.059 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedLabeled directly by 2 models reading the full record.
The models disagree on parts of this classification; every voice is preserved in the section at the end of the page.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".