User Perspectives of a Web-Based Data-Sharing Platform (Open Humans) on Ethical Oversight in Participant-Led Research: Protocol for a Quantitative Study
Bibliographic record
Abstract
BACKGROUND: Advances in medicine rely to a great extent on people's willingness to share their data with researchers. With increasingly widespread use of digital technologies, several Web-based communities have emerged aiming to enable their users to share large amounts of data, some of which can possibly be employed for research purposes by scientists, or to conduct participant-led research (PLR). Scholarship has recently addressed the necessity of interrogating how existing ethical standards can and should be applied and adapted in view of the specificities of such Web-based activities. So far, no study has explored participants' beliefs about and attitudes toward ethical oversight when it comes to platforms that involve medical data sharing. OBJECTIVE: This paper presents the protocol for a survey study aimed at understanding users' beliefs about Web-based data-sharing platforms regarding how research ethics principles should be applied in such a setting. Furthermore, the study aims at quantitatively assessing the relationship between participants' perspectives on ethical oversight and other variables such as previous participation in research, beliefs about data sharing, and attitudes toward self-experimentation. METHODS: We are conducting a Web-based survey with users of a popular Web-based data-sharing platform, Open Humans. The survey has been sent to approximately 4640 users registered for the Open Humans newsletter. To fill out the survey, participants need to have an account on Open Humans. We expect a 5%-10% response rate (between 200 and 400 completed surveys out of approximately 4000 survey invitations sent). Independent variables include past data-sharing behavior and intention, beliefs about data sharing, past participation in research, attitudes toward self-experimentation, perceived knowledge of the platform's guidelines and terms, perceived importance of having transparent guidelines, and governance-related beliefs. The main dependent variable is participants' expectations regarding who should ensure that ethical requirements are met within research projects conducted on open data-sharing platforms, based on Emanuel et al's ethical framework. We will use chi-square tests to assess the relationship between participants' expectations regarding ethical oversight and their past behavior, future intentions, beliefs, attitudes, and knowledge. RESULTS: Data collection started on June 13, 2018. A reminder to fill out the survey was sent to participants in mid-July. We expect to gain insights on users' perspectives on the ethical oversight of Web-based data-sharing platforms and on the associated experiences, beliefs, and sociodemographic characteristics. CONCLUSIONS: When digital tools allow people to engage in PLR including medical data, understanding how people interpret and envision the ethical oversight of their data-sharing practices is crucial. This will be the first study to explore users' perspectives on ethical oversight of Web-based data-sharing platforms. The results will help inform the development of a framework that can be employed for platforms hosting various kinds of research projects to accommodate participants' ethical oversight needs. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): RR1-10.2196/10939.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Direct model labels (unvalidated)
Per-model category and study-design labels from the labeling rounds. They are machine output, unvalidated, and the disagreement between models ships as data. No study design here is MEDLINE-validated yet.
| Model arm | Categories | Study design | Confidence |
|---|---|---|---|
| gemma | Open science Domain: not available · Genre: Protocol About the Canadian research system: no · About a Canadian topic: no | Not applicable | low |
| gpt | MetaresearchResearch integrity Domain: Methods · Genre: Protocol About the Canadian research system: no · About a Canadian topic: no | Observational | high |
Full frame machine prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.
Distilled classifier scores by category (both heads)
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.157 | 0.135 |
| Meta-epidemiology (narrow) | 0.004 | 0.003 |
| Meta-epidemiology (broad) | 0.003 | 0.003 |
| Bibliometrics | 0.004 | 0.005 |
| Science and technology studies | 0.008 | 0.006 |
| Scholarly communication | 0.004 | 0.004 |
| Open science | 0.004 | 0.005 |
| Research integrity | 0.008 | 0.008 |
| Insufficient payload (model declined to judge) | 0.029 | 0.007 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedLabeled directly by 2 models reading the full record.
The models disagree on parts of this classification; every voice is preserved in the section at the end of the page.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".