MétaCan
Menu
Back to cohort
Record W2884538269 · doi:10.2196/10939

User Perspectives of a Web-Based Data-Sharing Platform (Open Humans) on Ethical Oversight in Participant-Led Research: Protocol for a Quantitative Study

2018· article· en· W2884538269 on OpenAlex

Why this work is in the frame

A frame that forgets how it found something cannot be audited. These are the routes that admitted this work.

venuePublished in a venue whose home country is Canada.
no affNo Canadian affiliation: this work is invisible to an affiliation-only frame.
No Canadian affiliation. An affiliation-only frame, the usual design, would never have seen this work. It is one of the works that make the case for inverting the frame.

Bibliographic record

VenueJMIR Research Protocols · 2018
Typearticle
Languageen
FieldMedicine
TopicEthics in Clinical Research
Canadian institutionsnot available
Fundersnot available
KeywordsProtocol (science)Research ethicsComputer scienceData collectionData sharingWorld Wide WebPsychologyData scienceKnowledge managementInternet privacyMedicineAlternative medicineSociology

Abstract

fetched live from OpenAlex

BACKGROUND: Advances in medicine rely to a great extent on people's willingness to share their data with researchers. With increasingly widespread use of digital technologies, several Web-based communities have emerged aiming to enable their users to share large amounts of data, some of which can possibly be employed for research purposes by scientists, or to conduct participant-led research (PLR). Scholarship has recently addressed the necessity of interrogating how existing ethical standards can and should be applied and adapted in view of the specificities of such Web-based activities. So far, no study has explored participants' beliefs about and attitudes toward ethical oversight when it comes to platforms that involve medical data sharing. OBJECTIVE: This paper presents the protocol for a survey study aimed at understanding users' beliefs about Web-based data-sharing platforms regarding how research ethics principles should be applied in such a setting. Furthermore, the study aims at quantitatively assessing the relationship between participants' perspectives on ethical oversight and other variables such as previous participation in research, beliefs about data sharing, and attitudes toward self-experimentation. METHODS: We are conducting a Web-based survey with users of a popular Web-based data-sharing platform, Open Humans. The survey has been sent to approximately 4640 users registered for the Open Humans newsletter. To fill out the survey, participants need to have an account on Open Humans. We expect a 5%-10% response rate (between 200 and 400 completed surveys out of approximately 4000 survey invitations sent). Independent variables include past data-sharing behavior and intention, beliefs about data sharing, past participation in research, attitudes toward self-experimentation, perceived knowledge of the platform's guidelines and terms, perceived importance of having transparent guidelines, and governance-related beliefs. The main dependent variable is participants' expectations regarding who should ensure that ethical requirements are met within research projects conducted on open data-sharing platforms, based on Emanuel et al's ethical framework. We will use chi-square tests to assess the relationship between participants' expectations regarding ethical oversight and their past behavior, future intentions, beliefs, attitudes, and knowledge. RESULTS: Data collection started on June 13, 2018. A reminder to fill out the survey was sent to participants in mid-July. We expect to gain insights on users' perspectives on the ethical oversight of Web-based data-sharing platforms and on the associated experiences, beliefs, and sociodemographic characteristics. CONCLUSIONS: When digital tools allow people to engage in PLR including medical data, understanding how people interpret and envision the ethical oversight of their data-sharing practices is crucial. This will be the first study to explore users' perspectives on ethical oversight of Web-based data-sharing platforms. The results will help inform the development of a framework that can be employed for platforms hosting various kinds of research projects to accommodate participants' ethical oversight needs. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): RR1-10.2196/10939.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

Direct model labels (unvalidated)

Per-model category and study-design labels from the labeling rounds. They are machine output, unvalidated, and the disagreement between models ships as data. No study design here is MEDLINE-validated yet.

Model armCategoriesStudy designConfidence
gemmaOpen science
Domain: not available · Genre: Protocol
About the Canadian research system: no · About a Canadian topic: no
Not applicablelow
gptMetaresearchResearch integrity
Domain: Methods · Genre: Protocol
About the Canadian research system: no · About a Canadian topic: no
Observationalhigh
models splitAgreement compares identical category sets and study designs across arms.

Full frame distilled prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.

metaresearch head score (Codex)0.102
metaresearch head score (Gemma)0.093
Version: codex-gemma-dda1882f352aValidation status: machine_predicted_unvalidated
Candidate categoriesMetaresearch, Meta-epidemiology (narrow), Science and technology studies, Research integrity
Consensus categoriesMetaresearch
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Randomized trial · Consensus signal: none
GenreCandidate signal: Protocol · Consensus signal: Protocol
Teacher disagreement score0.269
Threshold uncertainty score1.000

Codex and Gemma teacher scores by category

CategoryCodexGemma
Metaresearch0.1020.093
Meta-epidemiology (narrow)0.0000.000
Meta-epidemiology (broad)0.0010.000
Bibliometrics0.0020.003
Science and technology studies0.0010.004
Scholarly communication0.0000.001
Open science0.0050.005
Research integrity0.0010.012
Insufficient payload (model declined to judge)0.0010.000

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.967
GPT teacher head0.805
Teacher spread0.162 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it