MétaCan
Menu
Back to cohort
Record W3188722327 · doi:10.1007/s12021-021-09533-8

Promoting FAIR Data Through Community-driven Agile Design: the Open Data Commons for Spinal Cord Injury (odc-sci.org)

2021· review· en· W3188722327 on OpenAlexaff
Abel Torres‐Espín, Carlos de Almeida, Austin Chou, J. Russell Huie, Michael Chiu, Romana Vavrek, Jeffrey Sacramento, Michael B. Orr, John C. Gensel, Jeffrey S. Grethe, Maryann E. Martone, Karim Fouad, Adam R. Ferguson, Warren J. Alilain, Mark Bacon, Nicholas J. Batty, Michael S. Beattie, Jacqueline C. Bresnahan, Emily R. Burnside, Sarah A. Busch, Randall Carpenter, Isaac Francos Quijorna, Xiaohui Guo, Agnes E. Haggerty, Sarah Haroon, J. E. Harris, Lyn B. Jakeman, Linda Jones, Naomi Kleitman, Timothy J. Kopper, Michael A. Lane, Francisco Magana, David S.K. Magnuson, I. Cortés Maldonado, Verena May, Katelyn E. McFarlane, Kazuhito Morioka, Martin Oudega, Philip Leo Pascual, Jean‐Baptiste Poline, E Rosenzweig, Emma Schmidt, Wolfram Tetzlaff, Lana Zholudeva

Bibliographic record

VenueNeuroinformatics · 2021
Typereview
Languageen
FieldDecision Sciences
TopicScientific Computing and Data Management
Canadian institutionsWomen and Children’s Health Research InstituteUniversity of Alberta
FundersNational Institute of Biomedical Imaging and BioengineeringNational Institute of Neurological Disorders and StrokeNational Institute of Mental HealthNational Institutes of HealthCraig H. Neilsen FoundationWings for LifeU.S. Department of Veterans Affairs
KeywordsData sharingOpen dataInteroperabilityComputer scienceAnalyticsData discoveryData managementData curationWorld Wide WebData scienceKnowledge managementMedicineMetadataData mining

Abstract

fetched live from OpenAlex

The past decade has seen accelerating movement from data protectionism in publishing toward open data sharing to improve reproducibility and translation of biomedical research. Developing data sharing infrastructures to meet these new demands remains a challenge. One model for data sharing involves simply attaching data, irrespective of its type, to publisher websites or general use repositories. However, some argue this creates a 'data dump' that does not promote the goals of making data Findable, Accessible, Interoperable and Reusable (FAIR). Specialized data sharing communities offer an alternative model where data are curated by domain experts to make it both open and FAIR. We report on our experiences developing one such data-sharing ecosystem focusing on 'long-tail' preclinical data, the Open Data Commons for Spinal Cord Injury (odc-sci.org). ODC-SCI was developed with community-based agile design requirements directly pulled from a series of workshops with multiple stakeholders (researchers, consumers, non-profit funders, governmental agencies, journals, and industry members). ODC-SCI focuses on heterogeneous tabular data collected by preclinical researchers including bio-behaviour, histopathology findings and molecular endpoints. This has led to an example of a specialized neurocommons that is well-embraced by the community it aims to serve. In the present paper, we provide a review of the community-based design template and describe the adoption by the community including a high-level review of current data assets, publicly released datasets, and web analytics. Although odc-sci.org is in its late beta stage of development, it represents a successful example of a specialized data commons that may serve as a model for other fields.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.077
metaresearch head score (Gemma)0.074
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesMetaresearch, Open science
Consensus categoriesnone
DomainCandidate signal: Reproducibility · Consensus signal: none
Study designCandidate signal: Not applicable · Consensus signal: none
GenreCandidate signal: Review · Consensus signal: none
Teacher disagreement score0.995
Threshold uncertainty score0.407

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.0770.074
Meta-epidemiology (narrow)0.0010.001
Meta-epidemiology (broad)0.0010.002
Bibliometrics0.0040.004
Science and technology studies0.0030.008
Scholarly communication0.0110.013
Open science0.0050.020
Research integrity0.0030.005
Insufficient payload (model declined to judge)0.0020.001

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.841
GPT teacher head0.584
Teacher spread0.257 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.

Study designNot applicable
DomainReproducibility
GenreReview

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations34
Published2021
Admission routes1
Has abstractyes

Explore more

Same venueNeuroinformaticsSame topicScientific Computing and Data ManagementFrench-language works237,207