MétaCan
Menu
Back to cohort
Record W4410632356 · doi:10.31219/osf.io/tnkp9_v1

Mapping Canadian institutional research data management strategies: A cross-sectional study

2024· preprint· en· W4410632356 on OpenAlexfundaboutno aff
Chantal Ripp, Anna Catarina Armond, Marc A. Albert, Alexandra Apavaloae, Alexandra Cooper, Lucia Costanzo, Dylanne Dearborn, Aaron Franks, Sadia Khan, Elizabeth Lartey, Kailyn MacKinnon, David Moher, Francesk Perpalaj, Dominique G. Roche, Janina Ramos, Michael Steeleworthy, Minglu Wang, Kelly D. Cobey

Bibliographic record

Venuenot available
Typepreprint
Languageen
FieldComputer Science
TopicResearch Data Management Practices
Canadian institutionsnot available
FundersResearch Executive AgencyEngineering and Physical Sciences Research CouncilAlliance de recherche numérique du CanadaUniversity of Ottawa
KeywordsCross-sectional studyData managementCross-sectional dataBusinessData scienceComputer scienceData miningEconomicsStatisticsEconometricsMathematics

Abstract

fetched live from OpenAlex

In March 2021 Canada’s three federal research funding agencies introduced the Tri-Agency Research Data Management (RDM) Policy, with the objective of promoting sound RDM and data stewardship practices at research institutions. Among the requirements of the Policy, each post-secondary institution and research hospital eligible to administer agency funds was required to publish an institutional RDM strategy. This study presents a cross-sectional mapping of published institutional strategies (n=211) in response to the Tri-Agency RDM Policy requirement. We extracted information pertaining to institutional characteristics, institutional needs, and support models for data management planning and data deposit. Our analysis of institutional strategies indicates that developing RDM expertise among researchers (84%, n=177) and research support staff (61%, n=129) is of high priority. We also found that institutions did not describe activities, such as shifting incentives and rewards (6%, n=12), to incite behavioural changes and foster a broader culture of RDM among researchers. A mapping of institutional RDM strategies is an important step to identify potential gaps in responding to the Policy. We find that further efforts are needed to address consultation gaps, resource constraints, and support for data management plans and data deposit to foster a robust and effective RDM culture at Canadian research institutions.***En mars 2021, les trois organismes fédéraux de financement de la recherche du Canada ont mis en place la Politique des trois organismes sur la gestion des données de recherche (GDR), en vue de promouvoir de bonnes pratiques de GDR et d’intendance des données dans les établissements de recherche. Entre autres exigences de cette politique, chaque établissement postsecondaire et hôpital de recherche admissible à administrer des fonds attribués par les organismes était tenu de publier une stratégie institutionnelle de GDR. Cette étude présente une schématisation transversale des stratégies institutionnelles publiées (n = 211) en réponse à l’exigence de la Politique des trois organismes sur la GDR. Nous avons extrait des renseignements sur les caractéristiques institutionnelles, les besoins institutionnels et les modèles de soutien pour la planification de la gestion des données et le dépôt des données. Notre analyse des stratégies institutionnelles indique que le développement de l’expertise en GDR chez les chercheurs (84 %, n = 177) et le personnel de soutien à la recherche (61 %, n = 129) est une priorité élevée. Nous avons également constaté que les établissements ne décrivaient pas d’activités, comme la réorientation des mesures incitatives et des récompenses (6 %, n = 12), pour susciter des changements de comportement et favoriser l’élargissement de la culture de la GDR chez les chercheurs. La schématisation des stratégies institutionnelles de GDR est une étape importante pour cerner les lacunes potentielles dans la réponse à la politique. Nous estimons que des efforts supplémentaires sont de mise pour combler les lacunes en matière de consultation, remédier aux contraintes budgétaires et soutenir les plans de gestion des données et le dépôt de données afin de favoriser une culture de GDR solide et efficace dans les établissements de recherche canadiens.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.020
metaresearch head score (Gemma)0.046
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesMetaresearch
Consensus categoriesnone
DomainCandidate signal: Reproducibility · Consensus signal: none
Study designCandidate signal: Observational · Consensus signal: Observational
GenreCandidate signal: Empirical · Consensus signal: Empirical
Teacher disagreement score0.980
Threshold uncertainty score0.636

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.0200.046
Meta-epidemiology (narrow)0.0010.001
Meta-epidemiology (broad)0.0010.001
Bibliometrics0.0080.023
Science and technology studies0.0110.003
Scholarly communication0.0050.002
Open science0.0040.005
Research integrity0.0010.002
Insufficient payload (model declined to judge)0.0030.000

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.518
GPT teacher head0.520
Teacher spread0.002 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.

Study designObservational
DomainReproducibility
GenreEmpirical

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations0
Published2024
Admission routes2
Has abstractyes

Explore more

Same topicResearch Data Management PracticesFrench-language works237,207