MétaCan
Menu
Back to cohort
Record W6968723892 · doi:10.5281/zenodo.4916261

D4.1 Initial report on dataset integration

2020· article· en· W6968723892 on OpenAlexaff

Bibliographic record

VenueZenodo (CERN European Organization for Nuclear Research) · 2020
Typearticle
Languageen
FieldComputer Science
TopicResearch Data Management Practices
Canadian institutionsPrairie Improvement Network
Fundersnot available
KeywordsMetadataDeliverableProcess (computing)OntologyPresentation (obstetrics)Metadata modelingLinked dataConceptual model

Abstract

fetched live from OpenAlex

This deliverable reports the work done within WP4, comprising Tasks 4.1, 4.2, 4.3, 4.4 and 4.5 during the initial 18 months, i.e. period 1 of the project, assessing it and planning the related activities for the second period, i.e. months 19-36. The document is structured according to the activities carried out by the work package. After an overall presentation of the main aims of WP4 in Chapter 2, Chapter 3 provides an overview of the conceptual model being developed in ARIADNEplus and its various components. It focuses on the new AO-Cat model, designed to describe the datasets in the Catalogue and improves the previous ACDM model developed in ARIADNE. The full AO-Cat ontology is provided in the Appendix of this deliverable. The chapter also presents the fundamental categories defined to classify the information in the Catalogue and make it easily available on the new ARIADNEplus Portal, according to the recommendations of the FAIR principles which inspired the model. An overview of the application profiles under development in WP14 along with a review of the compatible models already in use by some partners. Chapter 4 presents the tools developed and implemented in ARIADNEplus to facilitate the encoding process of metadata according to the AO-Cat model and to assist content providers in all phases of their ingestion, mapping, transformation, enrichment and publication activities. Of great importance in this sense is the 3M Mapping Tool developed by FORTH, which allows users to define in detail the correspondences between the legacy metadata schemas and the entities of the model, in order to implement an optimal level of integration. The Fast Cat tool, designed for the rapid acquisition of information directly in the AO-Cat format, is also offered to partners who do not use any format for their metadata or who have a limited amount of data to be provided. Chapter 5 presents the Helpdesk, a collaborative service provided by the ARIADNEplus platform to assist content providers in all phases of the data contribution and to provide assistance at every stage of the process, from preparation to the definition of mappings, up to the fine-tuning the data harvesting and data acquisition mechanisms in the ARIADNEplus infrastructure. The service is based on the ticketing system and offers efficient interaction with the special team of experts set up to provide all the necessary information to foster the process. Chapter 6 documents the status of the integration, shows how the partners are adapting their data to the ARIADNEplus standards and the priorities defined for ingestion, according to the progress of these operations. The encoding, enrichment and standardisation work also relies on the use of the various vocabularies adopted by ARIADNEplus (e.g., the Getty AAT for subjects and PeriodO for time periods) and documented in the deliverable D5.2. Particular attention is paid to the mapping operations and a detailed analysis of the progress made on these activities is provided for each partner and each discipline listed in Task 4.4. Chapter 7 presents the activities aimed at linking the ARIADNEplus Data Infrastructure with repositories of scientific publications, exploiting, in particular, OpenAire and its open access digital archives and the links to individual journals such as Internet Archaeology or A&C. The chapter also describes the use of the ARIADNEplus text mining service (Task 17.4) to improve the metadata for the textual resources. The conclusions and an evaluation of the activities carried out in the first 18 months of the project are presented in chapter 8. The same section presents the strategies proposed for future work and for the completion of WP4 activities.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame distilled prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.

metaresearch head score (Codex)0.001
metaresearch head score (Gemma)0.004
Version: codex-gemma-dda1882f352aValidation status: machine_predicted_unvalidated
Candidate categoriesScholarly communication, Insufficient payload (model declined to judge)
Consensus categoriesInsufficient payload (model declined to judge)
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Not applicable · Consensus signal: Not applicable
GenreCandidate signal: Empirical · Consensus signal: none
Teacher disagreement score0.893
Threshold uncertainty score0.999

Codex and Gemma teacher scores by category

CategoryCodexGemma
Metaresearch0.0010.004
Meta-epidemiology (narrow)0.0000.000
Meta-epidemiology (broad)0.0000.000
Bibliometrics0.0000.001
Science and technology studies0.0010.000
Scholarly communication0.0080.012
Open science0.0040.004
Research integrity0.0000.000
Insufficient payload (model declined to judge)0.0020.008

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.159
GPT teacher head0.343
Teacher spread0.183 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; both teacher heads agree on what is shown here.

Study designNot applicable
Domainnot available
GenreEmpirical

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations0
Published2020
Admission routes1
Has abstractyes

Explore more

Same venueZenodo (CERN European Organization for Nuclear Research)Same topicResearch Data Management PracticesFrench-language works237,207