ICES Data and Analytic Services: Eight Years Young.
Bibliographic record
Abstract
ObjectiveIn March 2014, ICES launched Data & Analytic Services (DAS), expanding the access to ICES data and analytics beyond ICES scientists and analytic staff. In eight years, DAS has grown and evolved to increase high quality services offered to an expanding client base of external researchers. ApproachAt the inception of DAS, two services were offered to public sector researchers: data access and analytics. Data access enabled researchers to analyze coded record-level data through a secure virtual environment. Analytics, conducted by DAS staff in ICES analytic environment, provided researchers with risk-cleared summary level reports. In response to growing demand from an increasingly diverse range of researchers, ICES engaged in extensive consultations with internal and external stakeholders to re-evaluate and operationalize new services. Compliance with contractual obligations and Ontario law, organizational capacity to scale up, alignment with ICES’ mission, vision and values, were cornerstones in establishing new offerings. ResultsAnalytic services became available to private sector researchers in June 2016. In March 2017, support for cohort and longitudinal follow-up studies became the newest service offering (researchers provided with a list of applicable individuals defined for the purposes of conducting publicly funded research). As more data assets become available to researchers, requests continue to increase in volume and complexity, particularly of projects seeking to import external data for linkage to ICES data. A second high performance computing virtual environment onboarded researchers September 2021 while the original analytic environment has undergone multiple upgrades, and will soon be fully refreshed. Regular solicitation of feedback has enabled DAS to increase staffing and diversify resources available which improves the client experience at all stages. ConclusionsSince its inception, DAS has expanded from five to thirty personnel, grown and diversified its new and returning client base and has responded to demand for new services. DAS continues to provide high quality services which enable impactful research and is responsive to new opportunities for collaboration and service provision.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame machine prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.
Distilled classifier scores by category (both heads)
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.074 | 0.117 |
| Meta-epidemiology (narrow) | 0.001 | 0.002 |
| Meta-epidemiology (broad) | 0.001 | 0.001 |
| Bibliometrics | 0.006 | 0.008 |
| Science and technology studies | 0.005 | 0.009 |
| Scholarly communication | 0.017 | 0.037 |
| Open science | 0.005 | 0.020 |
| Research integrity | 0.007 | 0.017 |
| Insufficient payload (model declined to judge) | 0.052 | 0.032 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".