Collaborative Use Cases between SSH Open Marketplace and the Language Resource Switchboard and Virtual Collection Registry
Why this work is in the frame
A frame that forgets how it found something cannot be audited. These are the routes that admitted this work.
Bibliographic record
Abstract
The CLARIN Language Resource Switchboard (LRS or Switchboard) serves as an established and valuable asset to provide the user with tools and services for their research data. Apart from looking at an already existing set of research data, moreover, many users would like to search for tools and services from the angle of the research method, a certain technology, interoperability or even just a research question, which calls for the SSH Open Marketplace (MP). The MP not only strives to provide individual items (tools, research data, tutorials, software) to the searching and browsing user, but first and foremost context. Contextualized items in the MP allow for a search serendipity which contributes substantially to the service experience. The LRS promises to be a suitable means to convey such serendipity. For this purpose, the following document outlines possible user stories in favor of its integration into the MP. Beyond the LRS-MP relation the document also considers scenarios for the relation of both components to the CLARIN Virtual Collection Registry (VCR). The VCR allows the user to create individual and persistent collections including records from a broad range of sources. Such sources may be repositories exposing research data (the common VCR use case= ’bibliography of research datasets’), but possibly also from other sources such as the MP. The overarching goal of the activity in T3.6 is to achieve - wherever useful and technically possible - an integration between CLARIN and DARIAH components, being developed and extended under the SSHOC umbrella. This includes especially the MP, the VCR and LRS. The DARIAH research infrastructure plays an important role in this regard, although this document focuses on the CLARIN LRS and CLARIN VCR as well as the MP. NOTE: Addendum to this document is available on Zenodo.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
Full frame distilled prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.
Codex and Gemma teacher scores by category
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.002 | 0.003 |
| Meta-epidemiology (narrow) | 0.000 | 0.000 |
| Meta-epidemiology (broad) | 0.000 | 0.000 |
| Bibliometrics | 0.000 | 0.001 |
| Science and technology studies | 0.002 | 0.000 |
| Scholarly communication | 0.009 | 0.001 |
| Open science | 0.002 | 0.007 |
| Research integrity | 0.000 | 0.000 |
| Insufficient payload (model declined to judge) | 0.000 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it