Validation of the global resource of eczema trials (GREAT database)
Why this work is in the frame
A frame that forgets how it found something cannot be audited. These are the routes that admitted this work.
Bibliographic record
Abstract
BACKGROUND: Eczema (syn. Atopic Eczema or Atopic Dermatitis) is a chronic, relapsing, itchy skin condition which probably results from a combination of genetic and environmental factors. The Global Resource of EczemA Trials (GREAT) is a collection of records of randomised controlled trials (RCTs) for eczema treatment produced from a highly sensitive search of six reference databases. We sought to assess the sensitivity of the GREAT database as a tool to save future researchers repeating extensive bibliographic searches. METHODS: All Cochrane systematic review on treatments for eczema and five non-Cochrane systematic reviews on eczema were identified as a reference set to assess the utility of the GREAT database in identifying randomised controlled trials (RCTs). RCTs included in the systematic reviews were checked for inclusion in the GREAT database by two independent authors. A third author resolved any disagreements. RESULTS: Five Cochrane and six non-Cochrane systematic reviews containing a total of 105 RCTs of eczema treatments were included. Of these, 95 fitted the inclusion criteria for the GREAT database and 88 were published from 2000 onwards. Of the 88 eligible studies, 92% were found in the GREAT database. Seven trials were not included in the GREAT database - two of these were reported within a review paper and one as an abstract with no trial results. CONCLUSIONS: The sensitivity of the GREAT database for trials from 2000 onwards was high (75/88 trials, 94%). Sensitivity for the period prior to 2000 was less sensitive, due to differences in how the trials were identified prior to this time. 'Dual' filtering for new records has recently become part of the GREAT database methodology and should further improve the sensitivity of the database in time. The GREAT database can be considered as a primary source for future systematic reviews including randomised controlled trials of eczema treatments, but searches should be supplemented by checking reference lists for eligible trials, searching trial registries and contacting pharmaceutical companies for unpublished studies.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
Full frame distilled prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.
Codex and Gemma teacher scores by category
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.000 | 0.004 |
| Meta-epidemiology (narrow) | 0.000 | 0.000 |
| Meta-epidemiology (broad) | 0.001 | 0.000 |
| Bibliometrics | 0.000 | 0.000 |
| Science and technology studies | 0.000 | 0.000 |
| Scholarly communication | 0.000 | 0.000 |
| Open science | 0.000 | 0.000 |
| Research integrity | 0.000 | 0.000 |
| Insufficient payload (model declined to judge) | 0.000 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it