Methodological research priorities for data sciences: Report from The International Methodology Consortium for Coded Health Information (IMECCHI)
Bibliographic record
Abstract
ABSTRACT ObjectivesThe vast amount of data produced by healthcare systems both structured and unstructured, termed ‘Big Data’ have the potential to improve the quality of healthcare through supporting a wide range of medical and healthcare functions, including clinical decision support, disease surveillance, and population health management. As the field of big data in healthcare is rapidly expanding, methodology to understand and analyze thereby enhancing and optimizing the use of this data is needed. We present priorities determined for future work in this area. ApproachAn international collaboration of health services researchers who aim to promote the methodological development and use of coded health information to promote quality of care and quality health policy decisions known as IMECCHI –proposes areas of development and future priorities for use of big data in healthcare. Thematic areas were determined through discussion of potential projects related to the use and evaluation of both structured /codeable and unstructured health information, during a recent meeting in October 2015 ResultsSeveral themes were identified. The top priorities included: 1) electronic medical record data exploration and utilization; 2) developing common data models and multimodal /multi-source databases from disparate sources development; 3) data quality assessment including developing indicators, automated logic checks and international comparisons; 4) the translation of ICD-10 to ICD-11 through field-testing 5) Exploration of non-physician produced/coded data; and 6) Patient safety and quality measure development. ConclusionsA list of expert views on critical international priorities for future methodological research relating to big data in healthcare were determined. The consortium's members welcome contacts from investigators involved in research using health data, especially in cross-jurisdictional collaborative studies.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame machine prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.
Distilled classifier scores by category (both heads)
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.788 | 0.687 |
| Meta-epidemiology (narrow) | 0.003 | 0.004 |
| Meta-epidemiology (broad) | 0.004 | 0.005 |
| Bibliometrics | 0.018 | 0.022 |
| Science and technology studies | 0.013 | 0.009 |
| Scholarly communication | 0.031 | 0.017 |
| Open science | 0.012 | 0.026 |
| Research integrity | 0.017 | 0.023 |
| Insufficient payload (model declined to judge) | 0.009 | 0.003 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; the direct Gemma label and the distilled Codex classifier agree on what is shown here.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".