Bibliographic record
Abstract
Librarians, informationists, researchers, health policymakers, and health care professionals retrieve reports of health technology assessments (HTAs) to review the evidence on medical, socioeconomic, and ethical implications of health care and health care investments [1]. These assessments are a useful type of gray literature that include cost-benefit analyses of health interventions, syntheses of intervention research findings, and discussion of the economic implications of health care and medical technology [2]. The HTA Database Canadian Repository is a new, valuable tool that aggregates these assessments and makes them findable via a convenient search interface. This international repository includes records for in-progress and published reports of HTAs, reviews, guidelines, protocols, journals, and articles. Launched in January of 2015, the database includes records beginning in 2003. The HTA Database is funded by the United Kingdom's National Institute for Health Research (NIHR) and administered by the University of York Centre for Reviews and Dissemination. The Canadian repository aggregates HTA records from Ontario, Quebec, Alberta, and pan-Canadian agencies (CADTH) in addition to records from the International Network of Agencies for Health Technology Assessment (INAHTA). The database includes reports from 93 INAHTA and other international repositories [3]. All records and documents are translated into English, French, and/or Spanish, representing about 20 source languages. As of May 2015, the Canadian repository contains over 14,000 unique records; approximately 2,400 are Canadian. Canadian search interface The Canadian interface for the HTA Database is free for noncommercial use [4]. The basic search can include title, full text, province, author, agency, and funder. Additional options allow the user to limit searches to Canadian databases, Canadian and international HTA databases, the Database of Abstracts of Reviews of Effects (DARE), Cochrane reviews, and the National Health Service Economic Evaluation Database (NHS EED) of assessed economic evaluations. While items in the DARE and NHS EED databases are critically appraised—in other words, reviewed for trustworthiness, value, and contextual relevance—items in the HTA database are not. However, if a critical appraisal exists, it is linked with the HTA database record [1]. Other search criteria include record date, publication year, and Medical Subject Headings (MeSH) term search. While search text can be truncated and wildcards accepted, special characters, such as the German umlaut, are not. Search results include year—although it is unclear if this indicates publication or record year—source database, source agency, and title. Although additional metadata exist for each record, search queries are limited to the basic metadata only. The Boolean operators AND, OR, and NOT are available, as well as the proximity operators NEAR and ADJ. Using proximity operators and restricting searches to specific fields (e.g., author [:au], title [:ti], language [:lp], source journal [:so], and funding [xfu]) are particularly helpful when performing advanced, full-text, and keyword searches. The MeSH terminology search is also helpful, if not ideal. MeSH terms can be searched by string (permut), stemming, or tree criteria, but combinations of terms cannot be selected for post-coordinated searching by index concept. Terms selected for searching are not visible in the interface for review or modification; using the interface can be frustrating when executing a high volume of advanced or expert searches. Also, terms cannot be exploded, and MeSH terms are not accompanied by MeSH tree numbers. This is significant for content and keyword analysis, because the tree number indicates the context of the MeSH term. Overall, the MeSH terminology search will not hinder basic or advanced terminology searches but may hinder expert searches. Records can be exported in hypertext markup language (HTML) format; however, downloading full-text reports, when available, must be done one-by-one on a case-by-case basis. Metadata Each record notes the title, agency location, publisher, year of publication, publication type, agency-assigned MeSH terms, HTA accession number, language, source database, and uniform resource locator (URL), along with other metadata. Some metadata are unique to the database from which they derive. For example, metadata vary in records from DARE, NHS EED, or HTA. Conformity of metadata is primarily applied when agencies upload records and input their metadata through the HTA interface. Considerations and advantages For record inclusion, the HTA Database has an “extremely flexible definition of what constitutes a health technology assessment,” which, although potentially beneficial to a variety of users, does not provide a reliable description of publications included in the database [3]. As a result, the database also contains records such as protocols for systematic reviews and care guidelines. Also, documentation is incomplete for metadata fields and database coverage, and there are no descriptions of governance policies. For example, in reviewing a sample of records, we found that not all metadata fields include the same type of information; however, this was a minor occurrence. As a final note, records appear to be added weekly, but since agencies add content on a voluntary basis, frequency of updates varies. The HTA Database Canadian repository and its interface will be helpful to librarians who support HTA investigators and policymakers, as well as patrons interested in assessments of health and health technologies. This new resource facilitates information retrieval and research and may reduce costly duplication of effort by enabling queries of both Canadian and international databases via one search interface. Additionally, the search interface enables discovery of gray literature that is otherwise unavailable or subject to purchase. Although its interface does not support expert searching, the superior aggregation of content makes the HTA Database Canadian Repository a valuable resource.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame distilled prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.
Codex and Gemma teacher scores by category
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.021 | 0.025 |
| Meta-epidemiology (narrow) | 0.000 | 0.000 |
| Meta-epidemiology (broad) | 0.001 | 0.000 |
| Bibliometrics | 0.000 | 0.000 |
| Science and technology studies | 0.000 | 0.000 |
| Scholarly communication | 0.000 | 0.001 |
| Open science | 0.001 | 0.000 |
| Research integrity | 0.000 | 0.000 |
| Insufficient payload (model declined to judge) | 0.001 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one teacher head, not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".