PD203 Comparison Of Health Technology Assessment Methodologies Across Australia, Canada, New Zealand And The United Kingdom: Implications For Future Collaboration
Bibliographic record
Abstract
Introduction In 2022, a group of health technology assessment (HTA) bodies from Australia, Canada, and the UK announced a collaboration to identify solutions to common challenges. This collaboration was later expanded to include agencies from New Zealand and Quebec, Canada. Since one possible activity of the consortium is joint assessments, we compared the methodologies of the agencies on 11 topics to assess the feasibility of this. Methods We reviewed the methodological guidelines of the Canadian Agency for Drugs and Technologies in Health (CADTH), L’Institut national d’excellence en santé et services sociaux (INESSS), the National Institute for Health and Care Excellence (NICE), the Pharmaceutical Benefits Advisory Committee (PBAC), the Pharmaceutical Management Agency (Pharmac), and the Scottish Medicines Consortium (SMC). The topics considered were real-world evidence, consideration of health effects, economic reference case, survival analysis, surrogate endpoints, patient involvement, uncertainty, orphan pathways, clinical evidence requirements, carer perspective, and decision modifiers. We analyzed the level of alignment across the collaborating agencies using information from the guidelines, supplemented by published literature where necessary. Results Three topics exhibited high alignment: consideration of health effects, clinical evidence requirements and surrogate endpoints. The topics of orphan pathways and carer perspective had low alignment. The remaining topics had moderate alignment. Regarding orphan pathways, NICE and the SMC had separate processes for ultra-orphan drugs, CADTH and INESSS implicitly consider rarity, and PBAC and Pharmac do not appear to consider rarity. Since carer perspective is not commonly accepted in HTA, NICE was the only agency with relevant guidance on this topic. INESSS required the societal perspective as standard, while the PBAC and Pharmac explicitly excluded it. CADTH may consider carer perspective in some circumstances, whereas the SMC guidance was ambiguous. Conclusions While there is good alignment on most topics, there are several areas where agencies would need to resolve divergences in preferred methodology if joint assessments are going to be carried out in the future. All relevant stakeholders should be part of this process, including patient groups and industry.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame machine prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.
Distilled classifier scores by category (both heads)
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.545 | 0.721 |
| Meta-epidemiology (narrow) | 0.001 | 0.001 |
| Meta-epidemiology (broad) | 0.002 | 0.004 |
| Bibliometrics | 0.014 | 0.029 |
| Science and technology studies | 0.003 | 0.004 |
| Scholarly communication | 0.014 | 0.007 |
| Open science | 0.004 | 0.010 |
| Research integrity | 0.002 | 0.002 |
| Insufficient payload (model declined to judge) | 0.003 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; the direct Gemma label and the distilled Codex classifier agree on what is shown here.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".