Hostname: page-component-7b7567c8c-fvjsw Total loading time: 0 Render date: 2026-11-17T03:26:50.931Z Has data issue: false hasContentIssue false

Uncertainty management in regulatory and health technology assessment decision-making on drugs: guidance of the HTAi-DIA Working Group

Published online by Cambridge University Press:  16 June 2023

Milou Amber Hogervorst
Affiliation:
Division of Pharmacoepidemiology and Clinical Pharmacology, Utrecht Institute for Pharmaceutical Sciences (UIPS), Utrecht University, Utrecht, The NetherlandsNational Health Care Institute (ZIN), Diemen, The Netherlands
Rick Vreman
Affiliation:
Division of Pharmacoepidemiology and Clinical Pharmacology, Utrecht Institute for Pharmaceutical Sciences (UIPS), Utrecht University, Utrecht, The Netherlands
Inkatuuli Heikkinen
Affiliation:
Global Regulatory Policy, MSD, Copenhagen, Denmark
Indranil Bagchi
Affiliation:
Global Pricing & Market Access, GSK, Philadelphia, PA, USA
Inaki Gutierrez-Ibarluzea
Affiliation:
Basque Foundation for Health Innovation and Research (BIOEF), Barakaldo, SpainBasque Office for Health Technology Assessment, Osteba, Barakaldo, Spain
Bettina Ryll
Affiliation:
Melanoma Patient Network Europe, Uppsala, Sweden
Hans-Georg Eichler
Affiliation:
Association of Austrian Social Insurance Bodies, Vienna, Austria
Elena Petelos
Affiliation:
Department of Health Services Research, CAPHRI Care and Public Health Research Institute, Maastricht University, Maastricht, The NetherlandsHealth and Society Lab, Faculty of Medicine, University of Crete, Heraklion, Greece
Sean Tunis
Affiliation:
Center for Evaluation of Value and Risk in Health, Tufts Medical Center, Boston, MA, USA
Claudine Sapede
Affiliation:
Global Public Affairs, Novartis, Basel, Switzerland
Wim Goettsch
Affiliation:
Division of Pharmacoepidemiology and Clinical Pharmacology, Utrecht Institute for Pharmaceutical Sciences (UIPS), Utrecht University, Utrecht, The NetherlandsNational Health Care Institute (ZIN), Diemen, The Netherlands
Rosanne Janssens
Affiliation:
Department of Pharmaceutical and Pharmacological Sciences, KU Leuven, Leuven, Belgium
Isabelle Huys
Affiliation:
Department of Pharmaceutical and Pharmacological Sciences, KU Leuven, Leuven, Belgium
Liese Barbier
Affiliation:
Department of Pharmaceutical and Pharmacological Sciences, KU Leuven, Leuven, Belgium
Deirdre DeJean
Affiliation:
Canadian Agency for Drugs and Technologies in Health, Ottawa, ON, Canada
Valentina Strammiello
Affiliation:
European Patients’ Forum, Brussels, Belgium
Dimitra Lingri
Affiliation:
European Healthcare Fraud and Corruption Network – EHFCN, Brussels, BelgiumAristotle University of Thessaloniki, Thessaloniki, Greece
Melinda Goodall
Affiliation:
Regulatory Affairs International, MSD (UK) Limited, London, UK
Magdalini Papadaki
Affiliation:
Regulatory Affairs International, MSD (UK) Limited, London, UK
Massoud Toussi
Affiliation:
Real World Evidence Solutions, IQVIA, Courbevoie, France
Despina Voulgaraki
Affiliation:
Medtronic Ltd, Watford, UKMaastricht University, Maastricht, The Netherlands
Ania Mitan
Affiliation:
DIA, Basel, Switzerland
Wija Oortwijn*
Affiliation:
Department for Health Evidence, Radboud Institute for Health Sciences, Radboud University Medical Centre, Nijmegen, The NetherlandsHealth Technology Assessment International (HTAi), Edmonton, AB, Canada
*
Corresponding author: Wija Oortwijn; Email: W.Oortwijn@radboudumc.nl
Rights & Permissions [Opens in a new window]

Abstract

Objectives

Uncertainty is a fundamental component of decision making regarding access to and pricing and reimbursement of drugs. The context-specific interpretation and mitigation of uncertainty remain major challenges for decision makers. Following the 2021 HTAi Global Policy Forum, a cross-sectoral, interdisciplinary HTAi-DIA Working Group (WG) was initiated to develop guidance to support stakeholder deliberation on the systematic identification and mitigation of uncertainties in the regulatory-HTA interface.

Methods

Six online discussions among WG members (Dec 2021–Sep 2022) who examined the output of a scoping review, two literature-based case studies and a survey; application of the initial guidance to a real-world case study; and two international conference panel discussions.

Results

The WG identified key concepts, clustered into twelve building blocks that were collectively perceived to define uncertainty: “unavailable,” “inaccurate,” “conflicting,” “not understandable,” “random variation,” “information,” “prediction,” “impact,” “risk,” “relevance,” “context,” and “judgment.” These were converted into a checklist to explain and define whether any issue constitutes a decision-relevant uncertainty. A taxonomy of domains in which uncertainty may exist within the regulatory-HTA interface was developed to facilitate categorization. The real-world case study was used to demonstrate how the guidance may facilitate deliberation between stakeholders and where additional guidance development may be needed.

Conclusions

The systematic approach taken for the identification of uncertainties in this guidance has the potential to facilitate understanding of uncertainty and its management across different stakeholders involved in drug development and evaluation. This can improve consistency and transparency throughout decision processes. To further support uncertainty management, linkage to suitable mitigation strategies is necessary.

Information

Type
HTAi Guidance
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0), which permits unrestricted re-use, distribution and reproduction, provided the original article is properly cited.
Copyright
© The Author(s), 2023. Published by Cambridge University Press
Figure 0

Table 1.Building blocks comprising decision-making uncertainty in the regulatory-HTA interface

Figure 1

Figure 1.Visualization of the link between the building blocks comprising decision-making uncertainty.

Figure 2

Table 2.Tool for the identification of uncertainties that may need mitigation

Figure 3

Figure 2.Uncertainty map covering the domains where uncertainty could exist for regulatory and/or HTA-informed decisions.

Figure 4

Figure 3.Populated uncertainty map based on a real-world case study by one of the participants.

Supplementary material: File

Hogervorst et al. supplementary material

Hogervorst et al. supplementary material 1

Download Hogervorst et al. supplementary material(File)
File 15.3 KB
Supplementary material: File

Hogervorst et al. supplementary material

Hogervorst et al. supplementary material 2

Download Hogervorst et al. supplementary material(File)
File 15.7 KB
Supplementary material: File

Hogervorst et al. supplementary material

Hogervorst et al. supplementary material 3

Download Hogervorst et al. supplementary material(File)
File 22.7 KB
Supplementary material: File

Hogervorst et al. supplementary material

Hogervorst et al. supplementary material 4

Download Hogervorst et al. supplementary material(File)
File 19.9 KB