Hostname: page-component-7b7567c8c-z4zkx Total loading time: 0 Render date: 2026-11-17T01:47:10.491Z Has data issue: false hasContentIssue false

Development, testing, and implementation of a new procedure to assess the clinical added benefit of pharmaceuticals

Published online by Cambridge University Press:  12 July 2022

Veronika Dóczy*
Affiliation:
Department of Health Technology Assessment, National Institute of Pharmacy and Nutrition, Budapest, Hungary
Barbara Wernerné Sódar
Affiliation:
Department of Health Technology Assessment, National Institute of Pharmacy and Nutrition, Budapest, Hungary
Áron Hölgyesi
Affiliation:
Department of Health Technology Assessment, National Institute of Pharmacy and Nutrition, Budapest, HungaryDoctoral School of Molecular Medicine, Semmelweis University, Budapest, Hungary
Gergő Merész
Affiliation:
Department of Health Technology Assessment, National Institute of Pharmacy and Nutrition, Budapest, HungaryDoctoral School of Mental Health Sciences, Semmelweis University, Budapest, Hungary
Péter Gaál
Affiliation:
Faculty of Health and Public Administration, Health Services Management Training Centre, Semmelweis University, Budapest, HungaryFaculty of Technical and Human Sciences, Department of Applied Social Sciences, Sapientia Hungarian University of Transylvania, Targu Mures, Romania
*
*Author for correspondence: Veronika Dóczy, E-mail: doczy.veronika@ogyei.gov.hu
Rights & Permissions [Opens in a new window]

Abstract

Objectives

The reimbursement process for innovative health technologies in Hungary lacks any formalized assessment of clinical added benefit (CAB). The aim of this research is to present the development, retrospective testing, and implementation of a local assessment framework for determining the CAB of cancer treatments at the Department of Health Technology Assessment of the National Institute of Pharmacy and Nutrition in Hungary.

Methods

The assessment framework was drafted after screening existing methods and a retrospective comparison of local reimbursement dossiers to that of German and French methods. The Magnitude of Clinical Benefit Scale of the European Society for Medical Oncology was chosen to rate the extent of CAB in oncology, as part of a conclusion complemented by the assessment of endpoint relevance and the quality of evidence. Several rounds of retrospective assessments have been conducted involving all clinical assessors, iterated with semistructured discussions to consolidate divergence between assessors. External stakeholders were consulted to provide feedback on the framework.

Results

Retrospective assessments resulted in average more than 75 percent concordance between assessors on each element of the conclusion. Input from ten stakeholders was also incorporated; stakeholders were generally supportive, and they mostly commented on the concept, the elements of the framework, and its implementation.

Conclusions

The procedure is suitable for routine use in the decision-making process to describe the CAB of antineoplastic technologies in Hungary. Further extension of the framework is required to cover more disease areas for structured and comparable conclusions on CAB of innovative health technologies.

Information

Type
Method
Copyright
© The Author(s), 2022. Published by Cambridge University Press
Figure 0

Figure 1.The schematic representation of the framework development.The designing of the framework can be divided into the steps of development, retrospective testing and feedback, and implementation; we can also distinguish internal and external phases, depending on whether the contributions were made solely by NIPN employees or if other stakeholders were involved.Notes. Some retrospective test and the stakeholder consultation were performed simultaneously, for time-saving purposes.CAB, clinical added benefit; NIPN, National Institute of Pharmacy and Nutrition; SOP, standard operating procedure.

Figure 1

Table 1.Comparison of the Distribution of CAB/CAV Categories Across Dossiers Submitted to HAS, IQWiG, and NIPN

Figure 2

Table 2.Concordance Between Assessors During the Three Rounds of Retrospective Assessments

Figure 3

Figure 2.Distribution of stakeholder responses.In total, ten stakeholders provides feedback from which two did not answer the questionnaire and two did not give any additional comments. Figure shows the responses of eight stakeholders to the questionnaire.*missing values = 1; **missing values = 2. A1-D2: IDs of questions of the stakeholder questionnaire (see Supplementary: stakeholder questionnaire). Domain A: feedback regarding the procedure of drawing conclusion on CAB (clinical added benefit). Domain B: feedback regarding the system used for describing the quality of evidence. Domain C: feedback regarding the scale used for scoring the extent of CAB. Domain D: feedback regarding the therapeutic field chosen for introduction (solid tumors).

Figure 4

Figure 3.Schematic presentation of the process of formulating conclusion on CAB.*In cases where the conclusion cannot be drawn on the extent, we provide conclusion only on the existence of CAB.**High: large, good quality randomized controlled trials (RCT) and meta-analyses of these without considerable heterogeneity. Moderate: small RCTs or large RCTs with susceptible of bias and meta-analyses of these or meta-analyses with considerable heterogeneity or indirect comparisons. Low: cohort studies, case reports, and indirect comparisons where the methodology is not clearly presented in the submitted application for reimbursement or if the indirect comparison carries serious methodological flaws. Further details are presented in Supplementary Table 2.***Categories based on use of an internationally accepted tool (e.g., GRADE or Cochrane RoB2).CAB, clinical added benefit; PICO, population-intervention-comparator-outcome.

Supplementary material: PDF

Dóczy et al. supplementary material

Dóczy et al. supplementary material

Download Dóczy et al. supplementary material(PDF)
PDF 768.4 KB