Hostname: page-component-7b7567c8c-z4zkx Total loading time: 0 Render date: 2026-11-16T16:27:12.635Z Has data issue: false hasContentIssue false

Implementing a sandbox approach in health technology assessment: benefits and recommendations

Published online by Cambridge University Press:  04 November 2024

Jamie Elvidge*
Affiliation:
Science Evidence and Analytics Directorate, National Institute for Health and Care Excellence, UK
Nick Crabb
Affiliation:
Science Evidence and Analytics Directorate, National Institute for Health and Care Excellence, UK
Diana Delnoij
Affiliation:
Erasmus School of Health Policy and Management, Erasmus University, The Netherlands
Saskia Knies
Affiliation:
National Health Care Institute, Diemen, Rotterdam, The Netherlands
Douglas Lundin
Affiliation:
Department of the General Director, The Dental and Pharmaceutical Benefits Agency, Stockholm, Sweden
François Houÿez
Affiliation:
Treatment Information and Access Department, EURORDIS, Paris, France
Juha Röning
Affiliation:
Biomimetics and Intelligent Systems Group, University of Oulu, Oulu, Finland
Junfeng Wang
Affiliation:
Division of Pharmacoepidemiology and Clinical Pharmacology, Utrecht University, Utrecht, The Netherlands
Li Jiu
Affiliation:
Division of Pharmacoepidemiology and Clinical Pharmacology, Utrecht University, Utrecht, The Netherlands
Alastair Bennett
Affiliation:
Centre for Health Economics, University of York, York, UK
Yingying Zhang
Affiliation:
Centre for Health Economics, University of York, York, UK
Dalia Dawoud
Affiliation:
Science Evidence and Analytics Directorate, National Institute for Health and Care Excellence, UKFaculty of Pharmacy, Cairo University, Cairo, Egypt
*
Corresponding author: Jamie Elvidge; Email: jamie.elvidge@nice.org.uk
Rights & Permissions [Opens in a new window]

Abstract

Objectives

The sandbox approach, developed in the financial technologies sector, creates an environment to collaboratively develop and test innovative new products, methods and regulatory approaches, separated from business as usual. It has been used in health care to encourage innovation in response to emerging challenges, but, until recently, has not been used in health technology assessment (HTA). This article summarizes our learnings from using the sandbox approach to address three challenges facing HTA organizations and to identify implications for the use of this approach in HTA.

Methods

We identified three challenging contemporary HTA-related topics to explore in a sandbox environment, away from the pressures and interests of “live” assessments. We convened a pool of 120 stakeholders and experts to participate in various sandbox activities and ultimately co-develop solutions to help HTA organizations respond to the identified challenges.

Results

Important general learnings about the potential benefits and implementation of a sandbox approach in HTA were identified. Consequently, we developed recommendations to guide its use, including how to implement an HTA sandbox in an effective way and the types of challenges for which it may be best suited.

Conclusions

For many HTA organizations, it is difficult to carefully consider emerging challenges and innovate their processes due to risks associated with decision errors and resource limitations. The sandbox approach could reduce these barriers. The potential benefits of addressing HTA challenges in a collaborative “safe space” are considerable.

Information

Type
Method
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0), which permits unrestricted re-use, distribution and reproduction, provided the original article is properly cited.
Copyright
© The Author(s), 2024. Published by Cambridge University Press
Figure 0

Figure 1.Composition of HTx sandbox expert pool.

Figure 1

Figure 2.Simplified overview of the Innovation in HTA Methods framework (17).

Figure 2

Figure 3.Step-by-step process for implementing an HTA sandbox.