Hostname: page-component-7b7567c8c-z4zkx Total loading time: 0 Render date: 2026-11-17T06:05:02.381Z Has data issue: false hasContentIssue false

Empirically evaluating the impact of adjudicative tribunals in the health sector: context, challenges and opportunities

Published online by Cambridge University Press:  26 August 2011

Steven J. Hoffman*
Affiliation:
Assistant Professor, Department of Clinical Epidemiology & Biostatistics, and Adjunct Faculty, McMaster Health Forum, McMaster University, Hamilton, Ontario, CanadaResearch Fellow, Global Health Diplomacy Program, Munk School of Global Affairs, University of Toronto, Toronto, Ontario, Canada
Lorne Sossin
Affiliation:
Dean and Professor, Osgoode Hall Law School, York University, Toronto, Ontario, Canada
*
Correspondence to: Steven J. Hoffman, BHSc, MA, JD, McMaster University, 1280 Main Street West, MML-417, Hamilton, Ontario, Canada L8S 4L6. Email: hoffmans@mcmaster.ca
Rights & Permissions [Opens in a new window]

Abstract

Adjudicative tribunals are an integral part of health system governance, yet their real-world impact remains largely unknown. Most assessments focus on internal accountability and use anecdotal methodologies; few, studies if any, empirically evaluate their external impact and use these data to test effectiveness, track performance, inform service improvements and ultimately strengthen health systems. Given that such assessments would yield important benefits and have been conducted successfully in similar settings (e.g. specialist courts), their absence is likely attributable to complexity in the health system, methodological difficulties and the legal environment within which tribunals operate. We suggest practical steps for potential evaluators to conduct empirical impact evaluations along with an evaluation matrix template featuring possible target outcomes and corresponding surrogate endpoints, performance indicators and empirical methodologies. Several system-level strategies for supporting such assessments have also been suggested for academics, health system institutions, health planners and research funders. Action is necessary to ensure that policymakers do not continue operating without evidence but can rather pursue data-driven strategies that are more likely to achieve their health system goals in a cost-effective way.

Information

Type
Articles
Copyright
Copyright © Cambridge University Press 2011
Figure 0

Table 1Categorizing questions about health-related adjudicative tribunals according to their orientation and the possible methodologies that can be used to answer them

Figure 1

Table 2Summary of the complexity, methodological and environmental challenges associated with empirically evaluating the impact of adjudicative tribunals in the health sector

Figure 2

Panel 1Steps for moving empirical impact evaluations forward at the individual level

Figure 3

Table 3Suggestions for an empirical impact evaluation matrix for Ontario's health-related adjudicative tribunals

Supplementary material: File

Hoffman Supplementary Appendix A

Online Appendix A: Twenty-Seven Examples of Evaluations of Adjudicative Tribunals

Download Hoffman Supplementary Appendix A(File)
File 60.9 KB
Supplementary material: File

Hoffman Supplementary Appendix B

Online Appendix B: Ninety-One Examples of External Impact Evaluations of Specialist Courts

Download Hoffman Supplementary Appendix B(File)
File 92.2 KB