Across many countries, as the editor and several of the contributors to this Handbook observe, there has been an increasing demand for evidence-based policies and programmes. Policy-makers and practitioners claim they want to know ‘what works’. This raises a number of questions, including what are the appropriate theoretical and methodological approaches to evaluating social policies, and to what extent evaluation findings influence policy design and implementation. This handbook aims to address these sorts of issues. As such there are some ‘big’ themes covered in the handbook – what is meant by evidence, how evidence affects policy and practice, the strengths and weaknesses of different approaches to evaluation, and the ‘politics’ and ideology that can underpin the practice of evaluation.
The 51 (co-)authors of the 26 chapters are mainly academics, with a few being practitioners. In general, they have a wealth of knowledge and experience of evaluating social policies.
Social policy is defined broadly, the substantive policies and programmes considered include early years’ interventions, disability, education, families, healthcare, labour markets, long-term social care, medicines, poverty and social impact bonds. Housing policy is a notable omission.
The handbook is divided into three parts. Part I, with six chapters, provides an outline and critique of different methodological approaches to evaluation. Chapters cover methods-driven approaches, notably randomised control trails (RCTs) and economic evaluations. There are also informative chapters on quasi-experimental designs and participatory evaluation. Less well represented in Part I are theory-driven approached to evaluation, a separate chapter on, say, theory of change would have been welcome. The first two chapters in Part I, on RCTs and quasi-experimental designs, presuppose that readers have some statistical knowledge, whilst the other chapters provide more of an introduction. Nonetheless, all these chapters provide the reader with a good ‘state of the art’ review and can refer to other helpful sources that readers might wish to follow-up.
Part II, comprising seven chapters, covers the influence of evaluation on policy-making. The chapters consider models of the use and utilisation of evaluations and evidence, and highlight the (unintentional) consequences and misuses of evidence in policy-making. The focus is on RCTs and performance management approaches. Examples are used to reinforce and illustrate the arguments made. Part II also includes an insightful chapter by Christopher Deeming on the uses and misuses of RCTs in advanced and developing countries. He highlights how the very use of evaluations can ‘. . . serve to legitimize particular policies and ideologies and existing power relations and inequalities within society’ (p.177). There are two chapters, covering UK welfare policies and social impact bonds, which provide good overviews of their respective topics, but would have been better located in Part III. A chapter on policy transfer between countries would be a useful addition to the Handbook.
In 11 chapters, Part III provides state of the art summaries of policy-related evaluation findings and specific examples of evaluations across a range of social policies. The chapters cover healthcare, new medicines, long-term social care, labour markets, assessments of incapacity to work, integration of migrants, children, young people and families, large-scale public sector policies, tackling poverty and consumption of education research. Part III includes some very good detailed examples of social policy evaluations that social policy practitioners and researchers might wish to sample. However, the lack of cross-referencing to other chapters, especially to those in Part I, could mean that the reader, especially one without an extensive knowledge of evaluation, dipping into the book is not guided to all the relevant material in the Handbook. Moreover, the lack of a chapter in Part I on theory-driven evaluation approaches is highlighted by such an approach being used in Edbrooke-Childs et al.’s chapter on interventions for children, young people and families.
The handbook is not a ‘how to’ manual. It provides an up-to-date and critical overview of (selected) approaches to evaluation; a comprehensive overview of the issues (pro and con) in social policy evaluation, debates on the influence of evidence on policy-making; and some very useful examples of social policy evaluations. However, some readers might find that too many of the (more detailed) examples are drawn from the UK, and / or focus on healthcare or the labour market. As a handbook for the reader looking to find specific information the chapters do contain descriptive (sub-)headings (unfortunately these are not included in the contents page), and a 22-page index. However, more terms (for instance, ‘counterfactual’) could have been included in the index, and there could have been a lot more cross-referencing between chapters. The audience for the handbook is wider than those researchers with an interest in social policy evaluations, as the examples used mean that those with no or limited interests in evaluation will find it a useful resource on specific policy areas.
