Try again. Fail again. Fail better. Analysis of the contribution of 65 evaluations to the modernisation of public action in France

Abstract

« Modernisation of Public Action » (MAP) was an initiative to make evaluation the main instrument of reform for public policies at State level in France: 80 evaluations were launched between 2012 and 2017. MAP is the late child of both « evaluation à la française » (a 1990s attempt to make evaluation a way to reinvent democracy) and RGPP (a policy review aimed at cost-cutting under President Sarkozy). We explain how this strange combination set the expectations for the MAP. We undertook a metaevaluation to assess the quality of the evaluations, which put a very high emphasis on use, but were initially lacking some basic features such as evaluation questions or an intervention logic. However they improved over time. Finally, using contribution analysis and Process Tracing, we subject 8 evaluation processes to 10 empirical tests to assess their use. We show the diversity of impact pathways leading to reform (or lack thereof), some of which are unexpected, stressing the importance of context and attitude of stakeholders in the impacts that can be expected.