Policy Analysis and Evaluation
A.Y. 2019/2020
Learning objectives
In comparative terms, the Italian government and policy-making is an example of low analytical capacity - in particular regarding the ability to use data - and of ineffective implementation of public policies. The scientific analysis and the evaluation of public policies offer the tools to reduce this gap, by teaching evidence-based policy-making, coherent policy design, and effective monitoring of the implementation in different policy fields. This course concentrates not only on individual or organizational performance, and on laws or regulations, but also on the processes spreading from the design, the implementation and the evaluation of policies, focusing on how public policies can solve problems that nor citizens nor the market would otherwise solve. The first goal of this course is to offer the methodological skills for the expert, independent and responsible evaluation of public policies. The second goal attains to the understanding of the usefulness of evaluation for the amelioration of the governance in contemporary political systems, by means of understanding mistakes and failures in order to positively affect accountability and policy learning. Finally, the course will offer a realistic picture of the resistance and the skepticism to the professional evaluation of public policies coming from both policy-takers and policy-makers.
Expected learning outcomes
The course aims to provide different outcomes and related skills, such as a) Knowledge and understanding: Provide a balanced and coherent map of theoretical and methodological major perspectives underlying the policy design, implementation and evaluation; Distinguish and integrate descriptive and prescriptive approaches to the policy-making; b) Applying knowledge and understanding: Produce an analysis of a specific policy problem through collaborative group work; c) Making judgements: Read and critique an existing example of policy analysis produced by a public watchdog institution; d) Communication skills: Prepare a short, concise presentation and provide policy recommendations with a clear set of well-documented arguments.
Lesson period: Second trimester
Assessment methods: Esame
Assessment result: voto verbalizzato in trentesimi
Single course
This course cannot be attended as a single course. Please check our list of single courses to find the ones available for enrolment.
Course syllabus and organization
Single session
Responsible
Lesson period
Second trimester
Course syllabus
Module one (Gloria Regonini)
The approaches of the policy studies
Evolution of the study of public policies
The most important prescriptive and descriptive theories in public policy
The policy cycle
Actors and institutions
Typologies of the substantive content of public policies
Module 2 (Gloria Regonini)
The uses of evaluation in different institutional contexts
Dynamics and tensions in the evaluation process
What kind of institutions favor the institutionalization of evaluation in the government and the parliament
Tensions between evidence-based policy-making and "post-truth" politics and policies
Module three (Maria Tullia Galanti)
Mapping types of evaluation
The counterfactual approach and the logic of experimental methods
Other methods to evaluate the effects of public policies
Challenges and opportunities from the diffusion of an evaluation culture in the public realm
For attending students, the list of topic and texts might be updated during the lessons
The approaches of the policy studies
Evolution of the study of public policies
The most important prescriptive and descriptive theories in public policy
The policy cycle
Actors and institutions
Typologies of the substantive content of public policies
Module 2 (Gloria Regonini)
The uses of evaluation in different institutional contexts
Dynamics and tensions in the evaluation process
What kind of institutions favor the institutionalization of evaluation in the government and the parliament
Tensions between evidence-based policy-making and "post-truth" politics and policies
Module three (Maria Tullia Galanti)
Mapping types of evaluation
The counterfactual approach and the logic of experimental methods
Other methods to evaluate the effects of public policies
Challenges and opportunities from the diffusion of an evaluation culture in the public realm
For attending students, the list of topic and texts might be updated during the lessons
Prerequisites for admission
Models of Governance and Data Analysis
Teaching methods
Class teaching with discussion; slides will be openly and freely available on the course website http://www.politichepubbliche.org/avanzato/corso.html
Meta-evaluation of a proper evaluation study carried by a public institution
Discussion of examples of evaluation studies
Presentation of a teamwork based on the analysis and the evaluation of a public policy
Meta-evaluation of a proper evaluation study carried by a public institution
Discussion of examples of evaluation studies
Presentation of a teamwork based on the analysis and the evaluation of a public policy
Teaching Resources
Module one
1. Regonini, Gloria (2001), Capire le politiche pubbliche, Il Mulino, Bologna. A digital copy will be available to the students upon registration on the website http://www.politichepubbliche.org/base/capirelepolitiche.html. Alternatively students can prepare the manual Frank Fischer, Gerald J. Miller, and Mara S. Sidney (eds.) (2007), Handbook of Public Policy Analysis: Theory, Politics, and Methods, CRC Press, Taylor & Francis Group, Boca Raton, FL, free download online
Module two
1. Bundi P (2017) Parliamentarians' strategies for policy evaluations. Evaluation and Program Planning, 69(3): 130-138. Alternatively, students can prepare Regonini, Gloria (2018), Sfiducia verso le istituzioni e policy analytical capacity: parte della soluzione o parte del problema?, in "Rivista Italiana di Politiche Pubbliche", n. 3, Dicembre, pp. 333-358,accessible through the online library
2. Perl, A., Howlett, M., & Ramesh, M. (2018). Policy-making and truthiness: Can existing models cope with politicized evidence and willful ignorance in a post-fact world? Policy Sciences, 51(4): 581-600, accessible through the online library
Module three
1. Trivellato, Ugo (2009), La valutazione degli effetti di politiche pubbliche: paradigma e pratiche, Working Paper No. 2009-01, IRVAPP, https://irvapp.fbk.eu/wp-content/uploads/2017/09/FBK-IRVAPP-Working-Paper-No.-2009_01-2.pdf. Alternatively, students can prepare Stern, Elliot, Nicoletta Stame, John Mayne, Kim Forss, Rick Davies, and Barbara Befani (2012), Broadening the Range of Designs and Methods for Impact Evaluations, DFID Working Paper 38, London: Department for International Development https://www.gov.uk/government/uploads/system/uploads/attachment_data/file/67427/design-method-impact-eval.pdf
2. Stame N. (2010), What Doesn't Work? Three Failures, Many Answers, Evaluation, 16(4) 371-387. Alternatively, students can prepare Stame N. (2018), Strengthening the ethical expertise of evaluators, Evaluation, 24(4) 438-451, accessible through the online library
The list of texts for attending students may vary.
The integration of the texts with the slides presented in class is strongly recommended. Slides are available on the course website: http://www.politichepubbliche.org/avanzato/corso.html
1. Regonini, Gloria (2001), Capire le politiche pubbliche, Il Mulino, Bologna. A digital copy will be available to the students upon registration on the website http://www.politichepubbliche.org/base/capirelepolitiche.html. Alternatively students can prepare the manual Frank Fischer, Gerald J. Miller, and Mara S. Sidney (eds.) (2007), Handbook of Public Policy Analysis: Theory, Politics, and Methods, CRC Press, Taylor & Francis Group, Boca Raton, FL, free download online
Module two
1. Bundi P (2017) Parliamentarians' strategies for policy evaluations. Evaluation and Program Planning, 69(3): 130-138. Alternatively, students can prepare Regonini, Gloria (2018), Sfiducia verso le istituzioni e policy analytical capacity: parte della soluzione o parte del problema?, in "Rivista Italiana di Politiche Pubbliche", n. 3, Dicembre, pp. 333-358,accessible through the online library
2. Perl, A., Howlett, M., & Ramesh, M. (2018). Policy-making and truthiness: Can existing models cope with politicized evidence and willful ignorance in a post-fact world? Policy Sciences, 51(4): 581-600, accessible through the online library
Module three
1. Trivellato, Ugo (2009), La valutazione degli effetti di politiche pubbliche: paradigma e pratiche, Working Paper No. 2009-01, IRVAPP, https://irvapp.fbk.eu/wp-content/uploads/2017/09/FBK-IRVAPP-Working-Paper-No.-2009_01-2.pdf. Alternatively, students can prepare Stern, Elliot, Nicoletta Stame, John Mayne, Kim Forss, Rick Davies, and Barbara Befani (2012), Broadening the Range of Designs and Methods for Impact Evaluations, DFID Working Paper 38, London: Department for International Development https://www.gov.uk/government/uploads/system/uploads/attachment_data/file/67427/design-method-impact-eval.pdf
2. Stame N. (2010), What Doesn't Work? Three Failures, Many Answers, Evaluation, 16(4) 371-387. Alternatively, students can prepare Stame N. (2018), Strengthening the ethical expertise of evaluators, Evaluation, 24(4) 438-451, accessible through the online library
The list of texts for attending students may vary.
The integration of the texts with the slides presented in class is strongly recommended. Slides are available on the course website: http://www.politichepubbliche.org/avanzato/corso.html
Assessment methods and Criteria
For attending students, there will be two intermediate tests and a final oral exam. The final score will result from this scheme:
- first test: meta-evaluation of one evaluation study (20% of the totat score)
- second test: presentation of a teamwork based on a case study (40% of the total score)
- final test: discussion about the texts of the program (40% of the total score)
Attendance and active participation will count for the 10% of the total score.
For non-attending students, the exam is a discussion of the whole program. Details about how to prepare for the exam are available on the website of the course: http://www.politichepubbliche.org/avanzato/nonfrequenta.html
The exam for not-attending students is oral. Usually exams are scheduled in the afternoon, and when the number of students is high, exams might extend to the following day. The exams of Political and Administrative Systems/Political Science and of Economics are mandatory.
- first test: meta-evaluation of one evaluation study (20% of the totat score)
- second test: presentation of a teamwork based on a case study (40% of the total score)
- final test: discussion about the texts of the program (40% of the total score)
Attendance and active participation will count for the 10% of the total score.
For non-attending students, the exam is a discussion of the whole program. Details about how to prepare for the exam are available on the website of the course: http://www.politichepubbliche.org/avanzato/nonfrequenta.html
The exam for not-attending students is oral. Usually exams are scheduled in the afternoon, and when the number of students is high, exams might extend to the following day. The exams of Political and Administrative Systems/Political Science and of Economics are mandatory.
SPS/04 - POLITICAL SCIENCE - University credits: 9
Lessons: 60 hours
Professors:
Galanti Maria Tullia, Regonini Gloria
Shifts:
-
Professors:
Galanti Maria Tullia, Regonini GloriaProfessor(s)