Start of project: February 2021
End of project: March 2024
Policy Analysis for the Evaluation of the German Climate Change Adaptation Strategy
The German Climate Change Adaptation Strategy (Deutsche Anpassungsstrategie an den Klimawandel, DAS) and the associated Action Plans (APA I to III) provide the national policy [Read More]The German Climate Change Adaptation Strategy (Deutsche Anpassungsstrategie an den Klimawandel, DAS) and the associated Action Plans (APA I to III) provide the national policy framework for adaptation to climate change in Germany. However, also at the sub-national level, many stakeholders contribute to increasing adaptation capacity and reducing vulnerability to climate impacts, for example the federal states, municipalities and other non-state actors.The second evaluation of the German Adaptation Strategy aims to answer, among others, the questions where Germany stands with adaptation, whether enough is already being done or whether more targeted, efficient measures are still needed in some areas, how the various actors cooperate and where there is still potential for improvement. Progress on adaptation in Germany, also at sub-national level, will be highlighted and needs for action identified. The results will contribute to the further development of the adaptation process in Germany.CEval GmbH is conducting the evaluation commissioned by the Federal Environment Agency (UBA) together with adelphi (Berlin) and a group of national adaptation experts. The main focus of CEval GmbH is on supporting the further development of the evaluation concept and methodology, the implementation of the actual evaluation applying a multi-method design and the updating of the handbook developed in the course of the first DAS evaluation on suitable methodological procedures for the evaluation of adaptation strategies.
Management: Hansjörg Gaus | Co-Worker: Susanne Johanna Väth, Laszlo Szentmarjay, Janis WickeClient: Umweltbundesamt
Start of project: June 2021
End of project: March 2022
Meta-Evaluation of MFA’s Decentralised Programme and Project Evaluations in 2017-2020
Together with a consortium of Particip and Niras, CEval was again commissioned by the Ministry of Foreign Affairs of Finland (MFA) to conduct a meta-evaluation [Read More]Together with a consortium of Particip and Niras, CEval was again commissioned by the Ministry of Foreign Affairs of Finland (MFA) to conduct a meta-evaluation of decentralised evaluations of development cooperation programmes and projects covering 2017-2020. The purpose was to build upon and amend the findings of the previous meta-evaluation to generate more learnings on the use and usefulness of decentralised evaluations, investigate the developments since the previous meta-evaluation, and to see if the quality of evaluations has further increased. Thus, this meta-evaluation is responsible for two firsts in MFAs meta-evaluation tradition. It is the first to replicate the methodology of the previous meta-evaluation allowing for sound comparison of results. Furthermore, it is the first to take into consideration the perspective of primary users of evaluations to assess the actual use and usefulness of decentralised evaluations. New features were also added and analysis tools amended to accommodate changes and developments since the previous meta-evaluation. A multi-method approach of qualitative and quantitative analysis was conducted on both secondary and primary data to generate evidence-based findings, conclusion and recommendations.
This meta-evaluation consists of three components:
Component 1- Meta-evaluation of 80 decentralised evaluations to assess the methodological quality of the evaluation reports and corresponding ToRs. The recent meta-evaluation was also compared to the previous one to identify differences and trends and identify gaps regarding MFAs evaluation capacity.
Component 2 Content assessment of 72 evaluation reports, that passed minimal quality standards, to assess the overall quality of the interventions. The assessment included quality of interventions according to the OECD DAC criteria, consideration of cross-cutting objectives (CCOs) i.e. gender equality, non-discrimination and climate sustainability, human rights-based approach (HRBA) and Finnish policy priority areas (PPAs). A qualitative synthesis of evaluators lessons and recommendations to improve quality of Finnish development cooperation was also performed.
Component 3- Primary data of 26 interviewed MFA commissioners at embassy and headquarters level, and 119 survey responses from MFA commissioners and intervention implementers were collected to assess the actual use and usefulness of decentralized evaluations from their perspectives. Facilitating and hampering factors for usefulness, as wells as interviewees lessons and recommendations were also identified from this data.
Management: Susanne Johanna Väth | Co-Worker: Hansjörg Gaus, Stefan Silvestrini, Maja Flaig, Janis WickeStart of project: October 2014
End of project: March 2017
Improving the Monitoring and reporting System to implement the Action plan "Inclusion of Persons with disabilities" in the German development co-operation
In February 2013, the Federal Ministry for Economic Cooperation and Development (BMZ) published an action plan for the inclusion of persons with disabilities (PWDs). In [Read More]In February 2013, the Federal Ministry for Economic Cooperation and Development (BMZ) published an action plan for the inclusion of persons with disabilities (PWDs). In doing so, it follows ist duties emanating from Article 32 of the UN Convention on the rights of PWDs. The action plan provides Information on strategic Goals and Actions to design development cooperation of the Federal Republic of Germany towards a better inclusion of PWDs.
To assess the progress and to steer the implementation of planned acitivities an appropriate Monitoring and reporting System is necessary. Hence, the Center of Evaluation (CEval) has been contracted to Support the sector Project "Inclusion of PWDs" of the German Agency for International Cooperation (GIZ) and the departement 300 of the BMZ with its methodological expertise to develop an Analysis grid to evaluate the implementation of the action plan.
Management: Susanne Johanna VäthStart of project: April 2016
End of project: September 2016
Evaluation and Consultancy Service: The QUIZ-Compass under Critical Review
In 2006, the department of International Development Coorperation of Friedrich-Ebert-Foundation (FES) developed a document to improve Quality Management in international development cooperation, called the QUIZ-Compass. [Read More]In 2006, the department of International Development Coorperation of Friedrich-Ebert-Foundation (FES) developed a document to improve Quality Management in international development cooperation, called the QUIZ-Compass. After several pilots and revisions the document became mandatory for all country projects in 2010. About the same time the Federal German Ministry for Economic Cooperation and Development (BMZ) began to work on an improved reporting and porposal System. Thus, in 2012 BMZ introduced new formats which became mandatory for all political foundations.
Given thes developments requirements by the QUIZ-Compass and by the BMZ regulations turned out to be partly overlapping and contradictory. Therefore FES decided to critically Review the QUIZ-Compass. The aim of the evaluation and consultancy Services was first to check whether it is still line with state of the art insights by the impact debate in development cooperation. Secondly, the practicability of the tool was tested. Finally, recommendations to enhance the QUIZ-Compass were derived.
Management: Susanne Johanna VäthClient: Friedrich-Ebert-Stiftung
Start of project: March 2016
End of project: June 2016
Meta-Evaluation World Vision Germany
For the second time World Vision Germany (WVG) has engaged CEval to conduct a meta-evaluation of 29 evaluation reports of its long-term Area Development Programmes. [Read More]For the second time World Vision Germany (WVG) has engaged CEval to conduct a meta-evaluation of 29 evaluation reports of its long-term Area Development Programmes. The aim of the evaluation was to analyze the reports with regard to their quality and validity. Beyond this assessment, CEval provided recommendations to enhance the design and implementation of future evaluation. Based on the OECD/DAC evaluation criteria relevance, effectiveness, efficiency, impact and sustainability, CEval implemented a two-tier analysis method. According to WVGs quality criteria (i.e. voice and inclusion, transparency, appropriateness of evaluation methods, methodology, triangulation, and contribution) we first assessed to which extent the evaluation reports complied with various sub-criteria within one criterion. In a second step, we consolidated findings and deviated one aggregated rating per criterion. CEval additionally examined the criteria satisfaction of information needs and organization of findings/conceptualization of change.
This year, additionally an online survey investigating the utility, usage and usefulness of evaluation findings within WV has been conducted. The semi-standardized questionnaire contained questions concerning the quality of evaluation reports against several criteria, similar to the above mentioned ones to compare the perception of quality within WV with the results from the document analysis. Furthermore, qualitative data has been collected to get insights into the usage, utility and usefulness of evaluation results.
Moreover, CEval evaluated the transparency of WVGs published impact report. It critically reviewed the report and rated it against the following criteria: comprehensibility, presentation of the relevant information for the target group, methodological approach, validity of the used data and sources, objectivity, and access.
Management: Stefan SilvestriniClient: World Vision Germany
Start of project: January 2012
End of project: December 2015
University Cooperation with Universidad de Costa Rica (UCR), with Funding Provided by the DAAD Program Subject-Specific Partnerships with Universities in Developing Countries
Having completed a successful 3-year cooperation focusing on the further development of the postgraduate study programme Project and Programme Evaluation for Social Development established at [Read More]Having completed a successful 3-year cooperation focusing on the further development of the postgraduate study programme Project and Programme Evaluation for Social Development established at Universidad de Costa Rica (UCR) in 1995, the Center for Evaluation (CEval) and the Universidad de Costa Rica (UCR) identified and realised new areas of cooperation. Since 2008, the German Academic Exchange Service (DAAD) has supported this cooperation with its funding project for sending German academics to universities in developing countries. Since 2012, the DAAD has also provided funding through the programme Subject-Specific Partnerships with Universities in Developing Countries (2012-2015), financially ensuring the plans to enhance the partnership between the two universities in Germany and Costa Rica.
The goal of the DAAD programme was to improve the teaching situation and to set up sustainable teaching structures in developing countries by facilitating academic exchange. Therefore, the international exchange between students, PhD candidates and lecturers was one of the most important aspects in the context of this enhanced cooperation. The focus also laid on opening up the master programme to other Central-American areas (regionalisation), embedding the partnership into an existing, international network (internationalisation), and adapting teaching of the master programme at UCR to regional demands and ensuing educational needs (creating a distinct programme profile). The four year partnership helped establishing or expanding regional and international professional networks and developing additional capacities regarding teaching and research.
It is planned to continue with the partnership in 2017 and integrate another Latinamerican university into the cooperation.
Management: Reinhard Stockmann | Co-Worker: Sandra Bäthge, Susanne Johanna VäthClient: German Academic Exchange Service
Start of project: October 2014
End of project: November 2015
Project Evaluation of GIZ’s Sector Project Inclusion of persons with Disabilities
Management: Stefan Silvestrini
Start of project: June 2014
End of project: May 2015
External Evaluation of Four Different Projects in the Field of Awareness Raising and a Synthesis
As international Christian development organisation, the Christian Blind Mission (CBM) aims at improving the human rights situation and the inclusion of people with disabilities. Awareness [Read More]As international Christian development organisation, the Christian Blind Mission (CBM) aims at improving the human rights situation and the inclusion of people with disabilities. Awareness raising is one important component to achieve this target successfully. To learn how awareness raising activities are implemented, how they contribute to CBMs overall aim and how project and country specifics produce different results, CBM Germany has engaged CEval to evaluate four projects and to compile findings and recommendations in a synthesis report.
With co-funding, either by the European Union or by the German Federal Ministry for Economic Cooperation and Development, CBM Germany implements two projects addressing the needs of people with hearing impairment in the Palestine Territories (Gaza and Gaza Strip), one project to improve eye care and rehabilitation in India, and one project to strengthen disability rights and inclusion in Swaziland. Given the diversity of these projects, issues of awareness raising can be studied from various perspectives. Thus, analysing the different underlying assumptions and needs which in turn lead to various approaches and expected outcomes, will contribute to a better understanding of the overall topic of awareness raising. While the projects in Gaza and India require a mid-term evaluation as they are still on-going, the projects in Gaza Strip and Swaziland are close to their end and will be finally evaluated
Management: Stefan Silvestrini | Co-Worker: Susanne Johanna Väth, Selina RöhrigClient: Christoffel Blindenmission
