Search

References

Start of project: February 2021
End of project: March 2024

Policy Analysis for the Evaluation of the German Climate Change Adaptation Strategy

The German Climate Change Adaptation Strategy (Deutsche Anpassungsstrategie an den Klimawandel, DAS) and the associated Action Plans (APA I to III) provide the national policy [Read More]The German Climate Change Adaptation Strategy (Deutsche Anpassungsstrategie an den Klimawandel, DAS) and the associated Action Plans (APA I to III) provide the national policy framework for adaptation to climate change in Germany. However, also at the sub-national level, many stakeholders contribute to increasing adaptation capacity and reducing vulnerability to climate impacts, for example the federal states, municipalities and other non-state actors.The second evaluation of the German Adaptation Strategy aims to answer, among others, the questions where Germany stands with adaptation, whether enough is already being done or whether more targeted, efficient measures are still needed in some areas, how the various actors cooperate and where there is still potential for improvement. Progress on adaptation in Germany, also at sub-national level, will be highlighted and needs for action identified. The results will contribute to the further development of the adaptation process in Germany.CEval GmbH is conducting the evaluation commissioned by the Federal Environment Agency (UBA) together with adelphi (Berlin) and a group of national adaptation experts. The main focus of CEval GmbH is on supporting the further development of the evaluation concept and methodology, the implementation of the actual evaluation applying a multi-method design and the updating of the handbook developed in the course of the first DAS evaluation on suitable methodological procedures for the evaluation of adaptation strategies.
Management: Hansjörg Gaus | Co-Worker: Susanne Johanna Väth, Laszlo Szentmarjay, Janis Wicke
Start of project: June 2021
End of project: March 2022

Meta-Evaluation of MFA’s Decentralised Programme and Project Evaluations in 2017-2020

Together with a consortium of Particip and Niras, CEval was again commissioned by the Ministry of Foreign Affairs of Finland (MFA) to conduct a meta-evaluation [Read More]Together with a consortium of Particip and Niras, CEval was again commissioned by the Ministry of Foreign Affairs of Finland (MFA) to conduct a meta-evaluation of decentralised evaluations of development cooperation programmes and projects covering 2017-2020. The purpose was to build upon and amend the findings of the previous meta-evaluation to generate more learnings on the use and usefulness of decentralised evaluations, investigate the developments since the previous meta-evaluation, and to see if the quality of evaluations has further increased. Thus, this meta-evaluation is responsible for two ‘firsts’ in MFA’s meta-evaluation tradition. It is the first to replicate the methodology of the previous meta-evaluation allowing for sound comparison of results. Furthermore, it is the first to take into consideration the perspective of primary users of evaluations to assess the actual use and usefulness of decentralised evaluations. New features were also added and analysis tools amended to accommodate changes and developments since the previous meta-evaluation. A multi-method approach of qualitative and quantitative analysis was conducted on both secondary and primary data to generate evidence-based findings, conclusion and recommendations. This meta-evaluation consists of three components: Component 1- Meta-evaluation of 80 decentralised evaluations to assess the methodological quality of the evaluation reports and corresponding ToRs. The recent meta-evaluation was also compared to the previous one to identify differences and trends and identify gaps regarding MFA’s evaluation capacity. Component 2 – Content assessment of 72 evaluation reports, that passed minimal quality standards, to assess the overall quality of the interventions. The assessment included quality of interventions according to the OECD DAC criteria, consideration of cross-cutting objectives (CCOs) i.e. gender equality, non-discrimination and climate sustainability, human rights-based approach (HRBA) and Finnish policy priority areas (PPAs). A qualitative synthesis of evaluators’ lessons and recommendations to improve quality of Finnish development cooperation was also performed. Component 3- Primary data of 26 interviewed MFA commissioners at embassy and headquarters level, and 119 survey responses from MFA commissioners and intervention implementers were collected to assess the actual use and usefulness of decentralized evaluations from their perspectives. Facilitating and hampering factors for usefulness, as wells as interviewees’ lessons and recommendations were also identified from this data.
Management: Susanne Johanna Väth | Co-Worker: Hansjörg Gaus, Stefan Silvestrini, Maja Flaig, Janis Wicke
Ex Post Evaluation
Start of project: September 2018
End of project: October 2018

Evaluation of hazard prevention and damage after the heavy rain events in Saarland in May/June 2018

In May and June 2018, Saarland was hit by heavy rainfalls which caused high damages in a number of municipalities. As a consequence, the Saarland [Read More]In May and June 2018, Saarland was hit by heavy rainfalls which caused high damages in a number of municipalities. As a consequence, the Saarland Ministry for the Environment and Consumer Protection (MUV) commissioned CEval GmbH to review the measures of hazard prevention and disaster management in the wake of these events. For this purpose, an analysis of strengths and weaknesses of hazard prevention and disaster management with regard to prevention, deployment and after-care was carried out in order to lay the foundation for identifying potential improvements and evidence-based recommendations. In addition, the damages caused by the heavy rainfalls should be assessed. To analyse the strengths and weaknesses of hazard prevention and disaster management, 62 guided interviews were conducted with representatives of the Ministry of Interior, Construction and Sport, fire-fighting coordinators, local aid organisations and mayors of the most affected municipalities. The results of the content analysis of these interviews formed the basis for identifying potential for improvement and deriving concrete recommendations for action. The evaluation of damages in the area of municipal infrastructure, agriculture and private households was carried out quantitatively on the basis of the data provided by the client.
Management: Stefan Silvestrini | Co-Worker: Hansjörg Gaus, Fabian Otto
Start of project: October 2015
End of project: September 2017

Evaluation and Further Development of German Strategy for Adaptation to Climate Change

The German Strategy for Adaptation to Climate Change (DAS) and the associated Adaptation Action Plan are central pillars of German adaptation policy. Over the long [Read More]The German Strategy for Adaptation to Climate Change (DAS) and the associated Adaptation Action Plan are central pillars of German adaptation policy. Over the long term, the Federal Government is pursuing the goal of reducing the vulnerability of the economy, environment and society to the impacts of climate change. In order to achieve this, a number of tangible measures have been implemented at various levels in recent years. For 2019, it is planned that DAS and the strategic elements associated with it are to be evaluated in a progress report. For the technical preparations for the evaluation of the DAS procedures, CEval GmbH supported adelphi in developing and testing an appropriate methodology. However, such an evaluation sometimes takes shape with difficulties: firstly, the identification of cause-effect relationships between adaptation activities and reduced vulnerability is not unproblematic. Secondly, the development of quantitative, measurable goals represents a major task. The methodology which was developed took account of these and other challenges in the evaluation of adaptation strategies and also developed appropriate solutions. To this end, adelphi analysed and assessed exiting methods for the evaluation of national adaptation and sustainability strategies. During this process, it was also examined to what extent individual factors can be sensibly carried over into the evaluation of DAS procedures. The outcomes of the evaluation and the suggested methodologies were finally be discussed during several workshops with the relevant political stakeholders. To close, the methodology was tested in a pilot procedure and the insights gained were included in the eventual finalisation of the evaluation method.
Management: Stefan Silvestrini
Start of project: January 2014
End of project: June 2017

Assessing the Impacts of Multinational Corporations on Global Development and Value Creation (Global Value)

The importance of multinational corporations for furthering global economic and social development is well established. Corporations invest in foreign countries, provide jobs, and thus generate [Read More]The importance of multinational corporations for furthering global economic and social development is well established. Corporations invest in foreign countries, provide jobs, and thus generate formalized labor relations and income. Furthermore, they pay taxes that contribute to the provision of public services. At the same time, multinational corporations particularly have received criticism by being accused of supporting exploitative employment conditions and human rights abuses, causing environmental deterioration, and failing to mainstream responsible conduct in developing countries. The GLOBAL VALUE project developed an innovative framework for assessing impacts of multinational corporations on issues related to sustainable development, working conditions, human rights, transparency, and anti-corruption. It shed light on institutional arrangement; analysed systems of governance for responsible business practices; explored responsible competitiveness; assessed the complementarity of public and private sector activities; and derived recommendations for decision makers in business, policy and non-governmental organisations. The project was carried out by universities and civil society organisations from Europe and ICPC countries. A toolkit for impact evaluation was developed and tested in close collaboration with leading multinational corporations (BATA (garment, Bangladesh), OLAM (food, Tanzania) and NOKIA (ICT, India)). The main responsibility of CEval was the development of an indicator-set for the framework which is based on Millennium Development Goals, human rights, gender & diversity, and anti-corruption & transparency and takes corporate management approaches (supply chain management, life cycle analysis and base-of-pyramid) as well as systems of governance for responsible business practices, competitiveness, and complementarity with official development aid (ODA) into account. In addition, it carried out two research case studies focusing on the complementarity of ODA with multinational corporations´ activities.
Management: Reinhard Stockmann
Start of project: December 2012
End of project: September 2016

Practice-Impact II: Development and Testing of a Concept for Documentation and Evaluation of Productive Interactions and Impacts on Practice and Society in Agricultural Research

Cooperation Partner: University of Kassel, Faculty of Organic Agricultural Sciences, Organic Farming and Cropping Systems Currently, established research evaluation procedures are largely based on peer [Read More]Cooperation Partner: University of Kassel, Faculty of Organic Agricultural Sciences, Organic Farming and Cropping Systems Currently, established research evaluation procedures are largely based on peer review publications, citation based indicators and third-party funds. However, the focus on the "scientific impact" only partially captures to what extent research contributes to solving societal or ecological problems. An increasing number of scientists and initiatives point out the responsibility of (public funded) science to contribute appropriate solutions for problems like global warming, food safety and loss of ecosystem services and research evaluations should set incentives to do so. This project was aimed at contributing to the implementation of complementary assessment of activities and impact of research regarding the needs of practice and society. Concepts for an evaluation beyond scientific impact do already exist for inter- and transdisciplinary research, applied agricultural research and broader/social/societal impact assessments and are partly used by funding agencies. They include criteria for productive interactions between research and society, which make an impact probable, as well as the impact on practice and society itself. Nevertheless, broader use of the existing concepts is hampered by the lack of reliable, easy to use data. The main task of the project was the further development and testing of a documentation and evaluation concept for agricultural research. The concept was defined to be broad enough to include all productive interactions and impacts of different types of agricultural research and can be used for the evaluation of scientists, institutions, projects and programmes. This requires a structured, standardized documentation in a database-system that enables to filter, aggregate and analyse data in different ways. In order not to increase the effort necessary for scientists to document their projects, the developed documentation system is connected to general documentation procedures in proposals and reports for research funding but also includes project independent research. The project developed and tested the structured documentation system and an assessment framework. This included three perspectives: Scientists responsible for documentation, funding agencies and evaluation experts. Furthermore, the project engaged in the development of applicable and accepted pathways to implement such evaluation in alignment with agricultural research and other relevant stakeholders and experts.
Management: Reinhard Stockmann
Start of project: September 2013
End of project: April 2016

Accompanying Research and Acceptance Research on Current Issues of Grid Extension in Germany – Scientific Monitoring of Planning Practice (Module III)

In order to reach a broad acceptance for grid extension within German society, information and communication actions on a large scale are necessary. First, Module [Read More]In order to reach a broad acceptance for grid extension within German society, information and communication actions on a large scale are necessary. First, Module III of the project provided an overview of existing and planned actions. Subsequently, the implementation of selected information and communication measures were analyzed to identify effects on attitude change towards grid extension, contributing factors and opportunities for optimization.
Management: Reinhard Stockmann
Start of project: April 2012
End of project: December 2012

Project Evaluation "Diakonie and Caritas as Places of Sustainable Lifestyles and Procurement"

The evaluated project "Diakonie and Caritas (Protestant and Catholic social welfare organisations) as Places of Sustainable Lifestyles and Procurement" was launched on November 1, 2010 [Read More]The evaluated project "Diakonie and Caritas (Protestant and Catholic social welfare organisations) as Places of Sustainable Lifestyles and Procurement" was launched on November 1, 2010 and ended on April 30, 2013. The project aim was to improve the sustainability of procurement in institutions providing inpatient care for the elderly, children and young people and people with disabilities. At the same time, staff, residents and visitors were informed and encouraged to adopt sustainable Lifestyles. In addition, approaches to reduce the use of resources and to introduce sustainable procurement Standards tested in pilot Projects were intended to be nationally disseminated and implemented in Diakonie and Caritas institutions as well as in non-church-based social welfare organisations. The Evaluation was formative, accompanied the process and began one and a half years into the project. It should provide relevant findings for the remaining Duration of the project and its planned continuation. Broadly speaking, a detailed Content description of the four project phases was compared to its current Status at the beginning of the Evaluation. More specifically, the aim was to document activities which had been realised when the evalzuation began, to obtain Information on the achievements of sub-Targets ("Improving Procurement Regarding Sustainability Standards", "National Dissemination of the Project", "Creating Network Structures") and to identify potentials for optimisation. Special Focus has been laid on Institution Management and staff and how they can be motivated to pursue sustainable procurement. CEval applied a mixed method Approach focusing on qualitative Guideline-based interviews and standardised online surveys to collect relevant data. Data and method analyses were enhanced by document analyses.
Management: Reinhard Stockmann