Countries of Cooperation
Accompanying, Ex Post Evaluation, Program Evaluation
Start of project: December 2023
End of project: November 2027
Copy permalink:
RePack-Network. Reduce, Reuse, Recycle – Sustainable Packaging of Food: Networking and Transfer Program for Plastics Reduction
Food is often packaged in plastics that are only used for a short time and are rarely reused or recycled. In addition to the considerable [Read More]Food is often packaged in plastics that are only used for a short time and are rarely reused or recycled. In addition to the considerable consumption of resources, the environment is also polluted by macro- or microplastics. The Federal Ministry of Food and Agriculture (BMEL) is therefore promoting innovations that help to package food more sustainably and reduce plastics along the value chain. In the RePack network, five research institutions under the leadership of the Institute for Ecological Economy Research (IÖW) accompany, support and evaluate twelve innovation projects in this funding programme. In the projects, universities and research institutions work together with companies to develop new production processes, innovative materials, packaging with an increased recycled content or reusable packaging.
The “Networking and Transfer Program for Plastics Reduction” is investigating how existing sustainable packaging concepts can be expanded. The aim is to bundle the results for different target groups and bring the projects into dialogue: To this end, cluster and themed workshops as well as conferences are being designed and organised at which the projects can network with each other and with the interested specialist public. A website and social media presence as well as a regular newsletter provide information on the progress of the projects and give insights into the innovations. The results of the funded projects are used to derive overarching recommendations for action for politics, business, civil society and consumers.
The task of CEval GmbH within the “Networking and Transfer Program for Plastics Reduction” is the conception and implementation of the accompanying and final evaluation of the BMEL funding programme for the development of packaging innovations for the food industry. To this end, a results model for the funding programme will be created, which will be empirically validated and refined, and indicator sets will be developed for the project level as well as the levels of the funding programme and the overarching innovation programme of the BMEL. Building on this, the annual accompanying evaluations and the final summative evaluation will analyse the design and implementation of the funding programme, its results and their sustainability and transferability to other fields of application, as well as identifying further fields of action and research needs. Methodologically, the theory-based evaluation follows a mix of document analyses, individual and group interviews and supplementary online surveys.
Management: Stefan Silvestrini | Co-Worker: Hansjörg Gaus, Matthias Klapproth, Hilde Folger, Juliane Löw | Cooperation Partner: Institute for Ecological Economy Research, IÖW, Gesellschaft für Verpackungsmarktforschung, GVM, Institute for Social-Ecological Research, ISOE, Sustainable Packaging Institute (SPI) of Albstadt-Sigmaringen UniversityAccompanying, Program Evaluation
Start of project: October 2023
End of project: September 2025
Copy permalink:
Evaluation of the Deval Funding Programme Rigorous Impact Evaluation
The RIE funding programme supported a matchmaking between actors from science and development cooperation, which led to funding of nine rigorous impact evaluations (RIE) to [Read More]The RIE funding programme supported a matchmaking between actors from science and development cooperation, which led to funding of nine rigorous impact evaluations (RIE) to be implemented between March 2023 and September 2025. Scientific institutions in Germany were eligible to apply together with a development project funded by the Federal German Ministry for Economic Cooperation and Development (BMZ). The programme aims to remove barriers to the implementation of RIE and to support systematic anchoring of RIE in German development cooperation.
CEval GmbH was commissioned with the evaluation of the RIE funding programme by the German Institute for Development Evaluation (DEval). The evaluation is carried out according to the OECD-DAC criteria and is based on a comprehensive analysis grid. A mix of methods is applied: The RIE project proposals and interim reports are assessed by means of a systematic review, which is structured by an assessment grid. Guideline based interviews are conducted with all relevant stakeholder groups of the programme at two points in time. In addition, a standardised online survey is implemented, which addresses all scientists and representatives of the development organisations as well as local scientists in the partner countries who are directly involved in the implementation of the nine RIE.
In addition, a Delphi survey is implemented as innovative method for looking to the future. For the first Delphi round, international experts will be recruited and their perspective on the future role of RIE in German development cooperation will be examined by thematic-focussed interviews. The results will be assessed and returned to the panel participants in a second round of inquiry in the form of an online survey in order to identify, weight and prioritise converging and diverging perspectives and views of the experts.
Management: Susanne Johanna Väth | Co-Worker: Matthias Klapproth, Hansjörg Gaus, Janis WickeImpact Analysis
Start of project: December 2022
End of project: April 2025
Copy permalink:
Support of the BfN in the Evaluation by the German Science and Humanities Council (WR) 2023/2024
As a federal departmental research institution, the Federal Agency for Nature Conservation (BfN) is evaluated at regular intervals by external experts. After the first external [Read More]As a federal departmental research institution, the Federal Agency for Nature Conservation (BfN) is evaluated at regular intervals by external experts. After the first external evaluation by the German Council of Science and Humanities (WR) in 2007 and the second evaluation in 2015, the third evaluation is now due in 2024. The aim of the project is to support the BfN in the conceptual preparation and follow-up of the upcoming evaluation process through external, scientific expertise.
The following core tasks will be fulfilled:
- Support in the collection, evaluation and preparation of data and information needed to answer the questions to the BfN and the preparation of the report;
- Support in the preparation and implementation of the inspection by the WR;
- Support in the analysis of the evaluation results and in the follow-up of the evaluation;
- Analysis of the effectiveness and quality of BfN's science-based policy advice and knowledge communication, including the development of recommendations for its systematic further development. Development of proposals for the integration of these recommendations into the quality management of BfN's scientific work.
Management: Hansjörg Gaus | Co-Worker: Susanne Johanna Väth, Laszlo Szentmarjay, Matthias Klapproth, Hilde FolgerAccompanying, Impact Analysis
Start of project: February 2021
End of project: March 2024
Copy permalink:
Policy Analysis for the Evaluation of the German Climate Change Adaptation Strategy
The German Climate Change Adaptation Strategy (Deutsche Anpassungsstrategie an den Klimawandel, DAS) and the associated Action Plans (APA I to III) provide the national policy [Read More]The German Climate Change Adaptation Strategy (Deutsche Anpassungsstrategie an den Klimawandel, DAS) and the associated Action Plans (APA I to III) provide the national policy framework for adaptation to climate change in Germany. However, also at the sub-national level, many stakeholders contribute to increasing adaptation capacity and reducing vulnerability to climate impacts, for example the federal states, municipalities and other non-state actors.The second evaluation of the German Adaptation Strategy aims to answer, among others, the questions where Germany stands with adaptation, whether enough is already being done or whether more targeted, efficient measures are still needed in some areas, how the various actors cooperate and where there is still potential for improvement. Progress on adaptation in Germany, also at sub-national level, will be highlighted and needs for action identified. The results will contribute to the further development of the adaptation process in Germany.CEval GmbH is conducting the evaluation commissioned by the Federal Environment Agency (UBA) together with adelphi (Berlin) and a group of national adaptation experts. The main focus of CEval GmbH is on supporting the further development of the evaluation concept and methodology, the implementation of the actual evaluation applying a multi-method design and the updating of the handbook developed in the course of the first DAS evaluation on suitable methodological procedures for the evaluation of adaptation strategies.
Management: Hansjörg Gaus | Co-Worker: Susanne Johanna Väth, Laszlo Szentmarjay, Janis WickeClient: Umweltbundesamt
Accompanying, Ex Post Evaluation, Impact Analysis, Meta-Evaluation, Organizational Consulting
Start of project: October 2021
End of project: September 2022
Copy permalink:
Program evaluation of the federal program for biological diversity
The German National Strategy on biodiversity strives to improve the protection and sustainable use of biodiversity in Germany. The strategy was adopted by the federal [Read More]The German National Strategy on biodiversity strives to improve the protection and sustainable use of biodiversity in Germany. The strategy was adopted by the federal government in 2007 and has been supplemented by the Nature Conservation Offensive 2020 since 2015.
Since 2011, the Federal Program for Biological Diversity has taken on a crucial role within the framework of the biodiversity strategy as Germany's most financially powerful funding instrument for nature conservation projects. It promotes measures aimed at halting the decline in biodiversity in Germany and reversing it into a positive trend in the medium to long term.
To assess its success, the federal programme has established evaluations of individual projects. However, a systematic and aggregated analysis of the pool of projects funded within the framework of the programme was missing in its 10-year duration.
Therefore, CEval was working with adelphi and PAN to develop a structured, precisely fitting analysis methodology to systematically assess the quality of the programme.
For this purpose, documents from more than 60 completed or far advanced projects were systematically evaluated and complemented by expert interviews. In addition, further interviews were conducted at the level of programme management in order to identify potentials for the improvement of the operational and strategic programme steering. Overall, key aspects, successes, weaknesses and potentials at programme and project level were identified and systematically reflected to formulate recommendations for the improvement of future funding practices.
Management: Hansjörg Gaus | Co-Worker: Susanne Johanna Väth, Janis Wicke | Cooperation Partner: Adelphi Research, Planungsbüro für angewandten NaturschutzCapacity Development, Meta-Evaluation
Start of project: June 2021
End of project: March 2022
Copy permalink:
Meta-evaluation of MFA’s Decentralised Programme and Project Evaluations in 2017-2020
Together with a consortium of Particip and Niras, CEval was again commissioned by the Ministry of Foreign Affairs of Finland (MFA) to conduct a meta-evaluation [Read More]Together with a consortium of Particip and Niras, CEval was again commissioned by the Ministry of Foreign Affairs of Finland (MFA) to conduct a meta-evaluation of decentralised evaluations of development cooperation programmes and projects covering 2017-2020. The purpose was to build upon and amend the findings of the previous meta-evaluation to generate more learnings on the use and usefulness of decentralised evaluations, investigate the developments since the previous meta-evaluation, and to see if the quality of evaluations has further increased. Thus, this meta-evaluation is responsible for two ‘firsts’ in MFA’s meta-evaluation tradition. It is the first to replicate the methodology of the previous meta-evaluation allowing for sound comparison of results. Furthermore, it is the first to take into consideration the perspective of primary users of evaluations to assess the actual use and usefulness of decentralised evaluations. New features were also added and analysis tools amended to accommodate changes and developments since the previous meta-evaluation. A multi-method approach of qualitative and quantitative analysis was conducted on both secondary and primary data to generate evidence-based findings, conclusion and recommendations. This meta-evaluation consists of three components:
Component 1 – Meta-evaluation of 80 decentralised evaluations to assess the methodological quality of the evaluation reports and corresponding ToRs. The recent meta-evaluation was also compared to the previous one to identify differences and trends and identify gaps regarding MFA’s evaluation capacity.
Component 2 – Content assessment of 72 evaluation reports, that passed minimal quality standards, to assess the overall quality of the interventions. The assessment included quality of interventions according to the OECD DAC criteria, consideration of cross-cutting objectives (CCOs) i.e. gender equality, non-discrimination and climate sustainability, human rights-based approach (HRBA) and Finnish policy priority areas (PPAs). A qualitative synthesis of evaluators’ lessons and recommendations to improve quality of Finnish development cooperation was also performed.
Component 3 – Primary data of 26 interviewed MFA commissioners at embassy and headquarters level, and 119 survey responses from MFA commissioners and intervention implementers were collected to assess the actual use and usefulness of decentralized evaluations from their perspectives. Facilitating and hampering factors for usefulness, as wells as interviewees’ lessons and recommendations were also identified from this data.
Management: Susanne Johanna Väth | Co-Worker: Stefan Silvestrini, Hansjörg Gaus, Maja Flaig, Janis Wicke | Cooperation Partner: NIRAS, ParticipImpact Analysis
Start of project: November 2020
End of project: January 2022
Copy permalink:
Evaluation of the Alexander von Humboldt Foundation’s Research Fellowship Programmes for Researchers from Germany (FLF, JSPS, MOST)
The Alexander von Humboldt Foundation (AvH) enables highly qualified academics from all over the world to spend longer periods of research in Germany and supports [Read More]The Alexander von Humboldt Foundation (AvH) enables highly qualified academics from all over the world to spend longer periods of research in Germany and supports the resulting academic and cultural links between Germany and abroad. The Foundation's network now comprises over 29,000 researchers from all disciplines in more than 140 countries.
To strengthen the Humboldt Network, the AvH's programme portfolio also includes three research fellowship programmes that support researchers from Germany to work at research institutions abroad. The BMBF-funded Feodor Lynen Research Fellowship Programme (FLF) enables German researchers to spend a longer period of time researching abroad. In this way, the existing Humboldt Network abroad is strengthened and the potential of Humboldt alumni abroad is tapped in their function as academic advisors and "door openers" for (junior) researchers from Germany. For the target countries Japan and Taiwan, the Humboldt Foundation cooperates with the Japan Society for the Promotion of Science (JSPS) and the Ministry of Science and Technology, Taiwan (MOST) within the framework of the JSPS Programme and the MOST Programme. The AvH also offers support services for alumni from all three scholarship programmes from the BMBF funding. These include reintegration assistance, return scholarships, renewed research stays, institute partnerships as well as annual conferences and networking events.
The evaluation is intended to fulfil two functions: On the one hand, it should provide an evidence-based foundation for the further development of the programmes in the sense of a formative evaluation. On the other hand, it is to be used to account to the funding agencies and the public for the implementation and achievement of the goals of the scholarship programmes. The evaluation focuses on the extent to which the Humboldt Network has benefited from the three programmes and whether suitable research fellows have been selected with regard to the programme goals.
The evaluation is characterised by a participatory and multi-method approach. The evaluation combines document and secondary analyses with qualitative (guided intensive interviews) and quantitative survey procedures (partially standardised online surveys).
Management: Hansjörg Gaus | Co-Worker: Susanne Johanna Väth, Teresa Böttcher, Laszlo SzentmarjayClient: Humboldt Foundation
Accompanying, Ex Post Evaluation
Start of project: May 2019
End of project: July 2021
Copy permalink:
External Evaluation of Climate-friendly Communal Catering within the Project “MehrWertKonsum” of the North Rhine-Westphalia Consumer Advice Centre
The project MehrWertKonsum More appreciation of food and finite resources conducted by the consumer advice centre of North Rhine-Westphalia aims to reduce carbon dioxide [Read More]The project MehrWertKonsum More appreciation of food and finite resources conducted by the consumer advice centre of North Rhine-Westphalia aims to reduce carbon dioxide emissions encouraging a responsible, sustainable and climate-friendly consumption. The primary objective of the project is to contribute to saving greenhouse gas emissions. Regarding communal catering, among other things that means to diminish leftovers and to offer more vegetarian dishes with seasonal and regional foods that are organically grown. Information and educational material will be passed to day care centres, schools, youth hostels and their food suppliers, waste will be measured, leftovers on plates and at the service counters will be analysed and suggestions for improvement will be developed. Furthermore, menus will be checked and enhanced regarding to their desirability as well as climate and environment protection. Schools, in addition, will have the possibility to get participative educational services and activities for their students. In youth hostels, there will be a special focus on the communication with the guests to encourage the acceptance of the measures and thus to contribute to waste prevention. The project is funded through the EFRE OP NRW, an operational programme of North Rhine-Westphalia concerning the promotion of investments in growth and employment supported by the European Regional Development Fund, and North Rhine-Westphalias Ministry of Environment. Within EFRE OP NRW projects greenhouse gas savings (t CO2 equivalents/year) have to be substantiated.
Moreover, the following objectives of the field of action climate-friendly communal catering had been evaluated:
- To reduce food and catering waste
- To establish climate-friendly and healthy catering offers
- To raise consciousness of and appreciation for food, climate-friendly nutrition and food waste
In the course of the external evaluation of MehrWertKonsum the impact of the project measures had been analyzed both on the outcome level (in particular altered behavior of the target group) as well as on the impact level (greenhouse gas savings). To do so, the evaluation team of CEval GmbH, schmidt evaluation and EBP applied a complex multi-method approach including participant observation, qualitative telephone interviews and quantitative online surveys. The results had been combined with the internal monitoring of the project MehrWertKonsum in a way that greenhouse gas savings could be calculated.
Management: Hansjörg GausEx Post Evaluation, Impact Analysis
Start of project: April 2019
End of project: July 2021
Copy permalink:
Evaluation of Individual Projects of the International Climate Initiative (IKI)
Since 2008, the International Climate Initiative (IKI) is funding initiatives regarding (i) climate protection, (ii) adaptation to the impacts of climate change, (iii) conserving natural [Read More]Since 2008, the International Climate Initiative (IKI) is funding initiatives regarding (i) climate protection, (ii) adaptation to the impacts of climate change, (iii) conserving natural carbon sinks and (iv) the protection of biological diversity in developing and newly industrialising countries on a project basis. Overall, the IKI now includes almost 600 individual projects and 2.8 billion euros in funding. The IKI focuses on climate protection which comprises almost half of the projects. There was a first evaluation conducted between 2010 and 2013 that included 115 projects. Within this evaluation, a full survey of the projects completed or almost completed by 2011 was realized. This project aimed to carry out further evaluations of those projects that were completed by the end of 2019. The individual project evaluations consisted of detailed analyses according to the OECD DAC criteria as well as other program-specific criteria. The focus of the results chain was on an analysis of inputs, outputs and outcomes. Impacts at higher levels were only analyzed on the basis of reliable information available at the time of the evaluations.
Management: Stefan Silvestrini | Co-Worker: Susanne Johanna Väth, Janis Wicke, Hansjörg GausEx Post Evaluation
Start of project: July 2017
End of project: March 2020
Copy permalink:
Evaluation of the German Strategy for Adaptation to Climate Change
The German Strategy for Adaptation to Climate Change (DAS) and the corresponding Adaptation Action Plan are the main pillars of Germanys climate policy. The Federal [Read More]The German Strategy for Adaptation to Climate Change (DAS) and the corresponding Adaptation Action Plan are the main pillars of Germanys climate policy. The Federal Government aims to reduce the vulnerability of the economy, the environment and society to the effects of climate change in the long term. To this end, a number of concrete measures have recently been implemented at various levels. In order to successfully adapt to climate change and to continue to develop the national climate change strategy, it is important to critically reflect on the current process as well as to acknowledge achievements and possible shortcomings.
The overarching goal of the evaluation commissioned by the German Federal Environmental Agency (UBA) was to determine whether the national adaptation strategy represents a successful approach for increasing the adaptive capacity and reducing the vulnerability of natural, social and economic systems to the effects of climate change. The evaluation included three central parts: (1) the process of developing and implementing the strategy on the national level (2) the implementation status of the adaptation measures at the federal level and (3), an impact assessment applying contribution analysis of the strategy's effects on the vulnerability and adapative capacities of natural, social and economic systems.
Together with adelphi, the Center for Evaluation (CEval) carried out the evaluation on behalf of the UBA. The consortium drew on the methodology developed in a previous project and already politically agreed. Data was initially collected using various methods (guided interviews, document analyses, etc.) based on key evaluation questions and taking into account an impact model. A comprehensive analysis and evaluation of the data was then carried out on the basis of defined evaluation criteria. The resulting findings and recommendations were reflected upon and further consolidated in an online Delphi process.
Management: Stefan Silvestrini | Co-Worker: Hansjörg Gaus, Selina Röhrig, Sandra Bäthge | Cooperation Partner: Our ProjectsClient: Umweltbundesamt