Countries of Cooperation
Accompanying, Accompanying evaluation, Ex Post Evaluation, Program Evaluation
Start of project: December 2023
End of project: November 2027
Copy permalink:
RePack-Network. Reduce, Reuse, Recycle – Sustainable Packaging of Food: Networking and Transfer Program for Plastics Reduction
Food is often packaged in plastics that are only used for a short time and are rarely reused or recycled. In addition to the considerable [Read More]Food is often packaged in plastics that are only used for a short time and are rarely reused or recycled. In addition to the considerable consumption of resources, the environment is also polluted by macro- or microplastics. The Federal Ministry of Food and Agriculture (BMEL) is therefore promoting innovations that help to package food more sustainably and reduce plastics along the value chain. In the RePack network, five research institutions under the leadership of the Institute for Ecological Economy Research (IÖW) accompany, support and evaluate twelve innovation projects in this funding programme. In the projects, universities and research institutions work together with companies to develop new production processes, innovative materials, packaging with an increased recycled content or reusable packaging.
The “Networking and Transfer Program for Plastics Reduction” is investigating how existing sustainable packaging concepts can be expanded. The aim is to bundle the results for different target groups and bring the projects into dialogue: To this end, cluster and themed workshops as well as conferences are being designed and organised at which the projects can network with each other and with the interested specialist public. A website and social media presence as well as a regular newsletter provide information on the progress of the projects and give insights into the innovations. The results of the funded projects are used to derive overarching recommendations for action for politics, business, civil society and consumers.
The task of CEval GmbH within the “Networking and Transfer Program for Plastics Reduction” is the conception and implementation of the accompanying and final evaluation of the BMEL funding programme for the development of packaging innovations for the food industry. To this end, a results model for the funding programme will be created, which will be empirically validated and refined, and indicator sets will be developed for the project level as well as the levels of the funding programme and the overarching innovation programme of the BMEL. Building on this, the annual accompanying evaluations and the final summative evaluation will analyse the design and implementation of the funding programme, its results and their sustainability and transferability to other fields of application, as well as identifying further fields of action and research needs. Methodologically, the theory-based evaluation follows a mix of document analyses, individual and group interviews and supplementary online surveys.
Management: Stefan Silvestrini | Co-Worker: Hansjörg Gaus, Matthias Klapproth, Hilde Folger | Cooperation Partner: Institute for Ecological Economy Research, IÖW, Gesellschaft für Verpackungsmarktforschung, GVM, Institute for Social-Ecological Research, ISOE, Sustainable Packaging Institute (SPI) of Albstadt-Sigmaringen UniversityImpact Analysis
Start of project: November 2023
End of project: November 2024
Copy permalink:
Tracer study of alumni of the Max Weber Foundation’s institutes abroad 2005-2022
The Max Weber Foundation (MWS) is one of the leading organisations supporting German research in humanities and social sciences abroad. Therefore, the foundation maintains 11 [Read More]The Max Weber Foundation (MWS) is one of the leading organisations supporting German research in humanities and social sciences abroad. Therefore, the foundation maintains 11 institutes located around the world, which have a bridging function between the host countries and Germany. The institutes abroad play a particularly important role in the professional development and support of young academics in an international and interdisciplinary environment.
CEval GmbH has been contracted by the MWS to carry out a tracer study. The study will analyse the professional careers of former employees who worked at one of the MWS's institutes abroad in a qualification position or a long-term scholarship and who left between 2005 and 2022. The aim of the study is to evaluate the success and thus the competitiveness of the promotion of young academics at the institutes.
The tracer study follows a mixed-methods approach combining qualitative and quantitative instruments for data collection and analysis. An online survey, semi-structured interviews and a secondary data analysis will be applied.
Management: Sandra Bäthge | Co-Worker: Vera Hennefeld, Sabrina Göbel, Tanja StockmannClient: Max Weber Foundation
Organizational Consulting, Program Evaluation
Start of project: November 2023
End of project: March 2024
Copy permalink:
Evaluability Assessment of UNICEF Jordan Country Program 2023-2027 commissioned by the UNICEF JCO
The purpose of the evaluability assessment of the UNICEF Jordan Country Programme (JCO) was to ensure that medium- and long-term results can ultimately be demonstrated. [Read More]The purpose of the evaluability assessment of the UNICEF Jordan Country Programme (JCO) was to ensure that medium- and long-term results can ultimately be demonstrated. The scope of the evaluability assessment covered JCO Country Programme Document (CPD) 2023-2027, including its six programme sections (health & nutrition, education, child protection, adolescent & youth, WASH, social policy & protection), monitoring systems, annual planning, and evaluation plans and the cross-cutting priorities (gender equality, disability inclusion, climate change, social equity, social behaviour change (SBC) and protection from sexual exploitation and abuse (PSEA)).
The objectives of the evaluability assessment were (1) to provide an independent assessment of how well JCO is prepared for a country programme or strategic framework evaluation and (2) to provide recommendations to enhance the evaluability of the CPD. The aim was to examine whether JCO has planned to effectively manage key risks, to establish mechanisms for timely implementation of evaluation recommendations, and whether it possesses the essential resources and infrastructure required to prove results achievement. The EA aimed to enhance JCO's preparedness for the upcoming evaluation of the CPD.
The evaluability assessment employed a theory-based approach to analyse the methodological preconditions necessary for assessing effectiveness, impacts, and sustainability of UNICEF's Country Programme. These preconditions included clear definitions of program results, baseline data availability, and timely target data. The assessment also aimed to establish meaningful hypotheses to understand the causal relationship between the JCO and observed development results. Contextual factors were considered crucial for a valid analysis, with an emphasis on identifying and monitoring risks and framework conditions. A detailed evaluability matrix guided the systematic analysis and structured data collection. A mixed-methods approach was adopted, using primary and secondary data sources as well as qualitative and quantitative methods to ensure validity and reliability. Stakeholder participation was integral, involving interviews with heads of JCO units and sections, consultations, and feedback loops to incorporate diverse perspectives.
Management: Susanne Johanna Väth | Co-Worker: Dafina Sinatra | Cooperation Partner: Center for Evaluation and Development (C4ED)Client: UNICEF
Accompanying, Program Evaluation
Start of project: October 2023
End of project: September 2025
Copy permalink:
Evaluation of the Deval Funding Programme Rigorous Impact Evaluation
The RIE funding programme supported a matchmaking between actors from science and development cooperation, which led to funding of nine rigorous impact evaluations (RIE) to [Read More]The RIE funding programme supported a matchmaking between actors from science and development cooperation, which led to funding of nine rigorous impact evaluations (RIE) to be implemented between March 2023 and September 2025. Scientific institutions in Germany were eligible to apply together with a development project funded by the Federal German Ministry for Economic Cooperation and Development (BMZ). The programme aims to remove barriers to the implementation of RIE and to support systematic anchoring of RIE in German development cooperation.
CEval GmbH was commissioned with the evaluation of the RIE funding programme by the German Institute for Development Evaluation (DEval). The evaluation is carried out according to the OECD-DAC criteria and is based on a comprehensive analysis grid. A mix of methods is applied: The RIE project proposals and interim reports are assessed by means of a systematic review, which is structured by an assessment grid. Guideline based interviews are conducted with all relevant stakeholder groups of the programme at two points in time. In addition, a standardised online survey is implemented, which addresses all scientists and representatives of the development organisations as well as local scientists in the partner countries who are directly involved in the implementation of the nine RIE.
In addition, a Delphi survey is implemented as innovative method for looking to the future. For the first Delphi round, international experts will be recruited and their perspective on the future role of RIE in German development cooperation will be examined by thematic-focussed interviews. The results will be assessed and returned to the panel participants in a second round of inquiry in the form of an online survey in order to identify, weight and prioritise converging and diverging perspectives and views of the experts.
Management: Susanne Johanna Väth | Co-Worker: Matthias Klapproth, Hansjörg Gaus, Janis WickeDevelopment M&E-System, Organizational Consulting
Start of project: October 2023
End of project: November 2023
Copy permalink:
Development of an M&E concept for the BBK’s international project work
The International Affairs Division at the Federal Office of Civil Protection and Disaster Assistance (BBK) develops projects abroad as part of Germany's international engagement. These [Read More]The International Affairs Division at the Federal Office of Civil Protection and Disaster Assistance (BBK) develops projects abroad as part of Germany's international engagement. These are based on expertise in civil protection and disaster relief and are implemented in cooperation with national and local authorities abroad.
The BBK commissioned CEval GmbH to support the development of a needs-based monitoring and evaluation (M&E) system for international project work. The objectives of the assignment were: (i) the development of an M&E concept for the BBK's international project work, taking into account existing project documents, the (political) framework conditions and the BBK's strategic orientation as well as staffing capacities; (ii) the further development of existing instruments and the development of additional instruments to make the impact-oriented monitoring of international projects more efficient; (iii) the presentation of the concept and the instruments at a workshop for the BBK's project staff and project managers.
In developing the M&E system for the BBK's International Affairs Division, CEval GmbH pursued a theory-led approach in order to create the foundations for an impact-orientated M&E system. In addition, the team pursued a participatory approach with the close involvement of the client in order to best align the M&E system with the client's needs. The team advised and supported BBK in the introduction of SMART indicators at various levels for a methodologically sound M&E system and organized an M&E workshop for project staff and project managers for the projects in Jordan, Ukraine and Tunisia.
Management: Susanne Johanna Väth | Co-Worker: Dafina SinatraStrategic Evaluation
Start of project: September 2023
End of project: May 2024
Copy permalink:
Evaluation of the admission procedures to scholarship programs of the Hans Böckler Foundation (HBS)
The Hans Böckler Foundation (HBS) awards scholarships to secondary school leavers, artists and students as well as to doctoral candidates in all academic fields. To [Read More]The Hans Böckler Foundation (HBS) awards scholarships to secondary school leavers, artists and students as well as to doctoral candidates in all academic fields. To obtain a scholarship, applicants go through a multi-stage and meanwhile digitalized admission procedure in which their appropriateness is assessed on the basis of a series of criteria. CEval GmbH was commissioned by the HBS to evaluate the application procedures. In particular, the CEval GmbH examines the appropriateness, purposefulness and efficiency of the procedures as well as the fairness and comprehensibility of the test criteria.
Therefore, the CEval team orientates itself on the OECD-DAC criteria (relevance, coherence, efficiency, effectiveness, impact, sustainability), which are used to systematically develop an analytical matrix. The evaluation follows a mixed-methods approach combining qualitative and quantitative instruments for data collection and analysis. Semi-structured guided interviews, qualitative short interviews, an online survey and a secondary data analysis will be applied.
Management: Stefan Silvestrini | Co-Worker: Sabrina Göbel, Hilde Folger, Ute Metje | Cooperation Partner: Our ProjectsClient: Hans Böckler Foundation
Ex Post Evaluation, Impact Analysis
Start of project: September 2023
End of project: June 2024
Copy permalink:
Central Project Evaluation: Agribusiness Facilities for Africa
The project Agribusiness Facilities for Africa (ABF) serves as a pan-African knowledge and advisory hub on agribusiness trainings and has worked with about 30 countries [Read More]The project Agribusiness Facilities for Africa (ABF) serves as a pan-African knowledge and advisory hub on agribusiness trainings and has worked with about 30 countries across the continent. With the objective of improving the effectiveness of private and public agribusiness support measures and supporting organisations for micro, small and medium-sized enterprises in Africa, ABF develops training concepts for farmers and processors to meet their partners’ specific needs. The Farmer Business School (FBS) training teaches farmers and producers principles of agriculture as a business and promises to strengthen the management skills of MSMEs for better and diversified incomes and nutrition. Other training modules approaches offered by ABF include, Processor Business School (PBS), Cooperative Business School (CBS) and the more recently developed Aquaculture Business School (ABS ).
The evaluation was conducted according to the specifications and guidelines for central project evaluations of GIZ, which include a standardized analysis grid (evaluation matrix) based on the OECD-DAC criteria (relevance, coherence, efficiency, effectiveness, impact, sustainability). The evaluation team applies qualitative methods for data collection and analysis. Semi-structured interviews and focus groups discussions (FGDs) are conducted for primary data collection. During a 3 week field study in Uganda, Zambia and Malawi, the evaluation team will visit partner projects of ABF to assess the implementation and the impact of FBS, CBS and ABS teaching approaches on the ground. Qualitative content analysis will be applied based on written transcripts of the interviews, FGDs and the vast body of project documents. Causal relations between project activities and potential impacts, are assessed following a contribution analysis approach.
Management: Stefan Silvestrini | Co-Worker: Janis Wicke, Nicolle Comafay-HeinrichEx Post Evaluation, Program Evaluation
Start of project: August 2023
End of project: April 2024
Copy permalink:
Evaluation of the Diakonie Katastrophenhilfe Programme Indonesia 2018-2023
The DKH Indonesia programme was launched in the immediate aftermath of three large scale natural disasters occurring in Lombok (earthquake), Central Sulawesi (earthquake and tsunami) [Read More]The DKH Indonesia programme was launched in the immediate aftermath of three large scale natural disasters occurring in Lombok (earthquake), Central Sulawesi (earthquake and tsunami) and the Sunda Strait (tsunami) in 2018. The programme was composed of eight individual projects implemented by two Indonesian partner organisations in five provinces and featured immediate emergency response measures, recovery assistance and Disaster Risk Reduction activities with a focus on inclusion of people with disability and prioritisation of most vulnerable groups. CEval was commissioned to provide an independent assessment of the programme based on the OECD-DAC criteria.
The evaluation was based on extensive stakeholder participation as well as on a mixed-methods and theory-based evaluation approach. The evaluation team developed a comprehensive Theory of Change (ToC) at programme level and a detailed evaluation matrix. A desk-based systematic review of project documents was complemented by a three-week on-site study in Indonesia. The systematic review was based on a standardised assessment grid developed from the evaluation matrix and applied to aggregate monitoring data and relevant information from project documents. During the on-site study, the evaluation team conducted 29 interviews and 29 focus group discussions with programme and project staff, local authorities, and beneficiaries. Primary data was analysed applying qualitative content analysis. Findings were presented in a comprehensive evaluation report and during several workshops.
Management: Susanne Johanna Väth | Co-Worker: Janis Wicke, Nicolle Comafay-HeinrichAccompanying, Ex Post Evaluation, Program Evaluation
Start of project: July 2023
End of project: September 2024
Copy permalink:
Evaluation of the EU Home Affairs Funds: Mid-term evaluations of the Internal Security Fund (ISF) and the Instrument for Financial Support for Border Management and Visa Policy (BMVI)
Under the responsibility of the Directorate-General for Migration and Home Affairs (DG HOME), the European Commission (EU COM) provides the Internal Security Fund (ISF; managed [Read More]Under the responsibility of the Directorate-General for Migration and Home Affairs (DG HOME), the European Commission (EU COM) provides the Internal Security Fund (ISF; managed by the Federal Criminal Police Office (BKA)), the Border Management and Visa Instrument (BMVI, managed by the Federal Police) and the Asylum, Migration and Integration Fund (AMIF, managed by the Federal Office for Migration and Refugees (BAMF)). Together, these form the so-called "Home Affairs Funds".
The member states are obliged to prepare mid-term and final evaluations for the EU Commission on the implementation of the measures financed by the individual funds and the degree to which the objectives of the national programmes supported by the Home Affairs Funds have been achieved. The main users of the evaluations are the EU (DG Home), the fund-managing authorities BKA, BPOL and BAMF and their monitoring committees.
The aim of the evaluations is to assess the results and outcomes of the programmes and measures co-financed by the Home Affairs Fund based on the criteria of effectiveness, efficiency, relevance, coherence and EU added value. The coherence between the individual funds is of particular interest. In addition to assessing success, the evaluations should also develop recommendations for improving the quality of the design and implementation of the national programmes and analyse the coherence and use of synergy potential between the individual funds.
After the Gesellschaft für Internationale Zusammenarbeit (GIZ) carried out the mid-term evaluation for the ISF on behalf of the BKA in 2017, it has now been commissioned again to carry out the final evaluation of the ISF for the 2014-2020 funding period and the mid-term evaluation of the ISF, the BMVI and the AMIF for the 2021-2027 funding period.
In the course of this, GIZ commissioned CEval GmbH to carry out the
> Final evaluation of the ISF, security sub-sector and border sub-sector, 2014-2021 funding period,
> Mid-term evaluation of the ISF, current funding period 2021-2027 and
> Mid-term evaluation of the BMVI, current funding period 2021-2027
to be carried out.
Various survey procedures are used to triangulate sources and methods:
> Research of all relevant programme and project documents as well as monitoring data,
> Semi-standardised online survey with project participants and their implementation partners as well as other potentially eligible applicants and
> Guided qualitative interviews with programme and project managers.
Management: Stefan Silvestrini | Co-Worker: Vera Hennefeld, Sandra Bäthge, Laszlo Szentmarjay, Juliane LöwAccompanying, Ex Post Evaluation
Start of project: May 2023
End of project: November 2024
Copy permalink:
Perspective study on the DAAD program “HAW.International” (2023/2024)
The program 'Securing Talents - Shaping the Future' of the Cusanuswerk - Bischöfliche Studienförderung aims to promote the next generation of female leaders. To this [Read More]The program 'Securing Talents - Shaping the Future' of the Cusanuswerk - Bischöfliche Studienförderung aims to promote the next generation of female leaders. To this end, the program relies on mentoring elements, i.e. tutorial support for female scholarship holders of German scholarship programs for the gifted by academics with professional experience, training and support measures geared to specific professions, and the establishment of a peer network. Since the start of the career development program in 2007, CEval has conducted external evaluations to ensure the quality of the program. An accompanying evaluation will also take place in the program run in 2023/2024. The central task of this evaluation is to provide the Cusanuswerk staff responsible for implementation with timely information relevant to management. In accordance with the program's objectives, questions regarding satisfaction with the events offered, the quality of the tutorial relationships, and the professional and personal benefits of the relationship for both sides are of particular interest. Methodologically, the evaluation is based on standardized baseline and final online surveys of mentees and mentors.
Management: Vera Hennefeld