Countries of Cooperation
Mid-term Evaluaton
Start of project: January 2025
End of project: July 2025
Copy permalink:
Evaluation of the implementation of the Biodiversity Strengthening Act (BiodivStG) in Baden-Württemberg
NABU e.V. Baden-Württemberg has commissioned CEval GmbH to evaluate the implementation of the Biodiversity Strengthening Act (BiodivStG) in Baden-Württemberg. The Biodiversity Strengthening Act, which was [Read More]NABU e.V. Baden-Württemberg has commissioned CEval GmbH to evaluate the implementation of the Biodiversity Strengthening Act (BiodivStG) in Baden-Württemberg. The Biodiversity Strengthening Act, which was passed by the state parliament of Baden-Württemberg on 20th July 2020, contains numerous regulations and targets that serve to better protect nature and, in particular, to promote the insect fauna in Baden-Württemberg (biotope network, insect protection, compensation, orchard meadows, organic farming, refugial areas, pesticides). The implementation of the law primarily affects the departments of nature conservation, agriculture, state property and state planning. Additionally, the impact of the Act extends to municipalities and all legal entities operating under public law, as well as to agricultural businesses and private individuals.
The objective of the evaluation is to assess the implementation status of the Biodiversity Act five years after its enactment, marking the midpoint of numerous legally binding deadlines (mid-term evaluation). The evaluation approach is participatory, and data collection employs a qualitative methodological framework. The evaluation involves the collection of primary data through key informant and group interviews with relevant stakeholders (ministries, subordinate authorities and municipalities, environmental and nature conservation associations, as well as other state associations). In addition, secondary data (desk study) is collected, and the data is analyzed and synthesized on the basis of a content-analytical approach, whereby both the achievement of objectives and a process assessment are carried out. To increase the validity and reliability of findings, individual evaluation questions are answered with data obtained by different data collection methods (method triangulation) and from various data sources (data triangulation).
Management: Vera Hennefeld | Co-Worker: Matthias KlapprothClient: NABU Baden-Württemberg
Accompanying
Start of project: December 2024
End of project: December 2025
Copy permalink:
Conducting a survey as part of an impact analysis of the Hessian digitization funding program “Distr@l”
Funded by: Hessian Ministry for Digitalization and Innovation (HMD) Since the beginning of 2020, the state of Hesse has been supporting digital innovation projects with [Read More]Funded by: Hessian Ministry for Digitalization and Innovation (HMD)
Since the beginning of 2020, the state of Hesse has been supporting digital innovation projects with the "Distr@l" funding program to drive digital transformation in the Hessian economy. The program, with four funding lines, targets small and medium-sized enterprises, start-ups, universities, and research institutions, funding application-oriented projects that support the transfer of knowledge between science and industry, the training and securing of skilled workers, and the further development of digital technologies.
CEval GmbH is conducting an accompanying impact analysis of the funding program to capture the medium-term effects of the innovation projects. This analysis is based on a written, semi-standardized online survey of funding recipients 12 to 24 months after the completion of their projects. The goal of the annual survey, which is to be conducted every year in the future, is to provide empirically measurable indicators that offer insights into project development and to provide recommendations for the further development of the funding program and for supporting SMEs in the digital transformation. The results are aimed at both project recipients and responsible political actors, as well as at press representatives and the interested public.
Management: Stefan Silvestrini | Co-Worker: Hilde FolgerClient: Hessen Trade & Invest GmbH
Ex Post Evaluation, Mid- term Evaluation
Start of project: November 2024
End of project: July 2025
Copy permalink:
Evaluation of the EndOCSEA@Europe Project
Funded by: Safe Online In response to the alarming rise of Online Child Sexual Exploitation and Abuse (OCSEA), the Council of Europe has commissioned the [Read More]Funded by: Safe Online
In response to the alarming rise of Online Child Sexual Exploitation and Abuse (OCSEA), the Council of Europe has commissioned the EndOCSEA@Europe project, implemented in two phases, to combat OCSEA across Council of Europe member states. Phase I (2018-2021) focused on mapping legislation, policies, and practices on OCSEA, strengthening laws, enhancing law enforcement capacities, and raising awareness in countries such as Albania, Armenia, and Ukraine. Phase II (2023-2025), focuses on further strengthening actions, particularly in Georgia, the Republic of Moldova, and Montenegro. The project promotes multi-stakeholder collaboration, legislative reforms, capacity-building, and awareness campaigns, integrating recommendations from Phase I, with synergies sought with other Council of Europe initiatives. Managed by the Children’s Rights Division, it involves key stakeholders, including government authorities, law enforcement, NGOs, and professionals working with children.
The evaluation of the EndOCSEA@Europe project aims to assess its effectiveness, impact, efficiency, and sustainability across both phases, focusing on legislative improvements, cross-border cooperation, capacity-building, and implementation challenges. Using a non-experimental, theory-based, mixed-methods approach with extensive stakeholder participation, the evaluation will examine the project's Theory of Change, impact, and scalability at political, institutional, community, and individual levels. Data will be gathered through interviews, case studies, and surveys, analyzed using triangulation for validity, and following the OECD-DAC criteria with a focus on age- and gender-sensitive methodologies.
Management: Stefan Silvestrini | Co-Worker: Hilde FolgerClient: Council of Europe
Accompanying evaluation, Program Evaluation, Strategic Evaluation
Start of project: November 2024
End of project: June 2025
Copy permalink:
Mid-term Evaluation: Empowering the Hearing Healthcare Sector in Developing and Emerging Countries
In response to existing gaps between hearing healthcare needs and current capacities, the Austrian medical device company MED-EL launched the Hearing Healthcare Alliance (HHA) in [Read More]In response to existing gaps between hearing healthcare needs and current capacities, the Austrian medical device company MED-EL launched the Hearing Healthcare Alliance (HHA) in February 2022 – an intervention with co-funding from the Austrian Development Agency (ADA). The primary objective of the intervention is to enhance the diagnosis and rehabilitation of individuals with hearing impairments by creating sustainable local structures within the hearing healthcare sector across 13 developing countries, including nine in Sub-Saharan Africa and four in South Asia. The intervention is set to conclude in January 2026, with plans for a subsequent phase to follow. In this context, CEval was commissioned by MED-EL to conduct a mid-term evaluation of one of the intervention’s central components, namely, the “Early diagnosis for people with hearing impairment”. The evaluation focusses on the two project countries Benin and Nepal, aiming to extract key insights from past implementation to strengthen and scale up the evaluated component in later implementation stages.
The evaluation is theory-based in its design and builds on extensive stakeholder participation as well as a mixed-methods approach. Primary data will be collected on site in both focus countries. The evaluation is being conducted along the six OECD/DAC criteria and in line with ADA’s Guidelines for Programme and Project Evaluation.
Management: Susanne Johanna Väth | Co-Worker: Juliane Löw, Sirjana Pant, Midjèou Béranger AvohouèmeClient: MED-EL Medical Electronics
Ex Post Evaluation
Start of project: August 2024
End of project: October 2024
Copy permalink:
Project Evaluation: Promotion of Adult Education Uganda
The Institute for International Cooperation of the German Adult Education Association (DVV International) is supporting the Government of Uganda with the implementation of the Integrated [Read More]The Institute for International Cooperation of the German Adult Education Association (DVV International) is supporting the Government of Uganda with the implementation of the Integrated Community Learning for Wealth Creation (ICOLEW) programme. As part of the programme, DVV has initiated the introduction of Community Learning Centres (CLC) together with government partners in six districts covering all major areas of Uganda. CLC provides a range of learning opportunities and services to youth and adults from surrounding communities on topics such as functional literacy/numeracy, other forms of non-formal livelihoods/vocational skills, health and sanitation, as well as business skills.
DVV International commissioned the CEval GmbH to evaluate the success of the CLC approach. The evaluation team assesses to what extent the introduction of CLC is functional and has achieved its objectives. The evaluation is based on the OECD-DAC criteria and is structured by an evaluation matrix developed be the CEval team. During a one-week on-site mission in Uganda, the evaluation team will visit CLCs to collect qualitative data by conducting interviews and focus group discussions. Data will be assessed applying qualitative content analysis. Findings will be presented and discussed in a comprehensive evaluation report.
Management: Susanne Johanna Väth | Co-Worker: Nicolle Comafay-Heinrich, Janis WickeAccompanying evaluation, Impact Analysis
Start of project: July 2024
End of project: December 2025
Copy permalink:
Evaluation of the KIWI-Programme of CARE Deutschland e. V.
The KIWI program of CARE Deutschland e.V. has the primary goal of closing educational gaps and promoting a more diversity-sensitive and inclusive society. The program [Read More]The KIWI program of CARE Deutschland e.V. has the primary goal of closing educational gaps and promoting a more diversity-sensitive and inclusive society. The program is aimed in particular at the target group of pupils with an international background who experience discrimination, as well as educational professionals. The program supports social and transcultural learning through materials, further training for teachers, workshops for pupils, digital exchanges and systemic process consulting for schools.
The evaluation of the KIWI program aims to analyze the project design and the impact of the program in the current funding period (2023-2025). A central task is the analysis of the program’s impact on the target groups, especially on pupils with an international history. Furthermore, the evaluation aims to generate recommendations for adjustments to the project design in order to optimize the effectiveness and impact of the program and ensure that it meets the needs of the target groups.
The evaluation is based on a qualitative case study design and uses a mix of quantitative and qualitative methods of data collection and analysis. This includes the analysis of secondary data as well as the collection of primary data via guided expert interviews, group discussions and a semi-standardized online survey. Following a participatory approach to evaluation, data collection is carried out in close consultation with the client.
Management: Sandra Bäthge | Co-Worker: Dafina SinatraClient: CARE
PPP, Program Evaluation
Start of project: March 2024
End of project: February 2025
Copy permalink:
Evaluation of the “Knauf Training Initiative Phase I and II”
DEG Impulse uses the develoPPP Classic program to support measures by well-established enterprises that wish to operate in developing and emerging countries on a long-term [Read More]DEG Impulse uses the develoPPP Classic program to support measures by well-established enterprises that wish to operate in developing and emerging countries on a long-term basis and thereby shape their business involvement in a sustainable manner. One of the projects under develoPPP Classic is the “Knauf Training Initiative” (KTI) in its phase I (2018-2023) and phase II (2021-2026). Knauf is one of Europe’s leading manufacturer of gypsum-based construction materials and also specialized in production of isolating materials and cement products.
The main objective of the KTI is the establishment of training centers (TCs) to improve the technical qualification and employability of young people, students and skilled workers in the field of drywall construction and related products. Through the TCs, both practical and theoretical modules imparting comprehensive knowledge regarding the application of drywall construction techniques are provided to installers, architects/civil engineers, academic staff and unemployed people. The KTI is to provide people with the possibility of completing a training, which in turn should lead in the long-term to sustainable career prospects.
CEval GmbH was commissioned by DEG Impulse to evaluate the KTI. The evaluation assessed the relevance, coherence, effectiveness, efficiency, impact and sustainability of the KTI, identified methodological lessons learned and conclusions resulting from the findings, and provided evidence-based, actionable recommendations for DEG Impulse and Knauf. Furthermore, the evaluation integrated a gender perspective, in order to address the initiative’s effects on gender mainstreaming and women empowerment. Eventually, the evaluation investigated the additionality of the initiative, i.e., the extent to which further and/or more impacts were achieved through the financial support of DEG Impulse.
The evaluation followed a mixed-methods case-study design, collecting primary data through individual and group interviews in Germany and three target countries (i.e., Egypt, Algeria and Mexico), as well as a semi-standardized online survey among TC staff in countries not visited. Secondary data, including monitoring reports, training materials, and TC survey data, were analyzed through a desk study. The evaluation team conducted interviews with TC staff, stakeholders, and beneficiaries, ensuring appropriate representation of diverse target groups.
The data analysis involved qualitative content analysis using the software MaxQDA, as well as a descriptive statistical analysis of quantitative data from the surveys, with disaggregation by gender and country where possible.
Management: Stefan Silvestrini | Co-Worker: Dzoara Santoyo CastilloClient: DEG Impulse
Accompanying, Accompanying evaluation, Ex Post Evaluation, Program Evaluation
Start of project: December 2023
End of project: November 2027
Copy permalink:
RePack-Network. Reduce, Reuse, Recycle – Sustainable Packaging of Food: Networking and Transfer Program for Plastics Reduction
Food is often packaged in plastics that are only used for a short time and are rarely reused or recycled. In addition to the considerable [Read More]Food is often packaged in plastics that are only used for a short time and are rarely reused or recycled. In addition to the considerable consumption of resources, the environment is also polluted by macro- or microplastics. The Federal Ministry of Food and Agriculture (BMEL) is therefore promoting innovations that help to package food more sustainably and reduce plastics along the value chain. In the RePack network, five research institutions under the leadership of the Institute for Ecological Economy Research (IÖW) accompany, support and evaluate twelve innovation projects in this funding programme. In the projects, universities and research institutions work together with companies to develop new production processes, innovative materials, packaging with an increased recycled content or reusable packaging.
The “Networking and Transfer Program for Plastics Reduction” is investigating how existing sustainable packaging concepts can be expanded. The aim is to bundle the results for different target groups and bring the projects into dialogue: To this end, cluster and themed workshops as well as conferences are being designed and organised at which the projects can network with each other and with the interested specialist public. A website and social media presence as well as a regular newsletter provide information on the progress of the projects and give insights into the innovations. The results of the funded projects are used to derive overarching recommendations for action for politics, business, civil society and consumers.
The task of CEval GmbH within the “Networking and Transfer Program for Plastics Reduction” is the conception and implementation of the accompanying and final evaluation of the BMEL funding programme for the development of packaging innovations for the food industry. To this end, a results model for the funding programme will be created, which will be empirically validated and refined, and indicator sets will be developed for the project level as well as the levels of the funding programme and the overarching innovation programme of the BMEL. Building on this, the annual accompanying evaluations and the final summative evaluation will analyse the design and implementation of the funding programme, its results and their sustainability and transferability to other fields of application, as well as identifying further fields of action and research needs. Methodologically, the theory-based evaluation follows a mix of document analyses, individual and group interviews and supplementary online surveys.
Management: Stefan Silvestrini | Co-Worker: Hansjörg Gaus, Matthias Klapproth, Hilde Folger, Juliane Löw | Cooperation Partner: Institute for Ecological Economy Research, IÖW, Gesellschaft für Verpackungsmarktforschung, GVM, Institute for Social-Ecological Research, ISOE, Sustainable Packaging Institute (SPI) of Albstadt-Sigmaringen UniversityMid-term Evaluaton
Start of project: December 2023
End of project: December 2024
Copy permalink:
Evaluation of the program “Quartiersimpulse”
The evaluation focused on the funding program "Quartiersimpulse" of the Allianz für Beteiligung e.V. and the Ministry of Social Affairs, Health and Integration of Baden-Wuerttemberg. [Read More]The evaluation focused on the funding program "Quartiersimpulse" of the Allianz für Beteiligung e.V. and the Ministry of Social Affairs, Health and Integration of Baden-Wuerttemberg. The programme has been part of the state strategy "Quartier 2030 – Gemeinsam.Gestalten" since 2018 and is aimed at municipalities in Baden-Wuerttemberg. It promotes projects with a focus on age- and generation-appropriate development in neighborhoods through citizen participation, which is supported by external consulting. A prerequisite for funding is collaboration with both civil society partners and the municipal political level.
The goal of the mid-term evaluation was to take stock and identify optimization potentials for the further development of the program. In this context, the evaluation aimed to assess the quality of program implementation, as well as the goals and outcomes achieved so far, and to capture the networking of the program and the resulting synergy effects in the context of the state strategy. Based on these findings, recommendations for the further development of the program were derived.
The evaluation was based on a multi-method approach that combined document analysis and a quantitative online survey with qualitative surveys conducted during on-site visits and virtual interviews.
Management: Stefan Silvestrini | Co-Worker: Wolfgang Meyer, Kathrin Buchheit, Anne KüttelClient: Allianz für Beteiligung e.V.
Organizational Consulting, Program Evaluation
Start of project: November 2023
End of project: March 2024
Copy permalink:
Evaluability Assessment of UNICEF Jordan Country Program 2023-2027 commissioned by the UNICEF JCO
The purpose of the evaluability assessment of the UNICEF Jordan Country Programme (JCO) was to ensure that medium- and long-term results can ultimately be demonstrated. [Read More]The purpose of the evaluability assessment of the UNICEF Jordan Country Programme (JCO) was to ensure that medium- and long-term results can ultimately be demonstrated. The scope of the evaluability assessment covered JCO Country Programme Document (CPD) 2023-2027, including its six programme sections (health & nutrition, education, child protection, adolescent & youth, WASH, social policy & protection), monitoring systems, annual planning, and evaluation plans and the cross-cutting priorities (gender equality, disability inclusion, climate change, social equity, social behaviour change (SBC) and protection from sexual exploitation and abuse (PSEA)).
The objectives of the evaluability assessment were (1) to provide an independent assessment of how well JCO is prepared for a country programme or strategic framework evaluation and (2) to provide recommendations to enhance the evaluability of the CPD. The aim was to examine whether JCO has planned to effectively manage key risks, to establish mechanisms for timely implementation of evaluation recommendations, and whether it possesses the essential resources and infrastructure required to prove results achievement. The EA aimed to enhance JCO's preparedness for the upcoming evaluation of the CPD.
The evaluability assessment employed a theory-based approach to analyse the methodological preconditions necessary for assessing effectiveness, impacts, and sustainability of UNICEF's Country Programme. These preconditions included clear definitions of program results, baseline data availability, and timely target data. The assessment also aimed to establish meaningful hypotheses to understand the causal relationship between the JCO and observed development results. Contextual factors were considered crucial for a valid analysis, with an emphasis on identifying and monitoring risks and framework conditions. A detailed evaluability matrix guided the systematic analysis and structured data collection. A mixed-methods approach was adopted, using primary and secondary data sources as well as qualitative and quantitative methods to ensure validity and reliability. Stakeholder participation was integral, involving interviews with heads of JCO units and sections, consultations, and feedback loops to incorporate diverse perspectives.
Management: Susanne Johanna Väth | Co-Worker: Dafina Sinatra | Cooperation Partner: Center for Evaluation and Development (C4ED)Client: UNICEF
