Interim Evaluation of the Global Impact Investment Facility (GIIF)
In 2019 the BMZ, together with KfW and DEG established the Global Impact Investment Facility (GIIF). The GIIF is a blended finance co-financing instrument designed to support DEG’s operations by providing appropriate financial services in high-risk countries and contexts and increasing development-effective financing. The main objective of the GIIF is to contribute to creating and preserving jobs decent jobs, even in times of crisis, in developing and emerging countries, and to promote renewable energy and transformative investments. GIIF targets projects and businesses that are developmentally impactful in constrained high-risk markets. To provide diverse financing opportunities, the facility is structured in three special financing windows: 1) Risk investment and crisis financing in Africa (and the Middle East), 2) AfricaGoGreen, and 3) Global risk investment and crisis financing. As a co-financing instrument with its risk-sharing mechanism and initial BMZ public funds of 190 million euros, GIIF expects to achieve high leverage and mobilize additional private and public capital.
DEG Impact commissioned CEval GmbH to conduct an interim evaluation of the GIIF, focusing on its implementation between 2019 and 2024. The purpose of the interim evaluation was to provide an assessment based on the OECD-DAC criteria: relevance, coherence, effectiveness, efficiency, and the impact of the GIIF; elaborate conclusions and recommendations from the findings for DEG, DEG Impact, and CREDION; and help shape the further implementation of the facility. To the extent possible, the evaluation explored the extent and types of the facility’s additionality.
The evaluation was based on a theory-based approach, with extensive stakeholder participation, and used a mix-methods design. During the inception phase, the evaluation team developed a results model of the facility, which DEG Impact validated. The evaluation was further guided by a detailed evaluation matrix structured by the OECD-DAC criteria, allocating specific data sources, data collection instruments, and analysis methods to evaluation questions. For the assessment, the evaluation team conducted a desk review of project documents facilitated by DEG Impact. Alongside the desk study, the evaluation team conducted 31 virtual interviews with key informants. Data obtained from the documents and interviews were analysed using qualitative content analysis. In addition, the financial data were subjected to a descriptive statistical analysis.
Programme Evaluation of APPEAR III
CEval GmbH is currently conducting the programme evaluation of the third phase of the Austrian Partnership Programme in Higher Education and Research for Development (APPEAR III) on behalf of the Austrian Agency for Education and Internationalisation (OeAD). APPEAR is a programme of the Austrian Development Cooperation (ADC) conceived, guided, and financed by the Austrian Development Agency (ADA) to implement ADC’s strategy for support of Higher Education and Research for Development on an academic institutional level in ADC’s priority regions. Implemented by OeAD, the programme currently is in its 15th year of implementation as part of which at least 107 projects (Component 1) and 183 scholarships (Component 2) have been funded through different funding instruments. In the programme phase that is being evaluated, participating institutions are based in the following countries (ADA’s “priority countries”): Albania, Armenia, Austria, Bhutan, Burkina Faso, Ethiopia, Georgia, Kosovo, Moldova, Mozambique, Palestinian Territories, Uganda, and further (“non-priority”) countries.
In comparison with previous programme phases, APPEAR has become increasingly complex in terms of its funding provisions. In response to this complexity, the evaluation team applies a theory-based and participatory approach in which both qualitative and quantitative evaluation methods are employed. While up to 42 interviews and focus group discussions constitute the qualitative data base of the evaluation and allow for an in-depth understanding of causal mechanisms and personal views on the programme, two online surveys targeting 179 programme beneficiaries generate quantitative data that allow for the identification of patterns and relationships that may not emerge from the qualitative data. Furthermore, on-site data collection in Armenia – as part of six case studies – provides close-up insights into programme implementation in one of APPEAR’s most recent partner countries.
The programme evaluation is being conducted along the OECD DAC evaluation criteria relevance, effectiveness, and efficiency, and aligns with ADA’s guiding evaluation principles. Its main purpose is to inform a potential fourth phase of the APPEAR programme.
Central Project Evaluation: Implementation of the Lao PDR Emission Reductions Programme through improved governance and sustainable forest landscape management
The “Implementation of the Lao PDR Emission Reductions Program through improved governance and sustainable forest landscape management” project supports the Lao Government in its readiness for the REDD+ process at national and sub-national levels. The project is funded by the Ministry for Economic Cooperation and Development (BMZ) with co-financing contributions of the Green Climate Fund (GCF). Due to its complexity and donor structure, the project is divided into two subprojects: Project 1 GCF FP117 (May 2020 until May 2025) and Project 2 GCF FP200 (March 2023 until March 2027). The project is operating in six provinces of northern Laos: Houaphan, Luang Prabang, Sayaboury, Bokeo, Luang Namtha and Oudomxay.
CEval will conduct a final evaluation for the subproject FP117, and a mid-term review for the subproject FP200, producing one inception report, and two separate evaluation reports. This evaluation is grounded in a theory-based approach and based on the OECD-DAC criteria. The evaluation team will conduct a 3-week on-site evaluation mission in Laos to collect data through interviews and focus group discussions with key stakeholders. Data analysis will be conducted, based on qualitative content analysis. To assess causalities, a contribution analysis approach will be applied. An efficiency analysis will be carried out, based on the “follow-the-money” approach and GIZ’s efficiency tool.
Central Project Evaluation: Reduce, Reuse, Recycle to Protect the Marine Environment and Coral Reefs
The project “Reduce, Reuse, Recycle to Protect the Marine Environment and Coral Reefs” (3RproMar) aims to support the ASEAN Member States (AMS) in the improvement of implementation capacities for reducing land-based waste leakage to protect the marine environment. It is funded by the German Federal Ministry for Economic Cooperation and Development (BMZ) with a total budget of 16,000,000 EUR and implemented from 17.12.2019 – 30.06.2025 in the four countries Indonesia, Cambodia, Vietnam, and the Philippines, setting a geographical focus on the Mekong River system and island states.
CEval has been commissioned to conduct a final evaluation, grounded in a theory-based and participatory approach. The evaluation will be guided by the OECD-DAC criteria and follows the standards of GIZ Central Project Evaluations. For the collection of primary data, the evaluation team will implement a 3-week on-site evaluation mission in two implementing countries (Indonesia and Cambodia), to conduct interviews and focus group discussions with key stakeholders. The team will deploy qualitative content analysis to analyse primary and secondary data. Causal relationships between outputs, outcomes, and impacts will be assessed by applying contribution analysis. An efficiency analysis will be carried out, based on the “follow-the-money” approach and GIZ’s efficiency tool. The final Evaluation report will provide lessons learned and recommendations for implementing a follow-on project.
Central Project Evaluation: Global Programme Sustainable Fisheries and Aquaculture
The Global Programme “Sustainable Fisheries and Aquaculture” is part of the BMZ Special Initiative “Transformation of Agriculture and Food Systems”. It features a total budget of 76,198,455 EUR with an overall term from 01.10.2016 – 31.10.2025. It is implemented in Uganda, Mauritania, Malawi, Madagascar, Zambia, Cambodia and India. The project’s interventions in Uganda and Mauritania are focusing on sustainable fishery management in Lake Victoria and Lake Kyoga (Uganda) and along the coastline (Mauritania). Interventions in Malawi, Madagascar and India are focused on sustainable aquaculture. Interventions in Zambia and Cambodia feature components on aquaculture production in ponds and on sustainable fishery management in dams (Zambia) and community fish refuges (Cambodia). The program is following a multi-level approach, working with producers, local organizations (training and research institutes), associations, producer groups and political partners.
In 2024, the project commissioned seven evaluative studies (EVAS) to assess the success of each country package against the OECD-DAC criteria. The Central Project Evaluation will aggregate and assess the results of these studies at the program level. To verify and complement the results of the EVAS, the evaluation team will conduct a remote evaluation mission to carry out online interviews with relevant stakeholders. Qualitative content analysis will be applied for the review of EVAS documents as well as to analyze primary data collected. To assess causal relationships between program interventions and intended objectives, the team will deploy contribution analysis. Additionally, an efficiency analysis will be conducted using the “follow-the-money” approach and GIZ’s efficiency tool.
Mid-term Evaluation: Empowering the Hearing Healthcare Sector in Developing and Emerging Countries
In response to existing gaps between hearing healthcare needs and current capacities, the Austrian medical device company MED-EL launched the Hearing Healthcare Alliance (HHA) in February 2022 – an intervention with co-funding from the Austrian Development Agency (ADA). The primary objective of the intervention is to enhance the diagnosis and rehabilitation of individuals with hearing impairments by creating sustainable local structures within the hearing healthcare sector across 13 developing countries, including nine in Sub-Saharan Africa and four in South Asia. The intervention is set to conclude in January 2026, with plans for a subsequent phase to follow. In this context, CEval was commissioned by MED-EL to conduct a mid-term evaluation of one of the intervention’s central components, namely, the “Early diagnosis for people with hearing impairment”. The evaluation focusses on the two project countries Benin and Nepal, aiming to extract key insights from past implementation to strengthen and scale up the evaluated component in later implementation stages.
The evaluation is theory-based in its design and builds on extensive stakeholder participation as well as a mixed-methods approach. Primary data will be collected on site in both focus countries. The evaluation is being conducted along the six OECD/DAC criteria and in line with ADA’s Guidelines for Programme and Project Evaluation.
Evaluation of the EndOCSEA@Europe Project
Funded by: Safe Online
In response to the alarming rise of Online Child Sexual Exploitation and Abuse (OCSEA), the Council of Europe has commissioned the EndOCSEA@Europe project, implemented in two phases, to combat OCSEA across Council of Europe member states. Phase I (2018-2021) focused on mapping legislation, policies, and practices on OCSEA, strengthening laws, enhancing law enforcement capacities, and raising awareness in countries such as Albania, Armenia, and Ukraine. Phase II (2023-2025), focuses on further strengthening actions, particularly in Georgia, the Republic of Moldova, and Montenegro. The project promotes multi-stakeholder collaboration, legislative reforms, capacity-building, and awareness campaigns, integrating recommendations from Phase I, with synergies sought with other Council of Europe initiatives. Managed by the Children’s Rights Division, it involves key stakeholders, including government authorities, law enforcement, NGOs, and professionals working with children.
The evaluation of the EndOCSEA@Europe project aims to assess its effectiveness, impact, efficiency, and sustainability across both phases, focusing on legislative improvements, cross-border cooperation, capacity-building, and implementation challenges. Using a non-experimental, theory-based, mixed-methods approach with extensive stakeholder participation, the evaluation will examine the project’s Theory of Change, impact, and scalability at political, institutional, community, and individual levels. Data will be gathered through interviews, case studies, and surveys, analyzed using triangulation for validity, and following the OECD-DAC criteria with a focus on age- and gender-sensitive methodologies.
Study on double counting of GIZ standard indicators at country level
Funded by: German Federal Ministry for Economic Cooperation and Development (BMZ)
In German development cooperation, several projects usually work towards a common goal in a country, a region, and/or a sector, but report their results individually and often without comparing them with each other.
2022 the BMZ has introduced the “BMZ 2030” reform concept and thus decided that GIZ projects should report on 44 so-called standard indicators along defined core topics. This laid the foundation for cross-project reporting of results, which can also be used for political communication. However, due to the multiple collection of data, there is a risk that the aggregation of these indicators at the country level will overestimate the results and impacts achieved. The aim of the study was to develop a method for identifying the frequency and magnitude of these overlaps, to apply this method, and, based on the findings, to draw up recommendations on how double counting can be avoided in the future.
To this end, a quantitative “hot spot” analysis was carried out on the basis of an online survey conducted by GIZ in order to identify the potential risk of overlaps. For the subsequent validation of the actual occurrence of overlaps, empirical data was collected from interviews with portfolio managers and cluster coordinators. Based on this data, the magnitude of overlaps was estimated, and a methodologically robust solution approach was developed.
Evaluation of the “Knauf Training Initiative Phase I and II”
DEG Impulse uses the develoPPP Classic program to support measures by well-established enterprises that wish to operate in developing and emerging countries on a long-term basis and thereby shape their business involvement in a sustainable manner. One of the projects under develoPPP Classic is the “Knauf Training Initiative” (KTI) in its phase I (2018-2023) and phase II (2021-2026). Knauf is one of Europe’s leading manufacturer of gypsum-based construction materials and also specialized in production of isolating materials and cement products.
The main objective of the KTI is the establishment of training centers (TCs) to improve the technical qualification and employability of young people, students and skilled workers in the field of drywall construction and related products. Through the TCs, both practical and theoretical modules imparting comprehensive knowledge regarding the application of drywall construction techniques are provided to installers, architects/civil engineers, academic staff and unemployed people. The KTI is to provide people with the possibility of completing a training, which in turn should lead in the long-term to sustainable career prospects.
CEval GmbH was commissioned by DEG Impulse to evaluate the KTI. The evaluation assessed the relevance, coherence, effectiveness, efficiency, impact and sustainability of the KTI, identified methodological lessons learned and conclusions resulting from the findings, and provided evidence-based, actionable recommendations for DEG Impulse and Knauf. Furthermore, the evaluation integrated a gender perspective, in order to address the initiative’s effects on gender mainstreaming and women empowerment. Eventually, the evaluation investigated the additionality of the initiative, i.e., the extent to which further and/or more impacts were achieved through the financial support of DEG Impulse.
The evaluation followed a mixed-methods case-study design, collecting primary data through individual and group interviews in Germany and three target countries (i.e., Egypt, Algeria and Mexico), as well as a semi-standardized online survey among TC staff in countries not visited. Secondary data, including monitoring reports, training materials, and TC survey data, were analyzed through a desk study. The evaluation team conducted interviews with TC staff, stakeholders, and beneficiaries, ensuring appropriate representation of diverse target groups.
The data analysis involved qualitative content analysis using the software MaxQDA, as well as a descriptive statistical analysis of quantitative data from the surveys, with disaggregation by gender and country where possible.
#eSkills4Girls Initiative
The #eSkills4Girls initiative aims to close the digital gender divide by promoting the access of women and girls to opportunities to help improve their digital skills. The initiative was launched in 2017 by the BMZ under Germany’s G20 presidency and managed by the GIZ sector programme education (SP Education). Since then, the initiative established partnerships with private and public sector actors and joined EQUALS, the global multi-stakeholder partnership promoting gender equality in the digital age. To improve the digital skills of women and girls, the initiative established the #eSkills4Girls Fund, which provided small grants to 27 existing grassroots initiatives through EQUALS. Additionally, the initiative served as community manager for 9 bilateral projects financed by the BMZ under the #eSkills4Girls banner. Other activities implemented by the initiative aimed at raising the awareness of policymakers, showcasing female role models, and fostering sharing and learning among projects.
CEval GmbH was commissioned by GIZ SP Education to conduct an impact evaluation of the #eSkills4Girls initiative. The goal of the evaluation was to understand how and to which extent the different activities achieved their respective goals. Based on the evaluation questions, the initiative was assessed against the OECD-DAC criterion ‘effectiveness’. To fill in missing information and data after an initial review of existing secondary documents, online-based questionnaires for the sub-grantees of the #eSkills4Girls Fund were disseminated. Furthermore, project reports and monitoring data by bilateral project partners were reviewed. In addition, focus group discussions and interviews with representatives of the sub-grantees and bilateral projects were conducted to complete the qualitative data collection.