Projekt-Kategorien: Development Cooperation

Development of an impact-orientated M&E-System in Germany for the Cooperation Platform of Latin America North (COPLAN)

Up to the present innovative environmental technologies are not sufficiently utilized in Mexico and Central America. One reason is the missing extension of modern environmental technologies in this region. That is the initial point of COPLAN (“Cooperation Platform of Latin America North”): The objective of COPLAN is the extension of (German) environmental technologies in Mexico and Central America to make a contribution to environment protection. In the last years the German environment economics has led the way worldwide and was responsible for many innovations in the area of application-oriented technologies. Three questions were the base of the survey, namely a) What is the export potential of the German industrial sector of environmental technologies? b) Correspond the German supply with the potential demand in Mexico and Central America? and c) Which export barriers exist and how they can be overcome?

Because of the intended project effects in Germany it was necessary to create another impact-orientated monitoring-system in Germany beside the local impact-orientated monitoring-system in Mexico. The central task was to create an impact-orientated Monitoring and Evaluation System for measuring the intended outcome of COPLAN in Germany. For this purpose the main task was to develop an extensive indicator raster and an investigation plan for implementing two panels measuring the changes of the two target groups, the German enterprises of environmental technologies on the one hand, and central multipliers of the German environment economics on the other hand. Following the development of the M&E system, the CEval was tasked with implementing the first wave of the panel design. This included quantitative as well as qualitative data collection methods (standardized survey with participating companies, a comparison group and multiplicators, analysis of documents and secondary data, guided expert interviews).

Energising Development (EnDev) stove assessment study in Ethiopia

The project Energising Development (EnDev), implemented by the GIZ, is a joint initiative of the governments of Australia, Germany, the Netherlands, Norway and the United Kingdom. Focus of this stove assessment study is the Energy Coordination Office (ECO), also known as EnDev Ethiopia. EnDev Ethiopia supports the development of a commercial stove sector and sustainable stove market not only by improving the business and technical skills of stove producers but also by strengthening the demand side of households.

The objective of this stove assessment study was therefore

• to analyze and assess the project intervention in three regions in Ethiopia by using the EnDev internal sustainability criteria and the HERA Sustainability Assessment Framework (HERA – Poverty-Oriented Basic Energy Services);
• to generate recommendations for future steering of EnDev’s project implementation.

Following a mixed methods approach, the study relied on standardised and qualitative methods of data collection in addition to the document analysis of relevant project and sector papers. CEval contributed to the study by providing its methodological expertise in data collection and analysis.

Meta-evaluation of 34 evaluation reports on the Area Development Programmes of World Vision Germany

World Vision Germany (WVG) had engaged CEval to conduct a meta-evaluation of 34 evaluation reports of its Area Development Programmes. The aim of the evaluation was to analyze the reports with regard to their quality and validity. Beyond this assessment, CEval provided recommendations to enhance the design and implementation of future evaluation.
Based on the evaluation criteria relevance, effectiveness, efficiency, impact and sustainability, CEval implemented a two-tier analysis method. According to WVG’s quality criteria (i.e. voice and inclusion, transparency, appropriateness of evaluation methods, methodology, triangulation, and contribution) it had been first assessed to which extent the evaluation reports comply with various sub-criteria within one criterion. In a second step, findings had been consolidated and deviated one aggregated rating per criterion.

Moreover, CEval supported WVG in the production of their impact reports by critical commenting and methodological counselling.

Evaluation of the German Egyptian Research Fund

On behalf of the Federal Ministry for Education and Research the Project Management Agency of the German Aerospace Centre (DLR) implements the programme activities of the German-Egyptian Research Fund (GERF). The programme activities that had been evaluated comprise two rounds of funding (GERF I: 2009-2011, GERF II: 2011-2013/14) supporting German-Egyptian research projects in the fields of Biotechnology, Energy Efficiency, Renewable Energies, Water Desalination, Health, and Natural Resource Management.

CEval was contracted to conduct both, an ex-post evaluation of GERF I and a mid-term evaluation of GERF II. Accordingly, the objectives and downstream effects achieved by GERF I and their sustainability had to be evaluated, and the implementation process of the ongoing GERF II program had to be examined with regard to its design and efficiency, and recommendations for the continuation of GERF II and the design of future funding cycles had to be developed on the basis of the findings.

External Evaluation of Four Different Projects in the Field of Awareness Raising and a Synthesis

As international Christian development organisation, the Christian Blind Mission (CBM) aims at improving the human rights situation and the inclusion of people with disabilities. Awareness raising is one important component to achieve this target successfully. To learn how awareness raising activities are implemented, how they contribute to CBM’s overall aim and how project and country specifics produce different results, CBM Germany has engaged CEval to evaluate four projects and to compile findings and recommendations in a synthesis report.

With co-funding, either by the European Union or by the German Federal Ministry for Economic Cooperation and Development, CBM Germany implements two projects addressing the needs of people with hearing impairment in the Palestine Territories (Gaza and Gaza Strip), one project to improve eye care and rehabilitation in India, and one project to strengthen disability rights and inclusion in Swaziland. Given the diversity of these projects, issues of awareness raising can be studied from various perspectives. Thus, analysing the different underlying assumptions and needs which in turn lead to various approaches and expected outcomes, will contribute to a better understanding of the overall topic of awareness raising. While the projects in Gaza and India require a mid-term evaluation as they are still on-going, the projects in Gaza Strip and Swaziland are close to their end and will be finally evaluated

Development of a Monitoring and Evaluation Framework for the Plan project “Adolescent Boys: Champions of Change on Gender Equality and Girls Rights”

Plan International is a non-religious, non-political and non-governmental development organization working to bring lasting improvements in children’s lives in Africa, Asia and Latin America.
In order to strengthen the promotion of gender equality and to engage boys and men in this work, Plan International Germany and Plan International Finland together with four Plan country offices from the region of the Americas implemented the pilot project „’Adolescent Boys: Champions of Change on Gender Equality and Girls Rights“’. The project built the capacity of male youth as peer educators for gender equality and was carried out in five countries: El Salvador, Guatemala, Honduras, Dominican Republic and Germany.
The Center for Evaluation (CEval) evaluated the pilot project using quantitative and qualitative methods, identified lessons learnt and designed a monitoring and evaluation framework for the future implementation and upscaling of the project.

Evaluation of CALIDENA – A participative instrument to support the improvement of quality infrastructures

CEval had been mandated by Physikalisch Technische Bundesanstalt (PTB) to conduct the evaluation of CALIDENA, a participative approach to systematically and sustainably support the improvement of national quality infrastructures in developing countries. The evaluation systematized the experiences that have been made with the instrument so far and, on that basis, aimed at delivering relevant information for the enhancement of the instrument and its transfer to and application in new contexts.

CEval employed a mixed-method approach. Data had been collected using qualitative expert interviews, quantitative surveys, participant observation and group discussions. Once the analysis of the data thus gathered had been finalized, the evaluation results had been presented in an evaluation report and nurture the overall evaluation synthesis of various PTB instruments in the area of quality infrastructure development, which was also being implemented by CEval.

Synthesis of three PTB technical cooperation instrument evaluations

CEval has been mandated by Physikalisch Technische Bundesanstalt (PTB) to synthesize the results of three PTB instrument evaluations. In 2014 PTB had commissioned separate evaluations of three of its technical cooperation instruments: CALIDENA, QuISP and NMI-Metrology User Relations, of which the first two evaluations have been implemented by CEval. Their findings had been aggregated, compared and contrasted in order to extract overarching success factors and lessons learnt and generate relevant recommendations, among others, with regard to the future incorporation of the three instruments into PTB technical cooperation.

To that end, CEval qualitatively analyzed the information contained in the evaluation reports and collected complementary information by conducting a number of qualitative expert interviews. The synthesis results had been presented in an evaluation report and a workshop had been held to present them to PTB management and staff.

Accompanying evaluation of the project ‘Media in Libya – Stability through Structure"

The „Media in Libya- Stability through Structure“ project had the main goal of supporting the introduction of modern media legislation in Libya and to strengthen the country’s media institutions. In addition, the project should contribute to strengthen independent and professional journalism in the provinces of Libya. The project had a total duration of 30 months and was funded by the European Commission within the SPRING program. The project was controlled and implemented by the Deutsche Welle Academy (Department of Media Development, Team Africa) in cooperation with the Institute for War and Peace Reporting (IWPR). The activities of the project were divided into four activity clusters, of which DW Academy three realised, while IWPR edited one. CEval evaluated in this project clusters 1 to 3, which were in responsibility of the DW Academy.
The evaluation of the project was divided into a baseline, an intermediate and a final evaluation at the end of the implementation phase. CEval followed a mixed-methods approach for data mining. An in-depth analysis of already existing documents was carried out as well as own surveys (standardized online surveys of the participants of the trainings and qualitative guideline interviews with external experts and officials DW Academy).

Conception, realization and analysis of an expert panel for the assessment of qualitative factors of the renewable energy sector in Chile

The Deutsche Gesellschaft für internationale Zusammenarbeit (GIZ), on behalf of the Federal Ministry for the Environment, Nature Conservation, Building and Nuclear Safety (BMUB), supports the Chilean Energy Ministry in the implementation of measures for the diversification of the countries energy supply. One component of this program is a project to promote the development of solar energy use. At the beginning of the project, the quantitative and qualitative factors influencing the effectivity and sustainability and therefore the achievement of the project‘s objectives needed to be identified. Particularly for the documentation of qualitative factors it was necessary to gather empirical data through an expert panel, i.e. structured interviews with energy experts.

In the context of this assignment, the CEval GmbH rendered the following services to GIZ:
– Concept development: Identification of experts for the panel in coordination with GIZ, development of structured questionnaires for each group of stakeholders, development of a concept for future periodic panel interviews, development of a methodological concept for the long-term continuation of the expert Panel
•- Realization of the first data collection round
•- Analysis and reporting of the first data collection round
•- Development of a concept for the identification of quantitative impacts using the qualitative data, applying Stockmann‘s funnel approach”