East4South – Development Awareness from the Roots
Subject of the evaluation was the EU-funded project of the Deutsche Welle Academy (DWA) East4South – Development Awareness from the Roots”. The projects overall goal was to raise awareness about development issues among EU-12 citizens and positively changing their attitude towards EU development policy. The project aimed specifically at enabling the EU12 journalists to prepare high quality media products covering development issues and to publish them in their home countries media by providing training in intercultural journalism and on-site research and a media production stay in Africa for young journalists from EU-12 countries. In the course of the project a total of 60 young journalists from Eastern Europe and Africa were fostered and supported when creating their own network.
Goal of the summative ex-post evaluation was to verify and analyze the outcome of the project activities and the quality of the project management. The CEval GmbH followed a mixed-method approach combining in-depth stakeholder interviews and secondary and document analysis of module evaluation surveys and participants short reports with a standardized online survey of all participants.Talking about migrants lives in Russia
Subject of Evaluation was the EU-funded project Talking about migrants lives in Russia of the DW Akademie and the Foundation for Independent Radio Broadcasting. The project aimed to increase awareness about the situation of migrants within Russian society by strengthening cooperation between the Russian media and civil society organizations (CSOs) who are working on migrant issues. In order to achieve this goal, training activities for radio journalists and CSO activists were provided. The workshops aimed to introduce the CSO activists to agenda-setting mechanism of the media and to equip the journalists with storytelling skills and in-the-field reporting skills in order to do genuine social reporting on migration issues. Following the training activities the workshop participants took part in panel discussions where they presented their media productions and exchanged experiences on the reporting on migrant issues. A major medium-term outcome of those activities was the establishment of a sustainable network between CSO activists and radio journalists.
Goal of the summative ex-post evaluation was to analyze and assess the short- and medium-term outcomes of the training workshops. For this purpose the evaluation additionally analyzed to what extent the projects web platform, the panel discussions and organizational aspects in general influenced the expected outcomes. For data acquisition, CEval GmbH followed a mixed-method approach combining in-depth stakeholder interviews, document as well as secondary analysis of module evaluation surveys. Additionally a standardized online survey in Russian of all workshop participants was carried out.Strengthening evaluation capacities within government and civil society in Uganda (ECD Uganda): Development of a blended-learning Master of Evaluation (2012-2015)
Evaluation as a scientific means to describe and assess interventions is gaining relevance worldwide. The needs for qualified evaluation professionals are increasing in Uganda, too. However, at the moment these needs cannot be satisfied due to lack of training- and evaluation programs in this region. It is for this reason that the BMZ together with CEval and GIZ initiated a program for developing evaluation capacities in Uganda.
The most important component of this program is the development and implementation of a master course in evaluation in the blended-learning format at Uganda Technology and Management University (UTAMU) in Kampala, Uganda. Blended-learning is an innovative concept which is gaining popularity worldwide and is now the default means of teaching at UTAMU. Blended-learning unites traditional face-to-face classes with modern forms of e-learning in a didactical coherent way. An advantage of this concept is, that it is possible not only for Ugandan students to attend classes but also for all students of English-speaking African countries.
The Master of Evaluation of Saarland University in cooperation with HTW Saarland serves as a template for the Ugandan Master, which will be introduced in fall 2015. The contents of the master program have been developed in cooperation with CEval GmbH, the teachers of the German master as well as Ugandan contact persons of Makarere University and have been adapted to the Ugandan context. The Ugandan Master of Monitoring and Evaluation will comprise 15 modules in total, seven of which are in compliance with the basic teaching program of evaluation at Saarland universities. This is to ensure that all topics relevant to acquire profound knowledge in the field of evaluation are covered. UTAMU has complemented this program with further modules regarding project management, monitoring as well as business start-up consulting. The modules are roughly comprised of web-based trainings, e-tutoring and face-to-face seminars. The teaching concepts have also been developed in cooperation with all stakeholders. The GIZ is responsible for the technical implementation of the e-learning concepts.
Two modules of the master of evaluation have been tested in an experimental phase together with UTAMU. During this experimental phase e-tutoring as well as the face-to-face seminars have been supervised in the tandem-principle by teachers of UTAMU and Saarland University/HTW. The hosting of the online study course has been undertaken by the GIZ platform GC 21. In a next step, the seven modules have been integrated into the already existing UTAMU master and the new course of study has been submitted to the responsible committees. The course of study is now aggregated and will be introduced experimentally. A decision about whether the course of study will be continued and which modifications would be necessary for this procedure, will be made in December 2016.
Strengthening of evaluation capacity in Central America (FOCEVAL)
The project “Strengthening of evaluation capacity in Central America (FOCEVAL)” of the Deutsche Gesellschaft für Internationale Zusammenarbeit (GIZ) GmbH aimed to strengthen the role of evaluation in the policy-making process and the control of policies in Costa Rica and selected countries in Central America. The measure was designed as a regional project, whose political sponsorship lies with the Costa Rican Ministry of National Planning and Economic Policy (MIDEPLAN).
Within the framework of the ECD-project, the task of the CEval GmbH was the implementation of a number of training courses on monitoring and evaluation (M&E) at different aspiration levels for the partner structures. The contents of the already tested and repeatedly conducted training courses reflect the different needs among the target groups. In addition, the CEval GmbH offered the regional project a continuous scientific support, which ensures a permanent connection to the current international discussion on evaluation, and maintains the link to scientific organizations and networks. It furthermore comprised a range of advisory services, particularly in the strategy and concept development, which was based on the latest scientific findings of monitoring and evaluation research.
Development and Implementation of a M&E-System for the Plan Honduras Project "Prevention, Protection and rights Restitution for Girls and Boys survivors of sexual violence"
The overarching objective of the Plan Honduras project was that girls and boys are protected from sexual violence and had access to child friendly and competent prevention and attention mechanisms from local to national level. In order to achieve this objective, Plan Honduras developed an action programme that was to strengthen prevention, protection and attention capabilities for at-risk girls and boys and survivors of sexual violence in the family, community, municipality, departments and at the national level.
The task of the Center for Evaluation (CEval) in this framework was to assist and consult the process of developing and implementing an impact oriented gender sensitive M&E-system that could be used throughout the project cycle and beyond. Therefore the CEval adviced and trained project executives and partners in order to enable them to systematically monitor and evaluate project related activities, to identify the most relevant aspects on all impact levels, to formulate impact oriented qualitative indicators for the project contributing to gender equality, to design a data collection plan and instruments and to solve occurring challenges during the data collection and analysis process.
The knowledge transfer was facilitated through a combination of continuous consultancy, training measures and practical implementation of the consultancy and training content within an accompanied baseline study including a gender analysis as well as an accompanied interim and a final project evaluation.
Impact Evaluation of WIENCO Ghana Ltd. Out-grower Schemes
The overall objective of the impact evaluation was to measure and evaluate the investment of the Agricultural Trade and Investment Fund (AATIF) in two of WIENCO’s out-grower schemes in Ghana. In particular, two out-grower arrangements, the Cocoa Abrabopa Association for cocoa farmers and the Masara N’Arziki for maize farmers, were under investigation. The main interest lied in identifying the causal link between participating in WIENCO’s out-grower arrangements and the following outcomes and their development over time:
- Productivity Levels
- Employment opportunities
- Farm and overall household income
- Living and working conditions
- Risk exposure regarding total household income; and
- Farm-households’ risk coping strategies and mechanisms.
This shall provide AATIF with evidence on the effectiveness of funding out-grower schemes. In addition a simplified tool allowing WIENCO to collect data on the key outcomes shall be designed.
The 5-year evaluation will be conducted by a consortium of the Center for Evaluation (CEval) and the German Institute for Global and Area Studies (GIGA), together with Ghanaian partners. A mixed-method approach had been embedded in a profound contextual analysis. The evaluation combined a quantitative analysis of household and village surveys with qualitative insight into WIENCO’s impacts derived from focus group discussions (FGDs) and expert interviews. The reports provided the counterpart with robust evaluation results while also presenting practical recommendations to improve WIENCO’s activities.
Trend and impact study on fair trade in Germany
Fair trade had been an issue in Germany for over 40 years now and has received increasing public awareness ever since. The impacts of fair trade in the producer countries of fairly traded goods and products have been the subject of numerous studies. By contrast, insights on how fair trade affects the consumer countries of these goods and products to date are scarce.
The study implemented by CEval on fair trade in Germany addresses this gap. It aimed at identifying the societal changes and trends that have been evoked by fair trade in Germany and to determine how the fair trade movement contributed to these changes.
In doing so, a participative approach made sure that the expertise and perspectives of relevant actors are adequately reflected in the study. Furthermore, the study approached its research subject drawing on a theory-based approach and employed a balanced mix of qualitative and quantitative methods.
An intensive literature study, qualitative expert interviews, focus group discussions, online surveys and a telephone consumer survey were carried out to collect data. The data was evaluated using qualitative content analyses, time series analyses and descriptive statistical evaluations. Once the data had been analyzed, the results of the study were compiled in a report and discussed at a final workshop together with those who commissioned and supported the study.
University Cooperation with Universidad de Costa Rica (UCR), with Funding Provided by the DAAD Program Subject-Specific Partnerships with Universities in Developing Countries
Having completed a successful 3-year cooperation focusing on the further development of the postgraduate study programme Project and Programme Evaluation for Social Development established at Universidad de Costa Rica (UCR) in 1995, the Center for Evaluation (CEval) and the Universidad de Costa Rica (UCR) identified and realised new areas of cooperation. Since 2008, the German Academic Exchange Service (DAAD) has supported this cooperation with its funding project for sending German academics to universities in developing countries. Since 2012, the DAAD has also provided funding through the programme Subject-Specific Partnerships with Universities in Developing Countries (2012-2015), financially ensuring the plans to enhance the partnership between the two universities in Germany and Costa Rica.
The goal of the DAAD programme was to improve the teaching situation and to set up sustainable teaching structures in developing countries by facilitating academic exchange. Therefore, the international exchange between students, PhD candidates and lecturers was one of the most important aspects in the context of this enhanced cooperation. The focus also laid on opening up the master programme to other Central-American areas (regionalisation), embedding the partnership into an existing, international network (internationalisation), and adapting teaching of the master programme at UCR to regional demands and ensuing educational needs (creating a distinct programme profile). The four year partnership helped establishing or expanding regional and international professional networks and developing additional capacities regarding teaching and research.
It is planned to continue with the partnership in 2017 and integrate another Latinamerican university into the cooperation.
Test
Test2
Development and Implementation of a Gender-Sensitive Continuous M&E-System for the Plan India Project “ENGENDERED! – Minimizing Gender Gap”
The aim of the project on behalf of Plan International India is to identify and eventually tackle structural causes of discrimination against women in India. To that end, responsible project managers of the partner organization should be enabled to implement gender-sensitive measures and to monitor and evaluate their impacts.
The task of the Center for Evaluation (CEval) was to provide support for the development of verifiable impact hypotheses and a user-friendly M&E system in cooperation with responsible project managers. Right at the beginning of the project, during a workshop in 2008, the LogFrame developed by Plan India had been discussed and revised regarding the measurability of included indicators. Further proceedings were a local training session in 2009 and further consultation services in the course of the project. In 2015, CEval conducted a final evaluation of the project.
