Accompanying, Ex Post Evaluation
Start of project: November 2021
End of project: November 2024
Process Evaluation of the support program ‘Collegium Cusanum’
The program 'Collegium Cusanum' of the Cusanuswerk - Bischöfliche Studienförderung is aimed at all scholarship holders of the Cusanuswerk (students and doctoral candidates) as well [Read More]The program 'Collegium Cusanum' of the Cusanuswerk - Bischöfliche Studienförderung is aimed at all scholarship holders of the Cusanuswerk (students and doctoral candidates) as well as Altcusaner who aspire to a professional activity in the school or pedagogical field or are already doing so. The support program thus makes a sustainable contribution to the personal development and qualification of teachers and educators. To this end, the program relies on mentoring elements, i.e. tutorial support for Cusanuswerk scholarship holders by teachers and educators with professional experience. The CEval carries out external evaluations accompanying the process for quality assurance purposes. The central task of this evaluation is to provide the Cusanuswerk staff responsible for implementation with timely information relevant to control. Of particular interest, in accordance with the objectives of the program, are questions regarding satisfaction with the events offered, the quality of tutorial relationships, and the professional and personal benefits of the relationship for both parties. Methodologically, the evaluation is based on standardized online surveys of mentees and mentors at three points in time.
Management: Vera HennefeldDevelopment M&E-System
Start of project: February 2022
End of project: July 2024
Implementation of an evaluation system for courses at the August Everding Theatre Academy
The August Everding Theatre Academy offers various artistic study programmes at Bachelor's and Master's level. In order to determine the students' satisfaction with individual courses [Read More]The August Everding Theatre Academy offers various artistic study programmes at Bachelor's and Master's level. In order to determine the students' satisfaction with individual courses and to identify potential for improvement, the August Everding Theatre Academy has commissioned CEval GmbH to implement an evaluation system for courses at the August Everding Theatre Academy. The aim is to create a regular database for the further development and optimisation of the courses. Methodologically, semi-standardised surveys will be designed for various teaching formats, which can be used for the evaluations of different courses (practically oriented and theoretically oriented courses as well as individual lessons).
Management: Vera HennefeldClient: Theaterakademie August Everding
Accompanying, Ex Post Evaluation
Start of project: March 2022
End of project: January 2024
Evaluation of the ASG Mentoring Programme 2022/2023
The overriding goal of the non-profit Agrarsoziale Gesellschaft e.V. is to work for the improvement of living conditions in rural areas and in agriculture. Qualified [Read More]The overriding goal of the non-profit Agrarsoziale Gesellschaft e.V. is to work for the improvement of living conditions in rural areas and in agriculture. Qualified and committed people are a central resource for the positive development of rural areas. Against this backdrop, an ASG mentoring programme was created in which students and graduates who would like to become professionally involved in and for rural areas are supported on their career path over a period of 18 months. The ASG Mentoring Programme is based on the three classic mentoring components: The tutorial support of mentees through the formation of mentoring tandems with leaders from science, administration, politics, non-governmental organisations and business, the acquisition of competencies by the mentees within the framework of the accompanying seminars of the programme, ASG conferences/seminars and the development of personal contacts and networks through the professional exchange with all stakeholder groups within the programme as well as in the context of the ASG conferences and seminars. CEval GmbH was commissioned with the accompanying evaluation of the mentoring programme. The central task of this evaluation is to provide the ASG staff who are responsible for the implementation of the project with timely and relevant information. Of particular interest are questions about satisfaction with the seminars offered, the quality of the tutorial relationships, and the professional and personal benefits of the relationship for both sides. Methodologically, the evaluation is based on standardised online surveys of the mentees and/or mentors at six points in time and on qualitative interviews of the programme leaders and mentors as well as on (focus) group discussions with the mentees.
Management: Vera HennefeldClient: Agrarsoziale Gesellschaft
Accompanying, Impact Analysis
Start of project: September 2022
End of project: November 2023
Evaluation of a digital Senior Citizens Portal “digital.vital”
The senior citizens' portal "digital.vital" is a model project of the Amt Hüttener Berge, the district of Germersheim and the city of Püttlingen. The aim [Read More]The senior citizens' portal "digital.vital" is a model project of the Amt Hüttener Berge, the district of Germersheim and the city of Püttlingen. The aim of the portal is to make a contribution to meeting the challenges associated with demographic change and advancing digitalisation: Through needs-based offers, people are to be supported in the areas of nutrition, exercise and leisure activities/social participation (incl. housing, mobility, support) in achieving and maintaining a high quality of life in old age. At the same time, the portal also aims to strengthen the digital participation of older people. The project started in July 2020 and from autumn 2022 various services and information will be made available on the portal.
The Amt Hüttener Berge has commissioned CEval GmbH to evaluate the senior citizens' portal in order to gain insights into the quality of the information and services offered and to identify possible potential for optimising the user experience in terms of portal functionality and content. Methodologically, a total of four participant observations will be carried out for the structured evaluation of the user experience among the pilot users in the context of so-called digital workshops at various locations. The participant observations will be supplemented by follow-up interviews with selected participants a few days after their visit to the digital workshops in order to collect data on the actual benefits of the workshops and the use of the website by the participants. In addition, a standardised online survey will be conducted among senior citizens' organisations and actors in the partner municipalities on their perceptions and professional assessments of the senior citizens' portal, its services and potential for further development.
Management: Vera Hennefeld | Co-Worker: Katharina HaryClient: Amt Hüttener Berge
Accompanying, Impact Analysis
Start of project: September 2022
End of project: September 2023
Evaluation Lectureships
As the world's largest funding organisation for the exchange of students and academics, the DAAD promotes lectureships of academics at universities abroad with. With its [Read More]As the world's largest funding organisation for the exchange of students and academics, the DAAD promotes lectureships of academics at universities abroad with. With its lectureships abroad, the DAAD pursues foreign cultural policy, development policy, higher education policy and/or programme policy goals. Depending on the host country, the host institution and the specific configuration of a lectureship, their objectives vary.
The evaluation focuses on the long-term, short-term and Herder lectureships for the period 2012 to 2022. The evaluation pursues three central objectives: To examine whether the programmes in their current design are up-to-date and needs-oriented, to support the DAAD's accountability to the Federal Foreign Office, and to support the strategic positioning of the programmes through further development. Methodologically, the evaluation is based on a combination of qualitative and quantitative methods of data collection and analysis. It relies on a comprehensive analysis of documents and secondary data, virtual site visits, guided interviews, group discussions and online surveys.
Management: Vera HennefeldClient: German Academic Exchange Service
Start of project: November 2021
End of project: April 2022
Study program evaluations of the Theaterakademie August Everding
The August Everding Theatre Academy, Munich, is an academic teaching and learning theatre that offers eight courses of study in the field of stage professions [Read More]The August Everding Theatre Academy, Munich, is an academic teaching and learning theatre that offers eight courses of study in the field of stage professions at Bachelor's and Master's level. These are realised in cooperation with the four Munich universities and the three Munich state theatres.
The Theatre Academy has commissioned CEval GmbH to carry out evaluations of five study programmes. The aim is to collect an evaluation of the theoretical and practical orientation by the students of the various study programmes in the sense of quality development, in order to further optimise the study programmes on the basis of this data. For this purpose, the students are surveyed online using partially standardised questionnaires.
Management: Vera HennefeldClient: Theaterakademie August Everding
Accompanying, Ex Post Evaluation, Impact Analysis
Start of project: August 2020
End of project: December 2021
Evaluation of the prevention campaign “Mach Dein Passwort stark!”
In January 2019, the Ministry of the Interior of North Rhine-Westphalia (IM NRW) commissioned the NRW State Criminal Police Office (LKA NRW) to develop a [Read More]In January 2019, the Ministry of the Interior of North Rhine-Westphalia (IM NRW) commissioned the NRW State Criminal Police Office (LKA NRW) to develop a prevention and publicity campaign to combat 'cybercrime'. The aim of the campaign was to strengthen the population in NRW in the safe use of digital end devices and thereby reduce opportunities for cybercrime in the broader sense and make the work of the perpetrators more difficult. The cross-media campaign "Make your password strong!" was launched in October 2020.
CEval GmbH was commissioned to carry out an accompanying evaluation for the campaign with the two sub-areas of process and impact evaluation. The aim of the study was to evaluate the implementation process as well as the effectiveness of the "Make your password strong!" campaign and to derive conclusions and recommendations for future police prevention campaigns based on these results.
The evaluation was based on a broad mix of qualitative and quantitative data collection involving all actors involved in the design and implementation of the campaign as well as the target groups. The design also included an experimental trial set-up for comparative impact evaluation of the different components of the campaign. Descriptive and inferential statistical methods as well as qualitative content analyses were realised within the framework of the data analysis.
Management: Vera HennefeldStart of project: February 2021
End of project: October 2021
Mid-Term Evaluation of the „Palestinian-German Science Bridge” (PGSB)
The program Palestinian-German Science Bridge is a pilot project financed by the German Federal Ministry of Education and Research (BMBF), which is jointly implemented by [Read More]The program Palestinian-German Science Bridge is a pilot project financed by the German Federal Ministry of Education and Research (BMBF), which is jointly implemented by Forschungszentrum Jülich and the Palestinian Academy for Science and Technology (PALAST). It aims at establishing a joint education and research cooperation between Forschungszentrum Jülich and the Palestinian partner universities. To this end, the program combines measures focusing on student and researcher mobility, scientific exchange among faculty staff, the support of research collaborations and the reintegration of young Palestinian researchers into the Palestinian academic sector.
Forschungszentrum Jülich mandated CEval GmbH to counsel the Forschungszentrum with regard to the conceptualization of a mid-term evaluation of the program and to assist the Forschungszentrum in implementing it. The purpose of the evaluation was to assess the short- and medium-term results of the program as well as the prospects for long-term goal achievement. The objective, further, was to identify potentials for improvement in relation to the program.
Methodologically, the evaluation was based on a mix of qualitative and quantitative data collection and analysis methods. Data collection combines a document and secondary data analysis with guided interviews and semi-standardized online surveys among the project stakeholders. During data analysis, descriptive statistics and qualitative content analysis were applied. Due to the COVID-19 pandemic, the evaluation was planned as a remote evaluation.
Management: Vera HennefeldClient: Forschungszentrum Jülich
Development M&E-System
Start of project: May 2021
End of project: August 2021
Development of results-based framework “Resilience in Strategic Communication”
The digital transformation has also greatly changed the demands on foreign policy and its communication. Whereas it used to be primarily the responsibility of the [Read More]The digital transformation has also greatly changed the demands on foreign policy and its communication. Whereas it used to be primarily the responsibility of the foreign minister and the global network of foreign missions, foreign policy today has many state and non-state actors. At the same time, global competition for attention has reached a new dimension due to digitalisation as well as numerous new players and alliances. But it has also changed due to a massive shift of communication to social media. Strategic communication today is therefore not only a different way of communicating in other social spaces, but at the same time a confrontation with challenges such as disinformation, propaganda or hate crime and a changed concept of the public, of freedom of expression and its threats.
The aim of the assignment was to provide a decision-making basis for project selection based on clear and predefined criteria on how well a proposed project fits into the overall logic of resilience promotion, as well as to create a basis for evaluating German engagement in the resilience sector. This took the form of developing a results-based framework with associated impact-oriented indicators, which were documented in an accompanying report and embedded in terms of communication theory.
Management: Vera HennefeldClient: Federal Foreign Office
Accompanying, Ex Post Evaluation, Impact Analysis
Start of project: March 2020
End of project: July 2021
Joint departmental strategic evaluation of the AA and BMZ engagement in Iraq
Within the framework of its crisis engagement in Iraq, the Federal Government intends to further embed monitoring and evaluation as instruments of learning and quality [Read More]Within the framework of its crisis engagement in Iraq, the Federal Government intends to further embed monitoring and evaluation as instruments of learning and quality assurance, accountability and strategic steering. In this context, a joint evaluation of the Iraq engagement of the Federal Foreign Office (AA) and the Federal Ministry for Economic Cooperation and Development (BMZ) was conducted. This was intended to serve as a pilot project and, if possible, as a model for joint evaluations of both ministries in relevant fields of action and at their interfaces. The main objective of this joint evaluation was joint institutional learning. The AA component of the evaluation was realised by a consortium under the leadership of the GFA Consulting Group, in which CEval GmbH was involved; the BMZ component by the German Evaluation Institute (DEval). Both evaluation teams worked closely together in a so called Arbeitsgemeinschaft.
The aim of the evaluation was to conduct an independent and comprehensive analysis and assessment of the engagement of the two ministries in order to gain and use insights for (joint) steering. The evaluation provided insights into the relevance, effectiveness and overarching impacts, efficiency, sustainability and connectivity as well as coordination, coherence and complementarity of the Iraq engagement of both ministries. Furthermore, the evaluation provided recommendations for optimising the overall engagement and individual measures, structures and processes in order to adjust the current portfolio if necessary. Finally, learning experiences from the AA-BMZ engagement in Iraq were identified for similar engagement in other crisis contexts. The evaluation also served as an accompanying or final performance review of the country portfolio in accordance with the Federal Budget Code (Bundeshaushaltsordnung).
Methodologically, the evaluation was based on a broad mix of qualitative and quantitative data collection and evaluation methods. Due to pandemic-related travel restrictions, the data collection was realised or managed remotely by the consortium in both Germany and Iraq.
Management: Vera HennefeldClient: Federal Foreign Office
