External auditing as part of the awarding of the quality seal “Fan project in accordance with the National Concept of Sport and Safety”.
In Germany, there is a dense nationwide network of social work facilities for young soccer fans in the form of fan projects, which work in accordance with the framework and specifications of the National Concept for Sport and Safety (NKSS). For the purposes of quality assurance and continuous improvement of the work of the fan projects, the fan project quality seal was introduced in 2010 in accordance with the NKSS. This is intended to contribute to an improved perception of the fan projects and to provide the fan projects with certainty of action. The quality seal was included in the revised NKSS in 2012 and is thus recognized at a high political level. The quality seal is awarded by the Quality Assurance Working Group, in which stakeholders from soccer, the highest state and family authorities, academia and fan projects are represented.
The award procedure for the quality seal should be revised from both a content and procedural perspective in order to create a seal that is a valid sign of the goodness and quality of a project. The award procedure should be as objective as possible and ensure transparency about the reasons for awarding or not awarding the seal. In the context of the revision of the seal, it was therefore the task of the Center for Evaluation (CEval) to develop a criteria catalog as well as a standardized survey questionnaire. In addition, the CEval, in consultation with the partners, developed a concept for the implementation of a pilot phase in which the revised quality seal and its awarding process were tested for their practical suitability. The pilot phase was implemented with five selected fan projects. Based on the findings and experiences of the pilot phase, the concept and the instruments were finalized.
Evaluation of the project ‘AnschlussDirekt’
The subject of the evaluation was the project AnschlussDirekt, initiated in 2010 by the Ministry of Economics and Science of Saarland and implemented over a period of three years. Within the scope of the project, pupils with a positive prognosis of a secondary school leaving certificate were intensively supported in the phase of vocational orientation and during the search for a training place. The support of the young people was primarily provided by the staff of the project coordination office, but also – and this is the special feature of the model project – by volunteer sponsors (economic experts and human resources managers of Saarland companies). The aim was to increase the proportion of pupils who start in-company vocational training immediately after completing secondary school.
The task of the accompanying evaluation was initially to support the development of a monitoring system in which data relevant to project management can be recorded and retrieved as required. In addition, the sponsors were asked about their impressions and evaluations of the project and their consultations within the framework of a telephone survey.
Furthermore, the task of the evaluation was to record project effects at the level of the target group. To this end, standardized surveys were conducted with the young people involved in the project at various points in time. The results of these surveys were systematically compared with specially collected baseline data from pupils not participating in the project.
Regular recommendations for project optimization were derived from the evaluation findings and made available to project coordination.
Ex-post evaluation of the regional development program ”La Malacateca” in Guatemala
From October 1998 till September 2012, World Vision implemented a regional development program in the municipality of Malacatán in Guatemala. The program adressed four key areas: health, education, economic development and sponsorships.
Three years after the conclusion of the program, World Vision wants to conduct an ex-post evaluation to appraise the sustainability of ist effects. To this end, the Center for Evaluation works with a local Guatemalan consultancy firm (CONSULTA) on the implementation of a quantitative household survey (including a control group) and qualitative interviews with the target group and relevant key informants.
Evaluation of the African Good Governance Networks (AGGN)
Young Africans educated at German universities are regarded by the DAAD as important resource persons who are able to play a key role in processes of development towards rule of law, democracy and economic prosperity after their return to their home countries. The African Good Governance Network (AGGN) was established at the beginning of 2007 under the patronage of Germany’s Federal President. This network is intended to contribute to the expansion and deepening of academic cooperation between Sub-Sahara Africa and Germany and at the same time to promote future African leaders in the field of good governance. The members of the AGGN support the principles of good governance, recognise them and actively disseminate them.
The AGGN can be understood as a long-term training programme in which up to ten new members are admitted annually. The network currently has 32 members from fourteen African countries who meet up to three times a year for workshops and seminars. These seminars deal with various theoretical and practical aspects of good governance as well as various personal skills. The aim is to raise awareness and understanding of good governance and the associated social attitude. The task of the evaluation was to evaluate the results and effects achieved so far and, on this basis, to derive recommendations for action for the design of further programme activities. The evaluation also takes the further development of the network and its potential into account.
The evaluation was methodically based on secondary and document analyses, a standardised online survey of all AGGN members and participation in one of the AGGN seminars in South Africa, in the context of which the results of the standardised survey were discussed with the AGGN members themselves.
Development of a concept for the evaluation of e-learning offers within the framework of VISU (Virtual Saar University)
On behalf of Prof. Dr. Reinhard Daugs, head of the VISU (Virtual Saarland University) project, a comprehensive concept was developed for the evaluation of Internet-based university courses. The aim was to provide all disciplines and chairs at Saarland University with a suitable set of tools for evaluating online courses across all phases of planning, development and implementation (provider side) and application (user side).
Evaluation of the new selecting process for scholars of the Cusanuswerk
Since 2009, the Cusanuswerk has carried out a new procedure for selecting scholarship holders, the so-called first semester selection, in parallel to the existing basic selection procedure. This condensed procedure, which was still in the pilot phase at the time of the evaluation, is intended to enable significantly earlier access to funding from the Cusanuswerk. After three cohorts of scholarship holders who had been accepted during the first semester selection had gone through the final admission process by the permanent committees, the first semester selection process was to be evaluated.
The task of the evaluation commissioned by the Cusanuswerk was to assess the predictive validity of the procedure. The previous basic selection procedure and the new first semester procedure were compared with each other by interviewing the participants of both procedures using standardized online surveys and analyzing existing data and documents.
Advising IBQM on the evaluation of vocational qualification networks
The “Initiativstelle Berufliche Qualifizierung von Migrantinnen und Migranten” (IBQM) at the Federal Institute for Vocational Education and Training (BIBB) was a project funded by the BMBF as part of the BQF program (Berufliche Qualifizierung für Zielgruppen mit besonderem Förderbedarf). In cooperation with the project sponsor, IBQM advised and supported applicants who initiated innovative pilot projects as part of the BQF program. These projects were intended to contribute to the further development of support services for disadvantaged young people for the very heterogeneous target group of young people with a migration background. One focus was on efforts to take into account the intercultural dimension of skills assessment and development for the target group in the field of in-company and school-based vocational training.
IBQM’s main task in improving the framework conditions for the vocational qualification of migrants was to initiate, advise and scientifically support local and regional cooperation networks for the vocational qualification of migrants (BQN). CEval advised IBQM on the development and implementation of the process-accompanying evaluation of the BQN. This essentially involved the following tasks: Support in the completion of the BQN evaluation concept of IBQM, input at the meetings of the BQN evaluation working group, support in the development of the criteria catalogs, presentation formats and indicators for the implementation of the stages of the process-accompanying evaluation agreed with the local evaluation officers of the BQN, technical advice on the implementation of the individual stages (local application of the criteria, informative value of the documentation and plausibility of the implementation).
Introduction of a monitoring and evaluation system in a vocational training project of German-Egyptian development cooperation
Development and implementation of a monitoring and evaluation system for the Mubarak-Kohl-Initiative for the introduction of dual vocational training in Egypt.
