Description
The Work and Skills for 100,000 Programme was conducted in 2011. Commissioned by the Western Cape Department of Economic Development and Tourism, the evaluation's main objective was to
assess to what extent the programme had been able to increase the employability of youth by affording them on the job work experience. The Evaluation was conducted by a private company, Devnomics.
The evaluation investigates the quality in terms of phases and overarching considerations. Organised on a scale of 1 to 5, the overall score of the evaluation was 2.69, just below the average of 3.0. In the context of four phases of evaluation, namely, planning and design, implementation, report writing, follow up, use and learning, the implementation phase scored highest. The preparatory phases of planning and design and follow up, use and learning were weakest. The preparatory phases involve the evaluator and evaluand and call for interaction of the two groups. The responsibility for utilisation of results largely depended on the evaluand and is, in this case, the Western Cape Government. A further breakdown of the assessment area shows that in the planning phase, there was need to strengthen the evaluation design and methodology. During implementation, there was weakness in project management and the report showed weaknesses in key elements of conclusions and recommendations. That the follow up and the utilisation section is weak suggests a lack of a strong plan of how findings were to be used or that the conclusions were not clearly articulated for easy application, This is consistent with the low scores seen on the section that explores the strength of conclusions and suitability of recommendations. In the context of overarching considerations, six measures of quality were scored, namely, partnership approach, free and open evaluation process, evaluation ethics, coordination and alignment, capacity development and quality control. All the elements scored below the average of 3 except for two elements. The two elements, Evaluation Ethics, Coordination and alignment scored 3.22 and 3.0 respectively.
Overall, the process of evaluation was just below average but there are lessons that can be drawn from the process. There is a demonstration of the importance of the planning phase for the whole implementation process, including utilization of results. The rigor of the analysis and report writing could be classified as average and thus requires greater attention in future. Despite the issues raised, the topic remains important for the country and needs to be addressed. Further, the evaluation provides a reference point for establishing standards that can help improve the field of monitoring and evaluation.
