Workshop Program

Community services, health and education programs face particular problems in evaluating their services. Lack of resources, lack of capacity to collect outcomes data, complex programs, and (sometimes) small participant numbers all contribute to the difficulties.

This workshop will introduce two new models of evaluation which have been designed for use in these settings and which help to address some of these difficulties. The models combine realist evaluation – and particularly Pawson and Tilley's (1997) ‘formula' for program theory (‘context, mechanism, outcome') - with action research and program logic models. Examples from recent evaluations in education, health promotion and community services programs will demonstrate key points.

introduce realist action research and realist program logic models, explain key assumptions and define key terms;
explain and provide examples of the implications of the models for the role of the evaluator, for research design and for the development of quantitative and qualitative instruments;
discuss and demonstrate strategies for analysis of both qualitative and quantitative data that can be used within the models; and
provide opportunities for participants to ‘try out' certain key skills (e.g. developing realist hypotheses, identifying mechanisms in qualitative data).

Teaching and learning methods will include a combination of presentation, practical exercises and group discussion. Resources to be provided will include one reading each in realist evaluation and the two specific models, a short collation of real-world examples of program hypotheses and realist program logic models, and materials for the practical exercises to be conducted within the workshop.

The co-presenters for this workshop are the designer of the two models and the manager of a large education program who purchased, and has worked collaboratively in, an evaluation using the models.

This workshop is aimed at… Community services, health, and education staff (managers, policy and program officers, and service providers) are encouraged to attend. Graduate students in evaluation methodology and both new and experienced evaluators are very welcome.