This sixth Research Insight provides equality and diversity practitioners with a useful example of how to evaluate the impact of a programme or intervention using a repeated-measures design. Specifically, this Research Insight identifies whether Advance HE’s ‘Achieving Race Equality in Higher Education’ programme is effective in improving participants’ familiarity with terms related to race equality and their confidence in engaging with race equality.
To investigate whether attending an introductory course to race equality improved participants’ confidence and competence in engaging with race equality, the current Research Insight employed a pre- and post-intervention design (also referred to as a repeated-measures design, see our Research and Data Briefing on impact evaluation for an overview of this method). Participants consisted of staff from higher education institutions (HEIs) who attended the 2-day programme in April 2017, October 2017, March 2018 and June 2018, and completed the pre- and post-training evaluation survey.
Analyses revealed significant improvement in participants’ familiarity with seven of the ten race equality terms and concepts listed in the evaluation survey, including critical race theory, deficit approach and institutional racism. The programme was also linked to significant improvements in participants’ confidence in engaging with race equality, particularly with regard to taking action and moving forwards (eg knowing what concrete steps to take to facilitate race equality in their institution, being able to name several successful approaches to achieving race equality). Together, these improvements suggest that the programme helped make participants more able and better prepared to engage in race equality within their institution, while highlighting the strengths and weaknesses of applying a repeated-measures design to equality interventions of this type.