Assessing bias in evaluations of lobby and advocacy: a new assessment tool for 'small n' impact evaluation with an application to sexual and reproductive health and rights
There has been a shift in global health and international development assistance towards programmes that aim to tackle the root causes of ill-health and poverty by improving the circumstances in which policy decisions are taken, including through more effective civil society lobby and advocacy (L&A). L&A programmes often aim to support complex partnerships among many actors in order to change policies or practices in a single institution like a Ministry of Health. Traditional 'large n' impact evaluation methods may therefore be neither鈥痜easible, nor meaningful if鈥痶he appropriate hypothesis is one of contribution rather than attribution.鈥疶here is a felt need among researchers, governments and NGOs for guidance on evaluation design, conduct and reporting for methods that can credibly evaluate causal claims in such circumstances.鈥
Dr Hugh Sharma Waddington and colleagues developed an assessment tool to evaluate the causal claims made in 'small n' impact evaluations using methods like contribution analysis, process tracing and outcome harvesting. The approach evaluates鈥痵ources of bias with reference to study design, conduct and reporting.鈥疶he tool was piloted in a synthesis of 32 programme evaluations of L&A programmes.鈥疍r Hugh Sharma Waddington will present the assessment tool and discuss the findings with reference to the effectiveness of support for sexual and reproductive health and rights programming.
鈥嬧婽his seminar is part of the鈥疞ondon Evidence Syntheses and Research Use Seminars鈥痵eries organised by the Centre for Evaluation at LSHTM鈥痑nd the EPPI-Centre at UCL.
Speaker
Dr Hugh Sharma Waddington, LSHTM
Admission
Contact