Resources

rss

UNICEF Impact Evaluation Series: Data Collection & Analysis

...

Impact evaluations need to go beyond assessing the size of the effects (i.e., the average impact) to identify for whom and in what ways a programme or policy has been successful. This video provides an overview of the issues involved in choosing and using data collection and analysis methods for impact evaluations. 

Impact assessment and the quest for the Holy Grail

Authors: Common Fund for Commodities, KIT
Publication date: 2014

This piece examines the prevailing thinking and trends in evaluation (specifically impact assessment), which is important for understanding how a contest of ideas has become something of a battleground in the quest for better evidence. It is particularly relevant for the many organisations, who desire methodological rigour in their evaluations and yet have to be realistic when it comes to evaluation budgets.

What methods may be used in impact evaluations of humanitarian assistance?

Authors: Puri, J. et alii.
Publication date: 2014

This paper explores the methodological options and challenges associated with collecting and generating high-quality evidence needed to answer important questions on the impact of humanitarian assistance.

Designing a Mixed-Method Impact Evaluation for a Mobile Phone Application for Nutrition Service Delivery in Indonesia

Authors: Barnett, I. et alii.
Publication date: 2014

In this mixed-methods impact evaluation case study, IDS researchers and World Vision assessed the impact of mobile phone application on growth-monitoring activities and the quality of nutrition counselling in Indonesia. This report presents the evaluation design and documents the process of choosing and developing an appropriate evaluation approach within the given contextual setting. 

Real-time Evaluations of Humanitarian Action - An ALNAP Guide

Authors: Cosgrave, J., Ramalingam, B. and Beck, T.
Publication date: 2009

This pilot guide is intended to help evaluation managers to commission and oversee, and team leaders to conduct, real-time evaluations (RTEs) of humanitarian operational responses. Drawing on a synthesis of existing good practices, it sets out a flexible approach that can be adapted to a variety of contexts.

Women as Entrepreneurs: The impact of having an independent income on women's empowerment

Authors: Haneef, C. et alii.
Publication date: 2014

Chars Livelihoods Programme (CLP) investigated the impact women’s entrepreneurship has on empowerment and the effects this has on the wider community. The objective of the research was to understand specifically the relationship women ‘having an independent income’ (one of CLP’s empowerment indicators) had with CLP’s other nine empowerment indicators.

The State of Measurement Practice in the SGB Sector

Authors: Edens, G. & Lall, S.
Publication date: 2014

This report reviews the current state of measurement in two types of organizations that directly support small and growing businesses (SGBs) – impact investors and capacity development providers. Using a mixed-methods approach, the authors collected data and interviewed over 30 organizations across these two categories, and analyzed key trends in measurement practice. 

Tool kit on gender equality results and indicators

Author: Hunt, J. (for ADB & Government of Australia)
Publication date: 2013

This tool kit aims to assist development practitioners to ensure that gender perspectives are incorporated into development initiatives, and to monitor and evaluate gender equality results. It presents a menu of gender equality outcomes, results, and indicators that may be selected or adapted by users.

Evaluation Rubrics: How to Ensure Clear and Transparent Assessment That Respects Diverse Lines of Evidence

Authors: Oakden, J.
Publication date: 2013

Independent external evaluators generally have to work within a range of constraints. Often there is less than ideal availability of time, money, or data. This article presents an example of how a team of external evaluators worked around these constraints on an evaluation in the education sector.

The World Bank: The mystery of the vanishing benefits. Ms. Speedy Analist's introduction to evaluation

Author: Ravallion, M. (for the World Bank)
Publication date: 1999

This World Bank working paper provides an entertaining introduction to the concepts and methods of impact evaluation. The paper is written from the perspective of Ms. Speedy Analist, a fictional character, who trains the readers in how to assess the impact of a social program. Doing so, the paper explains impact evaluation methods, how to use data for impact evaluation, how to form and match comparison groups, sources of bias, and so on.