Overview of peer reviews of multilateral evaluation systems and evaluations of multilateral effectiveness

Developing a methodology to evaluate multilateral effectiveness

Efforts such as multidonor evaluations of multilaterals, the work of MOPAN, and peer reviews of multilaterals’ evaluation functions have contributed information on the organisational effectiveness of multilaterals. As a number of DAC members spend a large portion of their aid budgets via multilateral institutions, there is however a growing demand for further information on the development effectiveness of these institutions.

To overcome the perceived information gap an approach is currently being developed to try to evaluate multilateral effectiveness. This approach will build on the work by MOPAN and where possible also the peer reviews of evaluation functions. Building on existing information would avoid duplication of work, evaluation fatigue and lessen the burden placed on multilaterals for information.

Peer reviews of multilateral evaluation systems

The DAC Evaluation Network and the United Nations Evaluation Group (UNEG) have joined forces to conduct peer reviews of the evaluation functions of UN organisations. These peer reviews are conducted using a framework developed by a collaborative task team of the two groups.

Since 2004 UNDP, UNICEF, World Food Programme, the Global Environmental Fund, the Office of Internal Oversight Services of the United Nations (OIOS) and the United Nations Industrial Development Organization (UNIDO) have, on a voluntary basis, been peer reviewed. See reports below.

The approach has several purposes: building greater knowledge, confidence and use of evaluation systems by management, governing bodies and others; providing a suitable way of “evaluating the evaluators”; sharing good practice, experience and mutual learning.

A peer review of the evaluation functions of an organisation is not in itself an assessment of the effectiveness of that organisation. However, it can contribute to the basis for assessing the effectiveness of the organisation, by testing the capacity and quality of the organisation’s own evaluations of effectiveness, and thus the confidence that can be placed in them.

UNEG/DAC Peer Reviews of multilateral evaluation systems - Reports

Peer Review of the Evaluation Function of the United Nations Industrial Development Organization
(UNIDO) - March 2010

“This approach has several purposes: building greater knowledge, confidence and use of evaluation systems by management, governing bodies and others; providing a suitable way of ‘evaluating the evaluators’; sharing good practice, experience and mutual learning.”

 

Peer Review of the Evaluation function of the Global Environment Facility (GEF) - 2009

The Peer Review examined the GEF evaluation function on three core criteria: independence of the GEF-EO and of its evaluation processes, credibility and utility of its evaluations. 

GEF Management Response to the UNEG-DAC Peer Review

Peer Review of the Evaluation Function of the Office of Internal Oversight Services of the United Nations (OIOS) - 2009

This report is the result of the fifth professional peer review of the evaluation function at a multilateral organization. It was carried out at the request of OIOS to the DAC Network on Evaluation. The aim of this review is to stimulate constructive peer exchange about possible improvements in the evaluation function.

Peer Review of the Evaluation Function at the World Food Programme (WFP)
2007

This report is the result of the third professional peer review of the evaluation function at a multilateral organisation. It was carried out at the request by WFP to the DAC Network on Evaluation and the UN Evaluation Group (UNEG).

Peer Review of the Evaluation Function at United Nations Children's Fund (UNICEF) -

2006

The OECD/DAC Network on Development Evaluation designed a process of peer review of the evaluation function of multilateral organizations as an alternative to costly institutional evaluations conducted by donors. UNICEF was the second pilot following a first test with UNDP.

Peer Review of the UNDP Evaluation Office

2005

Who evaluates the evaluator? Occasionally the independence, credibility and utility of evaluation are challenged both by those being evaluated and by the users of evaluation, who may often be the same.

Framework for Professional Peer Reviews

This framework was developed by a collaborative task team of UNEG and the Evaluation Network.

 

 

Other resources:

 

 


Back to current work

Top of page

Stay connected!

Members site

Members site

Horn of Africa Famine

Editor's Pick

Read the e-book

Quality standards