Office of Operations Evaluation

Identity area

Type of entity

Authorized form of name

Office of Operations Evaluation

Parallel form(s) of name

Standardized form(s) of name according to other rules

Other form(s) of name

Identifiers for corporate bodies

Description area

Dates of existence

History

Activities related to Bank operations evaluation began prior to the origin of the Operations Evaluation Department (OED), now known as the Independent Evaluation Group (IEG). In the late 1960s, a number of project reviews in the form of formal research and ad hoc analysis were undertaken. Aspects of the Programming and Budgeting Department (P&B) also focused on project evaluation and monitoring. However, with increased Bank lending and the introduction of new program initiatives, particularly in education, population, agriculture, and rural development, the need for an independent evaluation unit became evident and was addressed by the establishment of the Operations Evaluation Unit on September 2, 1970. The Unit, consisting of five individual staff members, was temporarily placed in the Programming and Budgeting Department and was tasked with assessing the usefulness of individual projects and the effects of groups of related projects in individual countries. The Unit was converted into the Operations Evaluation Division the following year.

In order to reduce the risk of actual or perceived conflict of interest for Bank management, it was soon decided that operations evaluation should be removed from P&B and set up as a separate entity under the charge of a vice president who would have no operational responsibilities. Effective July 1, 1973, the Operations Evaluation Division became the Operations Evaluation Department (OED). The Department was placed under the Joint Bank-IFC Audit Committee (JAC), which had been created in 1970 to supervise Bank and International Finance Corporation internal and external audit arrangements. Bank Vice President Mr. Mohamed Shoaib supervised the Department and Christopher R. Willoughby was appointed the first Director of the OED.

In 1973, a related development was initiated by the Bank's Vice President, Projects, which supported the OED's mandate. This related development was the requirement for all operating departments to prepare Project Completion Reports (PCRs), also referred to as Completion Reports, as the final step in the project cycle for lending operations. In these reports, projects were assessed generally in terms of: the extent to which they met their objectives; their economic and social impact; their impact on institution building; their completeness; their compliance with loan covenants and regulated agreements; and the involvement and influence of the Bank. These reports would then be evaluated as part of OED's new responsibilities.

OED was made responsible for conducting an audit of each completed project for submission to the Bank's executive board. Operating units produced PCRs which were forwarded to the new OED for audit. OED audit of the project could then result in changes or additions to the PCR. The OED audit produced the Project Performance Audit Report (PPAR) for submission to the executive board. The PPAR provided an evaluation of the extent to which project objectives stated in the lending documents were achieved and the general effectiveness and efficiency of the lending operation. While initially all projects were to be audited by the OED, the percentage of projects given full audits would decrease over the years.

PCRs, PPARs, and other Bank study reports would also serve as the basis for different types of special evaluation studies generated by the OED, which focused on a variety of broader topics, including countries, sectors, Bank processes and policies, and broad themes as identified by management, operations staff, and OED staff.

Efforts to further institutionalize the Department's independence led to President McNamara's proposal in 1974 of a new organizational position for the Department and a new managerial head: Director-General, Operations Evaluation (DGO), with rank of vice president. In 1975, Mervyn L. Weiner was appointed by the Executive Directors as the OED's first DGO. It was determined at this time that the OED would report directly to the Board with an administrative link to the President. OED's functions at this time included:


  • making periodical assessments of the Bank's operations evaluation system;


  • carrying out performance audits of completed projects supported by the Bank;


  • encouraging member countries to establish their own operations evaluation systems;


  • assessing actions taken by the Bank in connection with OED's findings; and


  • assisting in the dissemination of evaluation findings within the Bank and the development community.

On September 26, 1975, the first Annual Review of Project Performance Audit Results was released by OED. Including audits for fifty projects, it provided a summary of PPAR results and a relatively brief but comprehensive scorecard of the performance of completed Bank-assisted projects. It also highlighted lessons, ideas, and themes identified over the previous year. The annual review would be renamed a number of times: Annual Review of Project Performance Results in 1985; Annual Review of Evaluation Results in 1989; and Annual Review of Development Effectiveness in 1997.

Another form of evaluation was undertaken by the OED in 1979. The Impact Evaluation Report (IER) was designed as a second look at a project taken about five years after its completion. It assessed the effect of the project, both intentional and unintentional, on people and the environment as well as the sustainability of the implementing organization.

As OED's responsibilities for the creation of evaluation products increased through the 1970s and into the 1980s, corresponding changes in organization and staffing occurred. The number of senior evaluation officers continued to increase. By 1981/1982 each senior evaluator was assigned a specific sector or area of responsibility (public utilities, industry, development finance companies/corporation [DFCs], structural adjustment and program loans, agriculture, education and training, transport and tourism, and policy review). In 1983, three chief evaluation officer positions were created and each was assigned sector-specific divisions. Divisions at this time were simply referredto as Division 1, Division 2, and Division 3. By November 1985, the division's assignments were reflected in division titles: Division 1, Agriculture and Human Resources; Division 2, Industry and Policy Review; and Division 3, Infrastructure and Urban Development. This arrangement remained in place through September 1987.

OED was reduced to two divisions from September 1987 to July 1991: Division 1, Agriculture, Infrastructure and Human Resources, and; Division 2, Policy-Based Lending, Industry, Public Utilities and Urban Sectors. From 1991 to May 1997 OED was again re-organized into three divisions: Agriculture and Human Development (OEDD1), Country Policy, Industry and Finance (OEDD2), and Infrastructure and Energy Division (OEDD3).

In 1994, the Committee on Development Effectiveness (CODE) was created as a standing committee of the Board of Executive Directors and would serve as a replacement for the JAC. The eight-member committee was made responsible for overseeing the operations evaluation systems ofthe Bank (IBRD and IDA) and of the IFC.

That same year, OED began to offer a new product, Country Assistance Reviews (CARs), which provided countrywide impact evaluations that concentrated on the overall impact and development effectiveness of the Bank's whole program of assistance to a country over a number of years. Country assistance evaluations represented a shift in the Bank's and OED's focus. When OED was established, the Bank was essentially dealing with investment lending, and the project was the appropriate evaluation unit to assess Bank performance. By the 1990s, the situation had changed. With the growing recognition of the importance of a country's policy environment, the Bank was giving greater attention to a whole country strategy. Country Assistance Strategies (CASs), which outlined the Bank's program in a country for the next several years, became a central focus of Bank-client dialogue. OED responded to this new country focus by shifting from the project to the country as the basic unit of evaluation.

In 1995, the IFC's Operations Evaluation Unit was reorganized as a department, the Operations Evaluation Group (OEG), to provide for increased attention to the development impact of IFC operations. In addition, OEG began to transmit its report to the Board through the DGO.

The emerging emphasis on country and thematic evaluation and renewed emphasis on evaluation capacity and knowledge dissemination resulted in another organizational restructuring in 1997. In June of that year, the Department was divided into four component parts: Corporate Evaluation and Methods (OEDCM), Country Evaluation and Regional Relations (OEDCR), Sector and Thematic Evaluation (OEDST), and Partnership and Knowledge Program (OEDPK).

In January of 2002, the World Bank Group's Multilateral Investment Guarantee Agency (MIGA) created its own evaluation office. As with the IFC's OEG, it also began transmitting reports to the Board through the OED's DGO.

In December 2005, the OED changed its official name to the Independent Evaluation Group (IEG) to better reflect its three components: the Independent Evaluation Group (Bank) (IEGB), Independent Evaluation Group (IFC) (IEGI), and Independent Evaluation Group (MIGA) (IEGM). In 2008 or later, another reorganization took place. The resultant divisions were: Public Sector Evaluation (IEGPS); Private Sector Evaluation (IEGPE); Country, Corporate Global Evaluation (IEGCC); and Strategy, Learning and Communication (IEGCS).

Places

Legal status

Functions, occupations and activities

Mandates/sources of authority

Internal structures/genealogy

General context

Relationships area

Access points area

Occupations

Control area

Authority record identifier

Institution identifier

Rules and/or conventions used

Status

Level of detail

Dates of creation, revision and deletion

Language(s)

Script(s)

Sources

Maintenance notes

  • Clipboard

  • Export

  • EAC