The sub-series contains the working files for special studies generated by the Sector and Thematic Evaluation Division (OEDST) as well as some records of its predecessor, the Agriculture and Human Development Division (OEDD1).

Much of this sub-series consists of files relating to the preparation of papers concerning NGO involvement in World Bank-Supported Projects in Mali, Kenya, Bolivia and Brazil. These papers were part of five country case studies (covering India in addition to Mali, Kenya, Bolivia and Brazil) prepared as background papers for the OED study: Nongovernmental Organizations in World Bank-Supported Projects: A Review (1998).

Other studies covered in this sub-series include: Information Infrastructure: The World Bank Group's Experience (2001); The Bank's Assistance to China's Energy Sector, An OED Country Sector Evaluation (2001); Toward Sharpening the Focus on Rural Poverty: A Review of World Bank Experience (2002); Private Sector Development in the Energy Sector: A Review of the World Bank Group's Assistance (c. 2001); The Impact of Dairying Development in India: The Bank's Contribution (c. 1997); Meeting India's Energy Needs (1978-1999): A Country Sector Review (1999); and Education in Bangladesh: A Country Sector Review (1999).

There are fragmentary files for a sub-series of health studies that are not as complete as most of the working files. Evaluation Health Projects: Lessons from the Literature was developed by the Agriculture and Human Development division (OEDD1) in l995-1997. Theother health studies were generated by OEDST, including: An Analysis of Combating Iodine Deficiency: Case Studies of China, Indonesia, and Madagascar (2001); Supporting a Healthy Transition: Lessons from Early World Bank Experience in Eastern Europe (2002); and Case Study of World Bank Activities in the Health Sector in India (1998-1999).

This sub-series also contains the working files for a 1996 OEDD1 Performance Audit Report (PAR) for the project Brazil: Science and Technology Project (Loan 2489-BR). Inaddition, there are files for The Next Ascent: An Evaluation of the Aga Khan Rural Support Program (AKRSP), 2002, which was part of a series of evaluations of AKRSP conducted by OED at the request of and with funding from the Aga Khan Foundation.

This sub-series contains records documenting departmental staff meetings which were attended by all DGO/OED managers, regular OED staff, OED consultants, and temporary OED staff. The files contain: agendas; copies of documents discussed at the meetings; paper copies made from computer-assisted presentations; and handwritten notes of the meeting proceedings.

This sub-series contains the working files of the Directors, Operations Evaluation Department (OEDDR), relating to the drafting of the 1st - 16th (1975 - 1990), and 18th - 20th (1992 - 1994) Annual Review of Evaluation Results (ARER). The content of these files varies somewhat but a typical file contains: correspondence among the OED division chiefs and among members of the Annual Review team regarding the format and content of the Review; OEDDR's correspondence with other Bank units requesting their inputfor the Review; a draft of the Review; comments on the draft from the Director-General (DGO), OED staff, and other Bank officials; OED replies to the comments; copies of the comments the DGO made to the Executive Directors at the Board meeting at which the Review was discussed; minutes of meetings of the Joint Audit Committee at which the Review was discussed; and summaries of discussions of the Review at meetings of the Joint Audit Committee and of the Executive Directors.

Filed at the beginning of the sub-series are notes of a December 1982 meeting held to discuss the publishing of OED impact evaluation reports and edited versions of the Annual Reviews for readers outside the Bank. A copy of an article from Consulting Engineer, September 1978, discussing the first Annual Review and the organization of OED is found in the file for the third Annual Review.

The sub-series contains the working files for special studies generated by the Country Policy, Industry and Finance Division (OEDD2) and its predecessor, the Policy-Based Lending, Industry, Public Utilities and Urban Sectors Division. The studies cover a range of policies, themes, sectors, and countries, including: conditionality in World Bank financed loans; privatization; women in development; free-standing technical assistance for institutional development in Sub-Saharan Africa; trade policy reforms under adjustment programs; a study of Bank/country relations covering Mexico's agriculture, industry, infrastructure, urban, and electrical and power sectors; and the 1992 study The World Bank and Pacific Island Countries: An OED Review which covered the Bank's operations in six Pacific Island member countries: Fiji, Kiribati, Solomon Islands, Tonga, Vanuatu, and Western Samoa. There is also a draft of the design paper for the FY95 country assistance review for Nigeria.

Also included are files documenting OEDD2's participation in a Bank-wide steering group on Development Aid Effectiveness and a file for the development of a policy ledger of OED recommendations, management responses, and actions for all studies discussed by the Joint Audit Committee (JAC) after July 1, 1992.

The sub-series contains the working files for special studies generated by the Agriculture and Human Development Division (OEDD1) and its predecessors: the Agriculture and Family Planning Division; the Agriculture and Human Resources Division; and the Agriculture, Infrastructure and Human Resources Division. Included are files for process, policy, and thematic studies as well as sector studies concerning agriculture, education, population, and human resources projects and issues. Specifically, reports focus on: agricultural research and education; Bank project supervision; training included in Bank financed projects; population programs; Bank lending policy for plantation crops; agriculture projects in Sub-Saharan Africa; renewable resource management issues; gender issues in Bank lending; human resource framework for Bank projects; fertility decline; Bank lending for agricultural credit and rural finance; poverty alleviation; and the Bank's experience with government sponsored land settlement with irrigation development, agricultural marketing, and rural development.

Of special note are the files regarding the Narmada Project. It appears that OEDD1 began assembling many of the Narmada materials in this sub-series in 1991 when Bank President Conable commissioned in September of that year an independent review of two Bank-funded projects, Sardar Sarovar Dam and Power Project (Credit 1552; Loan 2497) and Sardar Sarovar Water Delivery and Drainage Project (Credit 1553), referred to collectively as the Narmada Project because of the relationship of the projects to the Narmada River in India.

Included in this sub-series are working files for a small number of OEDD1 Impact Evaluation Reports (IERs) covering: an irrigation project in Sri Lanka; a settlement project in the Terres Nueves region of Senegal; a Benin agricultural project; a cotton development project in Burkina Faso, Cote d'Ivoire, and Togo; education projects in Colombia, Indonesia, and Malawi; and others. There are also files for the 1990 and 1995 Interim Evaluations of the Aga Khan Rural Support Program (AKRSP) including the second and third of a series of evaluations of AKRSP conducted by OED at the request of, and with funding from, the Aga Khan Foundation. A few files in this sub-series contain comments that OEDD1 staff provided on studies and reports generated by other Bank units or by other organizations and institutions.

Some of the files in this sub-series contain background reports, studies, and publications dated as early as 1970.

The sub-series contains the working files for three major studies which the staff of the Corporate Evaluation and Methods Department (OEDCM) either participated in or directed. The first study, authorized by the Committee on Development Effectiveness (CODE) in January 1999, was an OED review of the IDA program during the IDA-10-11 period (fiscal years 1994 - 1999) and during the first year of the IDA-12 replenishment (2000). The review, which examined IDA compliance with recommendations made by the IDA Deputies in the replenishment reports for IDA 10-12, concentrated on IDA's development contributions in six program areas (poverty reduction, social sector development, gender, environmental sustainability, private sector development, and governance) and four process reform areas (enhanced Country Assistance Strategy [CAS] design and implementation, performance-based allocations, participation, and aid coordination). The files for this study cover the period 1998 to 2003 and include intra-Bank correspondence that analyze Country Assistance Strategies and contain comments on the proposed CAS redesign and draft background reports on the six program and four process areas.

The second special study was an assessment of the implementation of the Comprehensive Development Framework (CDF), an approach to development cooperation introduced by World Bank President James D. Wolfensohn in early 1999. The evaluation study was requested by CODE late in 1999. In the fall of 2000, the Bank hosted a global multi-partner conference to discuss how the evaluation should be conducted. As a result of that meeting, a Steering Committee was established in January 2001 to guide the study process with support from a Management Group, which was co-chaired by the Director-General of OED. The Steering Committee reflected the multi-partner nature of CDF and was composed of thirty members representing CDF pilot countries, donor agencies, development agencies, a developing country business firm, and an international non-governmental organization (NGO). The evaluation process itself focused on six case study countries: five for CDF pilot countries (Bolivia, Ghana, Romania, Uganda, and Vietnam) and one from a non-CDF country (Burkina Faso). The records documenting the CDF study cover the period from 2000 to 2004 and include, in addition to the usual special studies documents: planning documents for and minutes from the meetings of the Steering Committee and the Management Group and from a planning workshop held in October 2000; progress reports regarding the evaluation process; records from two workshops held in September and November 2002 to draft the CDF synthesis report; various drafts of the approach paper and an outline for the synthesis report; and drafts of chapters from the synthesis report itself.

The third study was an OED evaluative review of aid coordination policies, procedures, and practices. As part of this study, questionnaires were sent to three groups: Bank staff and managers; recipient government officials responsible for aid coordination; and representatives of local donor organizations. In addition to the OED questionnaires, OED and the United Nations Development Programme (UNDP) jointly requested the views on aid coordination from the directors of bilateral development agencies and officials of multi-lateral development banks (MDBs). The records in this sub-series are dated 1999 and relate only to the questionnaires received from the MDBs, the bilateral development agencies, and the local donor organizations. Included are the completed questionnaires and correspondence with World Bank country directors who selected the local donor organizations and with the directors of the MDBs and bilateral development agencies. Filed with the responses from MDBs and bilateral development agencies is a copy of the January 1999 report, Aid Coordination and the Role of the World Bank: An OED Review (Phase I) which summarized the first phase of the aid coordination study.

This sub-series contains the working files of the Directors-General, Operations Evaluation (DGO), that relate to the drafting of the Annual Report on Operations Evaluation (AROE). The files generally contain: copies of the DGO's correspondence with other Bank units (the Regional units, the Sectors, the Economic Development Institute, and IFC's evaluation unit) regarding their contributions to the report; draft initiating notes and outlines for the report; notes to the OED Management Team and other intra-OED memoranda regarding the report; comments on drafts of the report; copies of the draft management response to the report; printing requests for the report; copies of the DGO's statement to the Executive Directors regarding the report; summaries of discussions of the report at meetings of the Executive Directors; and post-publication correspondence regarding the report. Files for reports generated under DGOs Kapur and Picciotto consist almost exclusively of electrostatic copies; files for DGO Rovani containoriginal documents.

This sub-series contains the working files of the Director, Operations Evaluation Department (OEDDR), documenting the drafting of the Annual Reports on Operations Evaluation (AROE) for 1983 - 1985. The files primarily contain electrostatic copies of the correspondence of Alexander F. Kirk, chief of OEDD3, the unit assigned responsibility for compiling the report. Included are: memoranda from the sectors, regions, and other Bank units containing information for possible inclusion in the reports; intra-OED memoranda regarding the content and format of the reports; drafts of the reports and comments on the drafts; copies of the statements the Director-General, Operations Evaluation (DGO), made regarding the reports to the Executive Directors; and minutes of the meetings of the Executive Directors at which the AROE and the Annual Review of Project Performance Results were discussed. Also included is information regarding the input OED provided to the Bank's Annual Report.

This sub-series contains records documenting the weekly meetings of the Departmental Management Team (DMT) which consisted of the Director of OED, the directors of the OED Departments, and some support staff. The files generally contain handwritten notes of the meeting's proceedings, meeting agenda, copies of documents discussed at the meetings, and typed minutes of the preceding meeting. The typed minutes are columnar in format and for each topic covered show a summary of the discussion, the follow-up action required, the staff member responsible for the action, and the expected date of completion for the action. The files for many of the 2002 meetings do not contain minutes.

This sub-series contains correspondence and reports of the DGO that established policies and procedures regarding OED's programs and work products. Most of the records were compiled by Robert Picciotto, but a few early files contain correspondence of Directors-General Shiv Kapur and Yves Rovani. Much of the DGO's correspondence is with the Director of OED and OED staff or with Pablo Guerrero, special advisor and assistant to the DGO. The files contain information regarding: OED procedures and criteria for reviewing Project Completion Reports (PCRs) and Implementation Completion Reports (ICRs) (under ratings and PCR review process); evaluation capacity training for OED staff, other Bank staff, and external Bank partners (under training); procedures and standards for Country Assistance Reviews (CARs) and Country Assistance Notes (CANs) (under country assistance work); OED special studies and OED impact evaluations; the format and content of new OED issuances and tools designed to disseminate lessons learned from OED's evaluation work (under Lessons & Practices, Evaluation in the World Bank [WB] booklet, Policy Ledger, and Evaluation Text Base); revisions of the Project Information Form (PIF) and instructions for using it; the disclosure and publication of evaluation results; and the PCR (and later the ICR) backlog in each region. Filed under Initial Executive Project Summaries (IEPS) are OED procedures for reviewing IEPSs for proposed operations and copies of OED comments on specific IEPSs and responses from the Regions regarding the OED comments.

Much of this sub-series consists of the DGO's copies of records from a number of working groups and task forces that affected the work of OED. Particularly extensive are the records regarding the Task Force on Evaluation Capacity Development (ECD) in Developing Countries which was established in 1992 to design mechanisms to assist member countries in enhancing their post evaluation capacities. Pablo Guerrero was the DGO/OED member on the Task Force. A file labeled PCR Task Force contains copies of records relating to three groups established to review the PCR process: 1) the Committee on the Revision of the PCR, Audit, and Pass-Through Procedures which met in 1986; 2) the Working Group on Project Completion Reports which was established in January 1988 and sent its report to the Joint Audit Committee (JAC) in January 1989; and 3) the joint OED/Operations Review Panel on Project Completion Reporting which was established in November 1990 and sent its report to JAC in June 1991. Other groups whose work is documented in these files are the Bankwide ICR Process Review Working Group, which met in 1998 to make the ICR process more efficient, effective, and timely, and the Working Group on Evaluation Dissemination, which was established in fiscal year 1994 to review the Bank's experience in incorporating evaluation results into new operations. It issued its final report in June 1996.

The files in this sub-series, compiled by the Directors of OED (OEDDR), outline the policies and procedures affecting OED programs and work products. Included in the first segment (1970 - 1994) are files concerning: the Project Completion Report / Project Performance Audit Report (PCR/PPAR) evaluation system and the pass-through procedures for PCRs that began in 1982; the dissemination and use of OED findings; the various revisions of the Procedural Guidelines for Operations Evaluation Staff and of the chapters in the Operational Manual regarding Project Completion Report / Implementation Completion Report (PCR/ICR) guidelines and project supervision in the Bank; the development and use of the Project Information Form (PIF); the development of OED's evaluation seminars; and the role of environmental issues in Bank evaluations. One file (Lessons Learnt from Project Performance Audit Reports - Agriculture) contains the OEDDR's copies of memoranda dated December 1980 to July 1986 from the Assistant Director ofthe Agriculture and Rural Development Department (AGR) to AGR division chiefs outlining the lessons learned from reviews of Agricultural PCRs and PPARs. Another file (Operations Evaluation Department - General) contains copies of key documents in the history of OED from 1970 to 1988.

Much of the second segment (1985 - 2001) contains documentation regarding the Bankwide ICR Process Review Working Group which was co-chaired by OED Director Elizabeth McCallister and was established in December 1997 to make the ICR process more efficient, effective, and timely. The records for the working group include agenda and minutes of meetings, various drafts of the group's final report, comments on the drafts, and intra-OED correspondence on the workings of the group. Other files contain: correspondence concerning changes in the PIF and instructions for completing the form; intra-OED correspondence regarding the discrepancy between OED and Regional project ratings (PPAR-Project Ratings); internal OED e-mail discussions of the ICR review process and the development of the ICR Evaluation Summary form; intra-OED correspondence regarding specific ICR reviews; draft ICR guidelines and comments on them; revisions to the OED handbook, Procedural Guidelines for Operations Evaluation Staff (Guidelines - Amendments); the drafts of a style manual standardizing the format for OED reports; and a proposal for dealing with the workflow problems associated with ICR bunching, i.e. the receipt of the majority of ICRs during the months of May, June, and July. Filed under PPAR - General is a copy of July 1995 Performance Audit Guidance, which was prepared by the OED Audit Guidance Working Group in 1995.

This sub-series contains correspondence and other records exchanged between OED staff and officials located in industrialized countries who were responsible for, or interested in, monitoring and evaluation processes. Included is correspondence with officials in the Netherlands, Germany, Canada, Australia, Sweden, Denmark, France, Japan, Saudi Arabia, Ireland, Greece, Austria, the United Kingdom, and the United States. Most of the correspondence is with the Director of OED, the Director-General, Operations Evaluation (DGO), and the DGO's advisors, Robert van der Lugt and Pablo Guerrero, who were responsible for developing evaluation capacity in member countries. The correspondence concerns: requests for information regarding OED's evaluation policies and procedures or assistance in conducting an evaluation; exchanges of evaluation methodologies; international seminars on evaluation; visits of OED staff to other countries to conduct an evaluation or to attend an evaluation conference or seminar; and visits toOED of evaluation officials from abroad. Included are copies of other countries' studies, reports, and manuals regarding evaluations and evaluation methods.

The U.S. correspondence is with officials in the U. S. Agency for International Development (AID), the General Accounting Office (GAO), and the Department of Treasury; most are copies of records that are presumably located elsewhere in OED and Bank records. The US AID correspondence primarily concerns exchanges of policy papers, studies and reports onevaluation guidelines. The GAO correspondence relates to 1977, 1981, and 1991 congressionally required GAO reviews of the independent evaluation system of the Bank and a 1996 GAO review of the overall role of the World Bank in a post-Cold War environment.

The earliest GAO file contains documents assembled by OED Director Christopher R. Willoughby in 1973 and 1974 following release of the 1973 GAO report on U.S. participation in World Bank. Included in the file are a number of documents from Bank PresidentRobert McNamara, Vice President Mohamed Shoaib, the U.S. Executive Director Charles O. Sethness, and Willoughby, discussing the audit and evaluation functions in the Bank and proposed changes in the structure and function of Operations Evaluation.

The Department of Treasury file concerns the department's 1971-1973 interest in the evaluation function of the Bank and Treasury's support of the GAO recommendation for the establishment of an independent review body to evaluate the Bank's activities.

The files in this sub-series contain documents maintained by both DGO and OEDDR, and much of the content of this series is duplicated elsewhere, especially in the files for OED studies and process reviews.

Most of the files relate to the work of OED, but some, which concern non-OED matters, contain records from other Bank units that were forwarded to the DGO/OEDDR for comment or as a result of a general distribution to high-level Bank staff. Most of the files fall under one of two general headings: 1) Management and Oversight and 2) External Affairs. The Management and Oversight files concern issues involving the President, Executive Directors, members of the Committee on Development Effectiveness (CODE), and Bank Vice Presidents. Included are: correspondence with CODE members; copies of reports from OED that went to CODE and to the Executive Directors; intra-OED correspondence regarding preparation for meetings with CODE members and the Executive Directors; OED's response to a draft of the 1996 audit of OED by the Internal Auditing Department; agenda and minutes of OVP (Operations, Vice Presidents) meetings and retreats; intra-OED correspondence regarding the DGO's comments on records and topics to be discussed at OVP meetings; correspondence with Managing Directors and copies of records to be discussed with the Directors; files documenting OED preparations for briefings and/or briefing papers provided to President Wolfensohn on his arrival at the Bank and prior to some of his overseas trips; OED's contributions to the observance of the 50th anniversary of the Bank and comments from the DGO and OED staff on draft chapters of the Brookings Institution's history of the Bank; and agenda and background documents relating to the 1995 OED management team retreats. Under Clusters are files coordinating work on a study (or a broad area of interest) assigned to a specific OED Division (i.e., OEDCM, OEDCR, and OEDST).

Under External Affairs are files concerning the DGO's and OEDDR's interaction with, or reports regarding: IFC and MIGA staff; international aid organizations; evaluation organizations; the US General Accounting Office; the World Commission on Large Dams; NGOs; the Multilateral Development Banks; the members of the DAC Expert Group on Aid Evaluation (filed under OECD-Development Assistance Committee); and other Bank units and departments. Filed under Liaison with other OED Units - OEDDR is a chronological file of correspondence, 1988 - 1996, between the DGO and OEDDR or between OEDDR and other Bank units.

The sub-series consists of the working files for special studies and evaluation reviews conducted by OED and its predecessor organization, the Operations Evaluation Unit (later Division) of the Programming and Budgeting Department, prior to the formation of sector-specific divisions in 1983. Reports include sec