The sub-series contains the working files for special studies generated by the Country Evaluations and Regional Relations Division (OEDCR) as well as some records of its predecessor, the Country Policy, Industry and Finance Division (OEDD2).

• Much of this sub-series (six linear feet) consists of the 1999 - 2004 working files for the ODECR study The Gender Dimension of Bank Assistance I and II. These files include materials from the Bank gender issues workshops held in Nairobi, Delhi, Quito, and Warsaw in2000 and 2001.

• Other studies primarily concern finance, adjustment lending, civil service reform, and poverty reduction. Studies include: Civil Service Reform: A Review of World Bank Assistance (April, 1999); The World Bank and Microenterprise Finance from Concept to Practice (November, 1999); The Effectiveness of the World Bank's Poverty Reduction Strategy: An Evaluation (May, 2000); Adjustment Lending in Sub-Saharan Africa: An Update (1997); World Bank Assistance to Privatization in Developing Countries (August, 1994); Higher Impact Adjustment Lending (HIAL): Initial Evaluation (June 1999); The Impact of Public Expenditure Reviews: An Evaluation (1998); World Bank Assistance to CFA ('Communeaute Financiere Africaine'[African Financial Community]) Countries, An Evaluation of Selected Social, Economic and Regional Aspects of the Bank's Performance (2000); Financial Sector Reform: A Review of World Bank Assistance (1998); Fiscal Management in Adjustment Lending (1996); a joint 1998 OED/OEG study, An Evaluation of the Foreign Investment Advisory Service (FIAS); Implementation of Operational Directive 4.20 on Indigenous Peoples: An Independent Desk Review (2003); Legal and Judicial Reform in Europe and Central Asia (2002); Lessons for LICUS (Low Income Countries Under Stress) from OED Country Assistance Evaluations (2001 - 2004); and The Special Program of Assistance for Africa (SPA), an independent evaluation of the SPA as a mechanism to promote adjustment and development in Sub-Saharan Africa (1996 - 1998).

• The sub-series also contains incomplete background materials regarding two other studies: the Quality Assurance Group's 1996 assessment of the Argentine Convertibility Plan and OED's 1997 survey of the major participating financial institutions (PFIs) involved with the Industrial Guarantee Loan Fund (IGLF). The Argentine file primarily contains background information regarding the Convertibility Plan itself. The PFI survey file consists only of correspondence with officials at the Development Bank of thePhilippines concerning their advice regarding the design of the survey records. The survey was part of the OED evaluation of the IGLF program.

• In addition to study files, this sub-series contains files with copies of draft Bank issuances for which the OEDD2 and OEDCR staffs provided comments. Included are comments files for the Portfolio Improvement Program, proposed procedures for the Executive Directors, and Operations Manual draft chapters. The sub-series also contains a copy of the proceedings of a 1998 OED workshop on Indonesia that provided background information for a Country Assistance Review (CAR) of Indonesia.

The series primarily consists of Impact Evaluation Reports (IERs) and the working files produced during the creation of those reports. The series also consists of a number of special studies produced by the OED. IERs assess the performance of operations at full development, some five to ten years after the close of disbursements on the Bank's loan. The evaluations are selective; only a small percentage of projects undergo an impact evaluation. These evaluations provide a second look at a project by analyzing the long-term effects - intended or unintended - on people, institutions, and the physical environment. The evaluations assess projects against the goals that were stated at appraisal and also against a broad set of criteria that relate to social dynamics, income distributions, effects on women and families, institutional development, sustainability, and the environment. This series consists of IERs from the very beginning of their production in 1979 and through into the 1990s.

The content of the files for impact evaluations varies somewhat but the more complete files contain: copies of the Completion Reports, Audit Reports, and other OED-generated records relating to the project; non-Bank background reports and publications relating to the project; Terms of Reference for the OED staff members and/or consultants assigned to evaluation; drafts of the Approach Paper and Study Design Paper; memoranda and correspondence regarding the team's travel plans if a mission was required; a Back-to-Office Report regarding the mission; intra-OED correspondence regarding the format for the evaluation; various drafts of the evaluation; comments on the drafts from OED and Regional staff, officials in the client country, and representatives from other aid/lending organizations; drafts of comments by the Director-General, Operations, (DGO) to the Committee on Development Effectiveness (CODE) or its predecessor, the Joint Audit Committee (JAC) regarding evaluations; minutes of CODE or JAC meetings at which the evaluation was discussed; drafts of the DGO's transmittal memorandum to the Executive Directors and the President; and summaries of the Executive Directors' discussion of the evaluation and copies of the Board chairman's published comments. Many of the impact evaluations relied on field surveys to gather opinions of stakeholders. The raw survey data is not included in an evaluation file, but sample survey questionnaires and data derived from the surveys may be in the file.

The series contains the first IER produced by theOED, referred to as a Project Impact Evaluation Report (PIER). The report was for the Mexico Third Irrigation Project (1978 - 1979) which focused on irrigation rehabilitation programs in irrigation districts Nos. 17 (Region Lagunera) and 23 (San Juan del Ro). The evaluation was undertaken by Chief Evaluation Officer John Malone about five years after the performance audit was conducted for the project. Other early impact evaluation reports in this series are for: Kenya's First Smallholder Agricultural Credit Program (1980); the Kenya First Livestock Development Project (1981); the Roseires Irrigation Project in the Sudan (1980); the Burundi-First Arabica Coffee Improvement Project (1980); the Malaysian Muda and Kemubu Irrigation Projects (1981); the Atlantico Irrigation Project in Colombia (1982); and the San Lorenzo Irrigation and Land Settlement Projects in Peru (1982). In addition, records related to an IER conducted jointly with the National Economic and Development Authority (NEDA) and the Central Bank of the Philippines on the Philippines Second Rural Credit Project are included. The report was issued in 1983 after an extensive evaluation that involved a survey of beneficiaries in different regions. Also issued in 1983 was an IER for the Indonesia Irrigation Rehabilitation Project.

The series contains many other IERs and IER working files produced through the mid to late 1980s and 1990s. Agriculture, urban, education, transport, industry and transmigration projects are represented. Of note, one IER covers three income generating projects for refugees in Pakistan for which the Bank acted as executive agency on behalf of the United Nations High Commissioner for Refugees (UNHCR). Also contained are background materials on Indonesia that OED's Agriculture and Human Development Division (OEDD1) gathered from a wide variety of sources in preparation for a 1993 impact evaluation covering loans for three transmigration projects in Indonesia. The files include the Project Completion Reports for two of the loans (Transmigration II [L1707] and III [L 2248]) and Terms of Reference for the impact evaluation but no other documents regarding the impact evaluation.

The series also includes a number of special process and thematic studies. Reports and related working papers include: a 1987 and 1988 OED special study entitled Management of Renewable Resources in Agricultural Operations; two transport sector evaluation studies entitled The Transport Sector in Mexico: An Evaluation (1998) and Transport in China: An Evaluation of Bank Assistance (1999); a copy of a 1998 paper (The Industrial Organization of Corruption: Why Corruption Hurts More in Africa than in Asia) prepared by Sector and Thematic Evaluation Division (OEDST) staff members Antti Talvitie and Binyam Reja, based on their participation in an OED evaluation of five transport projects in Indonesia; background records for a 1996 Infrastructure and Energy Division (OEDD3) process study, Effectiveness of Environmental Assessments and National Environmental Action Plans (EA/NEAP Study), which evaluated the Bank's use of project-level environmental assessments (EAs) and highlighted the differences between countries that had an approved National Environmental Action Plan (NEAP) and those that did not; working files for the 1995 Country Policy, Industry and Finance Division (OEDD2) study The Social Impact of Adjustment Operations: An Overview; and special impact evaluation studies covering a range of agriculture topics, including Harvesting the Waters (1980s), The World Bank and Structural Adjustment in Agriculture; Reforming Agriculture: The World Bank Goes to Market, Irrigation O & M [Operation and Maintenance] and System Performance in Southeast Asia (1996), Natural Resource Management in Bolivia: 30 Years of Experience (1993), and Dynamics of Rural Development in Northeast Brazil: New Lessons from Old Project (1991), as well as one file for a special process study entitled Monitoring and Evaluation Plans in Staff Appraisal Reports Issued in Fiscal Year 1995.

Also in this series are correspondence, reports, and publications that evaluator Christian Polti gathered while OEDD1 was working on two impact evaluation studies. The first study deals with the World Bank's experience with irrigation development and examined irrigation projects in Morocco, Mexico, the Philippines, and Thailand. The second study deals with cotton development programs in Cote d'Ivoire, Burkina Faso, and Togo.

This sub-series contains reports, correspondence, and studies compiled by the Directors of OED (OEDDR). Most of the files contain comments from OED staff members and/or the director on draft documents from other Bank employees. Filed under General Comments on Review of Field Staff Benefits are OED comments on various Bank documents, 1995-1998. Key topics covered by other files include: OED staff views on the dissemination and use of OED findings (filed under Dissemination); ratings of the Narmada and Kedung Ombo Completion Reports (filed under Narmada); reports of the Joint Audit Committee Informal Subcommittee on OED Reports; a select review of OED by the Internal Auditing Department planned for 1996; plans for an OED study of NGOs; OED collaboration with the Economic Development Institute (now WBI); joint OED/Operations Policy Department reports on the quality of economic analysis in staff appraisal reports for projects approved 1993 - 1997 (filed under Economic Analysis, Econ III and Econ IV and Economic Analysis: Correspondence); a 1996 proposal for simplified project documentation for investment operations (filed under Simplified Documentation); and OED staff retreats for December 15-17, 1987, November 29-December 1, 1989, June 26-28, 1991, and September 8-10, 1993. These retreat files contain agenda and schedules, copies of documents discussed at the retreats, copies of presentations, and post-retreat evaluation forms.

Filed under Portfolio Management are: memoranda regarding funding arrangements for OED studies and on borrowers' interest in ex-post evaluations; OED staff comments on the draft Wapenhans Report and on the draft chapter concerning OED; and copies of minutes of the Task Force Steering Committee on which Eberhard Kopp served. Filed under Streamlining Bank Procedures are memoranda and correspondence Kopp compiled in 1985 and 1986 before he became OEDDR Director and while he was a member of Working Group #3 of the Task Force on Streamlining Bank Procedures.

The series consists of records related to the project monitoring and evaluation function of the Operations Evaluation Department (OED). The majority of the records in the series are final audit reports for individual, Bank-sponsored projects and records related to the creation of those reports. Reports date from the beginning of OED and its project evaluation activities in 1973. OED-authored reports include Project Performance Audit Reports (PPARs) and Performance Audit Reports (PARs). Reports completed byoperating departments and submitted to the OED include Project Completion Reports (PCRs), Project Completion Notes (PCNs), Implementation Completion Reports (ICRs), and Implementation Completion Notes (ICNs). The PCRs can be characterized as either reports that required and received an audit by the OED or as pass through PCRs which OED division chiefs determined did not require an audit. In the case of the latter, Notes of Record are sometimes included to explain why an audit was not required. The series also consists of background materials and working files created or collected during the preparation of audit reports. These records include: correspondence; memoranda; staff appraisal reports; reports and recommendations sent to the Executive Directors for approval of the loans or credits; loan or credit agreements that were executed; annotated audit drafts; project progress reports; and field notes. In some cases, working files related to audits and report preparation are those accumulated by specific evaluation officers in OED.

The types of records that accompany the final evaluation reports vary, as procedural requirements changed over the years. OED evaluating officers created files for all completion reports and audit reports for which they were assigned responsibility. Most of the pre-1982 working files containing PCRs and PPARs reflect procedures put in place by the Bank between 1973 and 1979. The time frame for completion of PCRs after final disbursements of loans / credits varied as did the extent ofthe involvement of operating departments and clients in their preparation. In the mid-1970s, the PCR was to be prepared within six months of final disbursement by the Bank's Regional Vice-Presidency of the country in which the project took place. Information for the PCR was gathered from project files, supervision reports, and discussions in the field between Bank and Government officials associated with the project. However, before 1976 the majority of the PPARs prepared by OED evaluating officers were for projects for which no PCR had been prepared.

In 1976, procedural changes required all PCRs to be sent through the Director-General, Operations Evaluation (DGO), without OED comment to the Executive Board along with the PPAR. In addition to the PCR, the PPAR working files from 1976 onward include: the Terms of Reference for the OED audit mission; the Back-to-Office Report from the mission; PPAR drafts; comments on the drafts from Bank officials in the Region, Government officials and representatives of businesses or institutions involved in the project; and copies of transmittal letters accompanying the PPAR. Loan or Credit Agreements, Staff Appraisal Reports, and Reports and Recommendations by the Bank President for loans and credits, most of which are of earlier date than the other records in the file, are included in some PCR and PPAR files. By the end of 1979, OED conducted abbreviated audit reviews for about half of the PCRs it received. The working files for these passed-through PCRs usually contain: a memorandum addressed to the Regional Vice President indicating that based on the OED review of the PCR an audit would not be performed; comments on the PCR; a final draft of the PCR sent for printing by OED; a copy of the printed PCR forwarded to the Executive Board; and copies of the transmittal letters used in the OED distribution of the printed PCR.

At the beginning of fiscal year 1983, a new system of selective project performance auditing was introduced which required that 40 to 50 percent of projects be audited. PCRs were selected for audit according to whether they were for: large, complex, or innovative projects; projects an Executive Director proposed for performance audit; projects with high lending priority; projects which were first in a given sector / sub-sector for a country or last in a series; or a series of projects subject to a combined audit. OED division chiefs were given responsibility for determining the projects to be audited and for making decisions on pass-through PCRs. Some files for projects which OED did not audit contain: a Summary Note explaining the reasons for the pass-through decision and evaluating the quality of the PCR; a copy of the draft PCR; comments regarding the draft PCR from the client country; a Pass-Through PCR Unit Cost Sheet tracking OED staff time allocated to the project; memoranda and letters transmitting a final copy of the PCR to the Executive Directors, the Bank President, and officials of the client country; and a final copy of the PCR. Found in other working files for post-fiscal year 1983 is the Note of Record, which was prepared by the OED evaluating officer after review of the PCR with the division chief. It contained the reasons for the pass-through decision. The Note of Record assessed the project as described in the PCR in terms of its objectives, scope, implementation, costs, and sustainability. It was distributed only to the Director of OED (OEDDR), the OED Library, the working file, and the OED annual review coordinator. Also found in some workingfiles with the Note of Record is the Project Information Form (PIF) used to input data about the project into OED's database for use in annual reviews and studies. Results for all PCRs were reported to the Executive Board.

New guidelines for completing PCRs were put into place effective July 1, 1989. Most of the PCRs in the OED working files after this date have a different format from earlier prepared PCRs. Parts I and II of the report were prepared by the Regional Office and Part III was completed by the client. Some working files include Project Completion Notes (PCNs) which were prepared in lieu of PCRs for projects for which: the loan was never signed by the client; the Bank withdrew the loan; disbursement was very fast or ahead of schedule; no PCR was ever completed; or for which there were no implementation issues. The decision to create the PCN was based on a review of the Staff Appraisal Report prepared before the loan or credit was granted, internal Bank memoranda, minutes of Board discussions, supervision reports, and interviews with staff. The PPAR was carried out on the basis of the recommendation for audit made by OED at the time of review of the PCR. The contents of the PPAR working file remained largely unchanged from earlier periods but some PPARS for cluster audits (i.e. audits of multiple projects) were included.

By 1994, operations staff (also called Regional staff) evaluated all completed operations for which they were responsible and OED audited a representative sample of completed operations. For last supervision missions departing after July 1, 1994, Regional staff was required to prepare an Implementation Completion Report (ICR) or Implementation Completion Note (ICN) similar to the earlier PCN. Issues encountered during implementation, achievements, and the economic rate of return, were among the factors covered in the ICR. Contributions from client agencies (whole reports or comments) were attached to the ICR. Co-financiers were invited to participate in evaluations in which they provided funding. All ICRs were to be completed within six months of the final loan / credit disbursement. By 1997, about 25 percent of completed projects were audited by OED. Like the earlier PPARs, Project Audit Reports (PARs) were field-based and incorporated the views of client countries and major stakeholders. Projects were subject to audit if they were: large and complex; innovative or had unusual features; controversial, with issues unresolved during the ICR evaluation; first in a series or expected to offer especially strong lessons; suitable to be analyzed together with similar projects; useful for providing building blocks for sector or country evaluation study; or requested by Executive Directors.

The ICR, PCR, PCN, and ICN working files for the mid-1990s and later generally contain the printed report, a PIF and control sheet, drafts of the DGO's evaluative memorandum regarding the report or note, a copy of a memorandum from OEDDR transmitting the draft evaluative memorandum to the relevant Country Director, and comments from the Bank's Regional staff on the draft. Some files contain the OED-ICR-Review-Evaluation Summary which recommended for or against an audit of the project. Projects were evaluated for outcome, sustainability, institution development, Bank performance, and client country performance based on information in the ICR and PIF. Correspondence with Regional and other Bank staff and with officials in client countries regarding their comments on the draft report can also be found in the files. Some files contain copies of intra-OED electronic messages commenting on the draft evaluative summary and on the review process. A few of the files contain background documents records such as Staff Appraisal Reports (as was the case for PCR files for earlier periods).

In addition to draft and final copies of the reports, the PAR files for this period typically include: Initiating Memoranda; Terms of Reference (TOR) addressed to OED evaluators designated to travel to the field to conduct the audit; letters to Government officials and others related to the project announcing the mission to develop the report; Back-to-Office Reports from the audit mission; and comments on the draft audit report. Comments from the OED audit panel and an Audit Panel Review form can be found in some files along with drafts of the DGO's evaluative memorandum, a PIF and cover sheet, and copies of letters transmitting the final printed copy of the PAR to officials in the client country. Some of the PAR files contain copies of related background materials such as the Staff Appraisal Report and the Loan Agreement.

The review and audit activities of regional operations and the OED were conducted for the projects of all sectors. These include:

*Education- Primary; secondary; tertiary; vocational; technical

• Health and nutrition Specific disease and HIV/AIDS prevention and management; population projects

• Water Sewarage and drainage; sanitation; water supply; water pollution control; flood control

• Agriculture Commodity production; livestock development; fisheries development; research; support services; marketing

• Human resources Extension and training; social sector management; science and technology

• Rural development Rural roads; rural electrification

• Urban development Urban engineering; air pollution; urban management

• Telecommunications General sector

• Energy and power Power generation; refinery engineering; energy efficiency; oil field development; gas transport and distribution; oil, thermal, and gas exploration and development; pipeline rehabilitation

• Transport Navigation; railways; highways; rural roads; aviation; ports

• Finance and trade Private sector finance projects; financial rehabilitation projects; economic management and public enterprise; technology development projects; small and medium enterprise projects; development banks; export development; shipping; imports program; debt and debt service

• Industry Foundry modernization; small-scale industry; fertilizer production; mining and other extractive sector projects; pulp and paper engineering; public enterprise assistance; natural resource management; forestry; off-shore development

• Infrastructure Housing; construction projects

• Reconstruction and emergency Earthquake and flood recovery; drought relief

• Tourism General sector

• Structural adjustment Public sector reform loans; adjustment loans and credits; trade policy adjustment

• Client capacity building Technical assistance loans; central government administration projects; planning support

Evaluations of non-sector and multi-sector projects are also included.

The series also consists of evaluative reports and related materials created by OED staff that are not PARs or PPARs and are not related specifically to individual projects. These include: staff appraisal reports initially developed for the projects; reports and recommendations sent to the Executive Directors for approval of the loans or credits; materials related to a study by Carl Jayarajah entitled Overview Study: World Bank Support for Small and Medium Industry; a draft of correspondence related to a proposed Review of Lessons Learned in Railway Projects (RLLRP) for the OED Lessons & Practices publication; an approach paper, drafts, and background materials for Review of the World Bank Experience with Electric Power Generating Facilities (1985); a draft study outline, Terms of Reference, and supporting materials for the 1987 - 1989 study Columbia: An Evaluation of Bank Lending to the Colombia Power Sector between 1970 and 1986 along with the March 1991 final study report; the approach paper and draft of the 1988 - 1989 country case study World Bank Support for Rural Roads Maintenance - Philippine Case Study; a draft of Senior Evaluator Jan de Weille's March 1992 report Annual Review, Project Performance Results for 1991 - Transport; the approach paper and drafts of the June 30, 1994, grey cover sector review (Report 13291) Rural Electrification in Asia: A Review of Bank Experience; records related to a study of the Bank's involvement in Mexico's power sector over four decades; background materials for Study of Adjustment Lending in Sub-Saharan Africa (Oct. 1996 - July 1997) including an approach paper, preliminary draft, draft speech prepared for the Director-General, Operations Evaluation, and copies of related reports; the report Case Study of World Bank Activities in the Health Sector in Mali accompanied by a memorandum from OEDST inviting the DGO and other OED personnel to a meeting review regarding the study; working files of evaluator Basil Coukis which include annotated copies of PCRs and PPARs as well as background materials such as loan guarantee agreements, staff appraisal reports developed for loan or credit applications, progress reports, background correspondence, and field notes used in the preparation of evaluations; and two reports concerning trade policy reform for Mexico, Mexico: Trade Policy Reform, World Bank's Support for Trade Liberalization Program by Yalcin M. Baran (Sept. 15, 1989) and Overview Study: World Support for Small and Medium Industry issued by the Projects Department of Latin America and the Caribbean Regional Office (June 24, 1986). Finally, the series consists of records related to the OED's problematic review of the Thirteenth Indian Railway Project (Credit 582-IN). The files contain the April 1979 PCR, various versions (dating from 1981 to 1986) of the PPAR, and correspondence regarding the project. The first and the subsequent draft PPARs for this project were controversial and found to be inadequate for various reasons. The controversy led President Clausen to appoint a special audit team for the Railway Project and to request a reevaluation of OED internal procedures. Materials related to the subsequent review as well as to the OED evaluation are included; the latter includes: intra-OED correspondence; correspondence with Transportation Department staff, the South Asia Regional Office, and Indian government officials; and minutes of a Joint Audit Committee meeting and Executive Directors' meeting.