Mostrar 8535 resultados

Descrição arquivística
Records of the Office of Operations Evaluation
Previsualizar a impressão Ver:

1 resultados com objetos digitais Mostrar resultados com objetos digitais

Agenda, Minutes, and Other Records of Weekly Departmental Management Team Meetings

This sub-series contains records documenting the weekly meetings of the Departmental Management Team (DMT) which consisted of the Director of OED, the directors of the OED Departments, and some support staff. The files generally contain handwritten notes of the meeting's proceedings, meeting agenda, copies of documents discussed at the meetings, and typed minutes of the preceding meeting. The typed minutes are columnar in format and for each topic covered show a summary of the discussion, the follow-up action required, the staff member responsible for the action, and the expected date of completion for the action. The files for many of the 2002 meetings do not contain minutes.

Subject Files of Directors-General, Operations Evaluation, Relating to Policies and Procedures Affecting OED Programs

This sub-series contains correspondence and reports of the DGO that established policies and procedures regarding OED's programs and work products. Most of the records were compiled by Robert Picciotto, but a few early files contain correspondence of Directors-General Shiv Kapur and Yves Rovani. Much of the DGO's correspondence is with the Director of OED and OED staff or with Pablo Guerrero, special advisor and assistant to the DGO. The files contain information regarding: OED procedures and criteria for reviewing Project Completion Reports (PCRs) and Implementation Completion Reports (ICRs) (under ratings and PCR review process); evaluation capacity training for OED staff, other Bank staff, and external Bank partners (under training); procedures and standards for Country Assistance Reviews (CARs) and Country Assistance Notes (CANs) (under country assistance work); OED special studies and OED impact evaluations; the format and content of new OED issuances and tools designed to disseminate lessons learned from OED's evaluation work (under Lessons & Practices, Evaluation in the World Bank [WB] booklet, Policy Ledger, and Evaluation Text Base); revisions of the Project Information Form (PIF) and instructions for using it; the disclosure and publication of evaluation results; and the PCR (and later the ICR) backlog in each region. Filed under Initial Executive Project Summaries (IEPS) are OED procedures for reviewing IEPSs for proposed operations and copies of OED comments on specific IEPSs and responses from the Regions regarding the OED comments.

Much of this sub-series consists of the DGO's copies of records from a number of working groups and task forces that affected the work of OED. Particularly extensive are the records regarding the Task Force on Evaluation Capacity Development (ECD) in Developing Countries which was established in 1992 to design mechanisms to assist member countries in enhancing their post evaluation capacities. Pablo Guerrero was the DGO/OED member on the Task Force. A file labeled PCR Task Force contains copies of records relating to three groups established to review the PCR process: 1) the Committee on the Revision of the PCR, Audit, and Pass-Through Procedures which met in 1986; 2) the Working Group on Project Completion Reports which was established in January 1988 and sent its report to the Joint Audit Committee (JAC) in January 1989; and 3) the joint OED/Operations Review Panel on Project Completion Reporting which was established in November 1990 and sent its report to JAC in June 1991. Other groups whose work is documented in these files are the Bankwide ICR Process Review Working Group, which met in 1998 to make the ICR process more efficient, effective, and timely, and the Working Group on Evaluation Dissemination, which was established in fiscal year 1994 to review the Bank's experience in incorporating evaluation results into new operations. It issued its final report in June 1996.

Subject Files of the OED Directors (OEDDR) Relating to Policies and Procedures Affecting OED Programs

The files in this sub-series, compiled by the Directors of OED (OEDDR), outline the policies and procedures affecting OED programs and work products. Included in the first segment (1970 - 1994) are files concerning: the Project Completion Report / Project Performance Audit Report (PCR/PPAR) evaluation system and the pass-through procedures for PCRs that began in 1982; the dissemination and use of OED findings; the various revisions of the Procedural Guidelines for Operations Evaluation Staff and of the chapters in the Operational Manual regarding Project Completion Report / Implementation Completion Report (PCR/ICR) guidelines and project supervision in the Bank; the development and use of the Project Information Form (PIF); the development of OED's evaluation seminars; and the role of environmental issues in Bank evaluations. One file (Lessons Learnt from Project Performance Audit Reports - Agriculture) contains the OEDDR's copies of memoranda dated December 1980 to July 1986 from the Assistant Director ofthe Agriculture and Rural Development Department (AGR) to AGR division chiefs outlining the lessons learned from reviews of Agricultural PCRs and PPARs. Another file (Operations Evaluation Department - General) contains copies of key documents in the history of OED from 1970 to 1988.

Much of the second segment (1985 - 2001) contains documentation regarding the Bankwide ICR Process Review Working Group which was co-chaired by OED Director Elizabeth McCallister and was established in December 1997 to make the ICR process more efficient, effective, and timely. The records for the working group include agenda and minutes of meetings, various drafts of the group's final report, comments on the drafts, and intra-OED correspondence on the workings of the group. Other files contain: correspondence concerning changes in the PIF and instructions for completing the form; intra-OED correspondence regarding the discrepancy between OED and Regional project ratings (PPAR-Project Ratings); internal OED e-mail discussions of the ICR review process and the development of the ICR Evaluation Summary form; intra-OED correspondence regarding specific ICR reviews; draft ICR guidelines and comments on them; revisions to the OED handbook, Procedural Guidelines for Operations Evaluation Staff (Guidelines - Amendments); the drafts of a style manual standardizing the format for OED reports; and a proposal for dealing with the workflow problems associated with ICR bunching, i.e. the receipt of the majority of ICRs during the months of May, June, and July. Filed under PPAR - General is a copy of July 1995 Performance Audit Guidance, which was prepared by the OED Audit Guidance Working Group in 1995.

Records of the Director, Country Policy, Industry and Finance Division (OEDD2)

The series consists of records created and received by the Director of OED's Country Policy, Industry and Finance Division (OEDD2). Records relate to Initial Executive Project Summaries (IEPS), adjustment lending, and other aspects of OEDD2's work. A very small number of records were added to the files by the Sector and Thematic Evaluation (OEDST) and Country Evaluation and Regional Relations (OEDCR) Divisions.

The series includes records containing comments that OEDD2 staff made on Initial Executive Project Summaries (IEPS) and on other project-related records generated by the Regions, including Final Executive Project Summaries (FEPS), Initiating Memoranda (IM), and Project Concept Documents. The record on which the comments were made is not always in the file, but in some cases the file does contain minutes from the OEDD2 staff review meeting at which the record was discussed.

Also contained in this series are files relating to adjustment lending. These include: copies of papers presented on various aspects of adjustment lending; memos on issues to be covered in adjustment audits; copies of statements made before the Board on structural adjustment lending; and memos on performance indicators for adjustment lending. Also included are background files for the FY 93 OED study of adjustment lending in Sub-Saharan Africa and the FY 96 OED report on The Social Impact of Adjustment Lending.

Also part of the series is OED's response to an Upstream Activities initiative encouraged by Bank President Wolfensohn toexpand OED's real time involvement in initial executive project summaries (IEPS) and initiating memoranda (IMs) for adjustment lending.

The series also includes files documenting activities associated with annual reviews and major studies undertaken by OEDD2 primarily between the years 1992 and 1996. A file containing records used in the 1991 annual review of performance results of 49 transport projects evaluated by OED and a file containing planning documents and drafts of the 1995 study of industrial restructuring are contained in the series. Also part of the series is files created to document activities associated with country assistance and other reviews. Files related to studies on OED methodology and procedures, conferences and seminars in which OED participated, and OED replies to studies and reports prepared in other Bank units are also included.

The series also includes project performance files containing draft and printed copies of a series of sectoral and project performance indicators study reports. This series of reports was developed as part of follow-up to the November 1992 Wappenhans Report (Report of the Task Force on Portfolio Management). Audit files were created for copies of comments received in OEDD2 in 1995 from reviewers of evaluative memoranda for Implementation Completion Reports (ICRs) and Performance Audit Reports (PARs) prepared in the division. These copies were retained as part of an initiative to incorporate findings or issues raised in the comments into divisional ledgers.

Chronological Files of Directors-General Mervyn L. Weiner and Shiv S. Kapur

This series contains the chronological files of Mervyn L. Weiner for May 4,1982 to June 11,1984 and of Shiv. S. Kapur for June 27,1984 to February 28,1986. Weiner's file consists of: carbon copies of the letters,memoranda,and telex messages he sent to officials in aid organizations and in development banks,evaluation officials in other organizations,President Clausen,the Bank's regional vice presidents,OED staff,staff in the Bank's Personnel Management Department,and job applicants. Most of his file consists of: courtesy correspondence such as replies to invitations to speak; thank you notes for articles and books received; memoranda regarding travel plans and arrangements; post-travel notes to officials in host countries; notes to friends and colleagues regarding his retirement plans; and replies to inquiries regarding employment in OED or requests for OED publications. Some are more substantive and include proposed speech material for President Clausen,comments on OED draft reports,memoranda regarding OED staffing issues,and letters to Bank country directors regarding his observations from a recent trip.

Kapur's file consists of electrostatic copies of his letters,memoranda,and telex messages sent to OED staff,evaluation officers in other organizations and countries,officials in client countries,regional Bank staff,and job applicants. Much of his correspondence is substantive and includes: copies of his oral presentations to the Joint Audit Committee and to the Executive Directors; his comments on draft OEDproducts; and memoranda regarding arrangements for OED seminars,the OED work program and budget,and OED personnel issues. The remainder of his correspondence is routine in nature and concerns requests for Bank publications or employment,his annual leave plans,or his appreciation for assistance while on official travel.

Files of the Directors-General, Operations Evaluation, Documenting Relations with United Nations Organizations

This series consists of records that document the Director-General's coordination with units and personnel within the United Nations (UN) that were responsible for evaluations. The correspondence in the files is primarily between UN evaluation personnel and the Director-General or his special advisors, and it concerns evaluation methodology and strategy, an exchange of evaluation personnel between the institutions, joint Bank and UN evaluation efforts, and funding for evaluations. Among the files for the United Nations Development Programme (UNDP) are reports, correspondence, and minutes of meetings of the Inter-Agency Working Group on Evaluation (IAWG), which was established in January 1984 to provide a forum for discussion of evaluation issues by the UNDP and the executing agency partners and to promote simplification and harmonization of evaluation reporting practices among the UNDP and the executing agencies. An advisor to the DGO was a member of the Group. The files also contain UN publications and reports regarding evaluation methods and procedures or specific evaluations.

Director-General Robert Picciotto's Working Files for OED Studies, Reports, and Reviews

This series contains the working files that Director-General Robert Picciotto and his assistant, Pablo Guerrero, maintained for OED's special evaluation studies, Annual Reviews (known as the Annual Review of Evaluation Results [ARER] until 1997 when they became the Annual Review of Development Effectiveness [ARDE]), impact evaluation reports, annual Process Reviews of Annual Reports on Portfolio Performance (ARPP), Country Assistance Reviews, and Country Assistance Notes. Also included are files for OED'sannual policy ledgers which compiled OED recommendations from its reports and management responses to those recommendations. Most of the documents in these files are presumably duplicated elsewhere among the OED records relating to Annual Reviews and to the creation of evaluation products, but many of the intra-OED memoranda and e-mail exchanges are originals, and a number of the documents are heavily annotated by DGO Picciotto. The records in the files relating to OED's 1993 - 1997 annual ARPPs are uniqueto this series.

The files on any given OED product generally contain: multiple drafts of the study, report, or review; intra-OED correspondence and e-mail exchanges; minutes of meetings of the Committee on Development Effectiveness (CODE) and of the Executive Directors at which the product was discussed; drafts of management responses to the OED product; comments on draft and final versions of the product; copies of OED presentation slides, agenda, and other documents from OED workshops related to a study; and clippings regarding OED issuances and Bank policies. Files for evaluation studies may also contain Terms of Reference for consultants assigned to the study, initiating memoranda, design and approach papers, and a copy of the printed study.

Files of the Directors-General, Operations Evaluation, Documenting the Early History of OED

This series consists of files compiled by the Director-General containing his copies of reports and correspondence documenting the early history of the Operations Evaluation Department. Filed under Operations Evaluation History are copies of documents dated 1969 - 1974 that established the evaluation function in the Bank and the responsibilities of the OED and the Director-General. Included are copies of the DGO's correspondence with President Robert McNamara, the President's memoranda and circulars regarding OED and the evaluation function, and a 1974 General Accounting Office (GAO) proposal regarding Operations Evaluation. Filed under GAO Audits are copies compiled in June 1973 of documents dated 1967, 1969, and 1973 regarding audits of several international and government institutions in response to a bill to revise the functions of the Comptroller General of the U.S (the head of GAO). Filed under U.S. Congressional Staff Report on International Finance Institutions (IFIs) and DGO's Commentary are copies of documents dated 1975 - 1981 regarding a 1979 investigation of International Finance Institutions by the U.S. House Committee on Appropriations. DGO Mervyn L. Weiner reviewed a draft of the investigative report and prepared the Bank's response. That file also includes a 1981 GAO review of operations evaluation in the World Bank and Weiner's response to recommendations from that review. A file labeled OED 50: 'Learning About Development - Major Evaluation Findings' contains the DGO's copy of the draft of abooklet on OED prepared in connection with the Bank's 50th anniversary and OED's 20th anniversary. Filed with the draft are background materials used by Stokes Tolbert, one of the two consultants who drafted the booklet. Filed under Operation and Impact of the Bank's Evaluation System are various drafts of the 1989 OED booklet, Improving the World Bank's Performance: the Role of Operations Evaluation. Also in that file are copies of the Operational Directives chapters that concerned OED and copies of OED staff and DGO memoranda, articles, and presentations about OED and the Bank's evaluation system, 1975 - 1989.

Records of the Directors-General, Operations Evaluation, Regarding the Evaluation Capacity Development Program

This series contains correspondence and other documents regarding: the development of monitoring and evaluation systems in member countries; the evaluation of specific Bank-funded projects; and the formal Evaluation Capability Development Program (ECDP), which was established in OED in 1987 and was renamed the Evaluation Capacity Development Program in 1993. The main tasks of ECDP were to: strengthen networks of evaluators in developing countries; assess countries' interest in evaluation and their evaluation capacity-building requirements; organize evaluation seminars and workshops; provide short-term training within OED for client staff; and organize pilot programs in a small number of countries. The files generally contain: correspondence; reports from evaluation missions; Terms of Reference for special studies or missions regarding project evaluations; studies, reports, and articles regarding ex-post evaluations or evaluation capabilities; agenda and other planning documents for monitoring and evaluation seminars and workshops; and schedules and other records regarding visits of staff from client countries to OED for monitoring and evaluation training. Of special note is the extensive documentation filed under India: Narmada which OED compiled while working on an evaluation of the Narmada project. Most of the correspondence in the series is with the Director-General or with Robert van der Lugt and Pablo Guerrero, the two special advisors who coordinated ECDP within OED.

Correspondence of the Directors-General with the International Finance Corporation (IFC)

The series consists of correspondence primarily between DGO Yves Rovani and IFC Chief Evaluation Officer Walter I. Cohn, and relates to the DGO's responsibility for oversight of IFC's operations evaluation activities. An Operations Evalution Unit (OEU) was established within the Development Department of IFC in 1984. Included are drafts of IFC operations evaluation work programs for fiscal years 1986-1993 forwarded by Cohn to Rovani and to his successor Robert Picciotto for review and comment. Accompanying many of the work programs are proposals for special studies. Draft approach papers for those studies, also forwarded to DGO for review, include those prepared for the following studies: IFC's experience in the tourism sector (1989); performance of IFC's oil and gas exploration program (1991); successful IFC investments in Sub-Saharan Africa (1991); lending for industrial technology development (1992); IFC's market assessments (1992); and IFC's experience in the privatization of State-owned enterprises (1992). Comments prepared by the Country Policy, Industry and Finance Division (OEDD2) on some of the approach papers are included.

Also among the correspondence are comments from the DGOs to Cohn on OEU work programs and use of resources along with notes from the first meeting (July 16, 1986) at which the role of DGO in operations evaluation in IFC was discussed. Also included are: minutes of special meetings of the Portfolio Committee at which IFC evaluation studies were discussed; a list of IFC project completion reports for fiscal year 1982 to fiscal year 1986; a copy of a May 20, 1987, memo distributed to all IFC high level staff on new procedures for project completion reports; and Cohn's February 21, 1991, memorandum copied to Rovani in which he responds extensively to issues raised at an earlier Joint Audit Committee (JAC) Sub-Committee on Operations Evaluation meeting regarding IFC's evaluation capacity, IFC evaluation work, and the relationship between IFC and DGO and OED. In this memo he also responds to issues surrounding a report prepared by OEU on IFC's experience in the agricultural production sector.

A small amount of miscellaneous correspondence arranged by subject (1983 - 1995) includes: formal and informal memoranda and other correspondence between the Director, OEU, Walter I. Cohn and DGO's Mervyn Weiner, Yves Rovani, and Robert Picciotto; approach papers for studies forwarded for approval to DGO before being sent to the JAC, copies of IFC policy papers, and draft IFC evaluation reports, workprograms, and budgets. Also included are an Annual Portfolio Evaluation Report for FY 1983 and an updated mandate statement for evaluation in the Bank and IFC that reflects findings of the March 1995 report of the review of evaluation in IFC.

Subject files (1980 - 1995) found with the correspondence include the report of IFC's first evaluation of a segment of its portfolio of investments, IFC Hotel Portfolio Review, forwarded by DGO Mervyn Wiener to the Joint Audit Committee (JAC) for review on May 11, 1981. Also included are reports of IFC evaluations in the agricultural, mining, and petrochemical sectors completed between 1983 and 1994 and in the cement and textile industries sectors between 1983 and 1989. There are also files containing correspondence and reports relating to: evaluations of successful investments in Sub-Saharan Africa (1994); support for small and medium scale enterprises (1995); investment assessments performed by OED (1992 - 1994); IFC's Five Year Program for fiscal years 1985 - 1989; and the review of evaluation in IFC (1994 - 1995).

A small amount of miscellaneous IFC and OEU reports (1979 - 1989), some of which are annotated, forwarded to DGOs Mervyn Weiner, Yves Rovani, and Robert Picciotto are in the series. A number of these reports were distributed to the Board of Directors including three confidential Project Completion Reports (PCRs) on three IFC investments in Guatemala (1979), Brazil (1979), and Indonesia (1979). These three reports were distributed in January 1980 to the Board based on a decision made at an October 30, 1979, Board meeting. Each director was to receive a copy to indicate the type of PCR IFC had been preparing and to illustrate why caution was necessary when disseminating information contained in the reports. Other IFC reports included are: Annual Portfolio Evaluation Reports for fiscal years 1984 and 1986 - 1988; a report entitled Deterioration in IFC's Portfolio: An Analysis (March 1985); and a report prepared by a consultant entitled IFC in Sub-Saharan Africa, Proposals for a New Approach (February 1987).

Publications

This series contains documentation regarding the drafting and publication of booklets aimed at explaining the evaluation function in the World Bank to non-Bank audiences. The early editions of this booklet were titled Operation Evaluation: World Bank Standards and Procedures. By 1993, the title had changed to Assessing Development Effectiveness: Evaluation in the World Bank and the International Finance Corporation.

The sub-series contains records documenting the drafting and publication of the booklets. Included are: intra-OED correspondence; multiple drafts of the booklets; comments on the drafts; and agenda, minutes, and summaries of meetings of the Joint Audit Committee and of the Board of Executive Directors at which drafts were discussed. The sub-series also contains draft and/or published copies (in English and French) of various booklet editions (1976, 1979, 1984 [draft only], 1993).

Infrastructure and Energy Division (OEDD3) special evaluation studies working files

The sub-series contains the working files for special studies generated by the Infrastructure and Energy Division (OEDD3) and the files of staff members Basil P. Coukis and Andres Liebenthal who worked on special studies while in OEDD3. Most of the special studies files are dated 1991 - 1993 and concern the study, The World Bank and Sub-Saharan Africa: An OED Review of Bank Assistance for Transport Corridors. Also included are: files for OEDD3's contribution to the Bank/Mexico Relations Study, a country relationship study completed in fiscal year 1994; a final copy of the OEDD3 report Rural Roads Maintenance - Review of Completed World Bank Operations (June 1992); and a March 1993 facsimile message from Senior Evaluator Jan de Weille to the Resident Mission in Jakarta, Indonesia, concerning de Weille's forthcoming mission to conduct an audit for an impact study of the Tanjung Priok Port project (Loan 13337).

The Coukis files concern four special OED studies on which Coukis worked from 1987 to 1993: the Senegal Country Study; a review of World Bank lending for natural gas; the Sub-Saharan Africa Transport Corridors study; and a review of World Bank experience in the Education Sector in which Coukis worked when he was in the Agriculture and Human Relations Division (OEDD1). The Coukis files also contain copies of a Project Performance Audit Report, Staff Appraisal Reports, and published articles dated as early as 1983.

The Liebenthal files primarily contain correspondence and e-mail exchanges dated 1996 - 1999concerning Liebenthal's role as the Task Manager for the August 1996 OED desk assessment of fifty Bank-financed large dams, The World Bank's Experience with Large Dams: A Preliminary Review of Impacts. The correspondence is with OED and other Bank staff, staff of the World Conservation Union (IUCN), and representatives of major stakeholder groups in the global large dams debate. Correspondence contains: comments regarding the 1996 OED large dams assessment; planning for and response to the April 11-12, 1997, international workshop on the Future of Large Dams co-hosted by the World Bank and the World Conservation Union in IUCN headquarters in Gland, Switzerland; comments on publications by Patrick McCully, the Campaigns Director of the International Rivers Network; and Bank/IUCN efforts to establish the International Commission of Experts on Large Dams (ICELD) to provide an independent review of the economic and technical performance of large dams. Some of Liebenthal's correspondence concerning his OEDD3 workon dams was sent after his assignment to the Sector and Thematic Evaluations Division (OEDST).

The Liebenthal files also contain a number of published articles and studies dated 1985 - 1995 and relating to dams. Included are: a copy of the August 1996 OED assessment; a copy of Silenced Rivers and Damming the Rivers: The World Bank's Lending for Large Dams both by Patrick McCully; and a compilation of documents provided as background material for the attendees of the April 1997 workshop in Switzerland.

Subject Files of the Directors, Operations Evaluation

This sub-series contains reports, correspondence, and studies compiled by the Directors of OED (OEDDR). Most of the files contain comments from OED staff members and/or the director on draft documents from other Bank employees. Filed under General Comments on Review of Field Staff Benefits are OED comments on various Bank documents, 1995-1998. Key topics covered by other files include: OED staff views on the dissemination and use of OED findings (filed under Dissemination); ratings of the Narmada and Kedung Ombo Completion Reports (filed under Narmada); reports of the Joint Audit Committee Informal Subcommittee on OED Reports; a select review of OED by the Internal Auditing Department planned for 1996; plans for an OED study of NGOs; OED collaboration with the Economic Development Institute (now WBI); joint OED/Operations Policy Department reports on the quality of economic analysis in staff appraisal reports for projects approved 1993 - 1997 (filed under Economic Analysis, Econ III and Econ IV and Economic Analysis: Correspondence); a 1996 proposal for simplified project documentation for investment operations (filed under Simplified Documentation); and OED staff retreats for December 15-17, 1987, November 29-December 1, 1989, June 26-28, 1991, and September 8-10, 1993. These retreat files contain agenda and schedules, copies of documents discussed at the retreats, copies of presentations, and post-retreat evaluation forms.

Filed under Portfolio Management are: memoranda regarding funding arrangements for OED studies and on borrowers' interest in ex-post evaluations; OED staff comments on the draft Wapenhans Report and on the draft chapter concerning OED; and copies of minutes of the Task Force Steering Committee on which Eberhard Kopp served. Filed under Streamlining Bank Procedures are memoranda and correspondence Kopp compiled in 1985 and 1986 before he became OEDDR Director and while he was a member of Working Group #3 of the Task Force on Streamlining Bank Procedures.

Completion Reports and Audit Reports

The series consists of records related to the project monitoring and evaluation function of the Operations Evaluation Department (OED). The majority of the records in the series are final audit reports for individual, Bank-sponsored projects and records related to the creation of those reports. Reports date from the beginning of OED and its project evaluation activities in 1973. OED-authored reports include Project Performance Audit Reports (PPARs) and Performance Audit Reports (PARs). Reports completed byoperating departments and submitted to the OED include Project Completion Reports (PCRs), Project Completion Notes (PCNs), Implementation Completion Reports (ICRs), and Implementation Completion Notes (ICNs). The PCRs can be characterized as either reports that required and received an audit by the OED or as pass through PCRs which OED division chiefs determined did not require an audit. In the case of the latter, Notes of Record are sometimes included to explain why an audit was not required. The series also consists of background materials and working files created or collected during the preparation of audit reports. These records include: correspondence; memoranda; staff appraisal reports; reports and recommendations sent to the Executive Directors for approval of the loans or credits; loan or credit agreements that were executed; annotated audit drafts; project progress reports; and field notes. In some cases, working files related to audits and report preparation are those accumulated by specific evaluation officers in OED.

The types of records that accompany the final evaluation reports vary, as procedural requirements changed over the years. OED evaluating officers created files for all completion reports and audit reports for which they were assigned responsibility. Most of the pre-1982 working files containing PCRs and PPARs reflect procedures put in place by the Bank between 1973 and 1979. The time frame for completion of PCRs after final disbursements of loans / credits varied as did the extent ofthe involvement of operating departments and clients in their preparation. In the mid-1970s, the PCR was to be prepared within six months of final disbursement by the Bank's Regional Vice-Presidency of the country in which the project took place. Information for the PCR was gathered from project files, supervision reports, and discussions in the field between Bank and Government officials associated with the project. However, before 1976 the majority of the PPARs prepared by OED evaluating officers were for projects for which no PCR had been prepared.

In 1976, procedural changes required all PCRs to be sent through the Director-General, Operations Evaluation (DGO), without OED comment to the Executive Board along with the PPAR. In addition to the PCR, the PPAR working files from 1976 onward include: the Terms of Reference for the OED audit mission; the Back-to-Office Report from the mission; PPAR drafts; comments on the drafts from Bank officials in the Region, Government officials and representatives of businesses or institutions involved in the project; and copies of transmittal letters accompanying the PPAR. Loan or Credit Agreements, Staff Appraisal Reports, and Reports and Recommendations by the Bank President for loans and credits, most of which are of earlier date than the other records in the file, are included in some PCR and PPAR files. By the end of 1979, OED conducted abbreviated audit reviews for about half of the PCRs it received. The working files for these passed-through PCRs usually contain: a memorandum addressed to the Regional Vice President indicating that based on the OED review of the PCR an audit would not be performed; comments on the PCR; a final draft of the PCR sent for printing by OED; a copy of the printed PCR forwarded to the Executive Board; and copies of the transmittal letters used in the OED distribution of the printed PCR.

At the beginning of fiscal year 1983, a new system of selective project performance auditing was introduced which required that 40 to 50 percent of projects be audited. PCRs were selected for audit according to whether they were for: large, complex, or innovative projects; projects an Executive Director proposed for performance audit; projects with high lending priority; projects which were first in a given sector / sub-sector for a country or last in a series; or a series of projects subject to a combined audit. OED division chiefs were given responsibility for determining the projects to be audited and for making decisions on pass-through PCRs. Some files for projects which OED did not audit contain: a Summary Note explaining the reasons for the pass-through decision and evaluating the quality of the PCR; a copy of the draft PCR; comments regarding the draft PCR from the client country; a Pass-Through PCR Unit Cost Sheet tracking OED staff time allocated to the project; memoranda and letters transmitting a final copy of the PCR to the Executive Directors, the Bank President, and officials of the client country; and a final copy of the PCR. Found in other working files for post-fiscal year 1983 is the Note of Record, which was prepared by the OED evaluating officer after review of the PCR with the division chief. It contained the reasons for the pass-through decision. The Note of Record assessed the project as described in the PCR in terms of its objectives, scope, implementation, costs, and sustainability. It was distributed only to the Director of OED (OEDDR), the OED Library, the working file, and the OED annual review coordinator. Also found in some workingfiles with the Note of Record is the Project Information Form (PIF) used to input data about the project into OED's database for use in annual reviews and studies. Results for all PCRs were reported to the Executive Board.

New guidelines for completing PCRs were put into place effective July 1, 1989. Most of the PCRs in the OED working files after this date have a different format from earlier prepared PCRs. Parts I and II of the report were prepared by the Regional Office and Part III was completed by the client. Some working files include Project Completion Notes (PCNs) which were prepared in lieu of PCRs for projects for which: the loan was never signed by the client; the Bank withdrew the loan; disbursement was very fast or ahead of schedule; no PCR was ever completed; or for which there were no implementation issues. The decision to create the PCN was based on a review of the Staff Appraisal Report prepared before the loan or credit was granted, internal Bank memoranda, minutes of Board discussions, supervision reports, and interviews with staff. The PPAR was carried out on the basis of the recommendation for audit made by OED at the time of review of the PCR. The contents of the PPAR working file remained largely unchanged from earlier periods but some PPARS for cluster audits (i.e. audits of multiple projects) were included.

By 1994, operations staff (also called Regional staff) evaluated all completed operations for which they were responsible and OED audited a representative sample of completed operations. For last supervision missions departing after July 1, 1994, Regional staff was required to prepare an Implementation Completion Report (ICR) or Implementation Completion Note (ICN) similar to the earlier PCN. Issues encountered during implementation, achievements, and the economic rate of return, were among the factors covered in the ICR. Contributions from client agencies (whole reports or comments) were attached to the ICR. Co-financiers were invited to participate in evaluations in which they provided funding. All ICRs were to be completed within six months of the final loan / credit disbursement. By 1997, about 25 percent of completed projects were audited by OED. Like the earlier PPARs, Project Audit Reports (PARs) were field-based and incorporated the views of client countries and major stakeholders. Projects were subject to audit if they were: large and complex; innovative or had unusual features; controversial, with issues unresolved during the ICR evaluation; first in a series or expected to offer especially strong lessons; suitable to be analyzed together with similar projects; useful for providing building blocks for sector or country evaluation study; or requested by Executive Directors.

The ICR, PCR, PCN, and ICN working files for the mid-1990s and later generally contain the printed report, a PIF and control sheet, drafts of the DGO's evaluative memorandum regarding the report or note, a copy of a memorandum from OEDDR transmitting the draft evaluative memorandum to the relevant Country Director, and comments from the Bank's Regional staff on the draft. Some files contain the OED-ICR-Review-Evaluation Summary which recommended for or against an audit of the project. Projects were evaluated for outcome, sustainability, institution development, Bank performance, and client country performance based on information in the ICR and PIF. Correspondence with Regional and other Bank staff and with officials in client countries regarding their comments on the draft report can also be found in the files. Some files contain copies of intra-OED electronic messages commenting on the draft evaluative summary and on the review process. A few of the files contain background documents records such as Staff Appraisal Reports (as was the case for PCR files for earlier periods).

In addition to draft and final copies of the reports, the PAR files for this period typically include: Initiating Memoranda; Terms of Reference (TOR) addressed to OED evaluators designated to travel to the field to conduct the audit; letters to Government officials and others related to the project announcing the mission to develop the report; Back-to-Office Reports from the audit mission; and comments on the draft audit report. Comments from the OED audit panel and an Audit Panel Review form can be found in some files along with drafts of the DGO's evaluative memorandum, a PIF and cover sheet, and copies of letters transmitting the final printed copy of the PAR to officials in the client country. Some of the PAR files contain copies of related background materials such as the Staff Appraisal Report and the Loan Agreement.

The review and audit activities of regional operations and the OED were conducted for the projects of all sectors. These include:

*Education- Primary; secondary; tertiary; vocational; technical

  • Health and nutrition Specific disease and HIV/AIDS prevention and management; population projects

  • Water Sewarage and drainage; sanitation; water supply; water pollution control; flood control

  • Agriculture Commodity production; livestock development; fisheries development; research; support services; marketing

  • Human resources Extension and training; social sector management; science and technology

  • Rural development Rural roads; rural electrification

  • Urban development Urban engineering; air pollution; urban management

  • Telecommunications General sector

  • Energy and power Power generation; refinery engineering; energy efficiency; oil field development; gas transport and distribution; oil, thermal, and gas exploration and development; pipeline rehabilitation

  • Transport Navigation; railways; highways; rural roads; aviation; ports

  • Finance and trade Private sector finance projects; financial rehabilitation projects; economic management and public enterprise; technology development projects; small and medium enterprise projects; development banks; export development; shipping; imports program; debt and debt service

  • Industry Foundry modernization; small-scale industry; fertilizer production; mining and other extractive sector projects; pulp and paper engineering; public enterprise assistance; natural resource management; forestry; off-shore development

  • Infrastructure Housing; construction projects

  • Reconstruction and emergency Earthquake and flood recovery; drought relief

  • Tourism General sector

  • Structural adjustment Public sector reform loans; adjustment loans and credits; trade policy adjustment

  • Client capacity building Technical assistance loans; central government administration projects; planning support

Evaluations of non-sector and multi-sector projects are also included.

The series also consists of evaluative reports and related materials created by OED staff that are not PARs or PPARs and are not related specifically to individual projects. These include: staff appraisal reports initially developed for the projects; reports and recommendations sent to the Executive Directors for approval of the loans or credits; materials related to a study by Carl Jayarajah entitled Overview Study: World Bank Support for Small and Medium Industry; a draft of correspondence related to a proposed Review of Lessons Learned in Railway Projects (RLLRP) for the OED Lessons & Practices publication; an approach paper, drafts, and background materials for Review of the World Bank Experience with Electric Power Generating Facilities (1985); a draft study outline, Terms of Reference, and supporting materials for the 1987 - 1989 study Columbia: An Evaluation of Bank Lending to the Colombia Power Sector between 1970 and 1986 along with the March 1991 final study report; the approach paper and draft of the 1988 - 1989 country case study World Bank Support for Rural Roads Maintenance - Philippine Case Study; a draft of Senior Evaluator Jan de Weille's March 1992 report Annual Review, Project Performance Results for 1991 - Transport; the approach paper and drafts of the June 30, 1994, grey cover sector review (Report 13291) Rural Electrification in Asia: A Review of Bank Experience; records related to a study of the Bank's involvement in Mexico's power sector over four decades; background materials for Study of Adjustment Lending in Sub-Saharan Africa (Oct. 1996 - July 1997) including an approach paper, preliminary draft, draft speech prepared for the Director-General, Operations Evaluation, and copies of related reports; the report Case Study of World Bank Activities in the Health Sector in Mali accompanied by a memorandum from OEDST inviting the DGO and other OED personnel to a meeting review regarding the study; working files of evaluator Basil Coukis which include annotated copies of PCRs and PPARs as well as background materials such as loan guarantee agreements, staff appraisal reports developed for loan or credit applications, progress reports, background correspondence, and field notes used in the preparation of evaluations; and two reports concerning trade policy reform for Mexico, Mexico: Trade Policy Reform, World Bank's Support for Trade Liberalization Program by Yalcin M. Baran (Sept. 15, 1989) and Overview Study: World Support for Small and Medium Industry issued by the Projects Department of Latin America and the Caribbean Regional Office (June 24, 1986). Finally, the series consists of records related to the OED's problematic review of the Thirteenth Indian Railway Project (Credit 582-IN). The files contain the April 1979 PCR, various versions (dating from 1981 to 1986) of the PPAR, and correspondence regarding the project. The first and the subsequent draft PPARs for this project were controversial and found to be inadequate for various reasons. The controversy led President Clausen to appoint a special audit team for the Railway Project and to request a reevaluation of OED internal procedures. Materials related to the subsequent review as well as to the OED evaluation are included; the latter includes: intra-OED correspondence; correspondence with Transportation Department staff, the South Asia Regional Office, and Indian government officials; and minutes of a Joint Audit Committee meeting and Executive Directors' meeting.

Resultados 8251 a 8300 de 8535