This is the accessible text file for GAO report number GAO-05-739SP entitled 'Performance Measurement and Evaluation: Definitions and Relationships' which was released on June 10, 2005. This text file was formatted by the U.S. Government Accountability Office (GAO) to be accessible to users with visual impairments, as part of a longer term project to improve GAO products' accessibility. Every attempt has been made to maintain the structural and data integrity of the original printed product. Accessibility features, such as text descriptions of tables, consecutively numbered footnotes placed at the end of the file, and the text of agency comment letters, are provided but may not exactly duplicate the presentation or format of the printed version. The portable document format (PDF) file is an exact electronic replica of the printed version. We welcome your feedback. Please E-mail your comments regarding the contents or accessibility features of this document to Webmaster@gao.gov. This is a work of the U.S. government and is not subject to copyright protection in the United States. It may be reproduced and distributed in its entirety without further permission from GAO. Because this work may contain copyrighted images or other material, permission from the copyright holder may be necessary if you wish to reproduce this material separately. [On May 20, 2011, GAO issued GAO-11-646SP, Performance Measurement and Evaluation: Definitions and Relationships, which supersedes this document] United States Government Accountability Office: Glossary: May 2005: Performance Measurement and Evaluation: Definitions and Relationships: GAO-05-739SP: Program Performance Assessment: Both the executive branch and congressional committees need evaluative information to help them make decisions about the programs they oversee--information that tells them whether, and in what important ways, a program is working well or poorly, and why. In enacting the Government Performance and Results Act of 1993 (GPRA), Congress expressed frustration that executive branch and congressional decisionmaking was often hampered by the lack of good information on the results of federal program efforts. Seeking to promote improved federal management and the increased efficiency and effectiveness of federal programs, GPRA instituted a governmentwide requirement for agencies to set goals and report annually on program performance. Many analytic approaches have been employed over the years by the agencies and others to assess the operations and results of federal programs, policies, activities, and organizations. Periodically, individual evaluation studies are designed to answer specific questions about how well a program is working, and thus such studies may take several fonns. GPRA explicitly recognizes and encourages a complementary role for these types of program assessment: annual performance reports are to include both performance measurement results and program evaluation findings. Both performance measures and program evaluation play key roles in the Program Assessment Rating Tool that the Office of Management and Budget introduced in 2002 to examine federal programs in the budget formulation process. This glossary describes and explains the relationship between two common types of systematic program assessments: performance measures and program evaluations. It is based on GAO publications and program evaluation literature and was first prepared in 1998. Major contributors were Stephanie Shipman and Joseph Wholey. Please address any questions to Stephanie Shipman (202) 512-4041. Signed by: Nancy R. Kingsbury, Managing Director: Applied Research and Methods: Types of Program Performance Assessment: Performance Measurement: Performance measurement is the ongoing monitoring and reporting of program accomplishments, particularly progress toward preestablished goals. It is typically conducted by program or agency management. Performance measures may address the type or level of program activities conducted (process), the direct products and services delivered by a program (outputs), or the results of those products and services (outcomes). A "program" may be any activity, project, function, or policy that has an identifiable purpose or set of objectives. Program Evaluation: Program evaluations are individual systematic studies conducted periodically or on an ad hoc basis to assess how well a program is working. They are often conducted by experts external to the program, either inside or outside the agency, as well as by program managers. A program evaluation typically examines achievement of program objectives in the context of other aspects of program performance or in the context in which it occurs. Four main types can be identified, all of which use measures of pro-gram performance, along with other information, to learn the benefits of a program or how to improve it. Relationship between Performance Measurement and Program Evaluation: Different Focus: Performance measurement focuses on whether a program has achieved its objectives, expressed as measurable performance standards. Pro gram evaluations typically examine a broader range of information on program performance and its con-text than is feasible to monitor on an ongoing basis. Depending on their focus, evaluations may examine aspects of program operations (such as in a process evaluation) or factors in the program environment that may impede or contribute to its success, to help explain the linkages between program inputs, activities, outputs, and outcomes. Alternatively, evaluations may assess the program's effects beyond its intended objectives, or estimate what would have occurred in the absence of the program, in order to assess the program's net impact. Additionally, program evaluations may systematically compare the effectiveness of alternative programs aimed at the same objective. Different Use: Both fonns of assessment aim to support resource allocation and other policy decisions to improve service delivery and program effectiveness. But performance measurement, because of its ongoing nature, can serve as an early warning system to management and as a vehicle for improving accountability to the public. A program evaluation's typically more in-depth examination of program performance and context allows for an overall assessment of whether the program works and identification of adjustments that may improve its results. Types of Program Evaluation: Process (or Implementation) Evaluation: This form of evaluation assesses the extent to which a program is operating as it was intended. It typically assesses program activities' conformance to statutory and regulatory requirements, program design, and professional standards or customer expectations. Outcome Evaluation: This form of evaluation assesses the extent to which a program achieves its outcome-oriented objectives. It focuses on outputs and outcomes (including unintended effects) to judge program effectiveness but may also assess program process to understand how outcomes are produced. Impact Evaluation: Impact evaluation is a form of out-come evaluation that assesses the net effect of a program by comparing program outcomes with an estimate of what would have happened in the absence of the program. This form of evaluation is employed when external factors are known to influence the program's outcomes, in order to isolate the program's contribution to achievement of its objectives. Cost-Benefit and Cost-Effectiveness Analyses: These analyses compare a program's outputs or outcomes with the costs (resources expended) to produce them. When applied to existing programs, they are also considered a form of program evaluation. Cost- effectiveness analysis assesses the cost of meeting a single goal or objective and can be used to identify the least costly alternative for meeting that goal. Cost-benefit analysis aims to identify all relevant costs and benefits, usually expressed in dollar terms. [End of Glossary] GAO's Mission: The Government Accountability Office, the investigative arm of Congress, exists to support Congress in meeting its constitutional responsibilities and to help improve the performance and accountability of the federal government for the American people. GAO examines the use of public funds; evaluates federal programs and policies; and provides analyses, recommendations, and other assistance to help Congress make informed oversight, policy, and funding decisions. GAO's commitment to good government is reflected in its core values of accountability, integrity, and reliability. Obtaining Copies of GAO Reports and Testimony: The fastest and easiest way to obtain copies of GAO documents at no cost is through the Internet. GAO's Web site ( www.gao.gov ) contains abstracts and full-text files of current reports and testimony and an expanding archive of older products. The Web site features a search engine to help you locate documents using key words and phrases. You can print these documents in their entirety, including charts and other graphics. Each day, GAO issues a list of newly released reports, testimony, and correspondence. GAO posts this list, known as "Today's Reports," on its Web site daily. The list contains links to the full-text document files. To have GAO e-mail this list to you every afternoon, go to www.gao.gov and select "Subscribe to e-mail alerts" under the "Order GAO Products" heading. Order by Mail or Phone: The first copy of each printed report is free. Additional copies are $2 each. A check or money order should be made out to the Superintendent of Documents. GAO also accepts VISA and Mastercard. Orders for 100 or more copies mailed to a single address are discounted 25 percent. Orders should be sent to: U.S. Government Accountability Office 441 G Street NW, Room LM Washington, D.C. 20548: To order by Phone: Voice: (202) 512-6000: TDD: (202) 512-2537: Fax: (202) 512-6061: To Report Fraud, Waste, and Abuse in Federal Programs: Contact: Web site: www.gao.gov/fraudnet/fraudnet.htm E-mail: fraudnet@gao.gov Automated answering system: (800) 424-5454 or (202) 512-7470: Public Affairs: Jeff Nelligan, managing director, NelliganJ@gao.gov (202) 512-4800 U.S. Government Accountability Office, 441 G Street NW, Room 7149 Washington, D.C. 20548: