National Academy of Sciences | 150 Year Anniversary

Questions? Call 800-624-6242

| Items in cart [0]

The National Academies Press

PAPERBACK
price:$35.00
add to cart

Rights & Permissions

topleft topright

Evaluating Research Efficiency in the U.S. Environmental Protection Agency (2008)
Committee on Science, Engineering, and Public Policy (COSEPUP)
Board on Environmental Studies and Toxicology (BEST)

Citation Manager

. "Appendix I: PART Guidance on Efficiency Measures." Evaluating Research Efficiency in the U.S. Environmental Protection Agency. Washington, DC: The National Academies Press, 2008.

Please select a format:

BibTeX EndNote RefMan


Page
129
bottomleft bottomright

The following HTML text is provided to enhance online readability. Many aspects of typography translate only awkwardly to HTML. Please use the page image as the authoritative form to ensure accuracy.


Evaluating Research Efficiency in the U.S. Environmental Protection Agency

Meaningful efficiency measures consider the benefit to the customer and serve as indicators of how well the program performs. For example, reducing processing time means little if error rates increase. A balanced approach is required to enhance the performance of both variables in pursuit of excellence to customers. In these instances, one measure (e.g., increase in customer satisfaction) may be used in conjunction with another complementary measure (e.g., reduction in processing time).

In all cases, efficiency measures must be useful, relevant to program purpose, and help improve program performance. An efficiency measure for a Federal program tracks the ratio of total outputs or outcomes to total inputs (Federal plus non-Federal). Leveraging program resources can be a rational policy decision, as it leads to risk or cost sharing; however, it is not an acceptable efficiency measure, because the leveraging ratio of non-Federal to Federal dollars represents only inputs. Although increasing the amount leveraging in a program may stretch Federal program dollars, this does not measure improvements in the management of total program resources, systems, or outcomes.


3.4: Does the program have procedures (e.g., competitive sourcing/cost comparisons, IT improvements, appropriate incentives) to measure and achieve efficiencies and cost effectiveness in program execution?


Purpose: To determine whether the program has effective management procedures and measures in place to ensure the most efficient use of each dollar spent on program execution.

Elements of Yes: A Yes answer needs to clearly explain and provide evidence of each of the following [see Box I-1]:

  • The program has regular procedures in place to achieve efficiencies and cost effectiveness.

  • The program has at least one efficiency measure with baseline and targets.

BOX I-1

Measures and PARTWeb

To receive a Yes answer, the program must include at least one efficiency measure, baseline data/estimates, and targets in the Measures screen in PARTWeb.

Only measures that meet the standards for a Yes should be entered in PARTWeb.

Please ensure that the proper characterization of measures is selected in PARTWeb (that is “efficiency”). Make sure to indicate the term of the measure in PARTWeb too (that is, long-term, annual, or long-term/annual).

Page
129
Front Matter (R1-R20)
Evaluating Research Efficiency in the U.S. Environmental Protection Agency (1-2)
Summary (3-10)
1 Introduction: The Government Performance and Results Act, the Program Assessment Rating Tool, and the Environmental Protection Agency (11-20)
2 Efficiency Metrics Used by the Environmental Protection Agency and Other Federal Research and Development Programs (21-37)
3 Are the Efficiency Metrics Used by Federal Research and Development Programs Sufficient and Outcome-Based? (38-51)
4 A Model for Evaluating Research and Development Programs (52-57)
5 Findings, Principles, and Recommendations (58-68)
Appendix A: Biographic Information on the Committee on Evaluating the Efficiency of Research and Development Programs at the U.S. Environmental Protection Agency (69-74)
Appendix B: Evaluating the Efficiency of Research and Development Programs at the Environmental Protection Agency: Workshop Summary (75-85)
Appendix C: Program Assessment Rating Tool (PART) Questions (86-89)
Appendix D: The Environmental Protection Agency's Strategic and Multi-year Planning Process (90-94)
Appendix E: Agency and Industry Efficiency Measures (95-108)
Appendix F: Draft Board of Scientific Counselors Handbook for Subcommittee Chairs: Draft Proposed Charge Questions for BOSC Reviews (109-112)
Appendix G: OMB's Research and Development Program Investment Criteria (113-118)
Appendix H: Charge to the BOSC Subcommittee on Safe Pesticides/Safe Products Research (119-127)
Appendix I: PART Guidance on Efficiency Measures (128-132)