A new book from the National Research Council recommends changes in how the federal government evaluates the efficiency of research at EPA and other agencies. Assessing efficiency should be considered only one part of gauging a program's quality, relevance, and effectiveness. The efficiency of research processes and that of investments should be evaluated using different approaches. Investment efficiency should examine whether an agency's R&D portfolio, including the budget, is relevant, of high quality, matches the agency's strategic plan. These evaluations require panels of experts. In contrast, process efficiency should focus on "inputs" (the people, funds, and facilities dedicated to research) and "outputs" (the services, grants, publications, monitoring, and new techniques produced by research), as well as their timelines and should be evaluated using quantitative measures. The committee recommends that the efficiency of EPA's research programs be evaluated according to the same standards used at other agencies. To ensure this, OMB should train and oversee its budget examiners so that the PART questionnaire is implemented consistently and equitably across agencies.
Table of Contents
|Evaluating Research Efficiency in the U.S. Environmental Protection Agency||1-2|
|1 Introduction: The Government Performance and Results Act, the Program Assessment Rating Tool, and the Environmental Protection Agency||11-20|
|2 Efficiency Metrics Used by the Environmental Protection Agency and Other Federal Research and Development Programs||21-37|
|3 Are the Efficiency Metrics Used by Federal Research and Development Programs Sufficient and Outcome-Based?||38-51|
|4 A Model for Evaluating Research and Development Programs||52-57|
|5 Findings, Principles, and Recommendations||58-68|
|Appendix A: Biographic Information on the Committee on Evaluating the Efficiency of Research and Development Programs at the U.S. Environmental Protection Agency||69-74|
|Appendix B: Evaluating the Efficiency of Research and Development Programs at the Environmental Protection Agency: Workshop Summary||75-85|
|Appendix C: Program Assessment Rating Tool (PART) Questions||86-89|
|Appendix D: The Environmental Protection Agency's Strategic and Multi-year Planning Process||90-94|
|Appendix E: Agency and Industry Efficiency Measures||95-108|
|Appendix F: Draft Board of Scientific Counselors Handbook for Subcommittee Chairs: Draft Proposed Charge Questions for BOSC Reviews||109-112|
|Appendix G: OMB's Research and Development Program Investment Criteria||113-118|
|Appendix H: Charge to the BOSC Subcommittee on Safe Pesticides/Safe Products Research||119-127|
|Appendix I: PART Guidance on Efficiency Measures||128-132|
The National Academies Press and the Transportation Research Board have partnered with Copyright Clearance Center to offer a variety of options for reusing our content. You may request permission to:
For most Academic and Educational uses no royalties will be charged although you are required to obtain a license and comply with the license terms and conditions.
For information on how to request permission to translate our work and for any other rights related query please click here.
For questions about using the Copyright.com service, please contact:
Copyright Clearance Center
22 Rosewood Drive
Danvers, MA 01923
Tel (toll free): 855/239-3415 (select option 1)
Loading stats for Evaluating Research Efficiency in the U.S. Environmental Protection Agency...