Skip to main content

Currently Skimming:

Appendix E: Executive Summar of Evaluating Federal Research Programs: Research and the Government Performance and Results Act
Pages 155-166

The Chapter Skim interface presents what we've algorithmically identified as the most significant single chunk of text within every page in the chapter.
Select key terms on the right to highlight them within pages of the chapter.


From page 155...
... One is that it should be possible to measure research, including basic research, annually and provide quantitative measures of the useful outcomes of both basic and applied research. The other is that, given the long-range 155
From page 156...
... COSEPUP concludes that both basic research and applied research programs1 can be meaningfully evaluated on a regular basis. For the applied research programs of the mission agencies, specific practical outcomes can be 156
From page 157...
... Since we cannot predict the ultimate practical outcomes of basic research, we must find ways to ensure that the basic research programs that the nation funds generate the kinds of knowledge that have given us great practical benefits in the past. To do that, we must find ways to measure the quality of our current research programs, their contributions to our world leadership in the relevant fields, and their relevance to agency goals and intended users.
From page 158...
... Evaluating basic research requires substantial scientific or engineering knowledge. Evaluating applied research requires, in addition, the ability to recognize its potential applicability to practical problems.
From page 159...
... Measuring both requires technical and scientific knowledge, but applied research entails some factors that basic research does not, such as ultimate . usability, so the input of potential users is required.
From page 160...
... For agencies whose missions include a specific responsibility for basic research such as the National Science Foundation in broad fields of science and engineering, the National Institutes of Health in fields related to health, or the Department of Energy in high-energy physics world leadership in a field can itself be an 160
From page 161...
... Conclusion 5: Mechanisms for coordinating research programs in multiple agencies whose fillips or subject matters overlap are insufficient. It is common and valuable for agencies to approach similar fields of research from different perspectives.
From page 162...
... The researchers who work in agency, university, and Industrial laboratories are the people who perform and best understand the research programs funded by the federal government. Many researchers contribute substantial time and effort to reviewing papers submitted for publication, grant applications, and program proposals, yet few of them are aware of GPRA, its objectives, and its mandates.
From page 163...
... be extremely destructive to quality work. Because the evaluation of applied research is directly connected to practical outcomes, whereas the evaluation of basic research is in terms of quality, relevance, and leadership, which ultimately lead to practical outcomes, there might be a tendency to bias an agency's overall research program toward applied research at the expense of basic research.
From page 164...
... A second form of expert review is relevance review, in which potential users and experts in other fields or disciplines related to an agency's mission or to the potential application of the research evaluate the relevance of research to the agency's mission. A third form of expert review is benchmarking, in which an international panel of experts compares the level of leadership of a research program relative to research being performed worldwide.
From page 165...
... performance plans, which are available on the agencies' web sites. The researchers who work in agency, university, and industrial laboratories are the people who perform and best understand the research programs funded by the federal government.
From page 166...
... Given the diverse portfolio of research conducted by federal agencies and the urgency of addressing the question of how basic research can be evaluated in the context of GPRA, the level of detail and specificity needed in designing procedures and guidelines for implementation was beyond the scope of this report. The Government Performance and Results Act provides an opportunity for the research community to ensure the effective use of the nation's research resources in meeting national needs and to articulate to policy-makers and the public the rationale for and results of research.


This material may be derived from roughly machine-read images, and so is provided only to facilitate research.
More information on Chapter Skim is available.