National Academies Press: OpenBook
« Previous: Addititional Issues on Conducting Quantitative Assessments
Suggested Citation:"Concluding Observations and References." National Research Council. 1994. Quantitative Assessments of the Physical and Mathematical Sciences: A Summary of the Lessons Learned. Washington, DC: The National Academies Press. doi: 10.17226/9199.
×

anomalies over time, making precise or detailed long-term comparisons difficult even within a single data set.

Some of the problems associated with relying on multiple sources of data can be alleviated by conducting a well-planned, comprehensive survey that addresses many of the major internal and external indicators of a discipline's status. Only the AMO Science Assessment Panel was able to have access to a specialized survey, which had been done in conjunction with a concurrent study (NRC, 1994). Nevertheless, obtaining full value from such a survey requires its periodic repetition, which makes it subject to some of the problems outlined above.

CONCLUDING OBSERVATIONS

Although the three panels' reviews of potential indicators of the status of their particular fields and of the related data were neither comprehensive nor conclusive, they were sufficiently informative to show that the Commission's initial optimism about the benefits of greater reliance on or systematic use of quantitative measures in the assessment of scientific disciplines was unfounded. A comprehensive statistical analysis of the status of a scientific discipline is difficult, expensive, and time consuming. Unfortunately, such an analysis also tends to be relatively easy to impugn, especially when it attempts to address larger issues.

Using existing information, it is usually possible to obtain detailed and accurate data about some discrete portion—a branch of inquiry, a type of activity, or a particular source of support—of the larger system. In trying to assemble the pieces of a statistical portrait of an entire discipline, however, one quickly finds mismatches and large gaps. The resulting picture is incomplete and potentially misleading.

Despite the inherent drawbacks of using quantitative measures, it is possible to gain some useful insights about certain aspects of discipline-related research, particularly in an historical context. Future discipline assessments that attempt to use such data, however, must take into account the full costs and drawbacks of this approach at the outset.

REFERENCES

National Research Council (NRC). 1984. Renewing U.S. Mathematics: Critical Resource for the Future, National Academy Press, Washington, D.C.

National Research Council (NRC). 1990. Renewing U.S. Mathematics: A Plan for the 1990s, National Academy Press, Washington, D.C.

National Research Council (NRC). 1991. The Decade of Discovery in Astronomy and Astrophysics, National Academy Press, Washington, D.C.

National Research Council (NRC). 1994. Atomic, Molecular, and Optical Science: An Investment in the Future , Panel on the Future of Atomic, Molecular, and Optical Sciences (FAMOS) , National Academy Press, Washington, D.C.

Suggested Citation:"Concluding Observations and References." National Research Council. 1994. Quantitative Assessments of the Physical and Mathematical Sciences: A Summary of the Lessons Learned. Washington, DC: The National Academies Press. doi: 10.17226/9199.
×
Page 13
Quantitative Assessments of the Physical and Mathematical Sciences: A Summary of the Lessons Learned Get This Book
×
MyNAP members save 10% online.
Login or Register to save!
  1. ×

    Welcome to OpenBook!

    You're looking at OpenBook, NAP.edu's online reading room since 1999. Based on feedback from you, our users, we've made some improvements that make it easier than ever to read thousands of publications on our website.

    Do you want to take a quick tour of the OpenBook's features?

    No Thanks Take a Tour »
  2. ×

    Show this book's table of contents, where you can jump to any chapter by name.

    « Back Next »
  3. ×

    ...or use these buttons to go back to the previous chapter or skip to the next one.

    « Back Next »
  4. ×

    Jump up to the previous page or down to the next one. Also, you can type in a page number and press Enter to go directly to that page in the book.

    « Back Next »
  5. ×

    Switch between the Original Pages, where you can read the report as it appeared in print, and Text Pages for the web version, where you can highlight and search the text.

    « Back Next »
  6. ×

    To search the entire text of this book, type in your search term here and press Enter.

    « Back Next »
  7. ×

    Share a link to this book page on your preferred social network or via email.

    « Back Next »
  8. ×

    View our suggested citation for this chapter.

    « Back Next »
  9. ×

    Ready to take your reading offline? Click here to buy this book in print or download it as a free PDF, if available.

    « Back Next »
Stay Connected!