National Academies Press: OpenBook
« Previous: Front Matter
Suggested Citation:"Executive Summary." National Research Council. 2003. Improving the Design of the Scientists and Engineers Statistical Data System (SESTAT). Washington, DC: The National Academies Press. doi: 10.17226/10571.
×

Executive Summary

SESTAT (the Scientists and Engineers Statistical Data System) is a system of surveys, developed and maintained by the Science Resources Statistics (SRS) division of the National Science Foundation (NSF) to provide timely information about the numbers and characteristics of scientists and engineers in the United States.

The committee examined three options presented by SRS to improve the SESTAT design: (1) conduct a new National Survey of College Graduates based on the 2000 census frame; (2) continue the existing 1990s panels; and (3) adopt a hybrid option, combining features of the 2000 census frame and the 1990 census frame options. Our primary criteria for evaluating these options were how well the design achieves and maintains an adequate response rate, how well it covers the complete population of interest, and whether sample sizes permit sampling precision that is adequate for the principal uses of the survey data. We also considered how well the designs support analyses of longitudinal data, trends, and biases. The committee was not asked, nor did it attempt, to perform an analysis of cost and implementation factors associated with various design options for SESTAT, examine the content of the surveys that support SESTAT, or revisit the question of how the population of scientists and engineers should be defined.

We conclude that the 2000 census frame option is the best choice of the three design options. We offer three primary recommendations:

Suggested Citation:"Executive Summary." National Research Council. 2003. Improving the Design of the Scientists and Engineers Statistical Data System (SESTAT). Washington, DC: The National Academies Press. doi: 10.17226/10571.
×

Recommendation 1: Almost all of the resources allocated to the SESTAT data collection effort in 2003 should be devoted to drawing a new National Survey of College Graduates from the 2000 census and supplementing this panel with the National Survey of Recent College Graduates.

Recommendation 2: If SRS staff confirm that a targeted sample could be useful for the purpose of adjustment, SRS should consider surveying in 2003 a very small, carefully targeted subset of the current panel to study biases in the current sample, possibly to use for the purpose of adjustment.

Recommendation 3: A cost-benefit analysis should be conducted to optimize the relative allocation of resources between the National Survey of College Graduates and the National Survey of Recent College Graduates. Also, additional oversampling should be applied to capture adequate numbers for small domains for which increased interest has become apparent since the last design.

To emphasize the importance of achieving and maintaining high quality of the data, we offer a recommendation on the new sample:

Recommendation 4: The SRS should make every effort to achieve a response rate of 85 percent or higher for the recommended new sample and to retain the sample over time.

We encourage SRS to make every effort to prevent occurrence, in the new sample, of the flaws now present in the old and to conduct methodological research to evaluate the major sources of nonsampling errors, particularly nonresponse error, as well as methods for reducing their effects on the survey estimates. We also offer recommendations pertaining to increasing coverage of populations of interest (e.g., immigrant scientists and engineers and a broader range of fields relevant to science and engineering); refining the definition of goals for SESTAT; regularly monitoring SESTAT data quality; performing more in-house research at SRS; and developing an agenda for subject matter analysis and methodological research.

Suggested Citation:"Executive Summary." National Research Council. 2003. Improving the Design of the Scientists and Engineers Statistical Data System (SESTAT). Washington, DC: The National Academies Press. doi: 10.17226/10571.
×
Page 1
Suggested Citation:"Executive Summary." National Research Council. 2003. Improving the Design of the Scientists and Engineers Statistical Data System (SESTAT). Washington, DC: The National Academies Press. doi: 10.17226/10571.
×
Page 2
Next: Introduction »
Improving the Design of the Scientists and Engineers Statistical Data System (SESTAT) Get This Book
×
Buy Paperback | $21.00 Buy Ebook | $16.99
MyNAP members save 10% online.
Login or Register to save!
Download Free PDF

The past decade has demonstrated the utility of SESTAT, but the SESTAT design shows some deficiencies with respect to response rates, coverage of populations of interest, and its ability to support some useful analyses. To tackle those deficiencies, NSF has proposed three possible design options for improving the database and asked the National Research Council's Committee on National Statistics (CNSTAT) to form the Committee to Review the 2000 Decade Design of the SESTAT.

This is the report of that committee. It presents our understanding of the purposes and characteristics of the SESTAT, applies the criteria we believe are important for assessing design options for the database, provides our recommendation for the best approach to adopt in the 2000 decade, and offers our encouragement to NSF to pursue opportunities to improve the understanding of the numbers and characteristics of scientists and engineers in the United States.

  1. ×

    Welcome to OpenBook!

    You're looking at OpenBook, NAP.edu's online reading room since 1999. Based on feedback from you, our users, we've made some improvements that make it easier than ever to read thousands of publications on our website.

    Do you want to take a quick tour of the OpenBook's features?

    No Thanks Take a Tour »
  2. ×

    Show this book's table of contents, where you can jump to any chapter by name.

    « Back Next »
  3. ×

    ...or use these buttons to go back to the previous chapter or skip to the next one.

    « Back Next »
  4. ×

    Jump up to the previous page or down to the next one. Also, you can type in a page number and press Enter to go directly to that page in the book.

    « Back Next »
  5. ×

    Switch between the Original Pages, where you can read the report as it appeared in print, and Text Pages for the web version, where you can highlight and search the text.

    « Back Next »
  6. ×

    To search the entire text of this book, type in your search term here and press Enter.

    « Back Next »
  7. ×

    Share a link to this book page on your preferred social network or via email.

    « Back Next »
  8. ×

    View our suggested citation for this chapter.

    « Back Next »
  9. ×

    Ready to take your reading offline? Click here to buy this book in print or download it as a free PDF, if available.

    « Back Next »
Stay Connected!