Recommendation 1: Almost all of the resources allocated to the SESTAT data collection effort in 2003 should be devoted to drawing a new National Survey of College Graduates from the 2000 census and supplementing this panel with the National Survey of Recent College Graduates.
Recommendation 2: If SRS staff confirm that a targeted sample could be useful for the purpose of adjustment, SRS should consider surveying in 2003 a very small, carefully targeted subset of the current panel to study biases in the current sample, possibly to use for the purpose of adjustment.
Recommendation 3: A cost-benefit analysis should be conducted to optimize the relative allocation of resources between the National Survey of College Graduates and the National Survey of Recent College Graduates. Also, additional oversampling should be applied to capture adequate numbers for small domains for which increased interest has become apparent since the last design.
To emphasize the importance of achieving and maintaining high quality of the data, we offer a recommendation on the new sample:
Recommendation 4: The SRS should make every effort to achieve a response rate of 85 percent or higher for the recommended new sample and to retain the sample over time.
We encourage SRS to make every effort to prevent occurrence, in the new sample, of the flaws now present in the old and to conduct methodological research to evaluate the major sources of nonsampling errors, particularly nonresponse error, as well as methods for reducing their effects on the survey estimates. We also offer recommendations pertaining to increasing coverage of populations of interest (e.g., immigrant scientists and engineers and a broader range of fields relevant to science and engineering); refining the definition of goals for SESTAT; regularly monitoring SESTAT data quality; performing more in-house research at SRS; and developing an agenda for subject matter analysis and methodological research.