National Academies Press: OpenBook
« Previous: References
Suggested Citation:"Appendix A: Workshop Summary and Agenda." National Research Council. 2008. Using the American Community Survey for the National Science Foundation's Science and Engineering Workforce Statistics Programs. Washington, DC: The National Academies Press. doi: 10.17226/12244.
×
Page 81
Suggested Citation:"Appendix A: Workshop Summary and Agenda." National Research Council. 2008. Using the American Community Survey for the National Science Foundation's Science and Engineering Workforce Statistics Programs. Washington, DC: The National Academies Press. doi: 10.17226/12244.
×
Page 82
Suggested Citation:"Appendix A: Workshop Summary and Agenda." National Research Council. 2008. Using the American Community Survey for the National Science Foundation's Science and Engineering Workforce Statistics Programs. Washington, DC: The National Academies Press. doi: 10.17226/12244.
×
Page 83
Suggested Citation:"Appendix A: Workshop Summary and Agenda." National Research Council. 2008. Using the American Community Survey for the National Science Foundation's Science and Engineering Workforce Statistics Programs. Washington, DC: The National Academies Press. doi: 10.17226/12244.
×
Page 84
Suggested Citation:"Appendix A: Workshop Summary and Agenda." National Research Council. 2008. Using the American Community Survey for the National Science Foundation's Science and Engineering Workforce Statistics Programs. Washington, DC: The National Academies Press. doi: 10.17226/12244.
×
Page 85

Below is the uncorrected machine-read text of this chapter, intended to provide our own search engines and external engines with highly rich, chapter-representative searchable text of each book. Because it is UNCORRECTED material, please consider the following text as a useful but insufficient proxy for the authoritative book pages.

Appendix A Workshop Summary and Agenda T he Panel on Assessing the Benefits of the American Community Survey for the NSF Division of Science Resources Statistics held a public workshop on October 5, 2007, in Washington, D.C., to dis- cuss NSF, Census Bureau, and data user needs for the Scientists and Engi- neers Statistical Data System (SESTAT), particularly the National Survey of College Graduates (NSCG). The workshop goals were to • clarify issues concerning alternative approaches to using the ACS as a sampling frame for the NSCG; • identify issues related to the use of field-of-degree information on the ACS with regard to statistical methodology, data quality, and data products; • consider the use of field-of-degree and other information from the ACS as a screening element for subsequent surveys such as the NSCG, which until now has used level of degree information from the decennial census long form; and • consider relevance and adequacy of ACS products for meeting current and emerging data needs for NSF. The workshop agenda is at the end of this appendix. Among the highlights of the workshop, NSF provided a background discussion on the range of workforce surveys in SESTAT, including the NSCG, National Survey of Recent College Graduates (NSRCG), Survey of 81

82 USING THE AMERICAN COMMUNITY SURVEY Doctorate Recipients (SDR), and the Survey of Earned Doctorates (SED). These surveys offer a comprehensive and integrated system of informa- tion on employment, education, and demographic characteristics of scien- tists and engineers in the United States. The three sample surveys consist of more than 100,000 respondents combined, representing a population of over 21 million who have science and engineering (S&E) or S&E-related degrees or occupations. The NSCG, which is the survey of interest to the panel, captures data on people with at least a bachelor’s degree, who account for 85-90 percent of the SESTAT population and is the only source of information on people with non-U.S. degrees. NSF staff also reviewed the several mandates under which the agency operates. Under the 1950 act that created the agency, it is mandated to be a clearinghouse of information on the S&E enterprise. The amended act calls for NSF to collect and analyze demographic and education informa- tion on individuals with degrees in science and engineering and to design, establish, and maintain a data collection and analysis capability for the purpose of identifying and assessing the number and characteristics of scientists and engineers in the United States. Additional congressional mandates require NSF to produce the Women, Minorities, and Persons with Disabilities in Science and Engineering and Science and Engineering Indicators biennial reports. The panel heard from five SESTAT data users, including three of the panel’s own members, on the various uses of and needs for the data. The uses range from reconstructing answers from the census long form to evaluate the quality of the Census Bureau’s imputation of education, assessing gender and racial earning gaps, evaluating the relationship between work activity and earnings, and determining the contribution to U.S. science from foreign-born versus native-born workers. The NSCG is especially useful to researchers interested in determining how the labor force is changing and the effects of immigration. The users stressed that within confidentiality and privacy limits, par- ticularly under Title 13, data linkages between the ACS and the NSCG and links from the SDR and the NSCG to the U.S. Patent and Trademark Office database would be helpful in answering additional research ques- tions. The latter of these linkages would facilitate research into the role of entrepreneurial activities in the fields of science and engineering. The Census Bureau provided a comprehensive overview of the con- tent testing planned for the field of bachelor’s degree question. There are two versions of the question: categorical or forced choice, and open- ended. Each version of the question was mailed to 15,000 housing units in July 2007, and nonresponse follow-up was conducted by telephone and personal visit in August and September. A content follow-up reinterview was conducted by telephone to assess the reliability of the responses. This

APPENDIX A 83 reinterview attempted to speak to the original respondent and asked both versions of the field-of-degree question. There are several decision criteria that will be used by the Census Bureau as evaluation measures for the ACS content test. They include comparing the content test results (distributions and percentages) to the NSCG, evaluating item missing data rates and the estimates’ reliability (gross difference rates and the L-fold index of inconsistency), assessing the response correspondence and rate of inconsistencies between the open-ended and categorical questions, determining the general impact to NSCG’s sampling frame, and comparing item nonresponse rates for the educational attainment question that precedes the field-of-degree ques- tion. The preliminary results from this evaluation process are expected in early 2008 with the goal to have approval by the U.S. Office of Manage- ment and Budget (OMB) by July 2008. Census Bureau personnel also addressed issues associated with using the ACS as a sample frame for other surveys. Based on the current ACS OMB terms of clearance, surveys that previously used decennial long- form data, such as the NSCG, may use the ACS as a sampling frame. To clarify the rules of access to ACS data, the Census Bureau has developed a policy that describes the criteria for determining appropriate uses of the ACS as a frame for reimbursable follow-on surveys. Thus far, NSF is one of only two survey sponsors that have officially requested the use of the ACS for this purpose. There are several technical issues associated with using the ACS as a sample frame for the NSCG. First, the ACS sample over a 12-month period does not capture enough of the rare populations needed in the NSCG. Most populations require two annual cycles of the ACS, while the rarest populations may need up to five rounds. NSF personnel offered their thinking regarding four options for drawing the NSCG sample from the ACS: 1. ����������������������������������������������������� Draw the sample once a decade (the current approach). 2. ���������������������������������������������������������������� Conduct selective updates, oversampling to capture certain popu- lations with a regularly scheduled major redesign. 3. ���������������������������������������������������������������� Design rotating panels by dividing the survey into multiple pan- els in a 2- to 3-year cycle. 4. ����������������������� Create rotating panels. The panel also solicited comments from Graham Kalton at the work- shop regarding the options provided by NSF. An additional option stem- ming from that conversation was to design rotating panels for the rare populations and cross-sections for the rest of the population.

84 USING THE AMERICAN COMMUNITY SURVEY Panel on Assessing the Benefits of the American Community Survey for the NSF Division of Science Resources Statistics October 5, 2007 The Keck Center of the National Academies 500 Fifth Street, N.W. Washington, D.C. 20001 Room 101 WORKSHOP AGENDA Friday, October 5 8:00-8:30 am Call to Order and Introductions Hal Stern, Chair 8:30-10:30 am Session 1: Future Design of the NSF Workforce Surveys Moderator: Dan Black  Mary Frase, Deputy Director, Division of Science Resources Statistics, NSF 10:45 am-12:15 pm Session 2: Requirements for the National Survey of College Graduates Moderator: Cathy Weinberger  Roundtable Discussion of Uses by Panel Members Using NSCG Data in Wage Inequality Research  Donna Ginther, University of Kansas (by phone) Using NSCG Data in Assessing the Quality and  Composition of the Scientific Workforce  Sharon Levin, University of Missouri, Kansas City (by phone) 12:15-1:00 pm Working Lunch: Roundtable Discussions of User Needs

APPENDIX A 85 1:00-2:30 pm Session 3: Use of the American Community Survey as a Sample Frame and for Analytical Purposes Moderator: Chet Bowie  Plans for Methods Panel and Testing FOD Question  Jennifer Tancreto, Chief, ACS Data Collection Methods Staff A  ccess to ACS Data for Sample Design and Analysis  Cheryl Landman, Chief, Demographic Surveys Division 2:45-4:00 pm Session 4: Sample Design Options and Criteria Moderator: Robert Santos Discussion of Options Stephen H. Cohen, Chief Statistician, Science Resources Statistics Division, NSF 4:00-5:30 pm Open Discussion and Summary Hal Stern, Chair  Guest Panelist: Graham Kalton, Chair, NRC Panel on the Functionality and Usability of Data from the American Community Survey

Next: Appendix B: Bibliographical Sketches of Panel Members and Staff »
Using the American Community Survey for the National Science Foundation's Science and Engineering Workforce Statistics Programs Get This Book
×
Buy Paperback | $40.00 Buy Ebook | $31.99
MyNAP members save 10% online.
Login or Register to save!
Download Free PDF

The National Science Foundation (NSF) has long collected information on the number and characteristics of individuals with education or employment in science and engineering and related fields in the United States. An important motivation for this effort is to fulfill a congressional mandate to monitor the status of women and minorities in the science and engineering workforce. Consequently, many statistics are calculated by race or ethnicity, gender, and disability status. For more than 25 years, NSF obtained a sample frame for identifying the target population for information it gathered from the list of respondents to the decennial census long-form who indicated that they had earned a bachelors or higher degree. The probability that an individual was sampled from this list was dependent on both demographic and employment characteristics. But, the source for the sample frame will no longer be available because the census long-form is being replaced as of the 2010 census with the continuous collection of detailed demographic and other information in the new American Community Survey (ACS). At the request of NSF's Science Resources Statistics Division, the Committee on National Statistics of the National Research Council formed a panel to conduct a workshop and study the issues involved in replacing the decennial census long-form sample with a sample from the ACS to serve as the frame for the information the NSF gathers. The workshop had the specific objective of identifying issues for the collection of field of degree information on the ACS with regard to goals, content, statistical methodology, data quality, and data products.

  1. ×

    Welcome to OpenBook!

    You're looking at OpenBook, NAP.edu's online reading room since 1999. Based on feedback from you, our users, we've made some improvements that make it easier than ever to read thousands of publications on our website.

    Do you want to take a quick tour of the OpenBook's features?

    No Thanks Take a Tour »
  2. ×

    Show this book's table of contents, where you can jump to any chapter by name.

    « Back Next »
  3. ×

    ...or use these buttons to go back to the previous chapter or skip to the next one.

    « Back Next »
  4. ×

    Jump up to the previous page or down to the next one. Also, you can type in a page number and press Enter to go directly to that page in the book.

    « Back Next »
  5. ×

    To search the entire text of this book, type in your search term here and press Enter.

    « Back Next »
  6. ×

    Share a link to this book page on your preferred social network or via email.

    « Back Next »
  7. ×

    View our suggested citation for this chapter.

    « Back Next »
  8. ×

    Ready to take your reading offline? Click here to buy this book in print or download it as a free PDF, if available.

    « Back Next »
Stay Connected!