National Academies Press: OpenBook

Capturing Change in Science, Technology, and Innovation: Improving Indicators to Inform Policy (2014)

Chapter: Appendix C: Workshop on Developing Science, Technology, and Innovation Indicators for the Future Agenda and Participants

« Previous: Appendix B: Users of Science, Technology, and Innovation (STI) Data and Indicators and Their Questions and Requests for STI Indicators
Suggested Citation:"Appendix C: Workshop on Developing Science, Technology, and Innovation Indicators for the Future Agenda and Participants." National Research Council. 2014. Capturing Change in Science, Technology, and Innovation: Improving Indicators to Inform Policy. Washington, DC: The National Academies Press. doi: 10.17226/18606.
×

Appendix C

Workshop on Developing Science, Technology, and Innovation Indicators for the Future Agenda and Participants
*

AGENDA

This workshop is part of a study by the Panel on Developing Science, Technology, and Innovation Indicators for the Future. During this two-day meeting, scholars and practitioners from around the world will discuss specific datasets, frameworks, methods, and tools for measuring science, technology and innovation (STI) activities at the national and subnational levels, and for developed and developing countries. Participants will discuss (1) metrics that have been shown to track changes in national economic growth, productivity, and other indicators of social development; (2) frameworks for gathering data on academic inputs to research, development, and translation processes toward commercialization of new scientific outputs, with specific regional outlooks; and (3) next-generation methods for gathering and disseminating data that give snapshot views of scientific research and innovation in sectors such as biotechnology and information and communication technology (ICT). Presentations and networked discussions will focus attention on the policy relevance of redesigned or new indicators.

DAY 1: Monday, July 11, 2011

8:00-9:00 AM REGISTRATION IN LOBBY (breakfast available in main foyer)
   
9:00-9:10 WELCOME AND OVERVIEW
Cochairs: Robert Litan (Kauffman Foundation) and Andrew Wyckoff (OECD)
  • Connie Citro (Committee on National Statistics, National Research Council)
  • Steve Merrill (Board on Science, Technology, and Economic Policy, National Research Council)
   
9:10-10:35 SESSION I: NEXT-GENERATION STI STATISTICS—FRAMEWORKS AND DATA
Objective: Identify what the federal statistical system can produce now regarding STI trends. Specific measures of business and university inputs and outputs and related outcomes and impacts are welcomed. What can be done now with existing surveys and administrative data? What do users want that requires new methods of gathering and disseminating data (types of data, linkages of agency surveys and periodicity)? What should NCSES produce to meet demand?
Chair: Bob Litan (Kauffman Foundation)
Discussant: John Rolph (University of Southern California) Presenters:
  • John Haltiwanger (University of Maryland)
  • Alicia Robb (Kauffman Foundation)
  • Stefano Bertuzzi (National Institutes of Health, STAR METRICS)
  • Matthieu Delescluse (European Commission)
   
10:35-10:45 BREAK (refreshments available in lobby)

____________________

*All listed affiliations are as of July 2011.

Suggested Citation:"Appendix C: Workshop on Developing Science, Technology, and Innovation Indicators for the Future Agenda and Participants." National Research Council. 2014. Capturing Change in Science, Technology, and Innovation: Improving Indicators to Inform Policy. Washington, DC: The National Academies Press. doi: 10.17226/18606.
×
10:45-12:45 PM SESSION II: INTERNATIONAL STI INDICATORS—RECENT DEVELOPMENTS
Objective: Identify recent developments in measuring STI and what is currently planned for the future.
Discussion should reveal what has been successfully and unsuccessfully measured. What are critical bottlenecks and perceived opportunities? Policy relevance of indicators is key. What global STI metrics and indicators should NCSES develop in the near and medium terms (the next 5-10 years)?
Chair: Michael Mandel (University of Pennsylvania)
Discussant: Andrew Wyckoff (OECD)
Presenters:
  • Jonathan Haskel (Imperial College Business School, U.K.)
  • Brian MacAulay (National Endowment for Science, Technology and the Arts, U.K.)
  • Hugo Hollanders (United Nations University-Maastricht Economic and Social Research Institute on Innovation and Technology [UNU-MERIT], Netherlands)
  • Shinichi Akaike (Institute of Innovation Research, Hitotsubashi University, Japan)
  • Cheonsik Woo (Korean Development Institute)
   
12:45-1:45 LUNCH (in main foyer)
   
1:45-3:45 SESSION III: NEXT-GENERATION STI STATISTICS—FRONTIER METHODS
Objective: Identify frameworks and tools beyond survey instruments that yield measurements of research and commercialization productivity. Details on how a statistical agency can utilize these tools are key. Education and workforce indicators are needed. Which tools are ripe for application that NCSES should use to produce new STI indicators?
Chair: Geoff Davis (Google)
Discussant: Richard Freeman (Harvard University)
Presenters:
  • Erik Brynjolfsson (Massachusetts Institute of Technology)
  • Lee Giles (Penn State University)
  • Carl Bergstrom (University of Washington)
  • Richard Price (Academia.edu)
   
3:45-4:00 BREAK (refreshments available in lobby)
   
4:00-5:00 SESSION IV: ROUNDTABLE: INDUSTRY, ACADEMIC, AND GOVERNMENT PERSPECTIVES
Objective: Identify what firms, universities, and statistical agencies can be expected to contribute to data inputs for STI indicators. Determine new uses for STI indicators at firms, particularly multinationals. Establish what policy makers and university sponsored research officers/technology transfer managers need to know in their respective decision-making processes. Where will the indicators be used and why, and why have they not already been developed? What are the new data inputs and new statistical outputs that should be the laser focus for NCSES in the next 5-10 years?
Chairs: Barbara Fraumeni (University of Southern Maine)
Discussants:
  • Nick Donofrio (IBM)
  • Richard Freeman (Harvard University)
  • David Goldston (Natural Resources Defense Council)
   
5:00-5:10 WRAP-UP
  • Cochairs: Robert Litan and Andrew Wyckoff
  • Study Director: Kaye Husbands Fealing (National Academies/ Committee on National Statistics)
   
5:30-7:00 RECEPTION (in main foyer)
   
7:00 pm ADJOURN
Suggested Citation:"Appendix C: Workshop on Developing Science, Technology, and Innovation Indicators for the Future Agenda and Participants." National Research Council. 2014. Capturing Change in Science, Technology, and Innovation: Improving Indicators to Inform Policy. Washington, DC: The National Academies Press. doi: 10.17226/18606.
×

DAY 2: Tuesday, July 12, 2011

8:00 -8:30 AM REGISTRATION IN LOBBY (breakfast available in main foyer)
   
8:30 -10:30 SESSION V: INTERNATIONAL STI INDICATORS—NEW REGIONS
Objective: Identify new foci for STI indicator initiatives. Includes presentations on emerging economies’ measurement of STI diffusion and impacts. Discussion of service-sector measures and measures of design activities. What indicators should NCSES develop to measure technological diffusion and design?
Chair: Carl Dahlman (Georgetown University)
Discussant: Fred Gault (UNU-MERIT)
Presenters:
  • Howard Alper (University of Ottawa, Canada)
  • Changlin Gao (Chinese Academy of Science and Technology for Development)
  • Philippe Mawoko (The New Partnership for Africa’s Development [NEPAD], South Africa)
  • Gustavo Crespi (Inter-American Development Bank, Uruguay)
  • Jayanta Chatterjee (Indian Institute of Technology-Kanpur)
   
10:30-10:45 BREAK (refreshments available in lobby)
   
10:45-12:30 PM SESSION VI: SUBNATIONAL STI INDICATORS
Objective: Identify state and regional indicators of entrepreneurial activities and hot spots of innovation.
What indicators should NCSES develop to measure state and regional STI and diffusion activities?
Chair: Lee Wilkinson (SYSTAT)
Discussant: David Goldston (Natural Resources Defense Council)
Presenters:
  • Andrew Reamer (George Washington University)
  • Robert Atkinson (Information Technology and Innovation Foundation)
  • Maryann Feldman (University of North Carolina)
  • David Winwood (University of Alabama-Birmingham Research Foundation)/Robert Samors (Association of Public and Land-grant Universities [APLU], by telephone)
   
12:30-12:40 Wrap-up
Cochairs: Robert Litan and Andrew Wyckoff
   
12:40-2:00 LUNCH (in main foyer)
   
2:00 pm ADJOURN
Suggested Citation:"Appendix C: Workshop on Developing Science, Technology, and Innovation Indicators for the Future Agenda and Participants." National Research Council. 2014. Capturing Change in Science, Technology, and Innovation: Improving Indicators to Inform Policy. Washington, DC: The National Academies Press. doi: 10.17226/18606.
×

PARTICIPANTS

Panel Members

Robert E. Litan (Cochair), The Ewing Marion Kauffman Foundation

Andrew W. Wyckoff (Cochair), OECD, Paris

Carl J. Dahlman, Georgetown University

Geoff Davis, Google, Inc.

Barbara M. Fraumeni, University of Southern Maine

Richard B. Freeman, Harvard University

Fred Gault, United Nations University-Maastricht Economic and Social Research Institute on Innovation and Technology, The Netherlands

David Goldston, Natural Resources Defense Council

Michael Mandel, University of Pennsylvania

John E. Rolph, University of Southern California

Leland Wilkinson, SYSTAT Software, Inc.

Presenters

Shinichi Akaike, Hitotsubashi University, Japan

Howard Alper, Canada’s Science, Technology, and Innovation Council

Rob Atkinson, Information Technology and Innovation Foundation

Carl Bergstrom, University of Washington

Stefano Bertuzzi, National Institutes of Health

Eric Brynjolfsson, Massachusetts Institute of Technology

Jayanta Chatterjee, Indian Institute of Technology, Kanpur, India

Gustavo Crespi, Inter-American Development Bank

Matthieu Delescluse, European Commission, Brussels, Belgium

Nick Donofrio, IBM

Maryann Feldman, University of North Carolina

Changlin Gao, Chinese Academy of Science and Technology, Beijing, China

Lee Giles, Penn State University

John Haltiwanger, University of Maryland

Jonathan Haskel, Imperial College Business School, United Kingdom

Hugo Hollanders, Maastrict University, The Netherlands

Brian MacAulay, National Endowment for Science, Technology and the Arts, United Kingdom

Philippe Mawoko, The New Partnership for Africa’s Development (NEPAD), Pretoria, South Africa

Richard Price, Academia.edu

Andrew Reamer, George Washington University

Alicia Robb, The Ewing Marion Kauffman Foundation

Robert Samors (by telephone), Association of Public and Land-grant Universities

David Winwood, Association of Public and Land-grant Universities

Guests

Ana Aizcorbe, U.S. Bureau of Economic Analysis

Jeff Alexander, SRI International

Gary Anderson, Jr., National Institute of Standards and Technology

Clara Asmail, National Institute of Standards and Technology

B.K. Atrostic, U.S. Census Bureau

David Ballard, GRA, Inc.

David Beede, U.S. Department of Commerce

Bob Bell, National Center for Science and Engineering Statistics, National Science Foundation

Brittany Bond, U.S. Department of Commerce

Patrice Bourdelais, Centre National de la Récherche Scientifique

Paul Bugg, U.S. Office of Management and Budget

Lynda Carlson, National Center for Science and Engineering Statistics, National Science Foundation

Carolyn Carroll, STAT TECH, Inc.

Arthur Cho, Japan Science and Technology Agency

Carol Corrado, Georgetown Center for Business and Public Policy

Louis Marc Ducharme, Statistics Canada

Louise Earl, Statistics Canada

Uchenna Egenti, East Tennessee State University

Jonathan Epstein, U.S. Senate

Paul Fakes, American Society for Mechanical Engineers

Chris Fall, U.S. Military

Jean Favero, Centre National de la Récherche Scientifique

Lauren Gilchrist, Center for Regional Economic Competitiveness

Stuart Graham, U.S. Patent and Trademark Office

Myron Gutmann, Directorate for the Social, Behavioral, and Economic Sciences, National Science Foundation

John Hall, PA Alliance for STEM Education

Kim Hamilton, U.S. Patent Board

Lee Herring, Office of Legislative and Public Affairs, National Science Foundation

Robert Hershey, Capital PC User Group

Chris Hill, George Mason University

Richard Hough, U.S. Census Bureau

Tommy Hudzik, Independent Consultant

Charles Hulten, University of Maryland

Elmer Iglesias, U.S. Department of Commerce

Takashi Inutsuka, Science Counselor, Embassy of Japan

John Jankowski, National Center for Science and Engineering Statistics, National Science Foundation

Ken Jarboe, Athena Alliance

Richard Johnson, Global Helix, LLC

David Kahaner, Asian Technology Information Program

Nimmi Kannankutty, National Center for Science and Engineering Statistics, National Science Foundation

Michael Kehoe, American Association for the Advancement of Science

Suggested Citation:"Appendix C: Workshop on Developing Science, Technology, and Innovation Indicators for the Future Agenda and Participants." National Research Council. 2014. Capturing Change in Science, Technology, and Innovation: Improving Indicators to Inform Policy. Washington, DC: The National Academies Press. doi: 10.17226/18606.
×

Todd Kuiken, Woodrow Wilson International Center for Scholars

Karen Laney, U.S. International Trade Commission

Chuck Larson, Innovation Research International

Marc Legault, Science, Technology, and Innovation Council, Canada

Rolf Lehming, National Center for Science and Engineering Statistics, National Science Foundation

Wendy Li, U.S. Bureau of Economic Analysis

Ying Lowrey, U.S. Small Business Administration

Shelley Martinez, U.S. Office of Management and Budget

Tony Mazzaschi, Association of American Medical Colleges

Christine McDonald, U.S. Office of Management and Budget

Javier Miranda, U.S. Census Bureau

T.C. Moore, Independent Consultant

Francisco Moris, National Center for Science and Engineering Statistics, National Science Foundation

Paul Morris, National Center for Science and Engineering Statistics, National Science Foundation

Manuel Mota, Massachusetts Institute of Technology

Jeri Mulrow, National Center for Science and Engineering Statistics, National Science Foundation

Vinh Nguyen, Independent Consultant

Kimberly Noonan, National Center for Science and Engineering Statistics, National Science Foundation

Pamela O’Neil, National Center for Science and Engineering Statistics, National Science Foundation

Takashi Ohama, Japan Science and Technology Agency

Sumiya Okubo, Independent Consultant

Erik Pages, EntreWorks Consulting

Diane Palmintera, Innovation Associates

Sapun Parekh, National Science Foundation

Jongwon Park, SRI International

Joel Parriott, U.S. Office of Management and Budget

Sebastian Pfotenhauer, Massachusetts Institute of Technology

Pallivi Phartiyal, American Association for the Advancement of Science

Brian Reinhardt, Defense Threat Reduction Agency

Sally Rood, Science Policy Works International

Robert Shelton, World Technology Evaluation Center, Inc.

Stephanie Shipp, IDA Science and Technology Policy Institute

Debbie Stine, President’s Council of Advisors on Science and Technology

Andrea Stith, International Higher Education and Science

Ezequiel Tacsir, Inter-American Development Bank

Greg Tassey, National Institute of Standards and Technology

Chris Thomas, Independent Consultant

Hua Tian, Arizona State University

James Tsang, Independent Consultant

Nick Vonortas, George Washington University

Philip Webre, Congressional Budget Office

Brittany Westlake, American Chemical Society

Jeremy Wise, U.S. International Trade Commission

Tim Wojan, U.S. Department of Agriculture

Rieko Yajima, American Association for the Advancement of Science

Arthur Yong Yeung Cho, Japan Science and Technology Agency

Pluvia Zuniga, United Nations University-Maastricht Economic and Social Research Institute on Innovation and Technology

NRC Staff

Connie Citro, Committee on National Statistics

Gail Greenfield, Policy and Global Affairs

Kaye Husbands Fealing, Committee on National Statistics

Anthony Mann, Committee on National Statistics

Steve Merrill, Board on Science, Technology, and Economic Policy

Miron Straf, Division of Behavioral and Social Sciences and Education

Suggested Citation:"Appendix C: Workshop on Developing Science, Technology, and Innovation Indicators for the Future Agenda and Participants." National Research Council. 2014. Capturing Change in Science, Technology, and Innovation: Improving Indicators to Inform Policy. Washington, DC: The National Academies Press. doi: 10.17226/18606.
×

This page intentionally left blank.

Suggested Citation:"Appendix C: Workshop on Developing Science, Technology, and Innovation Indicators for the Future Agenda and Participants." National Research Council. 2014. Capturing Change in Science, Technology, and Innovation: Improving Indicators to Inform Policy. Washington, DC: The National Academies Press. doi: 10.17226/18606.
×
Page 129
Suggested Citation:"Appendix C: Workshop on Developing Science, Technology, and Innovation Indicators for the Future Agenda and Participants." National Research Council. 2014. Capturing Change in Science, Technology, and Innovation: Improving Indicators to Inform Policy. Washington, DC: The National Academies Press. doi: 10.17226/18606.
×
Page 130
Suggested Citation:"Appendix C: Workshop on Developing Science, Technology, and Innovation Indicators for the Future Agenda and Participants." National Research Council. 2014. Capturing Change in Science, Technology, and Innovation: Improving Indicators to Inform Policy. Washington, DC: The National Academies Press. doi: 10.17226/18606.
×
Page 131
Suggested Citation:"Appendix C: Workshop on Developing Science, Technology, and Innovation Indicators for the Future Agenda and Participants." National Research Council. 2014. Capturing Change in Science, Technology, and Innovation: Improving Indicators to Inform Policy. Washington, DC: The National Academies Press. doi: 10.17226/18606.
×
Page 132
Suggested Citation:"Appendix C: Workshop on Developing Science, Technology, and Innovation Indicators for the Future Agenda and Participants." National Research Council. 2014. Capturing Change in Science, Technology, and Innovation: Improving Indicators to Inform Policy. Washington, DC: The National Academies Press. doi: 10.17226/18606.
×
Page 133
Suggested Citation:"Appendix C: Workshop on Developing Science, Technology, and Innovation Indicators for the Future Agenda and Participants." National Research Council. 2014. Capturing Change in Science, Technology, and Innovation: Improving Indicators to Inform Policy. Washington, DC: The National Academies Press. doi: 10.17226/18606.
×
Page 134
Next: Appendix D: OECD-National Experts on Science and Technology Indicators (NESTI) Workshop and Attendees »
Capturing Change in Science, Technology, and Innovation: Improving Indicators to Inform Policy Get This Book
×
Buy Paperback | $64.00 Buy Ebook | $49.99
MyNAP members save 10% online.
Login or Register to save!
Download Free PDF

Since the 1950s, under congressional mandate, the U.S. National Science Foundation (NSF) - through its National Center for Science and Engineering Statistics (NCSES) and predecessor agencies - has produced regularly updated measures of research and development expenditures, employment and training in science and engineering, and other indicators of the state of U.S. science and technology. A more recent focus has been on measuring innovation in the corporate sector. NCSES collects its own data on science, technology, and innovation (STI) activities and also incorporates data from other agencies to produce indicators that are used for monitoring purposes - including comparisons among sectors, regions, and with other countries - and for identifying trends that may require policy attention and generate research needs. NCSES also provides extensive tabulations and microdata files for in-depth analysis.

Capturing Change in Science, Technology, and Innovation assesses and provides recommendations regarding the need for revised, refocused, and newly developed indicators of STI activities that would enable NCSES to respond to changing policy concerns. This report also identifies and assesses both existing and potential data resources and tools that NCSES could exploit to further develop its indicators program. Finally, the report considers strategic pathways for NCSES to move forward with an improved STI indicators program. The recommendations offered in Capturing Change in Science, Technology, and Innovation are intended to serve as the basis for a strategic program of work that will enhance NCSES's ability to produce indicators that capture change in science, technology, and innovation to inform policy and optimally meet the needs of its user community.

  1. ×

    Welcome to OpenBook!

    You're looking at OpenBook, NAP.edu's online reading room since 1999. Based on feedback from you, our users, we've made some improvements that make it easier than ever to read thousands of publications on our website.

    Do you want to take a quick tour of the OpenBook's features?

    No Thanks Take a Tour »
  2. ×

    Show this book's table of contents, where you can jump to any chapter by name.

    « Back Next »
  3. ×

    ...or use these buttons to go back to the previous chapter or skip to the next one.

    « Back Next »
  4. ×

    Jump up to the previous page or down to the next one. Also, you can type in a page number and press Enter to go directly to that page in the book.

    « Back Next »
  5. ×

    Switch between the Original Pages, where you can read the report as it appeared in print, and Text Pages for the web version, where you can highlight and search the text.

    « Back Next »
  6. ×

    To search the entire text of this book, type in your search term here and press Enter.

    « Back Next »
  7. ×

    Share a link to this book page on your preferred social network or via email.

    « Back Next »
  8. ×

    View our suggested citation for this chapter.

    « Back Next »
  9. ×

    Ready to take your reading offline? Click here to buy this book in print or download it as a free PDF, if available.

    « Back Next »
Stay Connected!