National Academies Press: OpenBook
Suggested Citation:"Front Matter." National Research Council. 2012. For Attribution: Developing Data Attribution and Citation Practices and Standards: Summary of an International Workshop. Washington, DC: The National Academies Press. doi: 10.17226/13564.
×

For Attribution—

Developing Data Attribution and
Citation Practices and Standards

Summary of an International Workshop

Paul F. Uhlir, Rapporteur

Board on Research Data and Information

Policy and Global Affairs

NATIONAL RESEARCH COUNCIL
OF THE NATIONAL ACADEMIES

THE NATIONAL ACADEMIES PRESS
Washington, D.C.
www.nap.edu

Suggested Citation:"Front Matter." National Research Council. 2012. For Attribution: Developing Data Attribution and Citation Practices and Standards: Summary of an International Workshop. Washington, DC: The National Academies Press. doi: 10.17226/13564.
×

THE NATIONAL ACADEMIES PRESS    500 Fifth Street, NW    Washington, DC    20001

NOTICE: The project that is the subject of this report was approved by the Governing Board of the National Research Council, whose members are drawn from the councils of the National Academy of Sciences, the National Academy of Engineering, and the Institute of Medicine. The members of the committee responsible for the report were chosen for their special competences and with regard for appropriate balance.

This project was supported by the Alfred P. Sloan Foundation under Grant No. 2011-3-19, and by the Institute of Museum and Library Services under Grant No. 1042078. This report was prepared as an account of work sponsored by an agency of the United States government. Neither the United States government nor any agency thereof, nor any of their employees, makes any warranty, express or implied, or assumes any legal liability or responsibility for the accuracy, completeness, or usefulness of any information, apparatus, product, or process disclosed, or represents that its use would not infringe privately owned rights. Reference herein to any specific commercial product, process, or service by trade name, trademark, manufacturer, or otherwise does not necessarily constitute or imply its endorsement, recommendation, or favoring by the United States government or any agency thereof. Any opinions, findings, conclusions, or recommendations expressed in this publication are those of the authors and do not necessarily reflect the views of the National Academies or the organizations or agencies that provided support for the project.

International Standard Book Number-13: 978-0-309-26728-1
International Standard Book Number-10: 0-309-26728-5

Additional copies of this report are available for sale from the National Academies Press, 500 Fifth Street, NW, Keck 360, Washington, DC 20001; (800) 624-6242 or (202) 334-3313; Internet, http://www.nap.edu/.

Copyright 2012 by the National Academy of Sciences. All rights reserved.

Printed in the United States of America

Suggested Citation:"Front Matter." National Research Council. 2012. For Attribution: Developing Data Attribution and Citation Practices and Standards: Summary of an International Workshop. Washington, DC: The National Academies Press. doi: 10.17226/13564.
×

THE NATIONAL ACADEMIES

Advisers to the Nation on Science, Engineering and Medicine

The National Academy of Sciences is a private, nonprofit, self-perpetuating society of distinguished scholars engaged in scientific and engineering research, dedicated to the furtherance of science and technology and to their use for the general welfare. Upon the authority of the charter granted to it by the Congress in 1863, the Academy has a mandate that requires it to advise the federal government on scientific and technical matters. Dr. Ralph J. Cicerone is president of the National Academy of Sciences.

The National Academy of Engineering was established in 1964, under the charter of the National Academy of Sciences, as a parallel organization of outstanding engineers. It is autonomous in its administration and in the selection of its members, sharing with the National Academy of Sciences the responsibility for advising the federal government. The National Academy of Engineering also sponsors engineering programs aimed at meeting national needs, encourages education and research, and recognizes the superior achievements of engineers. Dr. Charles M. Vest is president of the National Academy of Engineering.

The Institute of Medicine was established in 1970 by the National Academy of Sciences to secure the services of eminent members of appropriate professions in the examination of policy matters pertaining to the health of the public. The Institute acts under the responsibility given to the National Academy of Sciences by its congressional charter to be an adviser to the federal government and, upon its own initiative, to identify issues of medical care, research, and education. Dr. Harvey V. Fineberg is president of the Institute of Medicine.

The National Research Council was organized by the National Academy of Sciences in 1916 to associate the broad community of science and technology with the Academy’s purposes of furthering knowledge and advising the federal government. Functioning in accordance with general policies determined by the Academy, the Council has become the principal operating agency of both the National Academy of Sciences and the National Academy of Engineering in providing services to the government, the public, and the scientific and engineering communities. The Council is administered jointly by both Academies and the Institute of Medicine. Dr. Ralph J. Cicerone and Dr. Charles M. Vest are chair and vice chair, respectively, of the National Research Council.

www.national-academies.org

Suggested Citation:"Front Matter." National Research Council. 2012. For Attribution: Developing Data Attribution and Citation Practices and Standards: Summary of an International Workshop. Washington, DC: The National Academies Press. doi: 10.17226/13564.
×

This page intentionally left blank.

Suggested Citation:"Front Matter." National Research Council. 2012. For Attribution: Developing Data Attribution and Citation Practices and Standards: Summary of an International Workshop. Washington, DC: The National Academies Press. doi: 10.17226/13564.
×

Steering Committee, Developing Data Attribution and Citation Practices and Standards: An International Workshop

Christine Borgman (Chair)
Professor and Presidential Chair
Graduate School of Education and Information Studies
University of California, Los Angeles

Steven Jackson
Assistant Professor, School of Information, and
Director, Technology Policy Culture Research Lab
University of Michigan

Gary King
Albert J. Weatherhead, III. Professor, Department of Government, and
Director, Institute for Quantitative Social Science
Harvard University

David Kochalko
Vice President, Business Strategy and Development, IP & Science
Thomson Reuters

Allen Renear
Associate Dean for Research
University of Illinois at Urbana-Champaign
Graduate School of Library and Information Science

Herbert van de Sompel
Research Scientist
Los Alamos National Lab

John Wilbanks
Vice President, Creative Commons,
Director, Science Commons
Creative Commons

Project Staff at the National Academies

Paul F. Uhlir, Director, Board on Research Data and Information

Daniel Cohen Program Officer
(on detail from Library of Congress)

Cheryl Williams Levey
Senior Program Associate

Suggested Citation:"Front Matter." National Research Council. 2012. For Attribution: Developing Data Attribution and Citation Practices and Standards: Summary of an International Workshop. Washington, DC: The National Academies Press. doi: 10.17226/13564.
×

BOARD ON RESEARCH DATA AND INFORMATION
MEMBERSHIP (as of the date of this workshop)

Michael Lesk, Chair, Rutgers University

Roberta Balstad, Vice Chair, Columbia University

Maureen Baginski, Serco

Francine Berman, Rensselaer Polytechnic Institute

R. Steven Berry, University of Chicago

Christine Borgman, University of California, Los Angeles

Norman Bradburn, University of Chicago

Bonnie Carroll, Information International Associates

Michael Carroll, American University, Washington College of Law

Paul A. David, Stanford Institute for Economic Policy Department of Economics

Barbara Entwisle, University of North Carolina

Michael Goodchild, University of California, Santa Barbara

Alyssa Goodman, Harvard University Margaret Hedstrom, University of Michigan

Michael Keller, Stanford University

Michael R. Nelson, Georgetown University

Daniel Reed, Microsoft Research

Cathy H. Wu, University of Delaware and Georgetown University Medical Center

Suggested Citation:"Front Matter." National Research Council. 2012. For Attribution: Developing Data Attribution and Citation Practices and Standards: Summary of an International Workshop. Washington, DC: The National Academies Press. doi: 10.17226/13564.
×

BOARD ON RESEARCH DATA AND INFORMATION
MEMBERSHIP (as of the date of this report)

Francine Berman, Cochair, Rensselaer Polytechnic Institute

Clifford Lynch, Cochair, Coalition for Networked Information

Laura Bartolo, Kent State University

Philip Bourne, University of California, San Diego

Henry Brady, University of California, Berkeley

Mark Brender, GeoEye Foundation

Bonnie Carroll, Information International Associates

Michael Carroll, Washington College of Law, American University

Sayeed Choudhury, Johns Hopkins University

Keith Clarke, University of California, Santa Barbara

Paul David, Stanford Institute for Economic Policy Research

Kelvin Droegemeier, University of Oklahoma

Clifford Duke, Ecological Society of America

Barbara Entwisle, University of North Carolina

Stephen Friend, Sage Bionetworks

Margaret Hedstrom, University of Michigan

Alexa McCray, Harvard Medical School

Alan Title, Lockheed Martin Advanced Technology Center

Ann Wolpert, Massachusetts Institute of Technology

EX OFFICIO

Robert Chen, Columbia University

Michael Clegg, University of California, Irvine

Page viii Cite
Suggested Citation:"Front Matter." National Research Council. 2012. For Attribution: Developing Data Attribution and Citation Practices and Standards: Summary of an International Workshop. Washington, DC: The National Academies Press. doi: 10.17226/13564.
×

Sara Graves, University of Alabama in Huntsville

John Faundeen, Earth Resources Observation and Science Center

Eric Kihn, National Geophysical Data Center

Chris Lenhardt, Oak Ridge National Laboratory

Kathleen Robinette, Air Force Research Laboratory

Alex de Sherbinin, Columbia University

Board on Research Data and Information Staff

Paul F. Uhlir, Board Director

Subhash Kuvelker, Senior Program Officer

Daniel Cohen, Program Officer (on detail from Library of Congress)

Cheryl Williams Levey, Senior Program Associate

Suggested Citation:"Front Matter." National Research Council. 2012. For Attribution: Developing Data Attribution and Citation Practices and Standards: Summary of an International Workshop. Washington, DC: The National Academies Press. doi: 10.17226/13564.
×

Preface and Acknowledgments

The growth of electronic publishing of literature has created new challenges, such as the need for mechanisms for citing online references in ways that can assure discoverability and retrieval for many years into the future. The growth in online datasets presents related, yet more complex challenges. It depends upon the ability to reliably identify, locate, access, interpret and verify the version, integrity, and provenance of digital datasets.

Data citation standards and good practices can form the basis for increased incentives, recognition, and rewards for scientific data activities that in many cases are currently lacking in many fields of research. The rapidly-expanding universe of online digital data holds the promise of allowing peer-examination and review of conclusions or analysis based on experimental or observational data, the integration of data into new forms of scholarly publishing, and the ability for subsequent users to make new and unforeseen uses and analyses of the same data - either in isolation, or in combination with other datasets.

The problem of citing online data is complicated by the lack of established practices for referring to portions or subsets of data. As funding sources for scientific research have begun to require data management plans as part of their selection and approval processes, it is important that the necessary standards, incentives, and conventions to support data citation, preservation, and accessibility be put into place.

There are, in fact, a number of initiatives in different organizations, countries, and disciplines already underway. An important set of technical and policy approaches have already been launched by the U.S. National Information Standards Organization (NISO) and other standards bodies regarding persistent identifiers and online linking. Another important group is DataCite. The World Data System is also focusing on these issues, but other initiatives remain ad hoc and uncoordinated.

The workshop summarized here was organized by a steering committee under the National Research Council’s (NRC’s) Board on Research Data and Information, in collaboration with an international CODATA-ICSTI Task Group on Data Citation Standards and Practices. The purpose of the symposium was to examine a number of key issues related to data identification, attribution, citation and linking, to help coordinate activities in this area internationally, and to promote common practices and standards in the scientific community. More specifically, the statement of task for this project asked the following questions:

1.    What is the status of data attribution and citation practices in the natural and social (economic and political) sciences in United States and internationally?

2.    Why is the attribution and citation of scientific data important and for what types of data? Is there substantial variation among disciplines?

3.    What are the major scientific, technical, institutional, economic, legal, and socio-cultural issues that need to be considered in developing and implementing scientific data citation

Suggested Citation:"Front Matter." National Research Council. 2012. For Attribution: Developing Data Attribution and Citation Practices and Standards: Summary of an International Workshop. Washington, DC: The National Academies Press. doi: 10.17226/13564.
×

standards and practices? Which ones are universal for all types of research and which ones are field or context specific?

4.    What are some of the options for the successful development and implementation of scientific data citation practices and standards, both across the natural and social sciences and in major contexts of research?

The workshop that was organized pursuant to these questions was held in Berkeley, CA on August 22-23, 2011. The presentations and discussions that are summarized from this meeting in the volume that follows are part of this effort.

This report has been prepared by the workshop rapporteur as a factual summary of what occurred at the workshop. The committee’s role was limited to planning and convening the workshop. The views contained in the report are those of the individual workshop participants and do not necessarily represent the views of all workshop participants, the planning committee, or the National Academies.

Acknowledgments

We are grateful to the following for support of this project: Institute of Museum and Library Services, grant number IMLS LG-00-11-0123-11; Sloan Foundation, grant number 2011-3-19; the Committee on Data for Science and Technology (CODATA); and Microsoft Research. Any views, findings, conclusions or recommendations expressed in this publication do not necessarily represent those of the Institute of Museum and Library Services, or the other sponsors.

This report has been reviewed in draft form by individuals chosen for their diverse perspectives and technical expertise, in accordance with procedures approved by the National Academies’ Report Review Committee. The purpose of this independent review is to provide candid and critical comments that will assist the institution in making its published report as sound as possible and to ensure that the report meets institutional standards for quality and objectivity. The review comments and draft manuscript remain confidential to protect the integrity of the process.

We wish to thank the following individuals for their review of this report: Suzanne Allard, University of Tennessee; Anne Fitzgerald, Queensland University, Australia; Charles Humphrey, University of Alberta; Brian McMahon, International Union of Crystallography, United Kingdom; and John Rumble, Information International Associates (retired).

Although the reviewers listed above have provided many constructive comments and suggestions, they were not asked to endorse the content of the report, nor did they see the final draft before its release. Responsibility for the final content of this report rests entirely with the rapporteur and the institution.

Many people devoted many months of effort to organizing this event. Dan Cohen and Cheryl Levey of the staff of the Board on Research Data and Infrastructure spent much of their 2011

Suggested Citation:"Front Matter." National Research Council. 2012. For Attribution: Developing Data Attribution and Citation Practices and Standards: Summary of an International Workshop. Washington, DC: The National Academies Press. doi: 10.17226/13564.
×

summer working on the Workshop project. Christine Borgman, Paul Uhlir, and Dan Cohen had conference calls with each session panel to ensure synthesis and continuity. The Workshop was coordinated with the activities of the CODATA-ICSTI Task Group on Data Citation Standards and Practices, whose co-chairs are Bonnie Carroll, Jan Brase, and Sarah Callaghan. Members of that Task Group are (in alphabetical order) Micah Altman, Elisabeth Arnaud, Christine Borgman, Dora Ann Lange Canhos, Todd Carpenter, Vishwas Chavan, Michael Diepenbroek, John Helly, Jianhui Li, Brian McMahon, Karen Morgenroth, Yasuhiro Murayama, Helge Sagen, Eefke Smit, Martie van Deventer, John Wilbanks, and Koji Zettsu. Paul Uhlir, Dan Cohen, and Franciel Linares are staff consultants to the Task Group. Special thanks also are due to the Workshop Steering Committee, consisting of Christine Borgman (Chair), Allen Renear, Herbert van de Sompel, Gary King, Steven Jackson, David Kochalko, and John Wilbanks, as well as to the young scientists who served as rapporteurs in the final afternoon sessions: Franciel Linares, Matthew Mayernick, Jillian Wallis, and Laura Wynholds.

Christine Borgman                Paul F. Uhlir
Steering Committee Chair                Project Director
Suggested Citation:"Front Matter." National Research Council. 2012. For Attribution: Developing Data Attribution and Citation Practices and Standards: Summary of an International Workshop. Washington, DC: The National Academies Press. doi: 10.17226/13564.
×

This page intentionally left blank.

Suggested Citation:"Front Matter." National Research Council. 2012. For Attribution: Developing Data Attribution and Citation Practices and Standards: Summary of an International Workshop. Washington, DC: The National Academies Press. doi: 10.17226/13564.
×

DISCUSSION BY WORKSHOP PARTICIPANTS

Moderated by Bonnie Carroll

26- Standards and Data Citations

Todd Carpenter

27- Data Citation and Attribution: A Funder’s Perspective

Sylvia Spengler

DISCUSSSION BY WORKSHOP PARTICIPANTS

Moderated by Christine Borgman

PART SIX SUMMARY OF BREAKOUT SESSIONS

Breakout Session on Technical Issues

Moderator: Martie van Deventer

Rapporteur: Franciel Linares

Breakout Session on Scientific Issues

Moderator: Sarah Callaghan

Rapporteur: Matthew Mayernik

Breakout Session on Institutional, Financial, Legal, and Socio-cultural Issues

Moderator: Vishwas Chavan

Rapporteur: Laura Wynholds

Breakout Session on Institutional Roles and Perspectives

Moderator: Bonnie Carroll

Rapporteur: Jillian Wallis

Appendix A: Agenda

Appendix B: Speaker and Moderator Biographical Information

Suggested Citation:"Front Matter." National Research Council. 2012. For Attribution: Developing Data Attribution and Citation Practices and Standards: Summary of an International Workshop. Washington, DC: The National Academies Press. doi: 10.17226/13564.
×

This page intentionally left blank.

Page xvii Cite
Suggested Citation:"Front Matter." National Research Council. 2012. For Attribution: Developing Data Attribution and Citation Practices and Standards: Summary of an International Workshop. Washington, DC: The National Academies Press. doi: 10.17226/13564.
×

DISCUSSION BY WORKSHOP PARTICIPANTS

Moderated by Bonnie Carroll

26- Standards and Data Citations

Todd Carpenter

27- Data Citation and Attribution: A Funder’s Perspective

Sylvia Spengler

DISCUSSSION BY WORKSHOP PARTICIPANTS

Moderated by Christine Borgman

PART SIX SUMMARY OF BREAKOUT SESSIONS

Breakout Session on Technical Issues

Moderator: Martie van Deventer

Rapporteur: Franciel Linares

Breakout Session on Scientific Issues

Moderator: Sarah Callaghan

Rapporteur: Matthew Mayernik

Breakout Session on Institutional, Financial, Legal, and Socio-cultural Issues

Moderator: Vishwas Chavan

Rapporteur: Laura Wynholds

Breakout Session on Institutional Roles and Perspectives

Moderator: Bonnie Carroll

Rapporteur: Jillian Wallis

Appendix A: Agenda

Appendix B: Speaker and Moderator Biographical Information

Page xviii Cite
Suggested Citation:"Front Matter." National Research Council. 2012. For Attribution: Developing Data Attribution and Citation Practices and Standards: Summary of an International Workshop. Washington, DC: The National Academies Press. doi: 10.17226/13564.
×

This page is blank.

Suggested Citation:"Front Matter." National Research Council. 2012. For Attribution: Developing Data Attribution and Citation Practices and Standards: Summary of an International Workshop. Washington, DC: The National Academies Press. doi: 10.17226/13564.
×
Page R1
Suggested Citation:"Front Matter." National Research Council. 2012. For Attribution: Developing Data Attribution and Citation Practices and Standards: Summary of an International Workshop. Washington, DC: The National Academies Press. doi: 10.17226/13564.
×
Page R2
Suggested Citation:"Front Matter." National Research Council. 2012. For Attribution: Developing Data Attribution and Citation Practices and Standards: Summary of an International Workshop. Washington, DC: The National Academies Press. doi: 10.17226/13564.
×
Page R3
Suggested Citation:"Front Matter." National Research Council. 2012. For Attribution: Developing Data Attribution and Citation Practices and Standards: Summary of an International Workshop. Washington, DC: The National Academies Press. doi: 10.17226/13564.
×
Page R4
Suggested Citation:"Front Matter." National Research Council. 2012. For Attribution: Developing Data Attribution and Citation Practices and Standards: Summary of an International Workshop. Washington, DC: The National Academies Press. doi: 10.17226/13564.
×
Page R5
Suggested Citation:"Front Matter." National Research Council. 2012. For Attribution: Developing Data Attribution and Citation Practices and Standards: Summary of an International Workshop. Washington, DC: The National Academies Press. doi: 10.17226/13564.
×
Page R6
Suggested Citation:"Front Matter." National Research Council. 2012. For Attribution: Developing Data Attribution and Citation Practices and Standards: Summary of an International Workshop. Washington, DC: The National Academies Press. doi: 10.17226/13564.
×
Page R7
Page viii Cite
Suggested Citation:"Front Matter." National Research Council. 2012. For Attribution: Developing Data Attribution and Citation Practices and Standards: Summary of an International Workshop. Washington, DC: The National Academies Press. doi: 10.17226/13564.
×
Page R8
Suggested Citation:"Front Matter." National Research Council. 2012. For Attribution: Developing Data Attribution and Citation Practices and Standards: Summary of an International Workshop. Washington, DC: The National Academies Press. doi: 10.17226/13564.
×
Page R9
Suggested Citation:"Front Matter." National Research Council. 2012. For Attribution: Developing Data Attribution and Citation Practices and Standards: Summary of an International Workshop. Washington, DC: The National Academies Press. doi: 10.17226/13564.
×
Page R10
Suggested Citation:"Front Matter." National Research Council. 2012. For Attribution: Developing Data Attribution and Citation Practices and Standards: Summary of an International Workshop. Washington, DC: The National Academies Press. doi: 10.17226/13564.
×
Page R11
Suggested Citation:"Front Matter." National Research Council. 2012. For Attribution: Developing Data Attribution and Citation Practices and Standards: Summary of an International Workshop. Washington, DC: The National Academies Press. doi: 10.17226/13564.
×
Page R12
Page xiii Cite
Suggested Citation:"Front Matter." National Research Council. 2012. For Attribution: Developing Data Attribution and Citation Practices and Standards: Summary of an International Workshop. Washington, DC: The National Academies Press. doi: 10.17226/13564.
×
Page R13
Suggested Citation:"Front Matter." National Research Council. 2012. For Attribution: Developing Data Attribution and Citation Practices and Standards: Summary of an International Workshop. Washington, DC: The National Academies Press. doi: 10.17226/13564.
×
Page R14
Suggested Citation:"Front Matter." National Research Council. 2012. For Attribution: Developing Data Attribution and Citation Practices and Standards: Summary of an International Workshop. Washington, DC: The National Academies Press. doi: 10.17226/13564.
×
Page R15
Suggested Citation:"Front Matter." National Research Council. 2012. For Attribution: Developing Data Attribution and Citation Practices and Standards: Summary of an International Workshop. Washington, DC: The National Academies Press. doi: 10.17226/13564.
×
Page R16
Page xvii Cite
Suggested Citation:"Front Matter." National Research Council. 2012. For Attribution: Developing Data Attribution and Citation Practices and Standards: Summary of an International Workshop. Washington, DC: The National Academies Press. doi: 10.17226/13564.
×
Page R17
Page xviii Cite
Suggested Citation:"Front Matter." National Research Council. 2012. For Attribution: Developing Data Attribution and Citation Practices and Standards: Summary of an International Workshop. Washington, DC: The National Academies Press. doi: 10.17226/13564.
×
Page R18
Next: Why Are the Attribution and Citation of Scientific Data Important? »
For Attribution: Developing Data Attribution and Citation Practices and Standards: Summary of an International Workshop Get This Book
×
Buy Paperback | $48.00 Buy Ebook | $38.99
MyNAP members save 10% online.
Login or Register to save!
Download Free PDF

The growth of electronic publishing of literature has created new challenges, such as the need for mechanisms for citing online references in ways that can assure discoverability and retrieval for many years into the future. The growth in online datasets presents related, yet more complex challenges. It depends upon the ability to reliably identify, locate, access, interpret, and verify the version, integrity, and provenance of digital datasets. Data citation standards and good practices can form the basis for increased incentives, recognition, and rewards for scientific data activities that in many cases are currently lacking in many fields of research. The rapidly-expanding universe of online digital data holds the promise of allowing peer-examination and review of conclusions or analysis based on experimental or observational data, the integration of data into new forms of scholarly publishing, and the ability for subsequent users to make new and unforeseen uses and analyses of the same data-either in isolation, or in combination with, other datasets.

The problem of citing online data is complicated by the lack of established practices for referring to portions or subsets of data. There are a number of initiatives in different organizations, countries, and disciplines already underway. An important set of technical and policy approaches have already been launched by the U.S. National Information Standards Organization (NISO) and other standards bodies regarding persistent identifiers and online linking.

The workshop summarized in For Attribution -- Developing Data Attribution and Citation Practices and Standards: Summary of an International Workshop was organized by a steering committee under the National Research Council's (NRC's) Board on Research Data and Information, in collaboration with an international CODATA-ICSTI Task Group on Data Citation Standards and Practices. The purpose of the symposium was to examine a number of key issues related to data identification, attribution, citation, and linking to help coordinate activities in this area internationally, and to promote common practices and standards in the scientific community.

  1. ×

    Welcome to OpenBook!

    You're looking at OpenBook, NAP.edu's online reading room since 1999. Based on feedback from you, our users, we've made some improvements that make it easier than ever to read thousands of publications on our website.

    Do you want to take a quick tour of the OpenBook's features?

    No Thanks Take a Tour »
  2. ×

    Show this book's table of contents, where you can jump to any chapter by name.

    « Back Next »
  3. ×

    ...or use these buttons to go back to the previous chapter or skip to the next one.

    « Back Next »
  4. ×

    Jump up to the previous page or down to the next one. Also, you can type in a page number and press Enter to go directly to that page in the book.

    « Back Next »
  5. ×

    Switch between the Original Pages, where you can read the report as it appeared in print, and Text Pages for the web version, where you can highlight and search the text.

    « Back Next »
  6. ×

    To search the entire text of this book, type in your search term here and press Enter.

    « Back Next »
  7. ×

    Share a link to this book page on your preferred social network or via email.

    « Back Next »
  8. ×

    View our suggested citation for this chapter.

    « Back Next »
  9. ×

    Ready to take your reading offline? Click here to buy this book in print or download it as a free PDF, if available.

    « Back Next »
Stay Connected!