National Academies Press: OpenBook
« Previous: 3 Partnering with Other Institutions
Suggested Citation:"4 Broadening Research Interactions." National Research Council. 2005. Building an Electronic Records Archive at the National Archives and Records Administration: Recommendations for a Long-Term Strategy. Washington, DC: The National Academies Press. doi: 10.17226/11332.
×

4
Broadening Research Interactions

The Electronic Records Archives (ERA) program of the National Archives and Records Administration (NARA), currently being undertaken to build significant new capabilities for preserving digital records, has contracted out for two system designs in preparation for the acquisition of an operational system. As a prelude and ongoing complement to procurement activities, the ERA program has sponsored several research and development (R&D) activities (Box 4.1). This chapter examines the role that future research could play in helping NARA better understand and address emerging and future technology issues and medium- and long-term technical challenges.

RATIONALE FOR SUPPORTING RESEARCH

Information technology (IT) research has traditionally been concentrated in several federal agencies, many of which have research as part of their central mission.1 A recent National Research Council (NRC) report, Information Technology Research, Innovation, and E-Government,2 broadly considers the rationale for IT research by a broader set of federal mission agencies. It concludes that, where possible, government should follow the private sector in designing and

1  

Twelve agencies or major units of agencies were participants in 2004 in the National Coordination Office for Information Technology Research and Development, which coordinates activities and prepares an annual summary of the federal IT R&D budget. These were the National Institute of Standards and Technology, National Oceanic and Atmospheric Administration, Defense Advanced Research Projects Agency, Defense Information Systems Agency, National Security Agency, National Nuclear Security Administration, Department of Energy’s Office of Science, Environmental Protection Agency, Agency for Healthcare Research and Quality, National Institutes of Health, National Aeronautics and Space Administration, and National Science Foundation.

2  

Computer Science and Telecommunications Board, National Research Council. 2002. Information Technology Research, Innovation, and E-Government. National Academy Press, Washington, D.C.

Suggested Citation:"4 Broadening Research Interactions." National Research Council. 2005. Building an Electronic Records Archive at the National Archives and Records Administration: Recommendations for a Long-Term Strategy. Washington, DC: The National Academies Press. doi: 10.17226/11332.
×

BOX 4.1
List of Electronic Records Archives Research Projects

The Web site of the Electronic Records Archives program lists the following as current research projects:

  • Persistent Object Preservation. Work by the National Partnership for Advanced Computing Infrastructure, led by the San Diego Supercomputer Center (SDSC), examining digital preservation methods.

  • Presidential Electronic Records Pilot Operations System. Work sponsored by the National Archives and Records Administration (NARA) at the Georgia Institute of Technology Research Institute, on archival processing of presidential electronic records.

  • Distributed Object Computation Testbed. This project, led by the SDSC, brings together supercomputers, large electronic archival technology, and high-speed wide-area networks. Its purpose is to develop solutions for handling massive amounts of data that are stored at sites nationwide and to provide an infrastructure on which to test advanced technologies for the preservation of electronic records.

  • U.S. InterPARES (I nternational Research on Permanent Authentic Records in Electronic Systems) Project. NARA is a participant in this project, which is studying the problem of authentic electronic records.

  • Grid Technology. Grid technology is being developed in a joint partnership with the SDSC and the University of Maryland Institute for Advanced Computer Studies. Its purpose is to provide a distributed interoperable network that will provide efficient and effective access to users, regardless of location, and be linked using a logical name space to create global, persistent identifiers.

SOURCE: National Archives and Records Administration. 2005. Electronic Records Archives: Research. Available online at <http://www.archives.gov/electronic_records_archives/research/research.html>. Accessed April 8, 2005.

implementing IT-based services. However, the report also concludes that there are some areas, such as the long-term preservation of government records, in which government requirements differ, at least somewhat, from those in the commercial world. In these areas, the report says, federal agencies should recognize and act on their role as a demand leader.

The NRC report goes on to characterize some of the benefits of research activities for both government agency sponsors and researchers. Government stands to benefit from collaboration between government agencies and the IT research community despite the fact that these two groups are at opposite ends of an extensive supply chain that also includes vendors and system integrators. Although government agencies and researchers may appear to be unlikely allies, they have a shared interest in innovation and in meeting future needs.

Through research, agencies can gain an understanding of emerging and future technologies, and of the technology risks they face. The most effective form of risk reduction occurs when an organization does in-house testing of research prototypes; with in-house testing the organization gains firsthand experience about what is easy and what is not, where the system is reliable and where it fails, and how to run the system on a daily basis. A somewhat-less-

Suggested Citation:"4 Broadening Research Interactions." National Research Council. 2005. Building an Electronic Records Archive at the National Archives and Records Administration: Recommendations for a Long-Term Strategy. Washington, DC: The National Academies Press. doi: 10.17226/11332.
×

effective form of risk reduction occurs when an external organization develops and tests the prototype; in this case the organization learns something, but most of the expertise about how the system really works resides within the external research organization. Agencies also gain an opportunity to influence the trajectory of technologies through engagement with researchers. Research should, however, not be seen as a way of short-circuiting the IT supply chain of researchers, technology vendors, and system integrators, and agencies should not necessarily be early adopters. However, when agencies and researchers work together, the overall risk of innovation in acquisition can be reduced.

Absorptive capacity for research results requires in-house people who can be engaged at a technical level with relevant research communities and who will take results from the researchers, test them in-house, and explain and propagate results within the agency. Mere funding is not enough. The real goal is substantive technical coupling between the research community and the agency that allows the organization to learn about new technologies, to learn more broadly about a research area than it would otherwise, and to understand how to apply research that it is not itself supporting.

RESEARCH MANAGEMENT FOR AGENCIES WITHOUT A TRACK RECORD IN SPONSORING RESEARCH IN INFORMATION TECHNOLOGY

For an agency such as NARA that has neither a long track record of sponsoring IT research nor a large research budget, how can limited research resources be spent most effectively? Information Technology Research, Innovation, and E-Government observes that most federal agencies have limited experience in and capability for managing IT research programs. The report goes on to recommend that consideration be given to cross-agency collaboration with agencies that already have IT research programs and/or that share common research interests.

Partners with Research Management Expertise

Several federal agencies, most notably the National Science Foundation (NSF) and the Defense Advanced Research Projects Agency (DARPA), but also the National Institute of Standards and Technology, the National Aeronautics and Space Administration (NASA), the Department of Energy, the National Institutes of Health and its National Library of Medicine, the armed services laboratories, and others, have extensive expertise in the management of IT research projects. The selection of specific research proposals and routine management of the research process—for example, selecting among peer-reviewed IT research proposals or maintaining an arm’s-length relationship with research organizations—are capabilities that these agencies have developed over time as they have gained experience, identified and worked with particular research communities, brought in researchers to manage programs, and otherwise developed research management talent. These organizations maintain relationships with varied research and user communities, which gives them easy access to a wide range of expertise and peer review when needed.

The agencies referred to above also have experience in launching research programs in new areas, including the building of a research community around a set of technical topics that were not previously identified as related or important. This process is more complicated than simply stating a problem and looking for people to work on it. Researchers will not be drawn

Suggested Citation:"4 Broadening Research Interactions." National Research Council. 2005. Building an Electronic Records Archive at the National Archives and Records Administration: Recommendations for a Long-Term Strategy. Washington, DC: The National Academies Press. doi: 10.17226/11332.
×

to work on problems that are not well thought out, for example, or that are shallow or short-term enough that they do not lead to significant research results (e.g., sufficient for the promotion of academics or the funding of start-up companies). Strong, successful research communities often are developed by several customers and funders. The digital libraries program managed by NSF is a highly relevant example of successful program development and community building.

Exchanging staff for limited assignments is a way of both learning about relevant research and letting others learn about one’s own research needs. NARA staff members could spend profitable 6-month assignments in other research organizations to learn what is on the cutting edge and let the researchers know what NARA’s problems are. Similarly, members of research organizations could spend profitable 6-month assignments inside NARA learning what NARA is really up against and offering suggestions on how to apply what they know to these problems.

Partners with Shared Research Interests

Many of NARA’s most basic needs for digital preservation and access are shared to varying degrees with organizations such as the Library of Congress, the National Library of Medicine, NASA, the National Oceanic and Atmospheric Administration (NOAA), and the intelligence agencies, all of which must maintain indefinite access to digital records. The Library of Congress has established the National Digital Information Infrastructure and Preservation Program (NDIIPP) to work collaboratively with federal agencies, research libraries, and other organizations that have an interest and expertise in digital preservation. It has partnered with the National Science Foundation to establish a research grant program focused on digital preservation and has launched joint research activities with four universities to investigate various approaches to digital preservation using a test collection.

A number of the technical problems faced by NARA are likely to be faced by other agencies as well. For example, semiautomatic redaction or declassification is a topic that could be investigated with partners such as DARPA or the intelligence community’s Advanced Research and Development Activity (ARDA). Another organization with shared interests in preservation is the Department of Veterans Affairs, which is currently developing the HealtheVet-VistA program to provide long-term access to veterans’ electronic health records (Box 4.2).

Partnership on Research-Oriented Prototypes

As NARA becomes engaged with a broader range of research communities, it will be natural for it to participate in research-oriented prototypes. The National Science Foundation’s Digital Government program has, for example, fostered close relationships between universities and agencies such as the Bureau of Labor Statistics, the Census Bureau, and the Environmental Protection Agency. NSF’s Digital Libraries program has fostered similar government and academic partnerships. These partnerships give the research community access to real data and users and thus an opportunity to receive real-world feedback about their research. In return, government agencies gain experience with new technologies before the innovations become commercially available, and the agencies develop long-term relationships with outside experts. Such partnerships and in-house testing of research prototypes should eventually become an important part of NARA’s research portfolio.

Suggested Citation:"4 Broadening Research Interactions." National Research Council. 2005. Building an Electronic Records Archive at the National Archives and Records Administration: Recommendations for a Long-Term Strategy. Washington, DC: The National Academies Press. doi: 10.17226/11332.
×

BOX 4.2
HealtheVet-VistA

HealtheVet-VistA is a program currently under design. It will create an online environment in which veterans’ electronic health records, medical images such as x-rays, pathology slides, scanned documents, results of cardiology examinations, wound photos, and endoscopies, among other records, are stored for ready access.

Currently, the Department of Veterans Affairs (VA) treats more than 3 million patients annually in more than 1,300 health units, 163 hospitals, and 850 clinics. The Committee on Veterans’ Affairs of the U.S. House of Representatives has mandated that the VA retain all veterans’ health records (which are in electronic form) for 75 years after the death of veterans. Given technology obsolescence, this mandated retention period creates an enormous challenge for the VA. The VA also faces a comparable challenge in standardizing veterans’ electronic health records across all of its components and in implementing “upstream” creation and capture of veterans’ electronic health records that facilitate access for 75 years or more.

Setting aside the commitment of the National Archives and Records Administration (NARA) to permanent storage (i.e., forever) of selected electronic records created by federal agencies, the VA and NARA face a comparable challenge over the next hundred years in ensuring long-term access to electronic records. The two agencies also share common interests in approaches, tools, and procedures to support long-term access to electronic records.

ENGAGING THE RESEARCH COMMUNITY THROUGH MEANS OTHER THAN FUNDING RESEARCH

NARA can engage relevant research communities in a number of ways other than direct sponsorship of research. They include the following:

  • Hosting workshops and seminars. Workshops and seminars bring researchers and NARA employees together, allowing a two-way exchange of ideas and problems. The ERA program took advantage of this opportunity by holding a November 2004 conference, called “Partnerships in Innovation: Serving a Networked Nation,” organized in conjunction with the University of Maryland’s Institute for Advanced Computer Studies.

  • Hiring students. Another way of engaging research communities is to seek out and hire their students. This is well understood in industry as a very effective approach to technology transfer.

  • Suggesting important problems and providing access to artifacts (data, software, and system capabilities) and subject-matter experts. As the NRC report Information Technology Research, Innovation, and E-Government observes, working on government IT problems offers researchers access to applications with a “richness and texture often lacking in the laboratory” as well as other potential benefits.3

3  

Computer Science and Telecommunications Board, National Research Council. 2002. Information Technology Research, Innovation, and E-Government. National Academy Press, Washington, D.C., pp. 12-13.

Suggested Citation:"4 Broadening Research Interactions." National Research Council. 2005. Building an Electronic Records Archive at the National Archives and Records Administration: Recommendations for a Long-Term Strategy. Washington, DC: The National Academies Press. doi: 10.17226/11332.
×

The opportunity of providing researchers with access to artifacts is discussed in more detail in the following subsection.

Providing Access to Artifacts

As a complement to sponsoring research, NARA can also engage the research community by providing data. This opportunity represents a very low cost yet effective way of engaging substantively with the research community. Academic researchers are often starved for data; they have good ideas, but no way to test them against reality. Providing interesting data in a form that the research community can use can be enough to get the best people in the world working on a problem, essentially for free. For example, Reuters created two databases of categorized newswire articles for research use and made them easy to acquire. Almost every text classification algorithm developed in the preceding decade was tested on these data sets, and hundreds of research papers have been published about them, none paid for by Reuters. Similar stories can be told about data sets from news organizations such as the Wall Street Journal, AP Newswire, Ziff-Davis, and the Financial Times, and about medical data sets based on the National Library of Medicine’s MedLine system.

There are many vehicles for providing data to the research community. Since 1992 the National Institute of Standards and Technology (NIST) has created a variety of widely used data sets that have focused research attention on a diverse set of problems, often of interest to the U.S. intelligence community. Some universities, for example the University of California at Irvine and the University of Pennsylvania, have specialized in creating and becoming long-term distributors of research data sets. Partnering with an organization that has prior experience in this area, such as NIST, the University of California at Irvine, or the Linguistic Data Consortium (LDC) at the University of Pennsylvania, would help NARA learn how to create data sets that are engaging and have long-term value to various research communities.

Chapter 3 in this report points out the benefits of providing an application programming interface (API) that gives direct access to some of the ERA’s digital archive so that third parties can develop new tools. This approach is particularly applicable to research initiatives. Google, for example, allows a simple API-level access to its search engine to anyone who registers. The advantage to Google is that others can spend their own research dollars to develop applications that might eventually be interesting or useful to Google. API-level access can also provide access to users, enabling researchers to conduct experiments with live populations in real time—for example, by varying system characteristics and observing user behavior. Such access would be extremely attractive to a variety of computer science and social science research communities, and it could be provided by NARA at relatively low cost relative to the benefits obtained.

RESEARCH CHALLENGES FACING THE NATIONAL ARCHIVES AND RECORDS ADMINISTRATION

The research problems facing NARA—and appropriate research strategies—fall into two categories:

  1. Problems shared with other organizations. Many of NARA’s technical problems are the same as those faced by designers and operators of any large digital library or repository. For

Suggested Citation:"4 Broadening Research Interactions." National Research Council. 2005. Building an Electronic Records Archive at the National Archives and Records Administration: Recommendations for a Long-Term Strategy. Washington, DC: The National Academies Press. doi: 10.17226/11332.
×

dealing with these problems, NARA’s greatest leverage will come from drawing on research sponsored by other organizations, learning about best practices, inducing others to work on problems of interest to NARA by offering corpora of content that researchers can use to test new ideas, and participating in joint research programs with other federal agencies and organizations that face similar challenges. Wherever technologies may be shared with other applications, partnerships to jointly address shared problems will help stretch limited research resources.

  1. Problems specific to government archives and similar institutions. A few problems are specific to the preservation of records or otherwise unique to NARA and may need separate research thrusts. Working on these more specialized problems may require specific engagement with existing research communities. Partnership with agencies that have greater experience in managing IT research programs is also likely to be the most effective mechanism for addressing this class of research problems.

What are some of the specific research problems that NARA faces? The organization must develop its own list, but it need not start from scratch in doing so.4 The subsections below provide some illustrative examples of research problems in each class.

Research Problems Shared with Other Organizations

Following is a list of examples of research problems that NARA shares with other organizations, together with appropriate strategies.

  • Automatic classification. Traditional archiving processes rely heavily on controlled-vocabulary metadata, which is usually assigned manually. Large-scale use of automatic categorization to assign metadata provides a way to handle the expected flood of digital records in a cost-effective manner. There has been significant progress in this technology area during the past decade, and there is now a greater understanding of what makes problems “difficult” and “easy.” Automatic categorization, which is used routinely in a variety of commercial settings, is often as accurate as human categorization is. Automatic categorization must become a core competency for NARA. Human effort should be applied only when automatic solutions are inadequate. The use of this technology can be broadened to related problems such as filtering records for retention and distinguishing between federal and presidential records.

    Engagement with leaders in the research community would provide NARA an opportunity to better understand the state of the art. NARA’s contributions in this case might well not involve direct support for research; NARA could make significant contributions to the research community by making corpora available, stating its own requirements clearly, and learning from research sponsored by other agencies.

  • Scholars’ tools for searching large collections of records. Some shortcomings of record classification can be remedied by increasingly powerful search methods. While a casual searcher

4  

See, for example, Library of Congress and National Science Foundation, 2003, It’s About Time: Research Challenges in Digital Archiving and Long-Term Preservation, Margaret Hedstrom (ed.), Library of Congress, Washington, D.C., p. ix, available online at <http://www.digitalpreservation.gov/repor/NSF_LC_Final_Report.pdf>; accessed May 1, 2005.

Suggested Citation:"4 Broadening Research Interactions." National Research Council. 2005. Building an Electronic Records Archive at the National Archives and Records Administration: Recommendations for a Long-Term Strategy. Washington, DC: The National Academies Press. doi: 10.17226/11332.
×

may be content with a result that is “good enough,” scholars want better tools and are likely to be continually pressing the limits of technology. For example, Google already offers a “Google Scholar” search designed to find online scholarly material, and libraries and technical literature publishers are beginning to offer customized searching. Many of these emerging techniques will probably be useful to scholars searching the ERA, but the archives may pose some unique problems. This is a case in which NARA could stimulate a research community with a database of archival records and a set of demanding users with specific needs.

  • Preserving computer programs. Improved capabilities for preserving software may be of general interest to the community interested in digital preservation, including NARA, but they may or may not be required by NARA to preserve records. Here a modest level of funding in a jointly funded program of research looking broadly at digital preservation problems might be appropriate.

  • How to preserve Web sites. Government Web sites publish information in a wide variety of formats, use static and dynamic information, use information from a single source or many sources, and present general or user-specific views of information. Government Web sites also collect information from the public—for example, public comments on proposed regulations. What government Web site material should be archived? The variety of problems posed by government Web sites could be viewed as daunting, but it can also be an advantage in that the sites afford a means to gather much valuable information. Of course not all Web sites produce unique “records”; some are merely access portals to an underlying set of records that may be archived in other ways. Web sites should be a particular priority for archiving because they are so dynamic and also because they provide information that may not be captured by other archiving processes. An essential part of the national historical record may have simply been lost because government Web sites were not systematically archived in the past decade. (Serious efforts aimed at archiving Web content, however, are being made by such organizations as the Internet Archive.) NARA will need to co-develop policies and technical approaches for handling Web sites.

  • The interplay between information technology and human and organizational behavior related to records. NARA, like many other organizations, has an interest in understanding how people and organizations use new technologies and an interest in the implications of this use for new forms of communication, new types of records, and new divisions of responsibilities for administrative and record-keeping activities. Relevant areas of research include business-process redesign, organizational restructuring as a result of new information technologies, adoption and adaptation of new technologies, work flow analysis and design, compliance with policies and requirements, and design of incentive mechanisms.

Problem Areas in Which NARA and Similar Institutions Have Special Interests

  • How to tease out (or define) records in interactive systems. Interactions with and within| government increasingly involve ephemeral views not stored as records but merely computed from online databases through software that itself changes over time. Web sites (discussed above) are one important example.

  • Transactions systems. How should government transactions systems be preserved? Are there uniform ways (e.g., logs or snapshots) to archive them? Or should transactions systems be designed to emit records in order to preserve records as part of the standard work flow?

  • Providing digital assurances over a long period of time. The computer science and cryptogra-

Suggested Citation:"4 Broadening Research Interactions." National Research Council. 2005. Building an Electronic Records Archive at the National Archives and Records Administration: Recommendations for a Long-Term Strategy. Washington, DC: The National Academies Press. doi: 10.17226/11332.
×

phy to support authenticity, integrity, and chain-of-custody requirements associated with long-term preservation are likely to be leading edge for the foreseeable future. A research program would explore new techniques to be able to assure integrity and authenticity of records held for many decades. Is an end-to-end scheme that would span hundreds of years possible?

CONCLUDING REMARKS

With necessarily limited resources, a limited capacity to manage research programs, and a large set of research challenges related to the general topic of archiving and digital preservation, NARA has to decide how and where it should invest. Questions for NARA to consider include these: What agencies share an interest in NARA’s problem or a similar problem? What research community is working on that problem or a similar problem? How can NARA most effectively join with and influence that community? Does NARA need to sponsor its own research, or can it learn from or participate in others’ research programs? What results are anticipated, and how will the results be brought back to NARA?

As the ERA starts to operate, NARA will surely uncover new problems. Some of the problems will lead to evolution of the system and its operation in straightforward ways—that is, known methods or engineering techniques will solve them. But operation may also reveal deeper problems worthy of new research activities.

Suggested Citation:"4 Broadening Research Interactions." National Research Council. 2005. Building an Electronic Records Archive at the National Archives and Records Administration: Recommendations for a Long-Term Strategy. Washington, DC: The National Academies Press. doi: 10.17226/11332.
×
Page 50
Suggested Citation:"4 Broadening Research Interactions." National Research Council. 2005. Building an Electronic Records Archive at the National Archives and Records Administration: Recommendations for a Long-Term Strategy. Washington, DC: The National Academies Press. doi: 10.17226/11332.
×
Page 51
Suggested Citation:"4 Broadening Research Interactions." National Research Council. 2005. Building an Electronic Records Archive at the National Archives and Records Administration: Recommendations for a Long-Term Strategy. Washington, DC: The National Academies Press. doi: 10.17226/11332.
×
Page 52
Suggested Citation:"4 Broadening Research Interactions." National Research Council. 2005. Building an Electronic Records Archive at the National Archives and Records Administration: Recommendations for a Long-Term Strategy. Washington, DC: The National Academies Press. doi: 10.17226/11332.
×
Page 53
Suggested Citation:"4 Broadening Research Interactions." National Research Council. 2005. Building an Electronic Records Archive at the National Archives and Records Administration: Recommendations for a Long-Term Strategy. Washington, DC: The National Academies Press. doi: 10.17226/11332.
×
Page 54
Suggested Citation:"4 Broadening Research Interactions." National Research Council. 2005. Building an Electronic Records Archive at the National Archives and Records Administration: Recommendations for a Long-Term Strategy. Washington, DC: The National Academies Press. doi: 10.17226/11332.
×
Page 55
Suggested Citation:"4 Broadening Research Interactions." National Research Council. 2005. Building an Electronic Records Archive at the National Archives and Records Administration: Recommendations for a Long-Term Strategy. Washington, DC: The National Academies Press. doi: 10.17226/11332.
×
Page 56
Suggested Citation:"4 Broadening Research Interactions." National Research Council. 2005. Building an Electronic Records Archive at the National Archives and Records Administration: Recommendations for a Long-Term Strategy. Washington, DC: The National Academies Press. doi: 10.17226/11332.
×
Page 57
Suggested Citation:"4 Broadening Research Interactions." National Research Council. 2005. Building an Electronic Records Archive at the National Archives and Records Administration: Recommendations for a Long-Term Strategy. Washington, DC: The National Academies Press. doi: 10.17226/11332.
×
Page 58
Next: 5 Record Integrity and Authenticity »
Building an Electronic Records Archive at the National Archives and Records Administration: Recommendations for a Long-Term Strategy Get This Book
×
Buy Paperback | $41.00 Buy Ebook | $32.99
MyNAP members save 10% online.
Login or Register to save!
Download Free PDF

The federal government generates and increasingly saves a large and growing fraction of its records in electronic form. In 1998, the National Archives and Record Administration (NARA) launched its Electronic Archives (ERA) program to create a system to preserve and provide access to federal electronic records. To assist in this project, NARA asked the NRC to conduct a two-phase study to provide advice as it develops the ERA program. The first two reports (phase one) provided recommendations on design, engineering, and related issues facing the program. This report (phase two) focuses on longer term, more strategic issues including technology trends that will shape the ERA system, archival processes of the ERA, and future evolution of the system. It also provides an assessment of technical and design issues associated with record integrity and authenticity.

  1. ×

    Welcome to OpenBook!

    You're looking at OpenBook, NAP.edu's online reading room since 1999. Based on feedback from you, our users, we've made some improvements that make it easier than ever to read thousands of publications on our website.

    Do you want to take a quick tour of the OpenBook's features?

    No Thanks Take a Tour »
  2. ×

    Show this book's table of contents, where you can jump to any chapter by name.

    « Back Next »
  3. ×

    ...or use these buttons to go back to the previous chapter or skip to the next one.

    « Back Next »
  4. ×

    Jump up to the previous page or down to the next one. Also, you can type in a page number and press Enter to go directly to that page in the book.

    « Back Next »
  5. ×

    Switch between the Original Pages, where you can read the report as it appeared in print, and Text Pages for the web version, where you can highlight and search the text.

    « Back Next »
  6. ×

    To search the entire text of this book, type in your search term here and press Enter.

    « Back Next »
  7. ×

    Share a link to this book page on your preferred social network or via email.

    « Back Next »
  8. ×

    View our suggested citation for this chapter.

    « Back Next »
  9. ×

    Ready to take your reading offline? Click here to buy this book in print or download it as a free PDF, if available.

    « Back Next »
Stay Connected!