National Academies Press: OpenBook
« Previous: Front Matter
Suggested Citation:"Summary." National Academies of Sciences, Engineering, and Medicine. 2015. Peer Review and Design Competition in the NNSA National Security Laboratories. Washington, DC: The National Academies Press. doi: 10.17226/21806.
×

Summary

During the Cold War, the United States designed, built, tested, and deployed numerous nuclear warheads of various designs. The results of nuclear tests of the nuclear explosive packages (NEPs) of these warheads provided the ultimate validation of the design procedures, weapon design codes, and designer judgment. Formal design competitions between teams from Los Alamos National Laboratory (LANL) and Lawrence Livermore National Laboratory (LLNL)—each supported by separate branches of Sandia National Laboratories (SNL) for the non-nuclear components and integration with the delivery system—were routinely held. Extensive peer reviews of the types in use today were less frequent and less formal during that era, primarily because of the availability of nuclear explosion testing.

Following the moratorium on nuclear explosion testing that began in 1992, all three National Nuclear Security Administration (NNSA) laboratories intensified their use of technical questioning, collaborative and competitive reviews, tests of components and subsystems, and modeling and simulation to regularly check their work and ensure that a range of perspectives is brought to bear so as to improve quality and uncover any problems. The laboratories have also strengthened their technical evaluation and peer review processes both to ensure the safety, security, and effectiveness of the nuclear stockpile and to help maintain associated science and engineering design and innovation capabilities in the laboratories. Although not a substitute for weapons tests, peer review has become an increasingly important practice at the three NNSA laboratories as a

Suggested Citation:"Summary." National Academies of Sciences, Engineering, and Medicine. 2015. Peer Review and Design Competition in the NNSA National Security Laboratories. Washington, DC: The National Academies Press. doi: 10.17226/21806.
×

means of mitigating the risks that the nation’s nuclear weapons will fail to perform as expected if needed.

After an assessment of peer review and design competition, the committee reached four conclusions:

Conclusion 1.1: In the main, peer review processes used by all three NNSA laboratories are healthy and robust, providing benefits such as increasing confidence in weapon assessment and certification, improving our understanding of weapons physics, addressing weapon aging issues, and identifying lower-cost approaches to Life-Extension Programs.

Conclusion 1.2: Incentives for peer review at the NNSA laboratories are abundantly evident.

  • Peer review reduces the risk of overlooking a technical option, of relying on suboptimal data or methods, or of simply making an embarrassing mistake, and thereby supports the ingrained culture at all three laboratories, which sets a high standard for quality.
  • Peer review is visibly valued by laboratory management.

Conclusion 1.3: SNL and the NEP design laboratories (LANL and LLNL) have taken somewhat different approaches to peer review, owing in large part to SNL’s ability to test non-nuclear components and systems.

  • With only archival nuclear explosion test data available, LANL and LLNL rely on vigorous, deep-dive reviews by true competitive peers and other subject-matter experts to critique the results of calculations and subcritical experiments relating to NEP performance.
  • With testing data available to verify the performance of components and systems and to validate modeling and simulation tools, peer review at SNL is driven more by the need to assure cost-effective performance of stockpile hardware under all anticipated conditions and by budget pressures to reduce the number of expensive tests.

Conclusion 1.4: All three NNSA laboratories have opportunities to improve their processes for peer review:

Suggested Citation:"Summary." National Academies of Sciences, Engineering, and Medicine. 2015. Peer Review and Design Competition in the NNSA National Security Laboratories. Washington, DC: The National Academies Press. doi: 10.17226/21806.
×
  • With the exception of major reviews associated with the Annual Assessment Report or Life-Extension Programs, LLNL and LANL lack written guidance for conducting peer reviews to determine in general when a review is needed, how the review is to be conducted, who should participate in the review, or how to address review findings.
  • SNL has developed useful written guidance for conducting peer reviews; however, during its visit to SNL and its probing of the presentations made, the committee determined that SNL could profitably make greater use of outside experts in its peer reviews, as called for in its written guidance.

These conclusions led the committee to the following recommendation:

Recommendation 1: The nuclear weapons laboratories should improve their peer review processes in the following ways:

  • Los Alamos National Laboratory and Lawrence Livermore National Laboratory should ensure they have short, written guidance for a graded approach to peer review, the rigor of which is appropriate to the stage of work and range of technical activities being reviewed.
  • Sandia National Laboratories should strengthen and broaden its use of outside experts on its peer review teams, as articulated in written guidance that Sandia recently finalized.

In the area of design competition, the committee reached one conclusion and one recommendation:

Conclusion 2: The innovations produced by design competitions during the Cold War, as well as the increased confidence in the safety and reliability of stockpile weapons resulting from current assessment processes such as the Independent Nuclear Weapons Assessment Process (INWAP), illustrate the value of having independent teams, using different approaches and methods, addressing common problems.

Recommendation 2: Los Alamos National Laboratory and Lawrence Livermore National Laboratory should continue to maintain independent design capabilities, using different approaches and methods, to enable independent peer review of critical technical issues. Sandia National Laboratories should likewise carry out, for high-priority issues, competitive designs with independent teams that

Suggested Citation:"Summary." National Academies of Sciences, Engineering, and Medicine. 2015. Peer Review and Design Competition in the NNSA National Security Laboratories. Washington, DC: The National Academies Press. doi: 10.17226/21806.
×

use different approaches, followed by peer reviews of components, subsystems, and full systems, as discussed in Recommendation 1.

The Reliable Replacement Warhead (RRW) design study produced innovative designs by competing teams at LANL/SNL-New Mexico and LLNL/SNL-California.1 However, the manner in which the study was conducted led to deep resentments at the laboratories.

Conclusion 3: Although the RRW design study succeeded in producing innovative weapon designs by the competing teams, its value was reduced because technical experts from the competing laboratories were not given the opportunity to critique one another’s ideas through interlaboratory peer review or to address criticisms at the science and engineering level before the final designs were formally presented to NNSA and potential end users.

Recommendation 3: To guide future design studies and design competitions, the National Nuclear Security Administration (NNSA) should provide a formal written statement articulating the design requirements and objectives, along with the selection criteria, in advance of any authorized work. NNSA should also ensure that interlaboratory peer review takes place and that competitors have an opportunity to address criticisms at the science and engineering level before the results are formally presented to stakeholders outside NNSA.

Finally, the committee is deeply concerned about the state of design competition at all three laboratories. There have been no full2 design competitions for NEPs since the 1992 moratorium on the testing of nuclear explosions. The Department of Defense (DOD) has not asked for any fundamentally new warhead designs, and for a considerable time Congress limited work on new designs.

______________

1 The Reliable Replacement Warhead design study was intended to generate competitive designs for a highly reliable warhead with enhanced surety. In addition, the competition aimed for a design that could be manufactured relatively easily with currently available materials, eliminating some potentially hazardous materials that had been used previously. Finally, it was necessary that the weapon as designed could be certified without nuclear explosion testing.

2 By “full design competition” the committee means competitions that integrate the full end-to-end design process, including design of the integrated NEP—from conceiving of a novel design to address a threat, through production of an engineering prototype, a step that provides essential feedback about the practicality of a design. Full design competition would not include nuclear explosion testing.

Suggested Citation:"Summary." National Academies of Sciences, Engineering, and Medicine. 2015. Peer Review and Design Competition in the NNSA National Security Laboratories. Washington, DC: The National Academies Press. doi: 10.17226/21806.
×

Design competitions, and the subsequent testing of components, subsystems, and systems (within the limits of national policy and agreements) are critical to developing the next generation of nuclear weapons designers with expertise that goes beyond analysis and modeling. Although it was considered too expensive for every design competition to result in the production of a prototype during the Cold War, those that did provided the feedback that designers needed to stay at the cutting edge. The number of the NEP laboratories’ science and engineering personnel with hands-on experience in nuclear weapons design and nuclear explosion testing continues to decrease and will reach zero in the next decade or so. Once this experience is lost, it could limit the nation’s strategic options, and it will be difficult to reestablish.

Looking to the future, maintaining nuclear weapons design skills at the NEP laboratories—as well as production skills within the NNSA complex—is essential to achieve three objectives:

  1. Maintaining a credible nuclear deterrent workforce that is capable of designing and building weapons to meet evolving threats;
  2. Understanding the status and direction of foreign nuclear weapon programs, and thus strengthening the nonproliferation regime; and,
  3. Determining the best and most cost-effective approaches to resolving problems that arise during stockpile weapon surveillance and life extension programs.

To avoid the potential of losing a capability that could be essential for responding to evolving threats, the NNSA complex needs a means of exercising, on a regular and ongoing basis, the full suite of nuclear weapons design, development, and engineering capabilities through true design competitions. Thus, the committee makes the following conclusion and recommendation.

Conclusion 4: In contrast to the robust state of peer review at the NNSA laboratories, the state of design competition is not robust.

  • There have been no full NEP design competitions since the 1992 nuclear explosion testing moratorium. Recent design studies have been good analysis and modeling exercises, but they did not result in actual engineering and fabrication of components and systems; thus, they did not exercise the complete set of skills required in the NNSA complex to design nuclear weapons that would be an effective deterrent, nor was the credibility of any design assessed by fabricating a device or by non-nuclear testing.
Suggested Citation:"Summary." National Academies of Sciences, Engineering, and Medicine. 2015. Peer Review and Design Competition in the NNSA National Security Laboratories. Washington, DC: The National Academies Press. doi: 10.17226/21806.
×
  • At SNL, the need to continually replace aging or obsolete nonnuclear components in stockpile weapons, as well as the large Life-Extension Programs for the W76 and B61, have indeed exercised designers’ skills. However, these exercises do not stimulate the full creativity and innovation that result from a true blank slate design competition that includes engineering and building a prototype.

Recommendation 4: In order to exercise the full set of design skills necessary for an effective nuclear deterrent, the National Nuclear Security Administration should develop and propose the first in what the committee envisions as a series of design competitions that include designing, engineering, building, and non-nuclear testing of a prototype. The non-nuclear components produced by Sandia should be integrated into the design and fabrication of the prototype. This should be done with the clear understanding that this prototype would not enter the stockpile.

Implementation of the committee’s four recommendations would help develop and maintain the most important asset—a competent workforce with demonstrated skills and judgment—and instill confidence by all stakeholders (including adversaries) in the ability of this workforce to maintain the nuclear deterrent.

Suggested Citation:"Summary." National Academies of Sciences, Engineering, and Medicine. 2015. Peer Review and Design Competition in the NNSA National Security Laboratories. Washington, DC: The National Academies Press. doi: 10.17226/21806.
×
Page 1
Suggested Citation:"Summary." National Academies of Sciences, Engineering, and Medicine. 2015. Peer Review and Design Competition in the NNSA National Security Laboratories. Washington, DC: The National Academies Press. doi: 10.17226/21806.
×
Page 2
Suggested Citation:"Summary." National Academies of Sciences, Engineering, and Medicine. 2015. Peer Review and Design Competition in the NNSA National Security Laboratories. Washington, DC: The National Academies Press. doi: 10.17226/21806.
×
Page 3
Suggested Citation:"Summary." National Academies of Sciences, Engineering, and Medicine. 2015. Peer Review and Design Competition in the NNSA National Security Laboratories. Washington, DC: The National Academies Press. doi: 10.17226/21806.
×
Page 4
Suggested Citation:"Summary." National Academies of Sciences, Engineering, and Medicine. 2015. Peer Review and Design Competition in the NNSA National Security Laboratories. Washington, DC: The National Academies Press. doi: 10.17226/21806.
×
Page 5
Suggested Citation:"Summary." National Academies of Sciences, Engineering, and Medicine. 2015. Peer Review and Design Competition in the NNSA National Security Laboratories. Washington, DC: The National Academies Press. doi: 10.17226/21806.
×
Page 6
Next: 1 Introduction and Charge »
Peer Review and Design Competition in the NNSA National Security Laboratories Get This Book
×
 Peer Review and Design Competition in the NNSA National Security Laboratories
Buy Paperback | $40.00 Buy Ebook | $32.99
MyNAP members save 10% online.
Login or Register to save!
Download Free PDF

The National Nuclear Security Administration (NNSA) is responsible for providing and maintaining the capabilities necessary to sustain a safe, secure, and reliable nuclear weapons stockpile for the nation and its allies. Major responsibility for meeting the NNSA missions falls to the three NNSA laboratories: Los Alamos National Laboratory (LANL), Lawrence Livermore National Laboratory (LLNL), and Sandia National Laboratories (SNL). The NNSA National Security Laboratories contribute to that goal by maintaining the skills and capabilities necessary for stewardship of a reliable nuclear stockpile and also by maintaining a high level of technical credibility, which is a component of the nuclear deterrent.

Since 1992 it has been U.S. policy not to conduct explosion tests of nuclear weapons. The resulting technical challenges have been substantial. Whereas a nuclear test was in some sense the ultimate "peer review" of the performance of a particular NEP design, the cessation of nuclear testing necessitated a much greater reliance on both intralab and interlab expert peer review to identify potential problems with weapon designs and define the solution space. This report assesses the quality and effectiveness of peer review of designs, development plans, engineering and scientific activities, and priorities related to both nuclear and non-nuclear aspects of nuclear weapons, as well as incentives for effective peer review. It also explores how the evolving mission of the NNSA laboratories might impact peer review processes at the laboratories that relate to nuclear weapons.

READ FREE ONLINE

  1. ×

    Welcome to OpenBook!

    You're looking at OpenBook, NAP.edu's online reading room since 1999. Based on feedback from you, our users, we've made some improvements that make it easier than ever to read thousands of publications on our website.

    Do you want to take a quick tour of the OpenBook's features?

    No Thanks Take a Tour »
  2. ×

    Show this book's table of contents, where you can jump to any chapter by name.

    « Back Next »
  3. ×

    ...or use these buttons to go back to the previous chapter or skip to the next one.

    « Back Next »
  4. ×

    Jump up to the previous page or down to the next one. Also, you can type in a page number and press Enter to go directly to that page in the book.

    « Back Next »
  5. ×

    Switch between the Original Pages, where you can read the report as it appeared in print, and Text Pages for the web version, where you can highlight and search the text.

    « Back Next »
  6. ×

    To search the entire text of this book, type in your search term here and press Enter.

    « Back Next »
  7. ×

    Share a link to this book page on your preferred social network or via email.

    « Back Next »
  8. ×

    View our suggested citation for this chapter.

    « Back Next »
  9. ×

    Ready to take your reading offline? Click here to buy this book in print or download it as a free PDF, if available.

    « Back Next »
Stay Connected!