National Academies Press: OpenBook

Live Fire Testing of the F-22 (1995)

Chapter: FRONT MATTER

Suggested Citation:"FRONT MATTER." National Research Council. 1995. Live Fire Testing of the F-22. Washington, DC: The National Academies Press. doi: 10.17226/4971.
×
Page R1
Suggested Citation:"FRONT MATTER." National Research Council. 1995. Live Fire Testing of the F-22. Washington, DC: The National Academies Press. doi: 10.17226/4971.
×
Page R2
Suggested Citation:"FRONT MATTER." National Research Council. 1995. Live Fire Testing of the F-22. Washington, DC: The National Academies Press. doi: 10.17226/4971.
×
Page R3
Suggested Citation:"FRONT MATTER." National Research Council. 1995. Live Fire Testing of the F-22. Washington, DC: The National Academies Press. doi: 10.17226/4971.
×
Page R4
Suggested Citation:"FRONT MATTER." National Research Council. 1995. Live Fire Testing of the F-22. Washington, DC: The National Academies Press. doi: 10.17226/4971.
×
Page R5
Suggested Citation:"FRONT MATTER." National Research Council. 1995. Live Fire Testing of the F-22. Washington, DC: The National Academies Press. doi: 10.17226/4971.
×
Page R6
Suggested Citation:"FRONT MATTER." National Research Council. 1995. Live Fire Testing of the F-22. Washington, DC: The National Academies Press. doi: 10.17226/4971.
×
Page R7
Page viii Cite
Suggested Citation:"FRONT MATTER." National Research Council. 1995. Live Fire Testing of the F-22. Washington, DC: The National Academies Press. doi: 10.17226/4971.
×
Page R8
Suggested Citation:"FRONT MATTER." National Research Council. 1995. Live Fire Testing of the F-22. Washington, DC: The National Academies Press. doi: 10.17226/4971.
×
Page R9
Suggested Citation:"FRONT MATTER." National Research Council. 1995. Live Fire Testing of the F-22. Washington, DC: The National Academies Press. doi: 10.17226/4971.
×
Page R10
Suggested Citation:"FRONT MATTER." National Research Council. 1995. Live Fire Testing of the F-22. Washington, DC: The National Academies Press. doi: 10.17226/4971.
×
Page R11
Suggested Citation:"FRONT MATTER." National Research Council. 1995. Live Fire Testing of the F-22. Washington, DC: The National Academies Press. doi: 10.17226/4971.
×
Page R12
Page xiii Cite
Suggested Citation:"FRONT MATTER." National Research Council. 1995. Live Fire Testing of the F-22. Washington, DC: The National Academies Press. doi: 10.17226/4971.
×
Page R13
Suggested Citation:"FRONT MATTER." National Research Council. 1995. Live Fire Testing of the F-22. Washington, DC: The National Academies Press. doi: 10.17226/4971.
×
Page R14
Suggested Citation:"FRONT MATTER." National Research Council. 1995. Live Fire Testing of the F-22. Washington, DC: The National Academies Press. doi: 10.17226/4971.
×
Page R15
Suggested Citation:"FRONT MATTER." National Research Council. 1995. Live Fire Testing of the F-22. Washington, DC: The National Academies Press. doi: 10.17226/4971.
×
Page R16

Below is the uncorrected machine-read text of this chapter, intended to provide our own search engines and external engines with highly rich, chapter-representative searchable text of each book. Because it is UNCORRECTED material, please consider the following text as a useful but insufficient proxy for the authoritative book pages.

Ire n e [-22 Committee on the Sway of Eve Fire Survivabitily Testing of the F-22 Aircraft Asking Commission on Engineering and Technical Systems National Research Council NATIONAL ACADEMY PRESS Washington, D.C. ~ 995

NOTICE: The project that is the subject of this report was approved by the Governing Board of the National Research Council, whose members are drawn from the councils of the National Academy of Sciences, the National Academy of Engineering, and the Institute of Medicine. The members of the committee responsible for the report were chosen for their special competencies and with regard for appropriate balance. This report has been reviewed by a group other than the authors according to procedures approved by a Report Review Committee consisting of members of the National Academy of Sciences, the National Academy of Engineering, and the Institute of Medicine. The National Academy of Sciences is a private, nonprofit, self-perpetuating society of distinguished scholars engaged in scientific and engineering research, dedicated to the furtherance of science and technology and to their use for the general welfare. Upon the authority of the charter granted to it by the Congress in 1863, the Academy has a mandate that requires it to advise the federal government on scientific and technical matters. Dr. Bruce M. Alberts is president of the National Academy of Sciences. The National Academy of Engineering was established in 1964, under the charter of the National Academy of Sciences, as a parallel organization of outstanding engineers. It is autonomous in its administration and in the selection of its members, sharing with the National Academy of Sciences the responsibility for advising the federal government. The National Academy of Engineering also sponsors engineering programs aimed at meeting national needs, encourages education and research, and recognizes the superior achievements of engineers. Dr. Harold Liebowitz is president of the National Academy of Engineering. The Institute of Medicine was established in 1970 by the National Academy of Sciences to secure the services of eminent members of appropriate professions in the examination of policy matters pertaining to the health of the public. The Institute acts under the responsibility given to the National Academy of Sciences by its congressional charter to be an adviser to the federal goverrunent and, upon its own initiative, to identify issues of medical care, research, and education. Dr. Kenneth I. Shine is president of the Institute of Medicine. The National Research Council was organized by the National Academy of Sciences in 1916 to associate the broad community of science and technology with the Academy's purposes of furthering knowledge and advising the federal government. Functioning in accordance with general policies determined by the Academy, the Council has become the principal operating agency of both the National Academy of Sciences and the National Academy of Engineering in providing services to the government, the public, and the scientific and engineering communities. The council is administered jointly by both Academies and the Institute of Medicine. Dr. Bruce M. Alberts and Dr. Harold Liebowitz are chairman and vice chairman, respectively, of the National Research Council. This is a report of work supported by Contract MDA972-92-C-0028 between the Advanced Research Projects Agency (ARPA) and the National Academy of Sciences. Library of Congress Catalog Card Number 95-70169 International Standard Book Number 0-309-05333-1 Additional copies are available for sale from: National Academy Press Box 285 2101 Constitution Avenue, N.W. Washington, D.C. 20055 800-624-6242 202-334-3313 (in the Washington Metropolitan Area) Copyright 1995 by the National Academy of Sciences. All rights reserved. Cover photo courtesy of F-22 System Program Office.

COMMI1lEE ON THE STUDY OF LIVE FIRE SURVIVABILITY TESTING OF THE F-22 AIRCRAFT JULIAN DAVIDSON, Chair, Booz.Allen & Hamilton, Huntsville, Alabama DALE B. ATKINSON, Consultant, Springfield, Virginia JOHN R. BODE, Sandia National Laboratories, Albuquerque, New Mexico CHARLES C. CRAWFORD, Jr., Georgia Tech Research Institute, Atlanta ALAN H. EPSTEIN, Massachusetts Institute of Technology, Cambridge DELORES M. ETTER, University of Colorado, Boulder DONALD L. GlADROSICH, Consultant, Destin, Florida ROBERT M. HILLYER, Scientific Applications International Corporation, San Diego, California ROBERT G. LOEWY, Georgia Institute of Technology, Atlanta MILTON A. MARGOLIS, Logistics Management Institute, McLean, Virginia HARRY L. REED, Ir., Consultant, Aberdeen, Maryland ALTON D. ROMIG, Ir., Sandia National Laboratories, Albuquerque, New Mexico CHARLES F. TIFFANY, Boeing Military Airplanes (retired), Tucson, Arizona LAWRENCE G. ULLYATT, Denver Research Institute, LittIeton, Colorado CYNTHIA A. VOLKERT, AT&T Bell Laboratories, Murray HtIT, New Jersey Commission on Engineering and Technical Systems Liaison ALTON D. SLAY, Slay Enterprises, Inc., Warrenton, Virginia Staff BRUCE A. BRAWN, Director, Division of Military Science and Technology MICHAEL A. CLARKE, Study Director JOHN A. HUGHES, Project Assistant NORMAN M. HAILER, Consultant . . .

COMMISSION ON ENGINEERING AND TECHNICAL SYSTEMS ALBERT R. C. WESTWOOD, Chair, Sandia National Laboratories, Albuquerque, New Mexico H. KENT BOWEN, Harvard University, Boston, Massachusetts NAOMI F. COLLINS, NAFSA: Association of International Educators, Washington, D.C. NANCY R. CONNERY, Consultant, Woolw~ch, Maine RICHARD A. CONWAY, Union Carbide Corp., South Charleston, West Virginia SAMUEL C. FLORMAN, KriesTer Borg Flonnan Construction Co., Scarsdale, New York TREVOR O. JONES, Libbey-Owens-Ford Co., Cleveland, Ohio NANCY G. LEVESON, University of Washington, Seattle ALTON D. SLAY, Slay Enterprises, Inc., Warrenton, Virginia JAMES I. SOLBERG, Purdue University, West Lafayette, Indiana BARRY M. TROST, Stanford University, Stanford, California GEORGE L. TURIN, Teknekron Corp., MenTo Park, California WILLIAM C. WEBSTER, University of CaTiforrna, Berkeley DEBORAH A. WHITEHURST, Arizona Community Foundation, Phoenix, Arizona ROBERT V. WHITMAN, Massachusetts Institute of Technology, Cambridge CHARLES E. WILLIAMS, Toll Road Investors Partnership If, Sterling, Virginia Staff ARCHIE L. WOOD, Executive Director DENNIS I. CHAMOT, Associate Executive Director ROBERT I. KATT, Associate Executive Director IV

Preface The Live Fire Test Law (10 U.S.C. 2366) mandates realistic survivability and lethality testing of certain systems or programs. The law defines realistic survivability testing as "testing for vulnerability of the system in combat by firing munitions likely to be encountered in combat . . . at the system configured for combat, with the primary emphasis on testing vulnerability with respect to potential user casualties and taking into equal consideration the susceptibility to attack and combat performance of the system." A provision of the law permits the Secretary of Defense to waive these tests if the Secrecy certifies to Congress, before a system enters engineering and manufacturing development, that live fire testing "would be unreasonably expensive and impractical." The Air Force did not request a waiver and the Secretary of Defense did not waive live fire tests for the F-22 combat aircraft before the program entered engineering and manufacturing development. Instead, the Department of Defense later requested that Congress enact new legislation to permit the Secretary of Defense to grant a retroactive waiver. Proposed legislation to this effect was submitted to Congress in October 1993. Rather them enacting such legislation Congress requested this study. O O , Specifically, language contained in the National Defense Authorization Act for fiscal year ~ 995 charged the Secretary of Defense to ask the National Research Council of the National Academy of Sciences "to conduct a study regarding the desirability of exercising Me authority . . . to waive for the F-22 aircraft program the survivability tests required pursuant to [the law]...."i 2 The StUdY'S Statement of Task, below, was drawn verbatim from the legislation: _ _~ ~ National Defense Authorization Act for fiscal year 1995, Conference Report to Accompany S.2182 (p. 43), August 12, 1994. The language requiring this study was enacted into law on October 5, 1994 (Public Law 103-337~. 2 The committee notes here that the 1993 National Research Council report Vulnerability Assessment of Aircraft: A Review of the Department of Defense Live Fire Test and Evaluation Program, prepared by the Air Force Studies Board Committee on Weapons Effects on Airborne Systems, was cited by Senator Roth in support of the legislation requiring this study. That report, which discussed the general subject of aircraft vulnerability assessment and the effect of the Live Fire Test Law, provided valuable background that allowed the current committee to focus on the v

Vl ; Live Fire Testing of the F-22 The report shall contain the following matters: (~) Conclusions regarding the practicality offilll-scaTe, filll-up testing for the F-22 aircraft program.3 (2) A discussion of the implications regarding the affordability of the F-22 aircraft program of conducting and of not conducting the survivability tests, including an assessment of the potential life cycle benefits that could be derived from filll-scaTe, filll-up live fire testing in comparison to the costs of such testing. A discussion of what, if any, changes of circumstances affecting the F-22 aircraft program have occurred since completion of the milestone I] program review to cause the program manager to (3) ~ ~ ~7 request a waiver of the survivability tests for the F-22 aircraft program that was not requested at that time. (4) The sufficiency of the F-22 aircraft program testing plans to fulfill the same requirements and purposes as are provided in subsection (e)~3) of section 2366 of title 10, United States Code, for realistic survivability testing for purposes of subsection (a)~(A) of such section. (5) Any recommendations regarding survivability testing of the F-22 aircraft program that the Council considers appropriate on the basis of the study. In response to the legislation and a request from the Deponent of Defense, the Committee on the Study of Live Fire Survivability Testing of the F-22 Aircraft was formed under the auspices of the National Research Council's Commission on Engineering and Technical Systems and its Division of Military Science and Technology to carry out the study. The committee began to function in December 1994. The filll committee met five times over the course of the study. At the early meetings and on other occasions, the members were briefed by representatives of the Air Force, Navy, Office of the Secretary of Defense, arid other government and industry officials on matters relating to the F-22 program and live fire testing. (See Appendix A for a detailed listing of meetings and the persons and orgarli- zations who addressed the fill committee and its members.) Many relevant documents from various agencies were also received. specific case of the F-22. Excerpts from and references to the previous report appear extensively in this report. 3 Full-scale, full-up testing would subject an F-22 to live fire in its combat configuration, including on-board ordnance and filet.

Preface . . V11 During the study, discussions among many experts, both on the committee and from other orgaruzations, allowed full airing of the issues concerning live fire testing. As a result, the committee believes that its study provided ample opportunity for consideration of all sides of the case involving full-up, full-scale testing of the F-22. The committee began by reviewing the threat, mission, and operational requirements for the F-22 to understand the kinds of hostile environments that the aircraft might encounter in future conflicts. The requirements for live fire testing and the testing plans and assumptions germane to the proposed waiver were then reviewed. In making the judgments documented in this report, the committee depended to a large extent on information provided by the Department of Defense and on the previous National Research Council report Vulnerability Assessment of Aircraft. There was neither the time nor the resources to develop substantial amounts of new information. The committee scrutinized the information it was given, bringing to bear the considerable experience, knowledge, and expertise of its members. The committee then made its assessments and formulated its conclusions and recommendations. The committee expresses its sincere appreciation to the many individuals and groups who provided invaluable information and support during this study. JULIAN DAVIDSON Chairman

Contents EXECUTIVE SUMMARY Principal Findings, 2 Practicality and Cost-Benefit, 2 Sufficiency, 3 Vulnerability Assessment Tools, 4 Conclusions and Recommendations, 4 Desirability of Waiver for the F-22 Tests, 5 Changed Circumstances Since Milestone II, 5 Affordability and Cost-Benefit, 5 Sufficiency of Tests Planned for the F-22, 6 Other Recommendations, 9 1 INTRODUCTION Vulnerability in the Context of Overall Survivability, 1 1 Vulnerability Testing of Aircraft Versus Ground Vehicles, 13 Report Orgaruzation, 14 References, 15 ORIGIN OF TESTING REQUIREMENTS Framework, 16 F-22 Live Fire Testing Requirements, 17 The Live Fire Test Law Requirements arid Historical Interpretations, 17 Recent Live Fire Test Guidelines and Interpretations, 19 Recent Amendment to Waiver Provision of the Live Fire Test Law, 21 Request for a Retroactive F-22 Test Waiver, 21 Position on Vulnerability, 23 Position on Full-Up, Full-Scale Testing, 23 Confusion Over Interpretation of the Law Help From the Previous Committee, 24 A Lingering Question, 25 F-22 Design Requirements for Vulnerability, 25 IX 11 16 , 23

x 3 4 Live Fire Testing of the F-22 Disposition of Prior Committee's Recommendations, 27 Summary, 27 Requirements Background, 27 What Changed to Cause Request for Waiver, 28 F-22 Design Requirements for Vulnerability, 28 Disposition of Previous Recoxrunendations, 28 References, 29 PRACTICALITY, AFFORDABILITY, AND COST-BENEFIT Practicality, 31 Relative Importance of Vulnerability Reduction to F-22 Survivability, 31 Realism in Aircraft Testing, 33 Destructive Versus Nondestructive Testing, 36 Expert Opinion, 36 · . . Affordability, 38 Affordability of Full-Up, Full-Scale Testing, 39 Investment Methodology for F-22 Vulnerability Tests, 40 Cost-Benefit Methodology, 40 Conclusions, 41 References, 43 SUFFICIENCY OF F-22 TESTING PLANS F-22 Threat Environment and Its Replication, 44 Overview of the Air Force Vulnerability Assessment Program, 47 Evaluation of the Vulnerability Assessment Program, 50 Structure and Integral Fuel Tanks, 5 ~ Fuel System and Associated Dry Bays, 59 Flight Control and Auxiliary Systems, 63 Weapons Bay and Ordnance, 65 Engines, 67 Flight Crew, 69 Fire Protection Systems, 71 Additional Observations, 76 Conclusions, 78 Adequacy of F-22 Threat Definition and Replication, 78 Overall Sufficiency, 78 Specific Actions, 79 Additional Action, 80 References, 81 ~ 1 . 44

Table of Contents 5 6 VULNERABILITY ASSESSMENT TOOLS Role of Testing, Modeling and Data Bases in Vulnerability Assessment, 83 Documentation, 85 Data Bases, 86 Models, 86 Phenomenological Models, 87 Encounter Models, 89 Models Used by the F-22 System Program Office, 89 Large-Scale Effects, 90 Conclusions, 91 References, 92 RECOMMENDATIONS Desirability of Waiver for the F-22 Tests, 94 Cost-Benefit Methodology, 94 Sufficiency of Tests Planned for the F-22, 95 Other Recommendations, 97 Vulnerability Requirements, 97 Vulnerability Assessment Tools, 97 APPENDIX A: MEETINGS, SITE VISITS, AND DISCUSSIONS APPENDIX B: LIVE FIRE TEST LAW APPENDIX C: DEPARTMENT OF DEFENSE F-22 WAIVER REOIJEST ............. APPENDIX D: VULNERABILITY ASSESSMENT PROCESS Xl . 83 . 94 · 99 105 108 117

List of Exhibits Table 4-l F-22 Threat Environment 45 Figure 4-1 Locations of the test areas 49 Figure 4-2 Structural configuration 52 Figure 4-3 Materials applications 53 Figure 4-4 Aft boom 54 Figure 4-5 Current wing configuration 56 Figure 4-6 Forward boom Al fuel tanks 57 Figure 4-7 Fuel system vulnerability testing 60 Figure 4-8 Vulnerability reduction features of the F-22 62 Figure 4-9 Areas of interest for Test 6 74 . . X11

List of Abbreviations ACC Air Combat Command AIM Air Intercept Missile AMAD Airframe Mounted Auxiliary Drive API Armor Piercing Incendiary APU Auxiliary Power Unit COVART Computation of Vulnerable Areas and Repair Times DoD Department of Defense EMD Engineering and Manufacturing Development ESAMS Enhanced Surface-to-Air Missile Simulation FASTC Foreign Aerospace Science and Technology Center FMECA Failure Modes Effects and Criticality Analysis HE} High-Explosive Incendiary TDAM Joint Direct Attack Munition ~TCG/AS Joint Technical Coordinating Group on Aircraft Survivability ITCG/ME Joint Technical Coordinating Group on Munitions Effectiveness EFT Live Fire Test EFT&E Live Fire Test and Evaluation NRC National Research Council OBIGGS On-Board Inert Gas Generating System ORD Operational Requirements Document OSD Office of the Secretary of Defense PAO Polyalphaolefin (a cooling fluid) SPO System Program Office STAR System Threat Assessment Report SURVIAC Survivability and Vulnerability Information Analysis Center TAP Tactical Air Force TEMP Test and Evaluation Master Plan . . . x'''

Live Fire Testing If the F 22

Next: EXECUTIVE SUMMARY »
Live Fire Testing of the F-22 Get This Book
×
Buy Paperback | $48.00 Buy Ebook | $38.99
MyNAP members save 10% online.
Login or Register to save!
Download Free PDF

The Live Fire Test Law mandates realistic survivability and lethality testing of covered systems or programs. A provision of the law permits the Secretary of Defense to waive tests if live fire testing would be "unreasonably expensive and impractical." Though no waiver was requested before the F-22 program entered engineering and manufacturing development, the Defense Department later asked that Congress enact legislation to permit a waiver to be granted retroactively. Rather than enact such legislation, Congress requested a study to explore the pros and cons of full-scale, full-up testing for the F-22 aircraft program. The book discusses the origin of testing requirements, evaluates the practicality, affordability, and cost-benefit of live fire tests, and examines the role of testing, modeling, and data bases in vulnerability assessment.

  1. ×

    Welcome to OpenBook!

    You're looking at OpenBook, NAP.edu's online reading room since 1999. Based on feedback from you, our users, we've made some improvements that make it easier than ever to read thousands of publications on our website.

    Do you want to take a quick tour of the OpenBook's features?

    No Thanks Take a Tour »
  2. ×

    Show this book's table of contents, where you can jump to any chapter by name.

    « Back Next »
  3. ×

    ...or use these buttons to go back to the previous chapter or skip to the next one.

    « Back Next »
  4. ×

    Jump up to the previous page or down to the next one. Also, you can type in a page number and press Enter to go directly to that page in the book.

    « Back Next »
  5. ×

    To search the entire text of this book, type in your search term here and press Enter.

    « Back Next »
  6. ×

    Share a link to this book page on your preferred social network or via email.

    « Back Next »
  7. ×

    View our suggested citation for this chapter.

    « Back Next »
  8. ×

    Ready to take your reading offline? Click here to buy this book in print or download it as a free PDF, if available.

    « Back Next »
Stay Connected!