NOTICE: The project that is the subject of this report was approved by the Governing Board of the National Research Council, whose members are drawn from the councils of the National Academy of Sciences, the National Academy of Engineering, and the Institute of Medicine. The members of the committee responsible for the report were chosen for their special competences and with regard for appropriate balance.
This report has been reviewed by a group other than the authors according to procedures approved by a Report Review Committee consisting of members of the National Academy of Sciences, the National Academy of Engineering, and the Institute of Medicine.
The National Academy of Sciences is a private, nonprofit, self-perpetuating society of distinguished scholars engaged in scientific and engineering research, dedicated to the furtherance of science and technology and to their use for the general welfare. Upon the authority of the charter granted to it by the Congress in 1863, the Academy has a mandate that requires it to advise the federal government on scientific and technical matters. Dr. Bruce M. Alberts is president of the National Academy of Sciences.
The National Academy of Engineering was established in 1964, under the charter of the National Academy of Sciences, as a parallel organization of outstanding engineers. It is autonomous in its administration and in the selection of its members, sharing with the National Academy of Sciences the responsibility for advising the federal government. The National Academy of Engineering also sponsors engineering programs aimed at meeting national needs, encourages education and research, and recognizes the superior achievements of engineers. Dr. Robert M. White is president of the National Academy of Engineering.
The Institute of Medicine was established in 1970 by the National Academy of Sciences to secure the services of eminent members of appropriate professions in the examination of policy matters pertaining to the health of the public. The Institute acts under the responsibility given to the National Academy of Sciences by its congressional charter to be an adviser to the federal government and, upon its own initiative, to identify issues of medical care, research, and education. Dr. Kenneth I. Shine is president of the Institute of Medicine.
The National Research Council was organized by the National Academy of Sciences in 1916 to associate the broad community of science and technology with the Academy's purposes of furthering knowledge and advising the federal government. Functioning in accordance with general policies determined by the Academy, the Council has become the principal operating agency of both the National Academy of Sciences and the National Academy of Engineering in providing services to the government, the public, and the scientific and engineering communities. The Council is administered jointly by both Academies and the Institute of Medicine. Dr. Bruce M. Alberts and Dr. Robert M. White are chairman and vice chairman, respectively, of the National Research Council.
This workshop was supported by funds from the Office of the Director, Operational Test and Evaluation, U.S. Department of Defense.
Additional copies of this report are available from:
Committee on National Statistics
National Research Council
2101 Constitution Avenue, N.W.
Washington, D.C. 20418
Copyright 1994 by the National Academy of Sciences. All rights reserved.
Printed in the United States of America
WORKSHOP ON STATISTICAL ISSUES IN DEFENSE ANALYSIS AND TESTING
Chair
JOHN E. ROLPH, The RAND Corporation, Santa Monica, California
Presenters
DAVID S.C. CHU, Assistant Secretary of Defense for Program Analysis and Evaluation
HENRY DUBIN, Army Operational Test and Evaluation Command, Alexandria, Virginia
JAMES B. DUFF, Navy Operational Test and Evaluation Force, Norfolk, Virginia
ROBERT C. DUNCAN, Director, Operational Test and Evaluation, The Pentagon
ARTHUR FRIES, Institute for Defense Analyses, Alexandria, Virginia
JOHN F. GEHRIG, Army Test and Evaluation Management Agency, The Pentagon
CHARLES F. HORTON, Office of the Director, Operational Test and Evaluation, The Pentagon
RICHARD R. LEDESMA, Office of the Director for Defense Research and Engineering, The Pentagon
WILLIAM G. LESE, Office of the Assistant Secretary of Defense for Program Analysis and Evaluation, General Purpose Programs, Land Forces Division, The Pentagon
MARTIN METH, Office of the Under Secretary of Defense for Acquisition, Production and Logistics, Weapons Support Improvement Group, The Pentagon
JIM METZGER, Office of the Assistant Secretary of Defense for Program Analysis and Evaluation, General Purpose Programs, Land Forces Division, The Pentagon
PATRICIA SANDERS, Office of the Assistant Secretary of Defense for Program Analysis and Evaluation, General Purpose Programs, Land Forces Division, The Pentagon
ERNEST SEGLIE, Office of the Director, Operational Test and Evaluation, The Pentagon
CYRUS J. STANIEC, Office of the Assistant Secretary of Defense for Program Analysis and Evaluation, General Purpose Programs, Land Forces Division, The Pentagon
MARION WILLIAMS, Air Force Operational Test and Evaluation Center, Kirtland Air Force Base, New Mexico
Discussants
LARRY H. CROW, AT&T Bell Labs, Whippany, New Jersey
ARTHUR P. DEMPSTER, Department of Statistics, Harvard University
DONALD P. GAVER, Naval Postgraduate School, Monterey, California
JAMES S. HODGES, The RAND Corporation, Santa Monica, California
KATHRYN B. LASKEY, School of Information Technology and Engineering, George Mason University
VIJAYAN N. NAIR, AT&T Bell Labs, Murray Hill, New Jersey
STEPHEN M. POLLOCK, Department of Industrial and Operations Engineering, University of Michigan, Ann Arbor
DONALD B. RUBIN, Department of Statistics, Harvard University
JEROME SACKS, National Institute of Statistical Sciences, Research Triangle Park, North Carolina
FRANCISCO SAMANIEGO, Department of Statistics, University of California, Davis
STEPHEN B. VARDEMAN, Department of Statistics, Iowa State University, Ames
MICHAEL B. WOODROOFE, Department of Statistics, University of Michigan, Ann Arbor
Rapporteurs
MICHAEL L. COHEN, School of Public Affairs, University of Maryland, College Park
LOUIS GORDON, Department of Mathematics, University of Southern California
NANCY L. SPRUILL, Office of the Assistant Secretary of Defense for Program Analysis and Evaluation, Projection Forces, The Pentagon
Other Participants
BOB BELL, Office of the Director for Operational Test and Evaluation Activity, U.S. Marine Corps, Quantico, Virginia
MARION BRYSON, Test and Experimentation Command, Fort Hood, Texas
HERB FALON, Office of the Deputy Under Secretary of the Army for Operations Research, The Pentagon
LEE FRAME, Office of the Director, Operational Test and Evaluation, The Pentagon
HERMANN HABERMANN, Statistical Policy Office, Office of Management and Budget
CHARLES HOLLAND, Air Force Office of Scientific Research, Bolling Air Force Base, District of Columbia
ROY RICE, Office of Aerospace Studies, Headquarters Air Force Materiel Command, Kirtland Air Force Base, New Mexico
JOHN RIENTE, Office of the Deputy Chief of Staff for Operations and Plans, U.S. Army, The Pentagon
CARL RUSSELL, Army Operational Test and Evaluation Command, Alexandria, Virginia
DUANE L. STEFFEY, Study Director, Committee on National Statistics
MIRON L. STRAF, Director, Committee on National Statistics
CLAYTON THOMAS, Air Force Studies and Analysis Agency, The Pentagon
JOHN R. TUCKER, Staff Officer, Committee on Applied and Theoretical Statistics
SUZANNE H. WOOLSEY, Executive Director, Commission on Behavioral and Social Sciences and Education
COMMITTEE ON NATIONAL STATISTICS 1992-1993
BURTON H. SINGER (Chair),
Department of Epidemiology and Public Health, Yale University
NORMAN M. BRADBURN (Vice Chair),
National Opinion Research Center, University of Chicago
MARTIN H. DAVID,
Department of Economics, University of Wisconsin, Madison
JOHN F. GEWEKE,
Department of Economics, University of Minnesota, Minneapolis
NOREEN GOLDMAN,
Office of Population Research, Princeton University
LOUIS GORDON,
Department of Mathematics, University of Southern California
JOEL B. GREENHOUSE,
Department of Statistics, Carnegie Mellon University
ERIC A. HANUSHEK,
Department of Economics, University of Rochester
ROBERT M. HAUSER,
Department of Sociology and Institute for Research on Poverty, University of Wisconsin, Madison
JANET L. NORWOOD,
The Urban Institute, Washington, D.C.
DOROTHY P. RICE,
Department of Social and Behavioral Sciences, School of Nursing, University of California, San Francisco
JOHN E. ROLPH,
The RAND Corporation, Santa Monica, California
KEITH RUST,
Westat, Inc., Rockville, Maryland
DANIEL L. SOLOMON,
Department of Statistics, North Carolina State University
MIRON L. STRAF, Director
SUSANNA McFARLAND, Administrative Associate
COMMITTEE ON APPLIED AND THEORETICAL STATISTICS 1992-1993
WILLIAM F. EDDY (Chair),
Department of Statistics, Carnegie Mellon University
YVONNE BISHOP,
Energy Information Agency, U.S. Department of Energy
MARY ELLEN BOCK,
Department of Statistics, Purdue University
MARJORIE G. HAHN,
Department of Mathematics, Tufts University
DOUGLAS M. HAWKINS,
Department of Applied Statistics, University of Minnesota
DAVID G. HOEL,
Department of Biostatistics, Epidemiology, and Systems Science, Medical University of South Carolina
JON R. KETTENRING,
Bellcore, Morristown, New Jersey
KARL E. PEACE,
Biopharmaceutical Research Consultants, Ann Arbor, Michigan
STEPHEN M. POLLOCK,
Department of Industrial and Operations Engineering, University of Michigan
DARYL PREGIBON,
AT&T Bell Laboratories, Murray Hill, New Jersey
JOHN R. TUCKER, Senior Program Officer