Improved Operational Testing and Evaluation and Methods of Combining Test Information for the Stryker Family of Vehicles and Related Army Systems Phase II Report (2004) / Chapter Skim
Currently Skimming:
Executive Summary
Executive Summary
Pages 1-10
The Chapter Skim interface presents what we've algorithmically identified as the most significant single chunk of text within every page in the chapter.
Select key terms on the right to highlight them within pages of the chapter.
From page 1... ...
The Panel on Operational Test Design and Evaluation of the Interim Armored Vehicle (Stryker) , building on the recommendations of an earlier National Research Council report (National Research Council, 1998)
|
From page 2... ...
This lack of useful RAM information will be exacerbated by the fact that the initial operational test is to be performed without using addon armor. For this reason, the panel stressed that RAM data collection should be an ongoing enterprise, with failure times, failure modes, and maintenance information tracked for the entire life of each vehicle (and its parts)
|
From page 3... ...
For example, the current test design, constructed primarily to compare Stryker/ SECT with the baseline, is balanced for a limited number of factors, allocating test samples to missions and environments similar to the proportion that would be expected in field use. The design precludes focusing test cases on environments in which Stryker is anticipated to have advantages over the baseline system, and it allocates a comparable number of test cases to environments for which Stryker is anticipated to provide little or no advantage.
|
From page 4... ...
In addition, the panel in its earlier report provided technical advice in areas such as statistical power calculations, identifying the appropriate test unit of analysis, issues involving use of SME ratings, aggregation of measures, and use of graphical methods in test evaluation. With respect to the general system development process, the panel believes that, absent strategic considerations, a system should not be forwarded to operational testing until the system design is relatively mature.
|
From page 5... ...
Formal methods for combining information include complete or partial pooling of data from two or more comparable sets of tests or other use, accommodating data from disparate sources using hierarchical or random effects models, and updating prior uncertainties about critical performance measures using Bayesian techniques. We stress that both formal and informal methods require the judicious selection and confirmation of underlying assumptions as well as a careful and open process by which various types of information, some of which involve subjective judgment, are gathered and combined.
|
From page 6... ...
To address these challenges, we suggest in the current report that ATEC develop a parametric space of test environments that can be strategically sampled for testing. ATEC should also develop a test and evaluation data archive to support evolutionary acquisition and a strategy for supporting test design within an evolutionary acquisition framework.
|
From page 7... ...
The fourth issue is whether the selected missions, types of terrain, and intensity of conflict are the correct choices for operational testing to support the decision on whether to pass Stryker to full-rate production. Other missions, types of terrain, intensities, and factors not included in the current test design might have an effect on the performance of Stryker, the baseline system, or both.
|
From page 8... ...
9. ATEC should analyze failure modes separately rather than trying to develop failure rates for the entire vehicle using simple exponential models.
|
From page 9... ...
Recommendations on Assessing the Stryker/SBCT Operational Test in a Broil Context 14. The estimation of system suitability, in particular the estimation of mean fatigue life, repair and replacement times, and the identification of failure modes, should not be the primary responsibility of operational testing, since operational testing cannot be expected to run long enough to accurately estimate these quantities.
|
From page 10... ...
16. The Department of Defense should provide the funds to establish a test data archive that will be a prerequisite for combining information for the testing and evaluation of future systems.
|
Key Terms
This material may be derived from roughly machine-read images, and so is provided only to facilitate research.
More
information on Chapter Skim is available.