Appendix B

Statement of Task

An ad hoc committee will conduct a study and prepare a report to the Domestic Nuclear Detection Office (DNDO) on quantitative approaches for evaluating the effectiveness of the Global Nuclear Detection Architecture (GNDA), specifically in the context of the following two tasks:

Task 1: Assess the feasibility of using performance measures and quantitative metrics for evaluating progress toward meeting the performance goals in the GNDA Strategic Plan.

The committee should assess the feasibility of using performance measures and quantitative metrics for evaluating progress in meeting these performance goals. This assessment should consider the following factors:

•   Definition of performance measures for each of the performance goals in the Strategic Plan.

•   Definition of quantifiable performance metrics for each performance measure including, as appropriate, efficiency, output, and outcome-oriented performance measures.

•   Identification of data to be used to quantify these performance metrics.

•   Identification of methodologies to be used to collect and analyze these data.

•   Specification of performance target values for assessing the effectiveness of each performance measure.



The National Academies | 500 Fifth St. N.W. | Washington, D.C. 20001
Copyright © National Academy of Sciences. All rights reserved.
Terms of Use and Privacy Statement



Below are the first 10 and last 10 pages of uncorrected machine-read text (when available) of this chapter, followed by the top 30 algorithmically extracted key phrases from the chapter as a whole.
Intended to provide our own search engines and external engines with highly rich, chapter-representative searchable text on the opening pages of each chapter. Because it is UNCORRECTED material, please consider the following text as a useful but insufficient proxy for the authoritative book pages.

Do not use for reproduction, copying, pasting, or reading; exclusively for search engines.

OCR for page 65
Appendix B Statement of Task An ad hoc committee will conduct a study and prepare a report to the Domestic Nuclear Detection Office (DNDO) on quantitative approaches for evaluating the effectiveness of the Global Nuclear Detection Architec- ture (GNDA), specifically in the context of the following two tasks: Task 1: Assess the feasibility of using performance measures and quan- titative metrics for evaluating progress toward meeting the performance goals in the GNDA Strategic Plan. The committee should assess the feasibility of using performance mea- sures and quantitative metrics for evaluating progress in meeting these performance goals. This assessment should consider the following factors: • Definition of performance measures for each of the performance goals in the Strategic Plan. • Definition of quantifiable performance metrics for each perfor- mance measure including, as appropriate, efficiency, output, and outcome-oriented performance measures. • Identification of data to be used to quantify these performance metrics. • Identification of methodologies to be used to collect and analyze these data. • Specification of performance target values for assessing the effec- tiveness of each performance measure. 65

OCR for page 65
66 APPENDIX B If the use of performance measures and quantitative metrics is deter- mined to be feasible, the committee should, to the extent practical, recom- mend specific performance measures, metrics, and the other supporting information described in the list above for consideration by the DNDO. If the use of performance measures and metrics is determined to be infea- sible, the committee should recommend alternative evaluation approaches. Task 2: Recommend approaches for evaluating the overall effectiveness of the GNDA. The committee should specifically recommend • Approaches for developing an overall analysis framework to assess the effectiveness of the GNDA in terms of its ability to detect, deny, confuse, and/or deter adversaries. • Approaches for exercising this analysis framework using combina- tions of modeling/simulation, red teaming, and/or related meth- ods to assess the cost-effectiveness of and tradeoffs in GNDA components. In executing these tasks the committee should examine efforts by other organizations to develop risk-informed metrics and analysis approaches for complex technological systems.