An ad hoc committee will conduct a study and prepare a report to the Domestic Nuclear Detection Office (DNDO) on quantitative approaches for evaluating the effectiveness of the Global Nuclear Detection Architecture (GNDA), specifically in the context of the following two tasks:
Task 1: Assess the feasibility of using performance measures and quantitative metrics for evaluating progress toward meeting the performance goals in the GNDA Strategic Plan.
The committee should assess the feasibility of using performance measures and quantitative metrics for evaluating progress in meeting these performance goals. This assessment should consider the following factors:
• Definition of performance measures for each of the performance goals in the Strategic Plan.
• Definition of quantifiable performance metrics for each performance measure including, as appropriate, efficiency, output, and outcome-oriented performance measures.
• Identification of data to be used to quantify these performance metrics.
• Identification of methodologies to be used to collect and analyze these data.
• Specification of performance target values for assessing the effectiveness of each performance measure.
If the use of performance measures and quantitative metrics is determined to be feasible, the committee should, to the extent practical, recommend specific performance measures, metrics, and the other supporting information described in the list above for consideration by the DNDO.
If the use of performance measures and metrics is determined to be infeasible, the committee should recommend alternative evaluation approaches.
Task 2: Recommend approaches for evaluating the overall effectiveness of the GNDA.
The committee should specifically recommend
• Approaches for developing an overall analysis framework to assess the effectiveness of the GNDA in terms of its ability to detect, deny, confuse, and/or deter adversaries.
• Approaches for exercising this analysis framework using combinations of modeling/simulation, red teaming, and/or related methods to assess the cost-effectiveness of and tradeoffs in GNDA components.
In executing these tasks the committee should examine efforts by other organizations to develop risk-informed metrics and analysis approaches for complex technological systems.
