Quantitative metrics that connect the research to applications transition of ASP products are lacking.
Comprehensive assessments of benefits to society of ASP products that include feedback from beneficiaries are not performed and documentation of implementation processes and practices of applying ASP products compromise third-party evaluations of benefits.
Key documentation of DSS in the form of benchmark reports, while effective in providing guidance on the application of DSS, lacks critical input from the end users and especially local governments and the private sector. The benchmark reports do provide a critically important database across many application areas for guiding future applications and the direction of the ASP.
Inefficient transition from research to operations of NASA products impairs the consideration of the applications community to commit to use of science products because of a lack of assurance of product continuity.
The performance and accountability evaluation process of ASP does not appear to be a clinical and critical process of quantifying performance on the basis of feedback from the user groups. The committee could find little to no evidence of input from the broader community on the evaluation of the societal benefits of ASP's work, thereby limiting the credibility of any such assessment.