Below is the uncorrected machine-read text of this chapter, intended to provide our own search engines and external engines with highly rich, chapter-representative searchable text of each book. Because it is UNCORRECTED material, please consider the following text as a useful but insufficient proxy for the authoritative book pages.
Appendix D Assessment Criteria 2004 ASSESSMENT CRITERIA 1. Effectiveness of Interaction with the Scientific and Technical Community: a. Papers in quality refereed journals and conference proceedings (and their citation index) b. Presentations and colloquia c. Participation in professional activities (society officers, conference committees, journal editors) d. Educational outreach (serving on graduate committees, teaching/lecturing, invited talks, mentoring students) e. Fellowships and awards (external and internal) f. Review panel participation (Army Research Office (ARO), National Science Foundation (NSF), Multidisciplinary University Research Initiative (MURI), â¦) g. Recruiting new talent into the Army Research Laboratory (ARL) h. Patents and Intellectual Property (IP) (and examples of how the patent or IP is used) i. Involvement in building an ARL-wide cross-directorate community j. Public recognition, e.g., in the press and elsewhere, for ARL research 2. Impact on Customers: a. Documented transfer/transition of technology, concepts or program assistance from ARL to Research, Development, and Engineering Centers (RDECs) or RDEC contractors for both the long term and short term b. Direct funding from customers to support ARL activities c. Documented demand for ARL support or services (is there competition for their support?) d. Customer involvement in directorate planning 123
124 APPENDIX D e. Participation in multidisciplinary, cross-directorate projects f. Surveys of customer base (direct information from customers on value of ARL research) 3. Formulation of Projectsâ Goals and Plan a. Is there a clear tie to ARL Strategic Focus Areas, Strategic Plan, or other ARL need? b. Are tasks well defined to achieve objectives? c. Does the project plan clearly identify dependencies (i.e., successes depend on success of other activities within the project or outside developments)? d. If the project is part of a wider activity, is role of the investigators clear, and are the project tasks and objectives clearly linked to those of other related projects? e. Are milestones identified, if they are appropriate? Do they appear feasible? f. Are obstacles and challenges defined (technical, resources)? g. Does the project represent an area where application of ARL strengths is appropriate? 4. R&D Methodology a. Are the hypotheses appropriately framed within the literature and theoretical context? b. Is there a clearly identified and appropriate process for performing required analyses, prototypes, models, simulations, tests, and so on? c. Are the methods (e.g., laboratory experiment, modeling/simulation, field test, analysis) appropri- ate to the problems? Do these methods integrate? d. Is the choice of equipment/apparatus appropriate? e. Is the data collection and analysis methodology appropriate? f. Are conclusions supported by the results? g. Are proposed ideas for further study reasonable? h. Do the trade-offs between risk and potential gain appear reasonable? i. If the project demands technological or technical innovation, is that occurring? j. What stopping rules, if any, are being or should be applied? 5. Capabilities and Resources a. Are the qualifications and number of the staff (scientific, technical, administrative) appropriate to achieve success of the project? b. Is funding adequate to achieve success of the project? c. Is the state of the equipment and facilities adequate? d. If staff, funding, or equipment are not adequate, how might the project be triaged (what thrust should be emphasized, what sacrificed?) to best move toward its stated objectives? e. Does the laboratory sustain the technical capability to respond quickly to critical issues as they arise? 6. Responsiveness to the Boardâs Recommendations a. Have the issues and recommendations presented in the previous report been addressed?