References
Agarwal, A., Durairajanayagam, D., Tatagari, S., Esteves, S.C., Harlev, A., Henkel, R., Roychoudhury, S., Homa, S., Puchalt, N.G., Ramasamy, R., Majzoub, A., Ly, K.D., Tvrda, E., Assidi, M., Kesari, K., Sharma, R., Banihani, S., Ko, E., Abu-Elmagd, M., Gosalvez, J., and Bashiri, A. (2016). Bibliometrics: Tracking research impact by selecting the appropriate metrics. Asian Journal of Andrology, 18(2), 296–309. doi:10.4103/1008-682X.171582.
Bornmann, L., and Marx, W. (2013). How good is research really?: Measuring the citation impact of publications with percentiles increases correct assessments and fair comparisons. EMBO Reports, 14(3), 226–230. doi:10.1038/embor.2013.9.
Department of Defense. (2008). Secretary of Defense Speech. Available: http://archive.defense.gov/Speeches/Speech.aspx?SpeechID=1228.
Department of Defense. (2017). Financial Management Regulation. DoD 7000.14-R. Available: https://comptroller.defense.gov/portals/45/documents/fmr/current/02b/02b_05.pdf.
Department of Defense Washington Headquarters Services/Acquisition Directorate. (2018). Minerva Research Initiative. FOA #WHS-AD-FOA-18. Available: https://www.grants.gov/web/grants/search-grants.html?keywords=whs-ad-foa-18 (June 2019).
deRijke, S., Wouters, P.F., Rushforth, A.D., Franssen, T.P., and Hammarfelt, B. (2015). Evaluation practices and effects of indicator use—a literature review. Research Evaluation, 25(2), 161–169.
Desch, M. (2019). Cult of the Irrelevant: The Waning Influence of Social Science on National Security. Princeton, NJ: Princeton University Press.
González-Pereira, B., Guerrero-Bote, V.P., and Moya-Anegón, F. (2010). A new approach to the metric of journals’ scientific prestige: The SJR indicator. Journal of Informetrics, 4(3), 379–391. doi:10.1016/j.joi.2010.03.002.
Hicks, D., and Melkers, J. (2013). Bibliometrics as a tool for research evaluation. In A. Link and N. Vornatas (Eds.), Handbook on the Theory and Practice of Program Evaluation (pp. 323–349). Cheltenham, UK: Edward Elgar Publishing.
Hicks, D., and Wouters, P. (2015). The Leiden Manifesto for research metrics. Nature, 520(23), 429–431.
Indiana University Center for Postsecondary Research. (2016). Carnegie Classifications 2015 Public Data File. Available: http://carnegieclassifications.iu.edu/downloads/CCIHE2015-PublicDataFile.xlsx.
James, C., Colledge, L., Meester, W., Azoulay, N., and Plume. (2018). CiteScore Metrics: Creating Journal Metrics from the Scopus Citation Index. Available: https://arxiv.org/ftp/arxiv/papers/1812/1812.06871.pdf.
Low, S.M. (2008). Letter to the Honorable Jim Nussle, Office of Management and Budget, May 28. Available: http://s3.amazonaws.com/rdcms-aaa/files/production/public/FileDownloads/pdfs/issues/policy-advocacy/upload/Minerva-Letter.pdf.
Minerva Research Initiative. (n.d.). About Minerva. Available: https://minerva.defense.gov/About.
Moed, H.F. (2017). Applied Evaluative Informatics. Switzerland: Springer International Publishing.
Montgomery, D. (2019, January). Minerva and Social Science. OUSD-R&E Briefing. Presentation slides provided to the committee.
Nair, B. (2018, January 16). Minerva Research Initiative Program Review Kick-Off. Presentation prepared for the Committee to Assess the Minerva Research Initiative and the Contribution of Social Science to Addressing Security Concerns, Washington, DC.
National Academies of Sciences, Engineering, and Medicine. (2019a). A Decadal Survey of the Social and Behavioral Sciences: A Research Agenda for Advancing Intelligence Analysis. Washington, DC: The National Academies Press. doi:10.17226/25335.
National Academies of Sciences, Engineering, and Medicine (2019b). Reproducibility and Replicability in Science. Washington, DC: The National Academies Press. https://doi.org/10.17226/25303.
National Research Council. (2005). Assessment of Department of Defense Basic Research. Committee on Department of Defense Basic Research, Division on Engineering and Physical Sciences. Washington, DC: The National Academies Press. doi:10.17226/11177.
National Science Foundation. (2008). Social and Behavioral Dimensions of National Security, Conflict, and Cooperation (NSCC). Program Solicitation NSF 08-594. Available: https://www.nsf.gov/pubs/2008/nsf08594/nsf08594.htm.
National Science Foundation. (2014). The National Science Foundation Proposal and Award Policies and Procedures Guide. NSF 15-1. Available: https://www.nsf.gov/pubs/policydocs/pappguide/nsf15001/nsf15_1.pdf.
National Science Foundation and Department of Defense. (2008). Memorandum of Understanding. Document provided by DoD to the committee.
Scopus. (2019a). FAQs for the Content Selection Process. Available: https://www.elsevier.com/solutions/scopus/how-scopus-works/content/content-policy-and-selection.
Scopus. (2019b). How Are Article Metrics Used in Scopus? Metric and Definition: Field Weighted Citation Impact and Citation Benchmarking. Available: https://service.elsevier.com/app/answers/detail/a_id/12031/supporthub/scopus.
Scopus. (2019c). How Are CiteScore Metrics Used in Scopus? What Are the Other CiteScore Metrics? CiteScore Percentiles. Available: https://service.elsevier.com/app/answers/detail/a_id/14880/supporthub/scopus.
Scopus. (2019d). How Are CiteScore Metrics Used in Scopus? What Is the CiteScore Methodology? Available: https://service.elsevier.com/app/answers/detail/a_id/14880/supporthub/scopus.
Scopus. (2019e). How Is SJR (SCImago Journal Rank) Used in Scopus? Available: https://service.elsevier.com/app/answers/detail/a_id/14883/supporthub/scopus/related/1.
Scopus. (2019f). What Is Peer Review? Available: https://www.elsevier.com/en-gb/reviewers/what-is-peer-review.
Scopus. (2019g). What Is the Complete List of Scopus Subject Areas and All Science Journal Classification Codes (ASJC)? Available: https://service.elsevier.com/app/answers/detail/a_id/15181/supporthub/scopus.
Siler, K., Lee, K., and Bero, L. (2015). Measuring the effectiveness of scientific gatekeeping. Proceedings of the National Academy of Sciences of the United States of America, 12(2), 360–365. doi:10.1073/pnas.1418218112.
Stokes, D.E. (1997). Pasteur’s Quadrant: Basic Science and Technological Innovation. Washington, DC: The Brookings Institution.
Sugimoto, C.R., and Lariviere, V. (2018). Measuring Research: What Everyone Needs to Know. New York: Oxford University Press.
Testa, J. (2017, September). The selection process for the book citation index in Web of Science. Clarivate Analytics. Available: https://clarivate.com/essays/selection-process-book-citation-index-web-science.
Ulrich’s Web. (n.d.). Frequently Asked Questions, About the Ulrich’s Knowledgebase, What Is a Refereed Serial? Available: http://www.ulrichsweb.com/ulrichsweb/faqs.asp.
Web of Science. (2019). Conference Proceedings Selection Process. Available: https://clarivate.com/essays/web-science-conference-proceedings-selection-process.
