A
Workshop Agenda and List of Participants

INSTITUTE OF MEDICINE
National Academy of Sciences

Committee on the Review of NASA Human Research Program’s Scientific Merit Assessment Processes

Workshop on Evaluating the Scientific Merit of Directed Research* Proposals
March 28, 2012
20F Conference Center
Washington, DC

Focus: This workshop is focused on scientific merit assessment processes, and specifically those processes used to assess directed research.

image

*Directed research is defined for the purposes of this workshop as commissioned or noncompetitively awarded research that is not competitively solicited because of specific reasons, such as time limitations or highly focused or constrained research topics. The research topic may be identified by the sponsor or by submission of an unsolicited proposal from external researchers.



The National Academies | 500 Fifth St. N.W. | Washington, D.C. 20001
Copyright © National Academy of Sciences. All rights reserved.
Terms of Use and Privacy Statement



Below are the first 10 and last 10 pages of uncorrected machine-read text (when available) of this chapter, followed by the top 30 algorithmically extracted key phrases from the chapter as a whole.
Intended to provide our own search engines and external engines with highly rich, chapter-representative searchable text on the opening pages of each chapter. Because it is UNCORRECTED material, please consider the following text as a useful but insufficient proxy for the authoritative book pages.

Do not use for reproduction, copying, pasting, or reading; exclusively for search engines.

OCR for page 27
A Workshop Agenda and List of Participants INSTITUTE OF MEDICINE National Academy of Sciences Committee on the Review of NASA Human Research Program’s Scientific Merit Assessment Processes Workshop on Evaluating the Scientific Merit of Directed Research* Proposals March 28, 2012 20F Conference Center Washington, DC Focus: This workshop is focused on scientific merit assessment processes, and specifically those processes used to assess directed research. __________________________ *Directed research is defined for the purposes of this workshop as commissioned or noncompetitively awarded research that is not competitively solicited because of specific reasons, such as time limitations or highly focused or constrained research topics. The research topic may be identified by the sponsor or by submission of an unsolicited proposal from external researchers. 27

OCR for page 27
28 A REVIEW OF NASA HRP’S SCIENTIFIC MERIT ASSESSMENT PROCESSES Workshop Format: Institute of Medicine (IOM) committee members will facilitate roundtable discussions. Invited speakers, National Aeronautics and Space Administration (NASA) staff, and committee members will be at the table and will use preselected discussion questions as a starting point for discussion. Invited speakers will be asked to provide information on the directed research and scientific merit processes used in their organization prior to the workshop. AGENDA 8:30 a.m. Welcome, Introductions, and Organization of the Workshop James Pawelczyk, Chair 9:00 NASA Human Research Program’s Scientific Merit Assessment Processes John Charles, NASA 9:30 Roundtable Discussion 1: Identifying Directed Research Facilitator: Carol Scott-Conner Discussion Questions:  Does your agency or organization fund directed research for any part of its research portfolio?  How does your organization determine what projects constitute directed research projects? What are the criteria? Who makes the decision that it should be directed research (“authorization to review”)?  Do you consider directed research concepts from both internal and external stakeholders? 10:30 Break

OCR for page 27
29 APPENDIX A 10:45 a.m.– Roundtable Discussion 2: Scientific Merit 12:15 p.m. Assessment Facilitator: Ian Graham Discussion Questions:  What type(s) of scientific merit assessment review does your organization use to assess directed research proposals? How does it differ from your process for assessing scientific merit for other types of research?  What are the strengths and weaknesses of each type of review?  What metrics are used in the review to evaluate scientific merit?  Who decides that a research project should be approved and that the research should be initiated (“authorization to proceed”)? 12:15 Lunch 1:00 Roundtable Discussion 3: Evaluation and Quality Improvement Facilitator: Kathie Olsen Discussion Questions:  Monitoring progress and evaluating project results: o How is the progress of a directed research project monitored over the course of the project? How is the success of each project evaluated once it is complete? o What metrics are used and over what period of time? (e.g., Did the researcher deliver the product on time? Did the result meet the needs of the requestor?)  Evaluating the directed research process: o How is the overall quality of directed research process evaluated?

OCR for page 27
30 A REVIEW OF NASA HRP’S SCIENTIFIC MERIT ASSESSMENT PROCESSES What metrics are used and with what o frequency? Who conducts the evaluation? Do researchers provide feedback about o the process and if so, how is that feedback incorporated? Are other quality improvement processes used? What is done to ensure transparency of o the process? 2:30 Break 2:45 Roundtable Discussion 4: Dialogue with NASA Sponsors Facilitator: James Pawelczyk, Chair Discussion about NASA’s directed research processes 4:15 Closing Remarks James Pawelczyk, Chair 4:30 p.m. Adjourn

OCR for page 27
31 APPENDIX A LIST OF PARTICIPANTS IOM Committee Members James A. Pawelczyk, Chair Kathie L. Olsen Associate Professor of Physiology, Founder, Managing Director Kinesiology and Medicine ScienceWorks, LLC Pennsylvania State University Terry M. Rauch Michelle H. Biros Program Director for Defense Professor and Vice Chair of Medical Research and Research Development Department of Emergency Office of the Assistant Secretary Medicine of Defense for Health Affairs Hennepin County Medical Center Department of Defense University of Minnesota Medical School Sally J. Rockey NIH Deputy Director for Divya Chandra Extramural Research Principal Technical Advisor Office of the Director Volpe National Transportation National Institutes of Health Systems Center Department of Transportation Carol E. H. Scott-Conner Professor of Surgery Ian D. Graham University of Iowa Hospitals Associate Professor and Clinics University of Ottawa Peter Suedfeld Chavonda Jacobs-Young Professor Emeritus of Associate Administrator Psychology Agricultural Research Service Department of Psychology U.S. Department of Agriculture University of British Columbia

OCR for page 27
32 A REVIEW OF NASA HRP’S SCIENTIFIC MERIT ASSESSMENT PROCESSES Invited Participants Kenneth Baldwin Adrian Mota Professor of Physiology and Manager of Knowledge Physics Translation Initiatives University of California, Irvine, Canadian Institutes of Health School of Medicine Research Wayman Wendell Cheatham Tim O’Leary Director of the Naval Medical Director of the Clinical Science Research and Development Research and Development Center Service U.S. Navy Department of Veterans Affairs David Dinges Sonia Ortega Professor of Psychology in Program Director, Graduate Psychiatry STEM Fellows in K-12 University of Pennsylvania Education Program School of Medicine National Science Foundation Karl Friedl Alfred M. Powell, Jr. Director of the Telemedicine Director of the Center for and Advanced Technology Satellite Applications and Research Center Research U.S. Army Medical Research National Oceanic and and Materiel Command Atmospheric Administration Paul Krois Jay Schnitzer Manager of the Human Factors Director of the Defense Research and Engineering Sciences Office Division Defense Advanced Research Federal Aviation Administration Projects Agency James Lightbourne Senior Advisor National Science Foundation

OCR for page 27
33 APPENDIX A Sharlene Weatherwax Associate Director of Science for Biological and Environmental Research Department of Energy Edward Zambraski Division Chief of the Military Performance Division U.S. Army Research Institute of Environmental Medicine Sponsor Participants Gale Allen Science Mission Directorate NASA John Charles Chief Scientist of the Human Research Program NASA Marisa Covington Wyle Integrated Science and Engineering Group Craig Kundrot Deputy Chief Scientist of the Human Research Program Manager of the Human Research Program Science Management Office NASA Marc Shepanek Deputy Chief of Medicine of Extreme Environments NASA

OCR for page 27