Appendix D

Biographical Sketches of Steering Committee Members and Presenters

Edward Awh (Presenter) is a professor in the Department of Psychology and the Institute for Neuroscience at the University of Chicago. His research focuses on limited-capacity systems for holding information active in the mind and for exerting voluntary control over which aspects of the environment are fully encoded. He uses a combination of behavioral, electroencephalography, and functional magnetic resonance imaging methods to investigate the nature of limits in online memory and attention, as well as the neural processes that support these cognitive faculties. He received a B.A. in psychology from Northwestern University and an M.A. and a Ph.D. in psychology from the University of Michigan.

Sujeeta Bhatt (Study Director) is a senior program officer with the National Academies of Sciences, Engineering, and Medicine and study director for the Decadal Survey of Social and Behavioral Sciences for Applications to National Security. She was formerly a research scientist at the Defense Intelligence Agency (DIA) and was detailed to the Federal Bureau of Investigation’s High-Value Detainee Interrogation Group (HIG). Prior to that, she was an assistant professor in the Department of Radiology at the Georgetown University Medical Center on detail to DIA/HIG. Her work at DIA and HIG entailed identifying knowledge gaps and developing and managing research projects to address those gaps. Her work in the Intelligence Community focused on the psychological and neuroscience bases for credibility assessment, biometrics, insider threat, intelligence interviewing and interrogation methods, and the development of research-to-practice modules on interrogation-related topics to promote the use of evidence-based practice

in interviews/interrogations. She holds a Ph.D. in behavioral neuroscience from American University.

Remco Chang (Presenter) is an associate professor in the Computer Science Department at Tufts University. Previously, he worked for Boeing, developing real-time flight tracking and visualization software. His current research interests include visual analytics, information visualization, human–computer interaction, and databases. He received the National Science Foundation’s CAREER Award in 2015. He received a B.A. in computer science and economics from Johns Hopkins University, an M.Sc. from Brown University, and a Ph.D. in computer science from the University of North Carolina, Charlotte.

Barbara A. Dosher (NAS) (Committee Member) is a distinguished professor of cognitive sciences at the University of California, Irvine, and recently served as dean of the School of Social Sciences. Her research addresses memory, attention, and perceptual learning in humans using a combination of behavioral testing and mathematical modeling. Previously, she was a professor of psychology at Columbia University. She is an elected fellow of the American Psychological Society, the Society for Experimental Psychologists, and the National Academy of Sciences, and received the 2013 Howard Crosby Warren Medal of the Society for Experimental Psychologists. She has served on the board and as president of the Society for Mathematical Psychology and on the executive board of the Vision Sciences Society. She received a B.A. in psychology from the University of California, San Diego. She received an M.S. and a Ph.D. in experimental psychology from the University of Oregon.

David Dunning (Presenter) is a social psychologist focusing primarily on the psychology underlying human misbelief. His most cited work shows that people hold flattering self-opinions that cannot be justified from objective evidence. He has also conducted extensive work on trust behavior, social cognition, and motivated reasoning. He has served as president of both the Society of Experimental Social Psychology and the Society for the Science of Motivation. He received a B.A. from Michigan State University and his Ph.D. from Stanford University.

Thomas Fingar (Presenter) is a Shorenstein APARC fellow in the Freeman Spogli Institute for International Studies at Stanford University. He was previously inaugural Oksenberg-Rohlen distinguished fellow and Payne distinguished lecturer at Stanford. Before that, he served as the first deputy director of national intelligence for analysis and, concurrently, as chairman of the National Intelligence Council. He served as assistant secretary of the

U.S. Department of State’s Bureau of Intelligence and Research; principal deputy assistant secretary, deputy assistant secretary for analysis; director of the Office of Analysis for East Asia and the Pacific; and chief of the China Division. Prior to his government service, he held a number of positions at Stanford University, including senior research associate in the Center for International Security and Arms Control. He holds an A.B. in government and history from Cornell University and an M.A. and a Ph.D. in political science from Stanford University.

Sallie Keller (Committee Member) is professor of statistics and director for the Social and Decision Analytics Laboratory of the Biocomplexity Institute at Virginia Polytechnic Institute and State University. She served as chair for the National Academies’ Decadal Summit Steering Committee. Her previous positions include academic vice-president and provost at the University of Waterloo; director of the Institute for Defense Analyses Science and Technology Policy Institute in Washington, DC; William and Stephanie Sick dean of engineering at Rice University; head of the Statistical Sciences Group at Los Alamos National Laboratory; professor of statistics at Kansas State University; and statistics program director at the National Science Foundation. Her areas of expertise are social and decision informatics, statistical underpinnings of data science, uncertainty quantification, and data access and confidentiality. She is a national associate of the National Academy of Sciences, fellow of the American Association for the Advancement of Science, elected member of the International Statistics Institute, and member of the JASON advisory group. She is also a fellow and past president of the American Statistical Association. She holds a Ph.D. in statistics from the Iowa State University of Science and Technology.

Gary Klein (Presenter) is a senior scientist at MacroCognition LLC, founder of ShadowBox LLC, and founder and previous owner of Klein Associates. He is known for describing cognitive models (such as the Recognition-Primed Decision model, the Data/Frame model of sensemaking, the Management By Discovery model of planning in complex settings, and the Triple Path model of insight); developing analytic techniques (Cognitive Task Analysis, the PreMortem method of risk assessment, and the ShadowBox training approach); and helping to found the naturalistic decision making research approach. Previously, he was an assistant professor at Oakland University in Rochester, Michigan, and then a research psychologist at Wright-Patterson Air Force Base. He received his Ph.D. from the University of Pittsburgh.

Roger C. Mayer (Presenter) is a professor of management, innovation, and entrepreneurship at North Carolina State University (NCSU). He previously

served on the faculties of the University of Notre Dame, Purdue University, Baylor University, Singapore Management University, and the University of Akron, where he served 4 years as department chair. His research is focused on trust, employee decision making, attitudes, and effectiveness. One line of his work focuses on trust within a global context. He has been involved in interdisciplinary research on trust and decision making through NCSU’s Laboratory for Analytic Sciences. He received a Ph.D. in organizational behavior and human resource management from the Krannert Graduate School of Management at Purdue University.

Barbara Mellers (Presenter) is the I. George Heyman university professor of marketing and psychology at the University of Pennsylvania. She conducts research on judgment and decision making. For years, she explored models of when and why people violate principles of rationality. She has investigated perceptions of fairness; why emotions influence choices; and how seemingly unimportant variables, such as the context around a stimulus and the phrasing of a question, can shape judgments and choice. Currently, she investigates methods for improving the accuracy of human forecasts. By examining hundreds of questions and millions of forecasts, she and her colleagues have discovered how to make human forecasts more accurate by using relatively simple behavioral and statistical interventions. She also studies nudges, choice environments, and behavioral interventions that result in better decisions. She holds a B.A. in psychology from the University of California, Berkeley, and an M.A. and a Ph.D. in psychology from the University of Illinois at Urbana-Champaign.

William “Bruno” Millonig (Presenter) is acting director of national intelligence for science and technology in the Office of the Assistant Director for Acquisition, Technology & Facilities at the Office of the Director of National Intelligence. Appointed in November 2017, Mr. Millonig is responsible for guiding the Intelligence Community’s (IC’s) scientific and technological integration through effective strategies, policies, and programs that ultimately allow the IC to close intelligence gaps. Prior to this position, he oversaw the Defense Intelligence Agency headquarters’ research and development, technical collection, and analytic responsibilities in support of the nation’s space and counterspace situational awareness. He also served as chief, National Measurement and Signature Intelligence (MASINT) Office, and chairman, National MASINT Committee. A command pilot with more than 4,800 flight hours, he retired from the U.S. Air Force in 2009 as director of strategic planning for homeland defense and counterterrorism issues. He is a Distinguished Flying Cross recipient, was commander of the U.S. Air Force’s training squadron of the year (2004), and holds numerous team and individual awards. He graduated from the U.S. Air Force

Academy with a B.S. in engineering and earned master’s degrees in aviation operations and management from Embry Riddle University and in strategic studies from the U.S. Army War College.

Fran Moore (Committee Member) is a vice president at CENTRA Technology, Inc., a midsized defense contractor for the Intelligence Community. She recently retired from the Central Intelligence Agency (CIA) as a senior executive with 32 years of leadership and intelligence analysis experience. She serves on the Board of Threat Deterrence Capital, advising its core business, Circinus, which serves the mission needs of the United States in the areas of defense, security, intelligence, and law enforcement. She also serves on the Intelligence and National Security Alliance’s Security Policy Review Committee and the Armed Forces Communications and Electronics Association’s Intelligence Committee. She is a council member for Gerson Lehrman Group. She was the CIA’s chair for Harvard’s Learning Innovations Lab and a senior ally for the CIA’s LGBT affinity group. Among her many career recognitions, she received a Presidential Rank Award, Distinguished Executive. She holds B.A. degrees in international relations and political science from Elmira College.

Peter Pirolli (Presenter) is a senior researcher at the Institute for Human & Machine Cognition. His research combines cognitive science, artificial intelligence, and human–computer interaction, with applications to information foraging, sensemaking in intelligence analysis, and digital health. He is an elected fellow of the American Association for the Advancement of Science, the American Psychological Association, the Association for Psychological Science, the National Academy of Education, the Association for Computing Machinery Computer–Human Interaction Academy, and the National Academy of Inventors. He received a Ph.D. in cognitive psychology from Carnegie Mellon University.

Paul Sackett (Decadal Survey Chair) is the Beverly and Richard Fink distinguished professor of psychology and liberal arts at the University of Minnesota. His research interests revolve around various aspects of testing and assessment in workplace, educational, and military settings. He has served as president of the Society for Industrial and Organizational Psychology, as co-chair of the committee producing the Standards for Educational and Psychological Testing, as a member of the National Academies of Sciences, Engineering, and Medicine’s Board on Testing and Assessment, as chair of the American Psychological Association’s (APA’s) Committee on Psychological Tests and Assessments, and as chair of APA’s Board of Scientific Affairs. He holds a Ph.D. in industrial/organizational psychology from Ohio State University.

Victoria Stodden (Presenter) is an associate professor in the school of information sciences at the University of Illinois at Urbana-Champaign, with affiliate appointments in the School of Law, the Department of Computer Science, the Department of Statistics, the Coordinated Science Laboratory, and the National Center for Supercomputing Applications. She is also a faculty affiliate of the Center for Informatics Research in Science and Scholarship at the University of Illinois. She is a data scientist working on open data and its implications. Her group focuses on understanding the effect of big data and computation on scientific inference—for example, studying adequacy and robustness in replicated results, designing and implementing validation systems, developing standards of openness for data and code sharing, and resolving legal and policy barriers to disseminating reproducible research. She completed her Ph.D. in statistics and a law degree at Stanford University.

Danielle Albers Szafir (Presenter) is an assistant professor and member of the founding faculty of the Department of Information Science, an affiliate professor of computer science, and a fellow in the Institute of Cognitive Science at the University of Colorado Boulder. Her research lies at the intersection of information visualization, data science, and cognitive science; has been integrated into leading tools such as D3 and Tableau; and has received best paper awards at visualization conferences of the Institute of Electrical and Electronics Engineers (IEEE) and an IEEE Visualization and Graphics Technical Committee Best Dissertation Award Honorable Mention. She is a member of the Forbes 30 Under 30 Class of 2018 for Science. She received a B.S. in computer science at the University of Washington as a National Aeronautics and Space Administration Space Grant Scholar and a Ph.D. in computer sciences at the University of Wisconsin–Madison.

Adam Waytz (Presenter) is a psychologist and associate professor of management and organizations in the Kellogg School of Management at Northwestern University. He uses methods from social psychology and cognitive neuroscience to study the causes and consequences of perceiving mental states in other entities and to investigate processes related to social influence, social connection, meaning making, morality, and ethics. His research has addressed such broad questions as what factors drive altruism, why people dehumanize others, and how people assign moral responsibility to groups versus their members. One line of his work has examined the extent to which people establish trust with a self-driving automobile and how people assign blame if the automobile is involved in an accident. He is a member of the Young Leaders Board of Advisors for Cure Violence, a nonprofit devoted to stopping the spread of violence in communities. He is also a member of the advisory board for Chicago-based data analytics startup

Uptake Technologies and a member of the Brain Trust for Chicago Ideas Week. He holds a bachelor’s degree in psychology from Columbia University and a doctorate in social psychology from the University of Chicago.

Alyson Wilson (Presenter and Committee Member) is a professor in the department of statistics and principal investigator for the Laboratory for Analytic Sciences at North Carolina State University (NSCU). She is a fellow of the American Statistical Association and the American Association for the Advancement of Science. Her research interests include statistical reliability, Bayesian methods, and the application of statistics to problems in defense and national security. She is the coordinator of NCSU’s Data-Driven Science cluster and associate director of the NCSU Data Science Initiative. Prior to coming to NCSU, she worked at the Institute for Defense Analyses Science and Technology Policy Institute, Iowa State University, Los Alamos National Laboratory, Cowboy Programming Resources, and the National Institutes of Health. She received a Ph.D. in statistics from Duke University.

Jeremy Wolfe (Committee Chair) is professor of ophthalmology and radiology at Harvard Medical School and head of the Visual Attention Lab at Brigham and Women’s Hospital. He has extensive expertise in vision, binocular perception, visual attention, and cognitive science. His research focuses on visual search and visual attention, with particular emphasis on socially important search tasks in such areas as medical image perception (e.g., cancer screening), security (e.g., baggage screening), and intelligence. His work led to the development of the Guided Search model through several iterations. In recent years, he has become increasingly interested in the role of vision and attention in medical and security errors. He is president of the Federation of Associations in Behavioral and Brain Science and past chair of the Board of the Psychonomic Society. He received an A.B. in psychology from Princeton University and a Ph.D. in psychology from the Massachusetts Institute of Technology.

This page intentionally left blank.