National Academies Press: OpenBook

Measuring Human Capabilities: An Agenda for Basic Research on the Assessment of Individual and Group Performance Potential for Military Accession (2015)

Chapter: Appendix A: Workshop Agenda and Selection of Additional Topics Considered for Workshop Agenda

« Previous: Appendixes
Suggested Citation:"Appendix A: Workshop Agenda and Selection of Additional Topics Considered for Workshop Agenda." National Research Council. 2015. Measuring Human Capabilities: An Agenda for Basic Research on the Assessment of Individual and Group Performance Potential for Military Accession. Washington, DC: The National Academies Press. doi: 10.17226/19017.
×

Appendix A

Workshop Agenda and Selection of Additional Topics Considered for Workshop Agenda

AGENDA

Workshop on New Directions in Assessing Individuals and Groups April 3-4, 2013

Workshop Goals

  1. Facilitate interdisciplinary dialogue on the current and future state-of-the-science in measurement of individual capabilities and the combination of individual capabilities to create collective capacity to perform.
  2. Inform the design of a maximally effective selection and assignment system.

Wednesday, April 3

8:00 am Workshop Check-In
   
9:00 Welcome from the National Research Council
 

Robert Hauser, Executive Director, Division of Behavioral and Social Sciences and Education

Suggested Citation:"Appendix A: Workshop Agenda and Selection of Additional Topics Considered for Workshop Agenda." National Research Council. 2015. Measuring Human Capabilities: An Agenda for Basic Research on the Assessment of Individual and Group Performance Potential for Military Accession. Washington, DC: The National Academies Press. doi: 10.17226/19017.
×
Overview of the Board on Behavioral, Cognitive, and Sensory Sciences
 

Barbara A. Wanchisen, Director, Board on Behavioral, Cognitive, and Sensory Sciences

   
  Introductions
   
9:30 Workshop Objectives and Study Overview
 

Jack Stuster, Anacapa Sciences, Inc., and Chair, Committee on Measuring Human Capabilities

   
10:00 Sponsor’s Perspective
 

Gerald (Jay) Goodwin, Chief, Foundational Science, U.S. Army Research Institute for the Behavioral and Social Sciences

   
10:45 Break
   
11:00 Setting the Stage: The Evolving Goals of Candidate Testing and Its Role in Personnel Selection
 

Fred Oswald, Rice University

   
12:00 pm Keynote Address: Psychometrics for a New Generation of Assessments
 

Alina von Davier, Research Director, Center for Advanced Psychometrics, Educational Testing Service

   
12:30 Working Lunch
 

Jack Stuster, Chair

 

Topic: Discussion of ideas presented in Keynote Address

   
1:15 Emerging Constructs and Theory
  Part One: Invited Presentations
  A Psychoneurometric Approach to Individual-Differences Assessment
 

Christopher Patrick, Florida State University

  The Emerging Cognitive Constructs of Working Memory Capacity and Executive Attention
 

Michael Kane, University of North Carolina, Greensboro

  The Agentic Self: Action Control Beliefs
 

Todd Little, University of Kansas

   
Suggested Citation:"Appendix A: Workshop Agenda and Selection of Additional Topics Considered for Workshop Agenda." National Research Council. 2015. Measuring Human Capabilities: An Agenda for Basic Research on the Assessment of Individual and Group Performance Potential for Military Accession. Washington, DC: The National Academies Press. doi: 10.17226/19017.
×
Part Two: Roundtable Discussion with Committee Members and Invited Presenters
   
3:30 Break
   
3:45 Ethical Implications of Future Testing Techniques and Personnel Selection Paradigms
 

Rodney Lowman, Alliant International University

   
  Reactions from Committee Members
   
4:45 Conclude Day One
   
Thursday, April 4
   
8:30 am Day Two Workshop Check-In
   
9:00 Summary of Day One and Overview of Day Two
 

Jack Stuster, Anacapa Sciences, Inc., and Chair, Committee on Measuring Human Capabilities

   
9:15 Measuring Individual Differences and Predicting Individual Performance
  Part One: Invited Presentations
  Taxonomic Structure for Thinking About Ways to Improve the Quality of Selection Systems
 

Paul Sackett, University of Minnesota

  Rethinking Interests
 

James Rounds, University of Illinois at

 

Urbana-Champaign

  Assessing Cognitive Skills: Case History, Diagnosis, and Treatment Plan
 

Earl Hunt, University of Washington

   
10:15 Break
   
10:30 Measuring Individual Differences and Predicting Individual Performance, Continued
   
  Part Two: Roundtable Discussion with Committee Members and Invited Presenters
Suggested Citation:"Appendix A: Workshop Agenda and Selection of Additional Topics Considered for Workshop Agenda." National Research Council. 2015. Measuring Human Capabilities: An Agenda for Basic Research on the Assessment of Individual and Group Performance Potential for Military Accession. Washington, DC: The National Academies Press. doi: 10.17226/19017.
×
12:00 pm Working Lunch
 

Jack Stuster, Chair

 

Topic: Continued roundtable discussion with committee members and invited presenters

   
12:45 Group Composition Processes and Performance
  Part One: Invited Presentations
 

Team Composition: Theory, Practice, and the Future Scott Tannenbaum, Group for Organizational Effectiveness

  Understanding and Enabling the Collective Capabilities of Teams
 

Leslie DeChurch, Georgia Institute of Technology

  Collective Intelligence in the Performance of Human Groups
 

Anita Williams Woolley, Carnegie Mellon University

   
  Part Two: Roundtable Discussion with Committee Members and Invited Presenters
   
3:15 Break
   
3:30 Cross-cutting Links and Research Gaps: Roundtable Discussion with Committee Members and All Invited Presenters
   
4:00 Workshop Implications
  Part One: Invited Presentation
  Summary of Emerging Themes
 

Randall Engle, Georgia Institute of Technology and Member, Committee on Measuring Human Capabilities

   
  Part Two: Reactions from Invited Presenters and Committee Members
   
4:45 Closing Comments
 

Jack Stuster, Chair

   
5:00 Adjourn
Suggested Citation:"Appendix A: Workshop Agenda and Selection of Additional Topics Considered for Workshop Agenda." National Research Council. 2015. Measuring Human Capabilities: An Agenda for Basic Research on the Assessment of Individual and Group Performance Potential for Military Accession. Washington, DC: The National Academies Press. doi: 10.17226/19017.
×

SELECTION OF ADDITIONAL TOPICS CONSIDERED FOR WORKSHOP AGENDA

The following list is an unprioritized selection of the topics developed by the committee through brainstorming and deliberation processes as potential topics for inclusion during the workshop. Many of the topics were included in the final workshop agenda, while others were not for a variety of reasons. Some potentially important topics were excluded due to reasons such as time limitations of the event, availability of key presenters, compatibility with broad categories selected for emphasis at the workshop, and the committee’s assessment of the likely value of discussion of particular topics over others. Some key topics not included in the workshop were included in later data gathering sessions of the committee during the study’s second phase, as listed in Appendix B. This list is not all-inclusive, and it does not document all of the topics considered through two years of in-person meetings, conference calls, emails, and other information sharing that occurred between committee members, invited experts, the study sponsor, and National Research Council staff in order to arrive at the contents of this final report.

Measurement Techniques

Unobtrusive testing methods

Bayesian modeling

Machine learning

Nonparametric analyses

Context

Quantitative group decision making

Measurement at an Individual Level

Constructs of cognition: knowledge, reasoning, memory, speed of processing, visualization

Biodata

Experience sampling

21st century skills

Vocational interest measurements

Situational judgment inventories

Situation awareness

Implicit biases

Modeling

Decision theoretic advances

Behavioral economics/game theory

Medical decision making

Suggested Citation:"Appendix A: Workshop Agenda and Selection of Additional Topics Considered for Workshop Agenda." National Research Council. 2015. Measuring Human Capabilities: An Agenda for Basic Research on the Assessment of Individual and Group Performance Potential for Military Accession. Washington, DC: The National Academies Press. doi: 10.17226/19017.
×

Information processing models

Group modeling

Methods

Asynchronous interviewing

Automatic scoring

Communication analysis

Computational linguistics

Latent semantic analysis

Data mining

Likert scales

Clinical interviews

Sociometry

Simulations and gaming

Synthetic validation

Unproctored tests

Neuroscience and Psychophysiology

Psychoneurometrics

Blood chemistry

Biomarkers

Suggested Citation:"Appendix A: Workshop Agenda and Selection of Additional Topics Considered for Workshop Agenda." National Research Council. 2015. Measuring Human Capabilities: An Agenda for Basic Research on the Assessment of Individual and Group Performance Potential for Military Accession. Washington, DC: The National Academies Press. doi: 10.17226/19017.
×
Page 233
Suggested Citation:"Appendix A: Workshop Agenda and Selection of Additional Topics Considered for Workshop Agenda." National Research Council. 2015. Measuring Human Capabilities: An Agenda for Basic Research on the Assessment of Individual and Group Performance Potential for Military Accession. Washington, DC: The National Academies Press. doi: 10.17226/19017.
×
Page 234
Suggested Citation:"Appendix A: Workshop Agenda and Selection of Additional Topics Considered for Workshop Agenda." National Research Council. 2015. Measuring Human Capabilities: An Agenda for Basic Research on the Assessment of Individual and Group Performance Potential for Military Accession. Washington, DC: The National Academies Press. doi: 10.17226/19017.
×
Page 235
Suggested Citation:"Appendix A: Workshop Agenda and Selection of Additional Topics Considered for Workshop Agenda." National Research Council. 2015. Measuring Human Capabilities: An Agenda for Basic Research on the Assessment of Individual and Group Performance Potential for Military Accession. Washington, DC: The National Academies Press. doi: 10.17226/19017.
×
Page 236
Suggested Citation:"Appendix A: Workshop Agenda and Selection of Additional Topics Considered for Workshop Agenda." National Research Council. 2015. Measuring Human Capabilities: An Agenda for Basic Research on the Assessment of Individual and Group Performance Potential for Military Accession. Washington, DC: The National Academies Press. doi: 10.17226/19017.
×
Page 237
Suggested Citation:"Appendix A: Workshop Agenda and Selection of Additional Topics Considered for Workshop Agenda." National Research Council. 2015. Measuring Human Capabilities: An Agenda for Basic Research on the Assessment of Individual and Group Performance Potential for Military Accession. Washington, DC: The National Academies Press. doi: 10.17226/19017.
×
Page 238
Next: Appendix B: Phase II Data Gathering Presentations »
Measuring Human Capabilities: An Agenda for Basic Research on the Assessment of Individual and Group Performance Potential for Military Accession Get This Book
×
Buy Paperback | $56.00 Buy Ebook | $44.99
MyNAP members save 10% online.
Login or Register to save!
Download Free PDF

Every year, the U.S. Army must select from an applicant pool in the hundreds of thousands to meet annual enlistment targets, currently numbering in the tens of thousands of new soldiers. A critical component of the selection process for enlisted service members is the formal assessments administered to applicants to determine their performance potential. Attrition for the U.S. military is hugely expensive. Every recruit that does not make it through basic training or beyond a first enlistment costs hundreds of thousands of dollars. Academic and other professional settings suffer similar losses when the wrong individuals are accepted into the wrong schools and programs or jobs and companies. Picking the right people from the start is becoming increasingly important in today's economy and in response to the growing numbers of applicants. Beyond cognitive tests of ability, what other attributes should selectors be considering to know whether an individual has the talent and the capability to perform as well as the mental and psychological drive to succeed?

Measuring Human Capabilities: An Agenda for Basic Research on the Assessment of Individual and Group Performance Potential for Military Accession examines promising emerging theoretical, technological, and statistical advances that could provide scientifically valid new approaches and measurement capabilities to assess human capability. This report considers the basic research necessary to maximize the efficiency, accuracy, and effective use of human capability measures in the military's selection and initial occupational assignment process. The research recommendations of Measuring Human Capabilities will identify ways to supplement the Army's enlisted soldier accession system with additional predictors of individual and collective performance. Although the primary audience for this report is the U.S. military, this book will be of interest to researchers of psychometrics, personnel selection and testing, team dynamics, cognitive ability, and measurement methods and technologies. Professionals interested in of the foundational science behind academic testing, job selection, and human resources management will also find this report of interest.

  1. ×

    Welcome to OpenBook!

    You're looking at OpenBook, NAP.edu's online reading room since 1999. Based on feedback from you, our users, we've made some improvements that make it easier than ever to read thousands of publications on our website.

    Do you want to take a quick tour of the OpenBook's features?

    No Thanks Take a Tour »
  2. ×

    Show this book's table of contents, where you can jump to any chapter by name.

    « Back Next »
  3. ×

    ...or use these buttons to go back to the previous chapter or skip to the next one.

    « Back Next »
  4. ×

    Jump up to the previous page or down to the next one. Also, you can type in a page number and press Enter to go directly to that page in the book.

    « Back Next »
  5. ×

    Switch between the Original Pages, where you can read the report as it appeared in print, and Text Pages for the web version, where you can highlight and search the text.

    « Back Next »
  6. ×

    To search the entire text of this book, type in your search term here and press Enter.

    « Back Next »
  7. ×

    Share a link to this book page on your preferred social network or via email.

    « Back Next »
  8. ×

    View our suggested citation for this chapter.

    « Back Next »
  9. ×

    Ready to take your reading offline? Click here to buy this book in print or download it as a free PDF, if available.

    « Back Next »
Stay Connected!