National Academies Press: OpenBook

Human-AI Teaming: State-of-the-Art and Research Needs (2022)

Chapter: Appendix B: Human-AI Teaming Workshop Agenda

« Previous: Appendix A: Committee Biographies
Suggested Citation:"Appendix B: Human-AI Teaming Workshop Agenda." National Academies of Sciences, Engineering, and Medicine. 2022. Human-AI Teaming: State-of-the-Art and Research Needs. Washington, DC: The National Academies Press. doi: 10.17226/26355.
×

Appendix B

Human-AI Teaming Workshop Agenda

July 28-29, 2021

MEETING OBJECTIVES

  • Identify key human-systems integration design considerations, methods, approaches, and associated research aimed at warfighter systems that incorporate human-AI teaming
  • Identify gaps in knowledge on effective human-machine teaming necessary to achieve future Air Force mission capability
  • Identify promising human-systems integration and human factors research opportunities that would accelerate mission capability development.

WEDNESDAY, JULY 28, 2021

10:00 a.m. Welcome and Introductions
  • Mica Endsley, Chair
10:15 a.m. AI in Future DOD Operations
Facilitated by Nancy Cooke (committee member)
  • Mark Draper, Human-AI Interaction in Future Joint All Domain Operations: Some Challenges and Opportunities, Air Force Research Laboratory
  • Robin Murphy, Role of Autonomy in DOD and HADR, Texas A&M University
  • Greg Zacharias, Human-Autonomy Test and Evaluation, DOD-OSD
12:00 p.m. Break
12:45 p.m. AI Status and Challenges
Facilitated by Missy Cummings (committee member)
  • Matt Turek, XAI Program, DARPA
  • Joanna Bryson, AI Ethics and Human Cooperation, Hertie School
Suggested Citation:"Appendix B: Human-AI Teaming Workshop Agenda." National Academies of Sciences, Engineering, and Medicine. 2022. Human-AI Teaming: State-of-the-Art and Research Needs. Washington, DC: The National Academies Press. doi: 10.17226/26355.
×
2:00 p.m. Break
2:30 p.m. Human-AI Teaming Approaches
Facilitated by Bill Rouse (committee member)
  • Ben Shneiderman, Human-Centered AI, University of Maryland
  • Jay Shively, Human Autonomy Teaming, NASA Ames
  • Matthew Johnson, Intelligent Teaming, Florida Institute for Human and Machine Cognition
4:45 p.m. Adjourn

THURSDAY, JULY 29, 2021

10:00 a.m. Welcome and First Day wrap up
  • Mica Endsley, Chair
10:15 a.m. Human-AI Team Design and Processes
Facilitated by Emilie Roth (committee member)
  • Jamie Gorman, Modeling Human-Autonomy Team Coordination Using Layered Dynamics, Georgia Tech University
  • Brian Sandberg, ASIST Program, DARPA
  • Thomas O’Neill, Future Directions in Human-Autonomy Teams Research, University of Calgary
12:15 p.m. Break
12:30 p.m. Bias and Trust
Facilitated by John Lee (committee member)
  • Chris Wickens, Black Swans, Complacency and Automation Bias
  • Peter Hancock, Trust in AI Meta-Analysis, University of Central Florida
  • Joe Lyons, Trust Research in AFRL, Air Force Research Laboratory
2:00 p.m. Break
2:30 p.m. Transparency and Explainability
Facilitated by Chris Miller (committee member)
  • Shane Mueller, XAI, Michigan Technology University
  • Jessie Chen, Transparent Communications for Effective Human-Autonomy Teaming, Army Research Laboratory
  • Tim Miller, Transparency and Explainability, University of Melbourne
4:30 p.m. Conclusions/Discussion
5:00 p.m. Adjourn
Suggested Citation:"Appendix B: Human-AI Teaming Workshop Agenda." National Academies of Sciences, Engineering, and Medicine. 2022. Human-AI Teaming: State-of-the-Art and Research Needs. Washington, DC: The National Academies Press. doi: 10.17226/26355.
×
Page 119
Suggested Citation:"Appendix B: Human-AI Teaming Workshop Agenda." National Academies of Sciences, Engineering, and Medicine. 2022. Human-AI Teaming: State-of-the-Art and Research Needs. Washington, DC: The National Academies Press. doi: 10.17226/26355.
×
Page 120
Next: Appendix C: Definitions »
Human-AI Teaming: State-of-the-Art and Research Needs Get This Book
×
 Human-AI Teaming: State-of-the-Art and Research Needs
Buy Paperback | $30.00 Buy Ebook | $24.99
MyNAP members save 10% online.
Login or Register to save!
Download Free PDF

Although artificial intelligence (AI) has many potential benefits, it has also been shown to suffer from a number of challenges for successful performance in complex real-world environments such as military operations, including brittleness, perceptual limitations, hidden biases, and lack of a model of causation important for understanding and predicting future events. These limitations mean that AI will remain inadequate for operating on its own in many complex and novel situations for the foreseeable future, and that AI will need to be carefully managed by humans to achieve their desired utility.

Human-AI Teaming: State-of-the-Art and Research Needs examines the factors that are relevant to the design and implementation of AI systems with respect to human operations. This report provides an overview of the state of research on human-AI teaming to determine gaps and future research priorities and explores critical human-systems integration issues for achieving optimal performance.

READ FREE ONLINE

  1. ×

    Welcome to OpenBook!

    You're looking at OpenBook, NAP.edu's online reading room since 1999. Based on feedback from you, our users, we've made some improvements that make it easier than ever to read thousands of publications on our website.

    Do you want to take a quick tour of the OpenBook's features?

    No Thanks Take a Tour »
  2. ×

    Show this book's table of contents, where you can jump to any chapter by name.

    « Back Next »
  3. ×

    ...or use these buttons to go back to the previous chapter or skip to the next one.

    « Back Next »
  4. ×

    Jump up to the previous page or down to the next one. Also, you can type in a page number and press Enter to go directly to that page in the book.

    « Back Next »
  5. ×

    Switch between the Original Pages, where you can read the report as it appeared in print, and Text Pages for the web version, where you can highlight and search the text.

    « Back Next »
  6. ×

    To search the entire text of this book, type in your search term here and press Enter.

    « Back Next »
  7. ×

    Share a link to this book page on your preferred social network or via email.

    « Back Next »
  8. ×

    View our suggested citation for this chapter.

    « Back Next »
  9. ×

    Ready to take your reading offline? Click here to buy this book in print or download it as a free PDF, if available.

    « Back Next »
Stay Connected!