The Handbook on Socially Interactive Agents provides a comprehensive overview of the research fields of Embodied Conversational Agents, Intelligent Virtual Agents, and Social Robotics. Socially Interactive Agents (SIAs), whether virtually or physically embodied, are autonomous agents that are able to perceive an environment including people or other agents, reason, decide how to interact, and express attitudes such as emotions, engagement, or empathy. They are capable of interacting with people and one another in a socially intelligent manner using multimodal communicative behaviors, with the goal to support humans in various domains.
Written by international experts in their respective fields, the book summarizes research in the many important research communities pertinent for SIAs, while discussing current challenges and future directions. The handbook provides easy access to modeling and studying SIAs for researchers and students, and aims at further bridging the gap between the research communities involved.
In two volumes, the book clearly structures the vast body of research. The first volume starts by introducing what is involved in SIAs research, in particular research methodologies and ethical implications of developing SIAs. It further examines research on appearance and behavior, focusing on multimodality. Finally, social cognition for SIAs is investigated using different theoretical models and phenomena such as theory of mind or pro-sociality. The second volume starts with perspectives on interaction, examined from different angles such as interaction in social space, group interaction, or long-term interaction. It also includes an extensive overview summarizing research and systems of human–agent platforms and of some of the major application areas of SIAs such as education, aging support, autism, and games.
Table of Contents
Introduction to Socially Interactive Agents
Empirical Methods in the Social Science for Researching Socially Interactive Agents
Social Reactions to Socially Interactive Agents and Their Ethical Implications
Appearance
Natural Language Understanding in Socially Interactive Agents
Building and Designing Expressive Speech Synthesis
Gesture Generation
Multimodal Behavior Modeling for Socially Interactive Agents
Theory of Mind and Joint Attention
Emotion
Empathy and Prosociality in Social Agents
Rapport Between Humans and Socially Interactive Agents
Culture for Socially Interactive Agents
About the Author(s)
Birgit Lugrin, University of Wurzburg
Birgit Lugrin (maiden name Birgit Endrass) is a professor for media informatics at the University of Wurzburg, Germany. Since her first contact with a socially interactive agent (the Greta agent) in 2003, she has been fascinated about the research area. Ten years later, she received the prestigious IFAAMAS Victor Lesser Distinguished Dissertation Award and the research award from Augsburg University for her doctoral thesis titled “Cultural Diversity for Virtual Characters.” Today she could not be happier about the chance to co-edit this handbook and work with all the great researchers who have contributed to make this happen.
Catherine Pelachaud, Sorbonne University
Catherine Pelachaud is Director of research at CNRS in the ISIR Laboratory, Sorbonne University. She received her PhD in Computer Graphics at the University of Pennsylvania, Philadelphia, PA, USA, in 1991. She participated in the elaboration of the first embodied conversation agent system, Gesture-Jack, with Justine Cassell, Norman Badler, and Mark Steedman when she was a post-doctoral researcher at the University of Pennsylvania. With her research
team, she has been developing an interactive virtual agent platform, Greta, that can display emotional and communicative behaviors.
David Traum, University of Southern California
David Traum is the Director for Natural Language Research at the Institute for Creative Technologies (ICT) and Research Professor in the Department of Computer Science at the University of Southern California (USC). He leads the Natural Language Dialogue Group at ICT. Traum’s research focuses on dialogue communication between humans and artificial agents. He has engaged in theoretical, implementational, and empirical approaches to the problem, studying human–human natural language and multimodal dialogue, as well as building a number of dialogue systems to communicate with human users. Traum earned his PhD in Computer Science at the University of Rochester in 1994.
