The Paradigm Shift to Multimodality in Contemporary Computer Interfaces

The Paradigm Shift to Multimodality in Contemporary Computer Interfaces

Sharon Oviatt, Philip R. Cohen
ISBN: 9781627057516 | PDF ISBN: 9781627057523
Copyright © 2015 | 234 Pages | Publication Date: 0000-00-00 00:00:00

BEFORE YOU ORDER: You may have Academic or Corporate access to this title. Click here to find out: 10.2200/S00636ED1V01Y201503HCI030

Ordering Options: Paperback $70.00   E-book $56.00   Paperback & E-book Combo $87.50

Why pay full price? Members receive 15% off all orders.
Learn More Here

Read Our Digital Content License Agreement (pop-up)

Purchasing Options:

During the last decade, cell phones with multimodal interfaces based on combined new media have become the dominant computer interface worldwide. Multimodal interfaces support mobility and expand the expressive power of human input to computers. They have shifted the fulcrum of human-computer interaction much closer to the human. This book explains the foundation of human-centered multimodal interaction and interface design, based on the cognitive and neurosciences, as well as the major benefits of multimodal interfaces for human cognition and performance. It describes the data-intensive methodologies used to envision, prototype, and evaluate new multimodal interfaces. From a system development viewpoint, this book outlines major approaches for multimodal signal processing, fusion, architectures, and techniques for robustly interpreting users' meaning. Multimodal interfaces have been commercialized extensively for field and mobile applications during the last decade. Research also is growing rapidly in areas like multimodal data analytics, affect recognition, accessible interfaces, embedded and robotic interfaces, machine learning and new hybrid processing approaches, and similar topics. The expansion of multimodal interfaces is part of the long-term evolution of more expressively powerful input to computers, a trend that will substantially improve support for human cognition and performance.

Table of Contents

Intended Audience and Teaching with this Book
Definition and Typre of Multimodal Interface
History of Paradigm Shift from Graphical to Multimodal Interfaces
Aims and Advantages of Multimodal Interfaces
Evolutionary, Neuroscience, and Cognitive Foundations of Multimodal Interfaces
Theoretical Foundations of Multimodal Interfaces
Human-Centered Design of Multimodal Interfaces
Multimodal Signal Processing, Fusion, and Architectures
Multimodal Language, Semantic Processing, and Multimodal Integration
Commercialization of Multimodal Interfaces
Emerging Multimodal Research Areas, and Applications
Beyond Multimodality: Designing More Expressively Powerful Interfaces
Conclusions and Future Directions
Author Biographies

About the Author(s)

Sharon Oviatt, Incaa Designs
Dr. Sharon Oviatt is well known for her extensive work in multi-modal and mobile interfaces, human-centered interface designs, educational interfaces, and communications interfaces. She was the recipient of the Inaugural ACM ICMI Sustained Accomplishment Award and a National Science Foundation Special Creativity Award for her pioneering research on mobile multimodal interfaces. She is also a member of the CHI Academy. Dr. Oviatt has published over 150 scientific articles in a multidisciplinary range of venues, including computer science, learning and cognitive sciences, and linguistic sciences. She is an Associate Editor of the main journals and edited book collections in the field of human interfaces, and authored the chapter on "Multimodal Interfaces" in The Human-Computer Interaction Handbook, 3rd Edition. She was a founder of the International Conference on Multimodal Interfaces (ICMI), which became an annual ACM-sponsored international conference series under her guidance.

Philip R. Cohen, VoiceBox Technologies
Dr. Philip R Cohen is internationally known for his work in multimodal systems and artificial intelligence (intelligent agents and natural language processing). He is a Fellow of the Association for the Advancement of Artificial Intelligence, and past President of the Association for Computational Linguistics. He has over 120 refereed publications in a wide range of venues, and is the recipient (with Prof. Hector Levesque) of an inaugural Influential Paper award by the International Foundation for Autonomous Agents and Multi-Agent Systems. Cohen is currently Vice President, Advanced Technologies at VoiceBox Technologis, Inc. His prior positions include being Founder and Executive Vice President of Research at Adapx Inc., professor and co-director of the Center for Human-Computer Communication in the Department of Computer Science and Engineering at the Oregon Health and Science University, and a Senior Computer Scientist and Director of the Natural Language Program in the Artificial Intelligence Center of SRI International.


Browse by Subject
Case Studies in Engineering
ACM Books
SEM Books
0 items

Note: Registered customers go to: Your Account to subscribe.

E-Mail Address:

Your Name: