This volume presents high quality, state-of-the-art research ideas and results from theoretic, algorithmic and application viewpoints. It contains contributions by leading experts in the obsequious scientific and technological field of multimedia. The book specifically focuses on interaction with multimedia content with special emphasis on multimodal interfaces for accessing multimedia information. The book is designed for a professional audience composed of practitioners and researchers in industry. It is also suitable for advanced-level students in computer science.

"This book provides concepts, methodologies, and applications used to design and develop multimodal systems"--Provided by publisher.

Multimodal signal processing is an important research and development field that processes signals and combines information from a variety of modalities – speech, vision, language, text – which significantly enhance the understanding, modelling, and performance of human-computer interaction devices or systems enhancing human-human communication. The overarching theme of this book is the application of signal processing and statistical machine learning techniques to problems arising in this multi-disciplinary field. It describes the capabilities and limitations of current technologies, and discusses the technical challenges that must be overcome to develop efficient and user-friendly multimodal interactive systems. With contributions from the leading experts in the field, the present book should serve as a reference in multimodal signal processing for signal processing researchers, graduate students, R&D engineers, and computer engineers who are interested in this emerging field. - Presents state-of-art methods for multimodal signal processing, analysis, and modeling - Contains numerous examples of systems with different modalities combined - Describes advanced applications in multimodal Human-Computer Interaction (HCI) as well as in computer-based analysis and modelling of multimodal human-human communication scenes.

A comprehensive synthesis of recent advances in multimodal signal processing applications for human interaction analysis and meeting support technology. With directly applicable methods and metrics along with benchmark results, this guide is ideal for those interested in multimodal signal processing, its component disciplines and its application to human interaction analysis.

Artificial Intelligence and Multimodal Signal Processing in Human-Machine Interaction presents an overview of an emerging field that is concerned with exploiting multiple modalities of communication in both Artificial Intelligence and Human-Machine Interaction. The book not only provides cross disciplinary research in the fields of multimodal signal acquisition and sensing, analysis, IoTs (Internet of Things), Artificial Intelligence, and system architectures, it also evaluates the role of Artificial Intelligence I in relation to the realization of contemporary Human Machine Interaction (HMI) systems.Readers are introduced to the multimodal signals and their role in the identification of the intended subjects, mental state and the realization of HMI systems are explored, and the applications of signal processing and machine/ensemble/deep learning for HMIs are assessed. A description of proposed methodologies is provided, and related works are also presented. This is a valuable resource for researchers, health professionals, postgraduate students, post doc researchers and faculty members in the fields of HMIs, Brain-Computer Interface (BCI), Prosthesis, Computer vision, and Mental state estimation, and all those who wish to broaden their knowledge in the allied field. - Covers advances in the multimodal signal processing and artificial intelligence assistive HMIs - Presents theories, algorithms, realizations, applications, approaches, and challenges that will have their impact and contribution in the design and development of modern and effective HMI (Human Machine Interaction) system - Presents different aspects of the multimodal signals, from the sensing to analysis using hardware/software, and making use of machine/ensemble/deep learning in the intended problem-solving

The Handbook of Multimodal-Multisensor Interfaces provides the first authoritative resource on what has become the dominant paradigm for new computer interfaces— user input involving new media (speech, multi-touch, gestures, writing) embedded in multimodal-multisensor interfaces. These interfaces support smart phones, wearables, in-vehicle and robotic applications, and many other areas that are now highly competitive commercially. This edited collection is written by international experts and pioneers in the field. It provides a textbook, reference, and technology roadmap for professionals working in this and related areas. This first volume of the handbook presents relevant theory and neuroscience foundations for guiding the development of high-performance systems. Additional chapters discuss approaches to user modeling and interface designs that support user choice, that synergistically combine modalities with sensors, and that blend multimodal input and output. This volume also highlights an in-depth look at the most common multimodal-multisensor combinations—for example, touch and pen input, haptic and non-speech audio output, and speech-centric systems that co-process either gestures, pen input, gaze, or visible lip movements. A common theme throughout these chapters is supporting mobility and individual differences among users. These handbook chapters provide walk-through examples of system design and processing, information on tools and practical resources for developing and evaluating new systems, and terminology and tutorial support for mastering this emerging field. In the final section of this volume, experts exchange views on a timely and controversial challenge topic, and how they believe multimodal-multisensor interfaces should be designed in the future to most effectively advance human performance.

With the advance of speech, image and video technology, human-computer interaction (HCI) will reach a new phase.In recent years, HCI has been extended to human-machine communication (HMC) and the perceptual user interface (PUI). The final goal in HMC is that the communication between humans and machines is similar to human-to-human communication. Moreover, the machine can support human-to-human communication (e.g. an interface for the disabled). For this reason, various aspects of human communication are to be considered in HMC. The HMC interface, called a multimodal interface, includes different types of input methods, such as natural language, gestures, face and handwriting characters.The nine papers in this book have been selected from the 92 high-quality papers constituting the proceedings of the 2nd International Conference on Multimodal Interface (ICMI '99), which was held in Hong Kong in 1999. The papers cover a wide spectrum of the multimodal interface.