It is generally known that human faces, as well as body motions and gestures, provide a wealth of information about a person, such as age, race, sex and emotional state. This monograph primarily studies the perception of facial expression of emotion, and secondarily of motion and gestures, with the purpose of developing a fully automated visual affect recognition system for use in modes of human/computer interaction. The book begins with a survey of the literature on emotion perception, followed by a decription of empirical studies conducted with human participants and the construction of a face image database . On the basis of this work, a visual affect recognition system was developed, consisting of two modules: a face detection subsystem and a facia expression recognition subsystem. Details of this system are demonstrated and analyzed, and extensive performance evaluations and test results are provided. Finally, current research avenues leading to visual affect recognition via analysis of body motin and gestures are also discussed."

It is generally known that human faces, as well as body motions and gestures, provide a wealth of information about a person, such as age, race, sex and emotional state. This monograph primarily studies the perception of facial expression of emotion, and secondarily of motion and gestures, with the purpose of developing a fully automated visual affect recognition system for use in modes of human/computer interaction. The book begins with a survey of the literature on emotion perception, followed by a decription of empirical studies conducted with human participants and the construction of a 'face image database'. On the basis of this work, a visual affect recognition system was developed, consisting of two modules: a face detection subsystem and a facia expression recognition subsystem. Details of this system are demonstrated and analyzed, and extensive performance evaluations and test results are provided. Finally, current research avenues leading to visual affect recognition via analysis of body motin and gestures are also discussed.

The very significant advances in computer vision and pattern recognition and their applications in the last few years reflect the strong and growing interest in the field as well as the many opportunities and challenges it offers. The second edition of this handbook represents both the latest progress and updated knowledge in this dynamic field. The applications and technological issues are particularly emphasized in this edition to reflect the wide applicability of the field in many practical problems. To keep the book in a single volume, it is not possible to retain all chapters of the first edition. However, the chapters of both editions are well written for permanent reference.

Multimodal Behavioral Analysis in the Wild: Advances and Challenges presents the state-of- the-art in behavioral signal processing using different data modalities, with a special focus on identifying the strengths and limitations of current technologies. The book focuses on audio and video modalities, while also emphasizing emerging modalities, such as accelerometer or proximity data. It covers tasks at different levels of complexity, from low level (speaker detection, sensorimotor links, source separation), through middle level (conversational group detection, addresser and addressee identification), and high level (personality and emotion recognition), providing insights on how to exploit inter-level and intra-level links. This is a valuable resource on the state-of-the- art and future research challenges of multi-modal behavioral analysis in the wild. It is suitable for researchers and graduate students in the fields of computer vision, audio processing, pattern recognition, machine learning and social signal processing. Gives a comprehensive collection of information on the state-of-the-art, limitations, and challenges associated with extracting behavioral cues from real-world scenarios Presents numerous applications on how different behavioral cues have been successfully extracted from different data sources Provides a wide variety of methodologies used to extract behavioral cues from multi-modal data

First Published in 1992. Routledge is an imprint of Taylor & Francis, an informa company.

Emotional mimicry has important social functions such as signalling affiliative intent and fostering rapport, and is considered one of the cornerstones of successful interactions. This multidisciplinary overview of research into emotional mimicry and empathy explores when, how and why emotional mimicry occurs.