Expressive Movement Generation with Machine Learning

Expressive Movement Generation with Machine Learning
Title Expressive Movement Generation with Machine Learning PDF eBook
Author Omid Alemi
Publisher
Pages 240
Release 2021
Genre
ISBN

Download Expressive Movement Generation with Machine Learning Book in PDF, Epub and Kindle

Movement is an essential aspect of our lives. Not only do we move to interact with our physical environment, but we also express ourselves and communicate with others through our movements. In an increasingly computerized world where various technologies and devices surround us, our movements are essential parts of our interaction with and consumption of computational devices and artifacts. In this context, incorporating an understanding of our movements within the design of the technologies surrounding us can significantly improve our daily experiences. This need has given rise to the field of movement computing - developing computational models of movement that can perceive, manipulate, and generate movements. In this thesis, we contribute to the field of movement computing by building machine-learning-based solutions for automatic movement generation. In particular, we focus on using machine learning techniques and motion capture data to create controllable, generative movement models. We also contribute to the field by creating datasets, tools, and libraries that we have developed during our research. We start our research by reviewing the works on building automatic movement generation systems using machine learning techniques and motion capture data. Our review covers background topics such as high-level movement characterization, training data, features representation, machine learning models, and evaluation methods. Building on our literature review, we present WalkNet, an interactive agent walking movement controller based on neural networks. The expressivity of virtual, animated agents plays an essential role in their believability. Therefore, WalkNet integrates controlling the expressive qualities of movement with the goal-oriented behaviour of an animated virtual agent. It allows us to control the generation based on the valence and arousal levels of affect, the movement's walking direction, and the mover's movement signature in real-time. Following WalkNet, we look at controlling movement generation using more complex stimuli such as music represented by audio signals (i.e., non-symbolic music). Music-driven dance generation involves a highly non-linear mapping between temporally dense stimuli (i.e., the audio signal) and movements, which renders a more challenging modelling movement problem. To this end, we present GrooveNet, a real-time machine learning model for music-driven dance generation.

Intelligent Virtual Agents

Intelligent Virtual Agents
Title Intelligent Virtual Agents PDF eBook
Author Jonas Beskow
Publisher Springer
Pages 490
Release 2017-08-24
Genre Computers
ISBN 3319674013

Download Intelligent Virtual Agents Book in PDF, Epub and Kindle

This book constitutes the proceedings of the 17th International Conference on Intelligent Virtual Agents, IVA 2017, held in Stockholm, Sweden, in August 2017. The 30 regular papers and 31 demo papers presented in this volume were carefully reviewed and selected from 78 submissions. The annual IVA conference represents the main interdisciplinary scientic forum for presenting research on modeling, developing, and evaluating intelligent virtual agents (IVAs) with a focus on communicative abilities and social behavior.

Neuromorphic Engineering Editors’ Pick 2021

Neuromorphic Engineering Editors’ Pick 2021
Title Neuromorphic Engineering Editors’ Pick 2021 PDF eBook
Author André van Schaik
Publisher Frontiers Media SA
Pages 177
Release 2021-08-10
Genre Science
ISBN 2889711617

Download Neuromorphic Engineering Editors’ Pick 2021 Book in PDF, Epub and Kindle

Towards Expressive Perception and Generation in Human-Computer Conversational Interaction

Towards Expressive Perception and Generation in Human-Computer Conversational Interaction
Title Towards Expressive Perception and Generation in Human-Computer Conversational Interaction PDF eBook
Author Yaohua Bu
Publisher Scientific Research Publishing, Inc. USA
Pages 193
Release 2024-07-31
Genre Antiques & Collectibles
ISBN 164997955X

Download Towards Expressive Perception and Generation in Human-Computer Conversational Interaction Book in PDF, Epub and Kindle

The construction of a natural interactive human-computer interaction has become an integral component of intelligent system development, constituting a core subject within the field of human-computer interaction. Grounded in the utilization of human perception theories, this study proposes a robust method for speech emotion recognition and a model for inferring user emotional state changes, thereby achieving a hu-man-computer interaction experience characterized by both listening and articulating, and conveying sentiments effectively. Simultaneously, focusing on the audio-visual modalities within human-computer interaction, this research explores methods for con-structing interactive feedback in auditory and visual modalities within real hu-man-computer dialog scenarios. This aims to synchronize textual, verbal, and visual expressions in human-computer interaction, enhancing its naturalness, improving user experience, and augmenting satisfaction and pleasure during interaction. The research contributions are as follows: Introducing a method that robustly identifies user emotional states in real hu-man-computer speech dialogue scenarios through the utilization of local and global attention mechanisms. This method generates robust and distinguishable representa-tions of speech emotion, thereby enhancing the robustness and accuracy of speech emotion recognition systems in authentic dialogue scenarios.

Social Signal Processing

Social Signal Processing
Title Social Signal Processing PDF eBook
Author Judee K. Burgoon
Publisher Cambridge University Press
Pages 441
Release 2017-05-08
Genre Computers
ISBN 1107161266

Download Social Signal Processing Book in PDF, Epub and Kindle

This book provides comprehensive, authoritative surveys covering the modeling, automatic detection, analysis, and synthesis of nonverbal social signals.

ArtsIT, Interactivity and Game Creation

ArtsIT, Interactivity and Game Creation
Title ArtsIT, Interactivity and Game Creation PDF eBook
Author Anthony L. Brooks
Publisher Springer Nature
Pages 642
Release 2023-04-01
Genre Technology & Engineering
ISBN 3031289935

Download ArtsIT, Interactivity and Game Creation Book in PDF, Epub and Kindle

This book constitutes the refereed post-conference proceedings the 11th EAI International Conference on ArtsIT, Interactivity and Game Creation, ArtsIT 2022 which was held in Faro, Portugal, November 21-22, 2022. The 45 revised full papers presented were carefully selected from 118 submissions. The papers are thematically arranged in the following sections: Dialogues Between Geometry, Computer Graphics and the Visual Arts; Games and Gamification; Museums and the Virtual; Animation, AI, Books and Behavior; Fluency, Fashion, Emotion and Play; Movement, Film and Audio.

Deep Learning Theory and Applications

Deep Learning Theory and Applications
Title Deep Learning Theory and Applications PDF eBook
Author Ana Fred
Publisher Springer Nature
Pages 382
Release
Genre
ISBN 3031666941

Download Deep Learning Theory and Applications Book in PDF, Epub and Kindle