English
Related papers

Related papers: Generating Emotive Gaits for Virtual Agents Using …

200 papers

Emotion prediction is the field of study to understand human emotions. Existing methods focus on modalities like text, audio, facial expressions, etc., which could be private to the user. Emotion can be derived from the subject's…

Signal Processing · Electrical Eng. & Systems 2023-08-25 Dhruv Limbani , Daketi Yatin , Nitish Chaturvedi , Vaishnavi Moorthy , Pushpalatha M , Harichandana BSS , Sumit Kumar

In this paper, a deep learning-based model for 3D human motion generation from the text is proposed via gesture action classification and an autoregressive model. The model focuses on generating special gestures that express human thinking,…

Computer Vision and Pattern Recognition · Computer Science 2022-11-21 Gwantae Kim , Youngsuk Ryu , Junyeop Lee , David K. Han , Jeongmin Bae , Hanseok Ko

We present a real-time algorithm for emotion-aware navigation of a robot among pedestrians. Our approach estimates time-varying emotional behaviors of pedestrians from their faces and trajectories using a combination of Bayesian-inference,…

Robotics · Computer Science 2019-03-11 Aniket Bera , Tanmay Randhavane , Rohan Prinja , Kyra Kapsaskis , Austin Wang , Kurt Gray , Dinesh Manocha

Understanding and generating multi-person interactions is a fundamental challenge with broad implications for robotics and social computing. While humans naturally coordinate in groups, modeling such interactions remains difficult due to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Vongani H. Maluleke , Kie Horiuchi , Lea Wilken , Evonne Ng , Jitendra Malik , Angjoo Kanazawa

People communicate using both speech and non-verbal signals such as gestures, face expression or body pose. Non-verbal signals impact the meaning of the spoken utterance in an abundance of ways. An absence of non-verbal signals impoverishes…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Manuel Rebol , Christian Gütl , Krzysztof Pietroszek

Face-to-face communication, as a common human activity, motivates the research on interactive head generation. A virtual agent can generate motion responses with both listening and speaking capabilities based on the audio or motion signals…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Ying Guo , Xi Liu , Cheng Zhen , Pengfei Yan , Xiaoming Wei

There is a growing need for sparse representational formats of human affective states that can be utilized in scenarios with limited computational memory resources. We explore whether representing neural data, in response to emotional…

Human emotions analysis has been the focus of many studies, especially in the field of Affective Computing, and is important for many applications, e.g. human-computer intelligent interaction, stress analysis, interactive games, animations,…

Computer Vision and Pattern Recognition · Computer Science 2020-05-13 Mohammad Rami Koujan , Luma Alharbawee , Giorgos Giannakakis , Nicolas Pugeault , Anastasios Roussos

Facial emotion expression for virtual characters is used in a wide variety of areas. Often, the primary reason to use emotion expression is not to study emotion expression generation per se, but to use emotion expression in an application…

Human-Computer Interaction · Computer Science 2012-11-20 Joost Broekens , Chao Qu , Willem-Paul Brinkman

Owing to the recent developments in Generative Artificial Intelligence (GenAI) and Large Language Models (LLM), conversational agents are becoming increasingly popular and accepted. They provide a human touch by interacting in ways familiar…

Computation and Language · Computer Science 2023-10-31 Fathima Abdul Rahman , Guang Lu

With the motivation of practical gait recognition applications, we propose to automatically create a large-scale synthetic gait dataset (called VersatileGait) by a game engine, which consists of around one million silhouette sequences of…

Computer Vision and Pattern Recognition · Computer Science 2021-01-06 Huanzhang Dou , Wenhu Zhang , Pengyi Zhang , Yuhan Zhao , Songyuan Li , Zequn Qin , Fei Wu , Lin Dong , Xi Li

Dynamic facial expression recognition in the wild remains challenging due to data scarcity and long-tail distributions, which hinder models from effectively learning the temporal dynamics of scarce emotions. To address these limitations, we…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Huanzhen Wang , Ziheng Zhou , Jiaqi Song , Li He , Yunshi Lan , Yan Wang , Wenqiang Zhang

Automatically generated emotion arcs -- that capture how an individual or a population feels over time -- are widely used in industry and research. However, there is little work on evaluating the generated arcs. This is in part due to the…

Computation and Language · Computer Science 2022-10-17 Daniela Teodorescu , Saif M. Mohammad

We propose a real-time system for synthesizing gestures directly from speech. Our data-driven approach is based on Generative Adversarial Neural Networks to model the speech-gesture relationship. We utilize the large amount of speaker video…

Computer Vision and Pattern Recognition · Computer Science 2022-08-08 Manuel Rebol , Christian Gütl , Krzysztof Pietroszek

The structural properties of naturally arising social graphs are extensively studied to understand their evolution. Prior approaches for modeling network dynamics typically rely on rule-based models, which lack realism and generalizability,…

Computation and Language · Computer Science 2025-01-07 Jiarui Ji , Runlin Lei , Jialing Bi , Zhewei Wei , Xu Chen , Yankai Lin , Xuchen Pan , Yaliang Li , Bolin Ding

Images are capable of conveying emotions, but emotional experience is highly subjective. Advances in artificial intelligence have enabled the generation of images based on emotional descriptions. However, the level of agreement between the…

Computer Vision and Pattern Recognition · Computer Science 2024-10-14 Miguel Carrasco , Cesar Gonzalez-Martin , Sonia Navajas-Torrente , Raul Dastres

We present AI-Gram, a fully deployed, continuously operating social platform where every participant is an autonomous LLM-driven agent generating and responding to visual content. Unlike prior multi-agent simulations, AI-Gram operates as a…

Artificial Intelligence · Computer Science 2026-05-05 Andrew Shin

The successful emotional conversation system depends on sufficient perception and appropriate expression of emotions. In a real-life conversation, humans firstly instinctively perceive emotions from multi-source information, including the…

Computation and Language · Computer Science 2022-03-31 Yunlong Liang , Fandong Meng , Ying Zhang , Jinan Xu , Yufeng Chen , Jie Zhou

Datasets with induced emotion labels are scarce but of utmost importance for many NLP tasks. We present a new, automated method for collecting texts along with their induced reaction labels. The method exploits the online use of reaction…

Computation and Language · Computer Science 2021-05-24 Boaz Shmueli , Soumya Ray , Lun-Wei Ku

This document presents endeavors to represent emotion in a computational cognitive architecture. The first part introduces research organizing with two axes of emotional affect: pleasantness and arousal. Following this basic of emotional…

Human-Computer Interaction · Computer Science 2023-01-03 Junya Morita