English
Related papers

Related papers: Enhancing Micro Gesture Recognition for Emotion Un…

200 papers

Contrastive learning techniques have been widely used in the field of computer vision as a means of augmenting datasets. In this paper, we extend the use of these contrastive learning embeddings to sentiment analysis tasks and demonstrate…

Computation and Language · Computer Science 2021-12-03 Ipsita Mohanty , Ankit Goyal , Alex Dotterweich

Recent increase of remote-work, online meeting and tele-operation task makes people find that gesture for avatars and communication robots is more important than we have thought. It is one of the key factors to achieve smooth and natural…

Human-Computer Interaction · Computer Science 2023-09-29 Hitoshi Teshima , Naoki Wake , Diego Thomas , Yuta Nakashima , Hiroshi Kawasaki , Katsushi Ikeuchi

While text-based emotion recognition methods have achieved notable success, real-world dialogue systems often demand a more nuanced emotional understanding than any single modality can offer. Multimodal Emotion Recognition in Conversations…

Computation and Language · Computer Science 2025-09-10 Chengyan Wu , Yiqiang Cai , Yang Liu , Pengxu Zhu , Yun Xue , Ziwei Gong , Julia Hirschberg , Bolei Ma

We study the task of gesture recognition from electromyography (EMG), with the goal of enabling expressive human-computer interaction at high accuracy, while minimizing the time required for new subjects to provide calibration data. To…

Human-Computer Interaction · Computer Science 2023-11-30 Niklas Smedemark-Margulies , Yunus Bicer , Elifnur Sunger , Tales Imbiriba , Eugene Tunik , Deniz Erdogmus , Mathew Yarossi , Robin Walters

Emotion recognition is a fundamental component of next-generation human-computer interaction (HCI), enabling machines to perceive, understand, and respond to users' affective states. However, existing systems often rely on single-modality…

Computer Vision and Pattern Recognition · Computer Science 2026-01-22 Ziwen Zhong , Zhitao Shu , Yue Zhao

Multimodal Emotion Recognition (MER) has attracted growing attention with the rapid advancement of human-computer interaction. However, different modalities exhibit substantial discrepancies in semantics, quality, and availability, leading…

Multimedia · Computer Science 2026-05-08 Yan Zhuang , Minhao Liu , Yanru Zhang , Jiawen Deng , Fuji Ren

With the growing technology, we humans always need something that stands out from the other thing. Gestures are most desirable source to Communicate with the Machines. Human Computer Interaction finds its importance when it comes to working…

Human-Computer Interaction · Computer Science 2014-11-20 Sandeep Vasave , Amol Plave

In recent years, emotion detection in text has become more popular due to its vast potential applications in marketing, political science, psychology, human-computer interaction, artificial intelligence, etc. In this work, we argue that…

Computation and Language · Computer Science 2019-07-23 Armin Seyeditabari , Narges Tabari , Shafie Gholizadeh , Wlodek Zadrozny

Emotion recognition using electroencephalography (EEG) signals has attracted increasing attention in recent years. However, existing methods often lack generalization in cross-corpus settings, where a model trained on one dataset is…

Human-Computer Interaction · Computer Science 2025-08-01 Qile Liu , Weishan Ye , Lingli Zhang , Zhen Liang

Emotion recognition is a core research area at the intersection of artificial intelligence and human communication analysis. It is a significant technical challenge since humans display their emotions through complex idiosyncratic…

Human-Computer Interaction · Computer Science 2018-09-14 Paul Pu Liang , Amir Zadeh , Louis-Philippe Morency

Emotion recognition from facial videos enables non-contact inference of human emotional states. Although facial expressions are widely used cues, they cannot fully reflect intrinsic affective states. Remote photoplethysmography (rPPG)…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Xiwen Luo , Jia Li , Rencheng Song , Yu Liu , Juan Cheng

Micro-expressions serve as essential cues for understanding individuals' genuine emotional states. Recognizing micro-expressions attracts increasing research attention due to its various applications in fields such as business negotiation…

Computer Vision and Pattern Recognition · Computer Science 2024-06-14 Fengyuan Zhang , Zhaopei Huang , Xinjie Zhang , Qin Jin

We examine the utility of implicit behavioral cues in the form of EEG brain signals and eye movements for gender recognition (GR) and emotion recognition (ER). Specifically, the examined cues are acquired via low-cost, off-the-shelf…

Human-Computer Interaction · Computer Science 2017-08-30 Maneesh Bilalpur , Seyed Mostafa Kia , Tat-Seng Chua , Ramanathan Subramanian

In this paper, we introduce EmoGist, a training-free, in-context learning method for performing visual emotion classification with LVLMs. The key intuition of our approach is that context-dependent definition of emotion labels could allow…

Computation and Language · Computer Science 2025-09-23 Ronald Seoh , Dan Goldwasser

The purpose of emotion recognition in conversation (ERC) is to identify the emotion category of an utterance based on contextual information. Previous ERC methods relied on simple connections for cross-modal fusion and ignored the…

Computation and Language · Computer Science 2024-05-29 Haoxiang Shi , Xulong Zhang , Ning Cheng , Yong Zhang , Jun Yu , Jing Xiao , Jianzong Wang

Gesture recognition is a perceptual user interface, which is based on CV technology that allows the computer to interpret human motions as commands, allowing users to communicate with a computer without the use of hands, thus making the…

Computer Vision and Pattern Recognition · Computer Science 2025-01-08 Rishabh Naulakha , Shubham Gaur , Dhairya Lodha , Mehek Tulsyan , Utsav Kotecha

We present Text2Gestures, a transformer-based learning method to interactively generate emotive full-body gestures for virtual agents aligned with natural language text inputs. Our method generates emotionally expressive gestures by…

Human-Computer Interaction · Computer Science 2024-11-26 Uttaran Bhattacharya , Nicholas Rewkowski , Abhishek Banerjee , Pooja Guhan , Aniket Bera , Dinesh Manocha

Due to the universal non-verbal natural communication approach that allows for effective communication between humans, gesture recognition technology has been steadily developing over the previous few decades. Many different strategies have…

Computer Vision and Pattern Recognition · Computer Science 2022-07-07 Finlay McKinnon , David Ada Adama , Pedro Machado , Isibor Kennedy Ihianle

One of the major challenges of machine translation (MT) is ambiguity, which can in some cases be resolved by accompanying context such as images. However, recent work in multimodal MT (MMT) has shown that obtaining improvements from images…

Computation and Language · Computer Science 2023-05-29 Matthieu Futeral , Cordelia Schmid , Ivan Laptev , Benoît Sagot , Rachel Bawden

Human emotions entail a complex set of behavioral, physiological and cognitive changes. Current state-of-the-art models fuse the behavioral and physiological components using classic machine learning, rather than recent deep learning…