English
Related papers

Related papers: MDAN: Multi-level Dependent Attention Network for …

200 papers

Facial Emotion Analysis (FEA) plays a crucial role in visual affective computing, aiming to infer a person's emotional state based on facial data. Scientifically, facial expressions (FEs) result from the coordinated movement of facial…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Zhuozhao Hu , Kaishen Yuan , Xin Liu , Zitong Yu , Yuan Zong , Jingang Shi , Huanjing Yue , Jingyu Yang

Humans are able to comprehend information from multiple domains for e.g. speech, text and visual. With advancement of deep learning technology there has been significant improvement of speech recognition. Recognizing emotion from speech is…

Audio and Speech Processing · Electrical Eng. & Systems 2020-06-16 Mandeep Singh , Yuan Fang

While machine learning approaches to visual emotion recognition offer great promise, current methods consider training and testing models on small scale datasets covering limited visual emotion concepts. Our analysis identifies an important…

Computer Vision and Pattern Recognition · Computer Science 2018-08-08 Rameswar Panda , Jianming Zhang , Haoxiang Li , Joon-Young Lee , Xin Lu , Amit K. Roy-Chowdhury

Multimodal Emotion Recognition refers to the classification of input video sequences into emotion labels based on multiple input modalities (usually video, audio and text). In recent years, Deep Neural networks have shown remarkable…

Machine Learning · Computer Science 2024-10-28 Ashish Ramayee Asokan , Nidarshan Kumar , Anirudh Venkata Ragam , Shylaja S Sharath

Recent state-of-the-art active learning methods have mostly leveraged Generative Adversarial Networks (GAN) for sample acquisition; however, GAN is usually known to suffer from instability and sensitivity to hyper-parameters. In contrast to…

Computer Vision and Pattern Recognition · Computer Science 2022-02-15 Jae Won Cho , Dong-Jin Kim , Yunjae Jung , In So Kweon

Training Vision Language Models (VLMs) for video event reasoning requires high-quality structured annotations capturing not only what happened, but when, where, why, and with what consequence, at a scale manual labelling cannot support. We…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Han Zhang , Wanting Jiang , Tomasz Kornuta , Tian Zheng , Vidya Murali

Recently, physiological data such as electroencephalography (EEG) signals have attracted significant attention in affective computing. In this context, the main goal is to design an automated model that can assess emotional states. Lately,…

Machine Learning · Computer Science 2023-07-07 Shadi Sartipi , Mastaneh Torkamani-Azar , Mujdat Cetin

Emotion recognition is essential for applications in affective computing and behavioral prediction, but conventional systems relying on single-modality data often fail to capture the complexity of affective states. To address this…

Multimedia · Computer Science 2025-09-08 Jianlu Wang , Yanan Wang , Tong Liu

Emotion represents an essential aspect of human speech that is manifested in speech prosody. Speech, visual, and textual cues are complementary in human communication. In this paper, we study a hybrid fusion method, referred to as…

Audio and Speech Processing · Electrical Eng. & Systems 2020-09-10 Zexu Pan , Zhaojie Luo , Jichen Yang , Haizhou Li

Leveraging complementary relationships across modalities has recently drawn a lot of attention in multimodal emotion recognition. Most of the existing approaches explored cross-attention to capture the complementary relationships across the…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 G Rajasekhar , Jahangir Alam

Cross-view image translation is challenging because it involves images with drastically different views and severe deformation. In this paper, we propose a novel approach named Multi-Channel Attention SelectionGAN (SelectionGAN) that makes…

Computer Vision and Pattern Recognition · Computer Science 2019-04-18 Hao Tang , Dan Xu , Nicu Sebe , Yanzhi Wang , Jason J. Corso , Yan Yan

Multimodal Emotion Recognition in Conversations (MERC) aims to predict speakers' emotional states in multi-turn dialogues through text, audio, and visual cues. In real-world settings, conversation scenarios differ significantly in speakers,…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-31 Yuntao Shou , Jun Zhou , Tao Meng , Wei Ai , Keqin Li

The data scarcity problem in emotion recognition from electroencephalography (EEG) leads to difficulty in building an affective model with high accuracy using machine learning algorithms or deep neural networks. Inspired by emerging deep…

Signal Processing · Electrical Eng. & Systems 2020-06-18 Yun Luo , Li-Zhen Zhu , Zi-Yu Wan , Bao-Liang Lu

Recently, the Visual Question Answering (VQA) task has gained increasing attention in artificial intelligence. Existing VQA methods mainly adopt the visual attention mechanism to associate the input question with corresponding image regions…

Computer Vision and Pattern Recognition · Computer Science 2018-03-02 Pan Lu , Hongsheng Li , Wei Zhang , Jianyong Wang , Xiaogang Wang

Trauma is the worldwide leading cause of death and disability in those younger than 45 years, and pelvic fractures are a major source of morbidity and mortality. Automated segmentation of multiple foci of arterial bleeding from…

Image and Video Processing · Electrical Eng. & Systems 2019-09-04 Yuyin Zhou , David Dreizin , Yingwei Li , Zhishuai Zhang , Yan Wang , Alan Yuille

Emotion recognition from speech is a challenging task. Re-cent advances in deep learning have led bi-directional recur-rent neural network (Bi-RNN) and attention mechanism as astandard method for speech emotion recognition, extractingand…

Sound · Computer Science 2021-06-09 Zixuan Peng , Yu Lu , Shengfeng Pan , Yunfeng Liu

Speech emotion recognition (SER) has been one of the significant tasks in Human-Computer Interaction (HCI) applications. However, it is hard to choose the optimal features and deal with imbalance labeled data. In this article, we…

Sound · Computer Science 2021-09-21 Nhat Truong Pham , Duc Ngoc Minh Dang , Sy Dzung Nguyen

Emotions play a crucial role in human interaction, health care and security investigations and monitoring. Automatic emotion recognition (AER) using electroencephalogram (EEG) signals is an effective method for decoding the real emotions,…

Machine Learning · Computer Science 2019-05-01 Emad-ul-Haq Qazi , Muhammad Hussain , Hatim AboAlsamh , Ihsan Ullah

Emotion lexica are commonly used resources to combat data poverty in automatic emotion detection. However, vocabulary coverage issues, differences in construction method and discrepancies in emotion framework and representation result in a…

Computation and Language · Computer Science 2021-06-21 Luna De Bruyne , Pepa Atanasova , Isabelle Augenstein

Semantic segmentation in very high resolution (VHR) aerial images is one of the most challenging tasks in remote sensing image understanding. Most of the current approaches are based on deep convolutional neural networks (DCNNs). However,…

Computer Vision and Pattern Recognition · Computer Science 2020-09-16 Ruigang Niu , Xian Sun , Yu Tian , Wenhui Diao , Kaiqiang Chen , Kun Fu