English
Related papers

Related papers: Learning Local to Global Feature Aggregation for S…

200 papers

With the rapid development of deep generative models (such as Generative Adversarial Networks and Diffusion models), AI-synthesized images are now of such high quality that humans can hardly distinguish them from pristine ones. Although…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Yan Ju , Shan Jia , Jialing Cai , Haiying Guan , Siwei Lyu

Speech emotion recognition (SER) classifies audio into emotion categories such as Happy, Angry, Fear, Disgust and Neutral. While Speech Emotion Recognition (SER) is a common application for popular languages, it continues to be a problem…

Sound · Computer Science 2022-11-17 Zihan Wang , Qi Meng , HaiFeng Lan , XinRui Zhang , KeHao Guo , Akshat Gupta

This paper introduces LLDif, a novel diffusion-based facial expression recognition (FER) framework tailored for extremely low-light (LL) environments. Images captured under such conditions often suffer from low brightness and significantly…

Computer Vision and Pattern Recognition · Computer Science 2024-08-09 Zhifeng Wang , Kaihao Zhang , Ramesh Sankaranarayana

Emotion recognition from speech is a challenging task that requires capturing both linguistic and paralinguistic cues, with critical applications in human-computer interaction and mental health monitoring. Recent works have highlighted the…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-21 Hugo Thimonier , Antony Perzo , Renaud Seguier

Modelling long-range contextual relationships is critical for pixel-wise prediction tasks such as semantic segmentation. However, convolutional neural networks (CNNs) are inherently limited to model such dependencies due to the naive…

Computer Vision and Pattern Recognition · Computer Science 2021-09-01 Xiangtai Li , Li Zhang , Guangliang Cheng , Kuiyuan Yang , Yunhai Tong , Xiatian Zhu , Tao Xiang

Graph representation learning has become a hot research topic due to its powerful nonlinear fitting capability in extracting representative node embeddings. However, for sequential data such as speech signals, most traditional methods…

Sound · Computer Science 2024-05-08 Yingxue Gao , Huan Zhao , Zixing Zhang

Emotion recognition has a pivotal role in affective computing and in human-computer interaction. The current technological developments lead to increased possibilities of collecting data about the emotional state of a person. In general,…

Computer Vision and Pattern Recognition · Computer Science 2020-07-10 Andreea Birhala , Catalin Nicolae Ristea , Anamaria Radoi , Liviu Cristian Dutu

The mainstream paradigm of speech emotion recognition (SER) is identifying the single emotion label of the entire utterance. This line of works neglect the emotion dynamics at fine temporal granularity and mostly fail to leverage linguistic…

Sound · Computer Science 2024-03-29 Siyuan Shen , Yu Gao , Feng Liu , Hanyang Wang , Aimin Zhou

We explore the task of language-guided video segmentation (LVS). Previous algorithms mostly adopt 3D CNNs to learn video representation, struggling to capture long-term context and easily suffering from visual-linguistic misalignment. In…

Computer Vision and Pattern Recognition · Computer Science 2024-01-22 Chen Liang , Wenguan Wang , Tianfei Zhou , Jiaxu Miao , Yawei Luo , Yi Yang

Owing to the recent developments in Generative Artificial Intelligence (GenAI) and Large Language Models (LLM), conversational agents are becoming increasingly popular and accepted. They provide a human touch by interacting in ways familiar…

Computation and Language · Computer Science 2023-10-31 Fathima Abdul Rahman , Guang Lu

While there have been significant advances in de-tecting emotions in text, in the field of utter-ance-level emotion recognition (ULER), there are still many problems to be solved. In this paper, we address some challenges in ULER in dialog…

Computation and Language · Computer Science 2020-02-19 QingBiao Li , ChunHua Wu , KangFeng Zheng , Zhe Wang

Using deep learning methods to classify EEG signals can accurately identify people's emotions. However, existing studies have rarely considered the application of the information in another domain's representations to feature selection in…

Signal Processing · Electrical Eng. & Systems 2023-03-22 Kexin Zhu , Xulong Zhang , Jianzong Wang , Ning Cheng , Jing Xiao

In this paper, we propose to utilise diffusion models for data augmentation in speech emotion recognition (SER). In particular, we present an effective approach to utilise improved denoising diffusion probabilistic models (IDDPM) to…

Sound · Computer Science 2023-05-22 Ibrahim Malik , Siddique Latif , Raja Jurdak , Björn Schuller

Advanced visual localization techniques encompass image retrieval challenges and 6 Degree-of-Freedom (DoF) camera pose estimation, such as hierarchical localization. Thus, they must extract global and local features from input images.…

Computer Vision and Pattern Recognition · Computer Science 2022-12-27 Wenzheng Song , Ran Yan , Boshu Lei , Takayuki Okatani

Integrating prior knowledge of neurophysiology into neural network architecture enhances the performance of emotion decoding. While numerous techniques emphasize learning spatial and short-term temporal patterns, there has been limited…

Machine Learning · Computer Science 2025-03-18 Yi Ding , Chengxuan Tong , Shuailei Zhang , Muyun Jiang , Yong Li , Kevin Lim Jun Liang , Cuntai Guan

Convolution neural networks (CNNs) have succeeded in compressive image sensing. However, due to the inductive bias of locality and weight sharing, the convolution operations demonstrate the intrinsic limitations in modeling the long-range…

Image and Video Processing · Electrical Eng. & Systems 2022-01-03 Dongjie Ye , Zhangkai Ni , Hanli Wang , Jian Zhang , Shiqi Wang , Sam Kwong

Speech Emotion Recognition (SER) aims to help the machine to understand human's subjective emotion from only audio information. However, extracting and utilizing comprehensive in-depth audio information is still a challenging task. In this…

Sound · Computer Science 2022-03-30 Heqing Zou , Yuke Si , Chen Chen , Deepu Rajan , Eng Siong Chng

End-to-end speech recognition generally uses hand-engineered acoustic features as input and excludes the feature extraction module from its joint optimization. To extract learnable and adaptive features and mitigate information loss, we…

Sound · Computer Science 2021-06-09 Max W. Y. Lam , Jun Wang , Chao Weng , Dan Su , Dong Yu

Facial expression recognition is an essential task for various applications, including emotion detection, mental health analysis, and human-machine interactions. In this paper, we propose a multi-modal facial expression recognition method…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Jun-Hwa Kim , Namho Kim , Chee Sun Won

Local feature extraction is a standard approach in computer vision for tackling important tasks such as image matching and retrieval. The core assumption of most methods is that images undergo affine transformations, disregarding more…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Guilherme Potje , Felipe Cadar , Andre Araujo , Renato Martins , Erickson R. Nascimento