English
Related papers

Related papers: DSNet: Disentangled Siamese Network with Neutral C…

200 papers

Disentangling the encodings of neural models is a fundamental aspect for improving interpretability, semantic control and downstream task performance in Natural Language Processing. Currently, most disentanglement methods are unsupervised…

Computation and Language · Computer Science 2023-02-17 Danilo S. Carvalho , Giangiacomo Mercatali , Yingji Zhang , Andre Freitas

Deep learning has emerged as a powerful alternative to hand-crafted methods for emotion recognition on combined acoustic and text modalities. Baseline systems model emotion information in text and acoustic modes independently using Deep…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-13 Darshana Priyasad , Tharindu Fernando , Simon Denman , Clinton Fookes , Sridha Sridharan

Speech emotion recognition (SER) systems aim to recognize human emotional state during human-computer interaction. Most existing SER systems are trained based on utterance-level labels. However, not all frames in an audio have affective…

Sound · Computer Science 2023-12-29 Qifei Li , Yingming Gao , Cong Wang , Yayue Deng , Jinlong Xue , Yichen Han , Ya Li

This paper proposes a speech emotion recognition method based on speech features and speech transcriptions (text). Speech features such as Spectrogram and Mel-frequency Cepstral Coefficients (MFCC) help retain emotion-related low-level…

Audio and Speech Processing · Electrical Eng. & Systems 2019-06-14 Suraj Tripathi , Abhay Kumar , Abhiram Ramesh , Chirag Singh , Promod Yenigalla

We propose EmoDistill, a novel speech emotion recognition (SER) framework that leverages cross-modal knowledge distillation during training to learn strong linguistic and prosodic representations of emotion from speech. During inference,…

Computation and Language · Computer Science 2024-03-18 Debaditya Shome , Ali Etemad

Speech Emotion Recognition (SER) aims to help the machine to understand human's subjective emotion from only audio information. However, extracting and utilizing comprehensive in-depth audio information is still a challenging task. In this…

Sound · Computer Science 2022-03-30 Heqing Zou , Yuke Si , Chen Chen , Deepu Rajan , Eng Siong Chng

Speech Emotion Recognition (SER) is an important research topic in human-computer interaction. Many recent works focus on directly extracting emotional cues through pre-trained knowledge, frequently overlooking considerations of…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-27 Haiyang Sun , Fulin Zhang , Yingying Gao , Zheng Lian , Shilei Zhang , Junlan Feng

Enabled by multi-head self-attention, Transformer has exhibited remarkable results in speech emotion recognition (SER). Compared to the original full attention mechanism, window-based attention is more effective in learning fine-grained…

Sound · Computer Science 2023-02-28 Weidong Chen , Xiaofen Xing , Xiangmin Xu , Jianxin Pang , Lan Du

In this work, we study the hypothesis that speaker identity embeddings extracted from speech samples may be used for detection and classification of emotion. In particular, we show that emotions can be effectively identified by learning…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-16 Morgan Sandler , Arun Ross

Automatic speech recognition research focuses on training and evaluating on static datasets. Yet, as speech models are increasingly deployed on personal devices, such models encounter user-specific distributional shifts. To simulate this…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-26 Anuj Diwan , Ching-Feng Yeh , Wei-Ning Hsu , Paden Tomasello , Eunsol Choi , David Harwath , Abdelrahman Mohamed

Cross-speaker emotion transfer in speech synthesis relies on extracting speaker-independent emotion embeddings for accurate emotion modeling without retaining speaker traits. However, existing timbre compression methods fail to fully…

Sound · Computer Science 2025-10-20 Deok-Hyeon Cho , Hyung-Seok Oh , Seung-Bin Kim , Seong-Whan Lee

Large language models have revolutionized sign language generation by automatically transforming text into high-quality sign language videos, providing accessible communication for the Deaf community. However, existing LLM-based approaches…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Yanchao Zhao , Jihao Zhu , Yu Liu , Weizhuo Chen , Yuling Yang , Kun Peng

Non-orthogonal communications are expected to play a key role in future wireless systems. In downlink transmissions, the data symbols are broadcast from a base station to different users, which are superimposed with different power to…

Information Theory · Computer Science 2022-08-01 Thien Van Luong , Nir Shlezinger , Chao Xu , Tiep M. Hoang , Yonina C. Eldar , Lajos Hanzo

Emotion detection is a critical technology extensively employed in diverse fields. While the incorporation of commonsense knowledge has proven beneficial for existing emotion detection methods, dialogue-based emotion detection encounters…

Computation and Language · Computer Science 2023-09-14 Yuting Su , Yichen Wei , Weizhi Nie , Sicheng Zhao , Anan Liu

With the rapid advancement of mobile imaging, capturing screens using smartphones has become a prevalent practice in distance learning and conference recording. However, moir\'e artifacts, caused by frequency aliasing between display…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Qirui Yang , Fangpu Zhang , Yeying Jin , Qihua Cheng , Peng-Tao Jiang , Huanjing Yue , Jingyu Yang

Training deep learning models in technical domains is often accompanied by the challenge that although the task is clear, insufficient data for training is available. In this work, we propose a novel approach based on the combination of…

Computer Vision and Pattern Recognition · Computer Science 2021-09-29 Tobias Schlagenhauf , Faruk Yildirim , Benedikt Brückner

Speech Emotion Recognition (SER) has become a growing focus of research in human-computer interaction. Spatiotemporal features play a crucial role in SER, yet current research lacks comprehensive spatiotemporal feature learning. This paper…

Sound · Computer Science 2023-12-29 Mengbo Li , Yuanzhong Zheng , Dichucheng Li , Yulun Wu , Yaoxuan Wang , Haojun Fei

Speech emotion recognition (SER) is crucial for enhancing affective computing and enriching the domain of human-computer interaction. However, the main challenge in SER lies in selecting relevant feature representations from speech signals…

Sound · Computer Science 2024-12-16 Niloy Kumar Kundu , Sarah Kobir , Md. Rayhan Ahmed , Tahmina Aktar , Niloya Roy

Speech signals are subjected to more acoustic interference and emotional factors than other signals. Noisy emotion-riddled speech data is a challenge for real-time speech processing applications. It is essential to find an effective way to…

Audio and Speech Processing · Electrical Eng. & Systems 2022-10-25 Shibani Hamsa , Ismail Shahin , Youssef Iraqi , Ernesto Damiani , Naoufel Werghi

Dense stereo matching with deep neural networks is of great interest to the research community. Existing stereo matching networks typically use slow and computationally expensive 3D convolutions to improve the performance, which is not…

Computer Vision and Pattern Recognition · Computer Science 2021-03-09 Zhengyu Huang , Theodore B. Norris , Panqu Wang