中文
相关论文

相关论文: Explainable speech emotion recognition through att…

200 篇论文

Speaker embeddings carry valuable emotion-related information, which makes them a promising resource for enhancing speech emotion recognition (SER), especially with limited labeled data. Traditionally, it has been assumed that emotion…

音频与语音处理 · 电气工程与系统科学 2024-06-03 Ismail Rasim Ulgen , Zongyang Du , Carlos Busso , Berrak Sisman

In human-computer interaction (HCI), Speech Emotion Recognition (SER) is a key technology for understanding human intentions and emotions. Traditional SER methods struggle to effectively capture the long-term temporal correla-tions and…

音频与语音处理 · 电气工程与系统科学 2024-07-18 Xincheng Wang , Liejun Wang , Yinfeng Yu , Xinxin Jiao

Speech Emotion Recognition (SER) task has known significant improvements over the last years with the advent of Deep Neural Networks (DNNs). However, even the most successful methods are still rather failing when adaptation to specific…

音频与语音处理 · 电气工程与系统科学 2021-04-16 Clément Le Moine , Nicolas Obin , Axel Roebel

This paper proposes a serialized multi-layer multi-head attention for neural speaker embedding in text-independent speaker verification. In prior works, frame-level features from one layer are aggregated to form an utterance-level…

声音 · 计算机科学 2021-07-15 Hongning Zhu , Kong Aik Lee , Haizhou Li

In speech emotion recognition (SER), using predefined features without considering their practical importance may lead to high dimensional datasets, including redundant and irrelevant information. Consequently, high-dimensional learning…

声音 · 计算机科学 2024-06-07 Alaa Nfissi , Wassim Bouachir , Nizar Bouguila , Brian Mishara

Recent speaker verification studies have achieved notable success by leveraging layer-wise output from pre-trained Transformer models. However, few have explored the advancements in aggregating these multi-level features beyond the static…

声音 · 计算机科学 2025-12-30 Jin Sob Kim , Hyun Joon Park , Wooseok Shin , Sung Won Han

Recent advancements in transformer-based speech representation models have greatly transformed speech processing. However, there has been limited research conducted on evaluating these models for speech emotion recognition (SER) across…

计算与语言 · 计算机科学 2023-08-21 Anant Singh , Akshat Gupta

Emotion and intent recognition from speech is essential and has been widely investigated in human-computer interaction. The rapid development of social media platforms, chatbots, and other technologies has led to a large volume of speech…

声音 · 计算机科学 2025-07-11 Zhao Ren , Rathi Adarshi Rammohan , Kevin Scheck , Sheng Li , Tanja Schultz

Automatic speech emotion recognition (SER) is a challenging task that plays a crucial role in natural human-computer interaction. One of the main challenges in SER is data scarcity, i.e., insufficient amounts of carefully labeled data to…

声音 · 计算机科学 2021-08-17 Sarala Padi , Seyed Omid Sadjadi , Dinesh Manocha , Ram D. Sriram

The process of identifying human emotion and affective states from speech is known as speech emotion recognition (SER). This is based on the observation that tone and pitch in the voice frequently convey underlying emotion. Speech…

声音 · 计算机科学 2024-06-18 Nishargo Nigar

In Speech Emotion Recognition (SER), emotional characteristics often appear in diverse forms of energy patterns in spectrograms. Typical attention neural network classifiers of SER are usually optimized on a fixed attention granularity. In…

声音 · 计算机科学 2021-02-04 Mingke Xu , Fan Zhang , Xiaodong Cui , Wei Zhang

The Hyperspace Analogue to Language (HAL) model relies on global word co-occurrence matrices to construct distributional semantic representations. While these representations capture lexical relationships effectively, aggregating them into…

计算与语言 · 计算机科学 2026-03-23 Ali Sakour , Zoalfekar Sakour

Affective computing is very important in the relationship between man and machine. In this paper, a system for speech emotion recognition (SER) based on speech signal is proposed, which uses new techniques in different stages of processing.…

声音 · 计算机科学 2021-11-16 Fatemeh Daneshfar , Seyed Jahanshah Kabudian

The pooling layer is an essential component in the neural network based speaker verification. Most of the current networks in speaker verification use average pooling to derive the utterance-level speaker representations. Average pooling…

声音 · 计算机科学 2018-08-23 Yi Liu , Liang He , Weiwei Liu , Jia Liu

Training SER models in natural, spontaneous speech is especially challenging due to the subtle expression of emotions and the unpredictable nature of real-world audio. In this paper, we present a robust system for the INTERSPEECH 2025…

Speech emotion recognition (SER) is vital for obtaining emotional intelligence and understanding the contextual meaning of speech. Variations of consonant-vowel (CV) phonemic boundaries can enrich acoustic context with linguistic cues,…

声音 · 计算机科学 2023-07-03 Anna Ollerenshaw , Md Asif Jalal , Rosanna Milner , Thomas Hain

Facial Expression Recognition (FER) in the wild is an extremely challenging task. Recently, some Vision Transformers (ViT) have been explored for FER, but most of them perform inferiorly compared to Convolutional Neural Networks (CNN). This…

计算机视觉与模式识别 · 计算机科学 2022-12-13 Fanglei Xue , Qiangchang Wang , Zichang Tan , Zhongsong Ma , Guodong Guo

With the advent of general-purpose speech representations from large-scale self-supervised models, applying a single model to multiple downstream tasks is becoming a de-facto approach. However, the pooling problem remains; the length of…

机器学习 · 计算机科学 2023-04-11 Jeongkyun Park , Kwanghee Choi , Hyunjun Heo , Hyung-Min Park

Large, pre-trained neural networks consisting of self-attention layers (transformers) have recently achieved state-of-the-art results on several speech emotion recognition (SER) datasets. These models are typically pre-trained in…

Speech emotion recognition (SER) is crucial for enhancing affective computing and enriching the domain of human-computer interaction. However, the main challenge in SER lies in selecting relevant feature representations from speech signals…

声音 · 计算机科学 2024-12-16 Niloy Kumar Kundu , Sarah Kobir , Md. Rayhan Ahmed , Tahmina Aktar , Niloya Roy