English
Related papers

Related papers: Emotional Speaker Identification using a Novel Cap…

200 papers

Convolutional neural networks (CNNs), such as the time-delay neural network (TDNN), have shown their remarkable capability in learning speaker embedding. However, they meanwhile bring a huge computational cost in storage size, processing,…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-22 Rui Wang , Zhihua Wei , Haoran Duan , Shouling Ji , Yang Long , Zhen Hong

Automatic speaker naming is the problem of localizing as well as identifying each speaking character in a TV/movie/live show video. This is a challenging problem mainly attributes to its multimodal nature, namely face cue alone is…

Computer Vision and Pattern Recognition · Computer Science 2015-07-20 Yongtao Hu , Jimmy Ren , Jingwen Dai , Chang Yuan , Li Xu , Wenping Wang

In multi-turn dialogs, natural language understanding models can introduce obvious errors by being blind to contextual information. To incorporate dialog history, we present a neural architecture with Speaker-Sensitive Dual Memory Networks…

Computation and Language · Computer Science 2017-11-30 Young-Bum Kim , Sungjin Lee , Ruhi Sarikaya

Despite the widespread utilization of deep neural networks (DNNs) for speech emotion recognition (SER), they are severely restricted due to the paucity of labeled data for training. Recently, segment-based approaches for SER have been…

Audio and Speech Processing · Electrical Eng. & Systems 2021-03-31 Shuiyang Mao , P. C. Ching , Tan Lee

In the field of human-computer interaction and psychological assessment, speech emotion recognition (SER) plays an important role in deciphering emotional states from speech signals. Despite advancements, challenges persist due to system…

Sound · Computer Science 2025-02-04 Alaa Nfissi , Wassim Bouachir , Nizar Bouguila , Brian Mishara

Conversational emotion recognition (CER) has attracted increasing interests in the natural language processing (NLP) community. Different from the vanilla emotion recognition, effective speaker-sensitive utterance representation is one…

Computation and Language · Computer Science 2020-03-06 Jingye Li , Meishan Zhang , Donghong Ji , Yijiang Liu

Neural network-based dialog systems are attracting increasing attention in both academia and industry. Recently, researchers have begun to realize the importance of speaker modeling in neural dialog systems, but there lacks established…

Computation and Language · Computer Science 2018-10-01 Zhao Meng , Lili Mou , Zhi Jin

Visually-grounded spoken language datasets can enable models to learn cross-modal correspondences with very weak supervision. However, modern audio-visual datasets contain biases that undermine the real-world performance of models trained…

Computation and Language · Computer Science 2021-10-15 Ian Palmer , Andrew Rouditchenko , Andrei Barbu , Boris Katz , James Glass

Representation learning for speech emotion recognition is challenging due to labeled data sparsity issue and lack of gold standard references. In addition, there is much variability from input speech signals, human subjective perception of…

Audio and Speech Processing · Electrical Eng. & Systems 2021-08-13 Haoqi Li , Ming Tu , Jing Huang , Shrikanth Narayanan , Panayiotis Georgiou

Modern noise-cancelling headphones have significantly improved users' auditory experiences by removing unwanted background noise, but they can also block out sounds that matter to users. Machine learning (ML) models for sound event…

Machine Learning · Computer Science 2024-06-18 N Shashaank , Berker Banar , Mohammad Rasool Izadi , Jeremy Kemmerer , Shuo Zhang , Chuan-Che Huang

Emotion recognition datasets are relatively small, making the use of the more sophisticated deep learning approaches challenging. In this work, we propose a transfer learning method for speech emotion recognition where features extracted…

Sound · Computer Science 2021-04-09 Leonardo Pepino , Pablo Riera , Luciana Ferrer

This study presents a novel transfer learning approach and data augmentation technique for mental stability classification using human voice signals and addresses the challenges associated with limited data availability. Convolutional…

Sound · Computer Science 2026-01-26 Rafiul Islam , Md. Taimur Ahad

Deep learning has been widely adopted in automatic emotion recognition and has lead to significant progress in the field. However, due to insufficient annotated emotion datasets, pre-trained models are limited in their generalization…

Computer Vision and Pattern Recognition · Computer Science 2020-06-25 Dung Nguyen , Sridha Sridharan , Duc Thanh Nguyen , Simon Denman , David Dean , Clinton Fookes

Advent of modern deep learning techniques has given rise to advancements in the field of Speech Emotion Recognition (SER). However, most systems prevalent in the field fail to generalize to speakers not seen during training. This study…

Computation and Language · Computer Science 2024-06-21 Arnav Goel , Medha Hira , Anubha Gupta

Although few-shot learning has attracted much attention from the fields of image and audio classification, few efforts have been made on few-shot speaker identification. In the task of few-shot learning, overfitting is a tough problem…

Audio and Speech Processing · Electrical Eng. & Systems 2022-04-26 Yanxiong Li , Wucheng Wang , Hao Chen , Wenchang Cao , Wei Li , Qianhua He

Accent recognition with deep learning framework is a similar work to deep speaker identification, they're both expected to give the input speech an identifiable representation. Compared with the individual-level features learned by speaker…

Sound · Computer Science 2021-08-26 Wei Wang , Chao Zhang , Xiaopei Wu

Wav2vec2 has achieved success in applying Transformer architecture and self-supervised learning to speech recognition. Recently, these have come to be used not only for speech recognition but also for the entire speech processing. This…

Sound · Computer Science 2023-09-12 Harunori Kawano , Sota Shimizu

Automatic emotion recognition is one of the central concerns of the Human-Computer Interaction field as it can bridge the gap between humans and machines. Current works train deep learning models on low-level data representations to solve…

Audio and Speech Processing · Electrical Eng. & Systems 2021-11-22 Mariana Rodrigues Makiuchi , Kuniaki Uto , Koichi Shinoda

Recently, researchers have utilized neural network-based speaker embedding techniques in speaker-recognition tasks to identify speakers accurately. However, speaker-discriminative embeddings do not always represent speech features such as…

Audio and Speech Processing · Electrical Eng. & Systems 2023-01-24 Kwangje Baeg , Yeong-Gwan Kim , Young-Sub Han , Byoung-Ki Jeon

Capsule Networks have emerged as a powerful class of deep learning architectures, known for robust performance with relatively few parameters compared to Convolutional Neural Networks (CNNs). However, their inherent efficiency is often…

Computer Vision and Pattern Recognition · Computer Science 2024-03-11 Miles Everett , Mingjun Zhong , Georgios Leontidis