English
Related papers

Related papers: Emotion Recognition from Speech Using Wav2vec 2.0 …

200 papers

Speech Emotion Recognition (SER) is a challenging task due to limited data and blurred boundaries of certain emotions. In this paper, we present a comprehensive approach to improve the SER performance throughout the model lifecycle,…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-01 Xuechen Wang , Shiwan Zhao , Yong Qin

This paper aims to bring a new lightweight yet powerful solution for the task of Emotion Recognition and Sentiment Analysis. Our motivation is to propose two architectures based on Transformers and modulation that combine the linguistic and…

Computation and Language · Computer Science 2020-10-06 Jean-Benoit Delbrouck , Noé Tits , Stéphane Dupont

This paper describes our system that has been submitted to SemEval-2018 Task 1: Affect in Tweets (AIT) to solve five subtasks. We focus on modeling both sentence and word level representations of emotion inside texts through large distantly…

Computation and Language · Computer Science 2018-04-24 Ji Ho Park , Peng Xu , Pascale Fung

Automatic facial expression recognition is an important research area in the emotion recognition and computer vision. Applications can be found in several domains such as medical treatment, driver fatigue surveillance, sociable robotics,…

Computer Vision and Pattern Recognition · Computer Science 2020-02-03 Sevegni Odilon Clement Allognon , Alessandro L. Koerich , Alceu de S. Britto

Emotions recognition is commonly employed for health assessment. However, the typical metric for evaluation in therapy is based on patient-doctor appraisal. This process can fall into the issue of subjectivity, while also requiring…

Human-Computer Interaction · Computer Science 2021-01-21 Jumana Almahmoud , Kruthika Kikkeri

Wav2vec 2.0 is a recently proposed self-supervised framework for speech representation learning. It follows a two-stage training process of pre-training and fine-tuning, and performs well in speech recognition tasks especially ultra-low…

Sound · Computer Science 2021-01-15 Zhiyun Fan , Meng Li , Shiyu Zhou , Bo Xu

Affective computing is a field of study that focuses on developing systems and technologies that can understand, interpret, and respond to human emotions. Speech Emotion Recognition (SER), in particular, has got a lot of attention from…

Computation and Language · Computer Science 2023-12-20 Varun Sharma

Speech emotion recognition is an important aspect of human-computer interaction. Prior work proposes various end-to-end models to improve the classification performance. However, most of them rely on the cross-entropy loss together with…

Computer Vision and Pattern Recognition · Computer Science 2019-10-25 Zheng Lian , Ya Li , Jianhua Tao , Jian Huang

In this work, we propose an acoustic embedding based approach for representation learning in speech recognition. The proposed approach involves two stages comprising of acoustic filterbank learning from raw waveform, followed by modulation…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-16 Purvi Agrawal , Sriram Ganapathy

In this paper, we propose to improve emotion recognition by combining acoustic information and conversation transcripts. On the one hand, an LSTM network was used to detect emotion from acoustic features like f0, shimmer, jitter, MFCC, etc.…

Audio and Speech Processing · Electrical Eng. & Systems 2019-11-04 Jaejin Cho , Raghavendra Pappagari , Purva Kulkarni , Jesus Villalba , Yishay Carmiel , Najim Dehak

In this work, we tackle a problem of speech emotion classification. One of the issues in the area of affective computation is that the amount of annotated data is very limited. On the other hand, the number of ways that the same emotion can…

Computation and Language · Computer Science 2018-04-02 Egor Lakomkin , Cornelius Weber , Stefan Wermter

Wav2Vec2.0 is a state-of-the-art model which learns speech representations through unlabeled speech data, aka, self supervised learning. The pretrained model is then fine tuned on small amounts of labeled data to use it for speech-to-text…

Sound · Computer Science 2022-02-15 Santosh Gondi

Speaker recognition systems are widely used in various applications to identify a person by their voice; however, the high degree of variability in speech signals makes this a challenging task. Dealing with emotional variations is very…

Sound · Computer Science 2022-01-11 Ali Bou Nassif , Ismail Shahin , Ashraf Elnagar , Divya Velayudhan , Adi Alhudhaif , Kemal Polat

It is important for machines to interpret human emotions properly for better human-machine communications, as emotion is an essential part of human-to-human communications. One aspect of emotion is reflected in the language we use. How to…

Computation and Language · Computer Science 2018-08-23 Ji Ho Park

Textless speech-to-speech translation systems are rapidly advancing, thanks to the integration of self-supervised learning techniques. However, existing state-of-the-art systems fall short when it comes to capturing and transferring…

Sound · Computer Science 2023-10-12 Jarod Duret , Benjamin O'Brien , Yannick Estève , Titouan Parcollet

The detection of emotions using an Electroencephalogram (EEG) is a crucial area in brain-computer interfaces and has valuable applications in fields such as rehabilitation and medicine. In this study, we employed transfer learning to…

Signal Processing · Electrical Eng. & Systems 2024-04-09 Sidharth Sidharth , Ashish Abraham Samuel , Ranjana H , Jerrin Thomas Panachakel , Sana Parveen K

This paper describes the approach to the Emotion Classification shared task held at WASSA 2022 by team PVGs AI Club. This Track 2 sub-task focuses on building models which can predict a multi-class emotion label based on essays from news…

Computation and Language · Computer Science 2022-05-03 Shaily Desai , Atharva Kshirsagar , Aditi Sidnerlikar , Nikhil Khodake , Manisha Marathe

Recent studies have explored the use of pre-trained embeddings for speech emotion recognition (SER), achieving comparable performance to conventional methods that rely on low-level knowledge-inspired acoustic features. These embeddings are…

Sound · Computer Science 2023-05-22 Tiantian Feng , Rajat Hebbar , Shrikanth Narayanan

There has been a lot of prior work on representation learning for speech recognition applications, but not much emphasis has been given to an investigation of effective representations of affect from speech, where the paralinguistic…

Computation and Language · Computer Science 2016-02-16 Sayan Ghosh , Eugene Laksana , Louis-Philippe Morency , Stefan Scherer

We introduce Wav2Seq, the first self-supervised approach to pre-train both parts of encoder-decoder models for speech data. We induce a pseudo language as a compact discrete representation, and formulate a self-supervised pseudo speech…

Computation and Language · Computer Science 2022-05-03 Felix Wu , Kwangyoun Kim , Shinji Watanabe , Kyu Han , Ryan McDonald , Kilian Q. Weinberger , Yoav Artzi
‹ Prev 1 8 9 10 Next ›