English
Related papers

Related papers: Towards Universal End-to-End Affect Recognition fr…

200 papers

We consider the task of predicting various traits of a person given an image of their face. We estimate both objective traits, such as gender, ethnicity and hair-color; as well as subjective traits, such as the emotion a person expresses or…

Computer Vision and Pattern Recognition · Computer Science 2016-05-31 Yoad Lewenberg , Yoram Bachrach , Sukrit Shankar , Antonio Criminisi

Continuous affect prediction involves the discrete time-continuous regression of affect dimensions. Dimensions to be predicted often include arousal and valence. Continuous affect prediction researchers are now embracing multimodal model…

Human-Computer Interaction · Computer Science 2020-01-24 Jonny O'Dwyer

The ability to recognize facial expressions automatically enables novel applications in human-computer interaction and other areas. Consequently, there has been active research in this field, with several recent works utilizing…

Computer Vision and Pattern Recognition · Computer Science 2016-12-12 Christopher Pramerdorfer , Martin Kampel

Sentiment analysis is attracting more and more attentions and has become a very hot research topic due to its potential applications in personalized recommendation, opinion mining, etc. Most of the existing methods are based on either…

Computation and Language · Computer Science 2017-11-22 Xingyue Chen , Yunhong Wang , Qingjie Liu

Image and video-capturing technologies have permeated our every-day life. Such technologies can continuously monitor individuals' expressions in real-life settings, affording us new insights into their emotional states and transitions, thus…

Machine Learning · Computer Science 2020-01-20 Vansh Narula , Zhangyang , Wang , Theodora Chaspari

Speaker recognition using i-vector has been replaced by speaker recognition using deep learning. Speaker recognition based on Convolutional Neural Networks (CNNs) has been widely used in recent years, which learn low-level speech…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-22 Wencheng Li , Zhenhua Tan , Jingyu Ning , Zhenche Xia , Danke Wu

Convolutional Neural Networks have achieved impressive results in various tasks, but interpreting the internal mechanism is a challenging problem. To tackle this problem, we exploit a multi-channel attention mechanism in feature space. Our…

Computer Vision and Pattern Recognition · Computer Science 2019-05-01 Masanari Kimura , Masayuki Tanaka

Emotions are an inherent part of human interactions, and consequently, it is imperative to develop AI systems that understand and recognize human emotions. During a conversation involving various people, a person's emotions are influenced…

Computation and Language · Computer Science 2022-05-06 Abhinav Joshi , Ashwani Bhat , Ayush Jain , Atin Vikram Singh , Ashutosh Modi

Emotion recognition (ER) from facial images is one of the landmark tasks in affective computing with major developments in the last decade. Initial efforts on ER relied on handcrafted features that were used to characterize facial images…

Computer Vision and Pattern Recognition · Computer Science 2021-09-09 Fernanda Hernández-Luquin , Hugo Jair Escalante

Emotion analysis is a crucial problem to endow artifact machines with real intelligence in many large potential applications. As external appearances of human emotions, electroencephalogram (EEG) signals and video face signals are widely…

Computer Vision and Pattern Recognition · Computer Science 2018-05-10 Tong Zhang , Wenming Zheng , Zhen Cui , Yuan Zong , Yang Li

Multimodal Language Analysis is a demanding area of research, since it is associated with two requirements: combining different modalities and capturing temporal information. During the last years, several works have been proposed in the…

Computation and Language · Computer Science 2022-01-10 Panagiotis Koromilas , Theodoros Giannakopoulos

Although speech recognition has become a widespread technology, inferring emotion from speech signals still remains a challenge. To address this problem, this paper proposes a quaternion convolutional neural network (QCNN) based speech…

Sound · Computer Science 2021-11-02 Aneesh Muppidi , Martin Radfar

The majority of existing speech emotion recognition research focuses on automatic emotion detection using training and testing data from same corpus collected under the same conditions. The performance of such systems has been shown to drop…

Computer Vision and Pattern Recognition · Computer Science 2020-07-29 Siddique Latif , Rajib Rana , Shahzad Younis , Junaid Qadir , Julien Epps

In this paper, we exploit a Fully Convolutional Network (FCN) to analyze the audio data of spontaneous speech for dementia detection. A fully convolutional network accommodates speech samples with varying lengths, thus enabling us to…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-18 Youxiang Zhu , Xiaohui Liang

Facial emotion recognition is a vast and complex problem space within the domain of computer vision and thus requires a universally accepted baseline method with which to evaluate proposed models. While test datasets have served this…

Computer Vision and Pattern Recognition · Computer Science 2022-02-01 Nyle Siddiqui , Rushit Dave , Tyler Bauer , Thomas Reither , Dylan Black , Mitchell Hanson

Emotion recognition in conversation (ERC) is a crucial component in affective dialogue systems, which helps the system understand users' emotions and generate empathetic responses. However, most works focus on modeling speaker and…

Computation and Language · Computer Science 2021-07-15 Jingwen Hu , Yuchen Liu , Jinming Zhao , Qin Jin

Recognizing emotional signals in speech has a significant impact on enhancing the effectiveness of human-computer interaction (HCI). This study introduces EmoAugNet, a hybrid deep learning framework, that incorporates Long Short-Term Memory…

Sound · Computer Science 2025-08-11 Durjoy Chandra Paul , Gaurob Saha , Md Amjad Hossain

This paper presents a novel deep neural network (DNN) for multimodal fusion of audio, video and text modalities for emotion recognition. The proposed DNN architecture has independent and shared layers which aim to learn the representation…

Computer Vision and Pattern Recognition · Computer Science 2019-07-09 Juan D. S. Ortega , Mohammed Senoussaoui , Eric Granger , Marco Pedersoli , Patrick Cardinal , Alessandro L. Koerich

Silent Speech Interfaces aim to reconstruct the acoustic signal from a sequence of ultrasound tongue images that records the articulatory movement. The extraction of information about the tongue movement requires us to efficiently process…

Human-Computer Interaction · Computer Science 2022-06-28 Amin Honarmandi Shandiz , Laszlo Toth

This paper proposes an approach to detect emotion from human speech employing majority voting technique over several machine learning techniques. The contribution of this work is in two folds: firstly it selects those features of speech…

Sound · Computer Science 2018-07-12 Md. Kamruzzaman Sarker , Kazi Md. Rokibul Alam , Md. Arifuzzaman