English
Related papers

Related papers: Synheart Emotion: Privacy-Preserving On-Device Emo…

200 papers

The majority of existing speech emotion recognition research focuses on automatic emotion detection using training and testing data from same corpus collected under the same conditions. The performance of such systems has been shown to drop…

Computer Vision and Pattern Recognition · Computer Science 2020-07-29 Siddique Latif , Rajib Rana , Shahzad Younis , Junaid Qadir , Julien Epps

Stress is a complex issue with wide-ranging physical and psychological impacts on human daily performance. Specifically, acute stress detection is becoming a valuable application in contextual human understanding. Two common approaches to…

Machine Learning · Computer Science 2022-03-21 Van-Tu Ninh , Manh-Duy Nguyen , Sinéad Smyth , Minh-Triet Tran , Graham Healy , Binh T. Nguyen , Cathal Gurrin

For many years, the emotion recognition task has remained one of the most interesting and important problems in the field of human-computer interaction. In this study, we consider the emotion recognition task as a classification as well as…

Computer Vision and Pattern Recognition · Computer Science 2020-06-22 Denis Rangulov , Muhammad Fahim

We present a systematic study of multimodal emotion recognition using the EAV dataset, investigating whether complex attention mechanisms improve performance on small datasets. We implement three model categories: baseline transformers…

Machine Learning · Computer Science 2026-02-03 Anmol Guragain

Automated human emotion recognition from facial expressions is a well-studied problem and still remains a very challenging task. Some efficient or accurate deep learning models have been presented in the literature. However, it is quite…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Monu Verma , Murari Mandal , Satish Kumar Reddy , Yashwanth Reddy Meedimale , Santosh Kumar Vipparthi

Classification of human emotions can play an essential role in the design and improvement of human-machine systems. While individual biological signals such as Electrocardiogram (ECG) and Electrodermal Activity (EDA) have been widely used…

Machine Learning · Computer Science 2021-08-06 Anubhav Bhatti , Behnam Behinaein , Dirk Rodenburg , Paul Hungler , Ali Etemad

In this paper, we propose to improve emotion recognition by combining acoustic information and conversation transcripts. On the one hand, an LSTM network was used to detect emotion from acoustic features like f0, shimmer, jitter, MFCC, etc.…

Audio and Speech Processing · Electrical Eng. & Systems 2019-11-04 Jaejin Cho , Raghavendra Pappagari , Purva Kulkarni , Jesus Villalba , Yishay Carmiel , Najim Dehak

The congruence between affective experiences and physiological changes has been a debated topic for centuries. Recent technological advances in measurement and data analysis provide hope to solve this epic challenge. Open science and open…

Machine Learning · Computer Science 2023-12-27 Felix Dollack , Kiyoshi Kiyokawa , Huakun Liu , Monica Perusquia-Hernandez , Chirag Raman , Hideaki Uchiyama , Xin Wei

Classifying group-level emotions is a challenging task due to complexity of video, in which not only visual, but also audio information should be taken into consideration. Existing works on multimodal emotion recognition are using bulky…

Computer Vision and Pattern Recognition · Computer Science 2021-11-12 Lev Evtodienko

In the field of affective computing, researchers in the community have promoted the performance of models and algorithms by using the complementarity of multimodal information. However, the emergence of more and more modal information makes…

Computer Vision and Pattern Recognition · Computer Science 2023-05-01 Binqiang Wang , Gang Dong , Yaqian Zhao , Rengang Li , Lu Cao , Lihua Lu

Facial emotion recognition (FER) is significant for human-computer interaction such as clinical practice and behavioral description. Accurate and robust FER by computer models remains challenging due to the heterogeneity of human faces and…

Computer Vision and Pattern Recognition · Computer Science 2021-05-11 Yousif Khaireddin , Zhuofa Chen

Machine learning methods, such as deep learning, show promising results in the medical domain. However, the lack of interpretability of these algorithms may hinder their applicability to medical decision support systems. This paper studies…

Signal Processing · Electrical Eng. & Systems 2021-07-23 Juan Manuel Mayor-Torres , Mirco Ravanelli , Sara E. Medina-DeVilliers , Matthew D. Lerner , Giuseppe Riccardi

Research in automatic affect recognition has seldom addressed the issue of computational resource utilization. With the advent of ambient intelligence technology which employs a variety of low-power, resource-constrained devices, this issue…

Machine Learning · Computer Science 2020-06-01 Fasih Haider , Senja Pollak , Pierre Albert , Saturnino Luz

Speech Emotion Recognition (SER) refers to the recognition of human emotions from natural speech. If done accurately, it can offer a number of benefits in building human-centered context-aware intelligent systems. Existing SER approaches…

Machine Learning · Computer Science 2022-02-08 Vasileios Tsouvalas , Tanir Ozcelebi , Nirvana Meratnia

In this paper, we present SAFER, a novel system for emotion recognition from facial expressions. It employs state-of-the-art deep learning techniques to extract various features from facial images and incorporates contextual information,…

Computer Vision and Pattern Recognition · Computer Science 2023-06-19 Mijanur Palash , Bharat Bhargava

Multimodal emotion recognition from physiological signals is receiving an increasing amount of attention due to the impossibility to control them at will unlike behavioral reactions, thus providing more reliable information. Existing deep…

Human-Computer Interaction · Computer Science 2023-10-12 Eleonora Lopez , Eleonora Chiarantano , Eleonora Grassucci , Danilo Comminiello

In this paper, we propose a sentiment-enriched lightweight network SeLiNet and an end-to-end on-device pipeline for contextual emotion recognition in images. SeLiNet model consists of body feature extractor, image aesthetics feature…

Computer Vision and Pattern Recognition · Computer Science 2023-07-07 Tuneer Khargonkar , Shwetank Choudhary , Sumit Kumar , Barath Raj KR

The recognition of emotions by humans is a complex process which considers multiple interacting signals such as facial expressions and both prosody and semantic content of utterances. Commonly, research on automatic recognition of emotions…

Computation and Language · Computer Science 2019-09-10 Deniz Cevher , Sebastian Zepf , Roman Klinger

Transformers are state-of-the-art networks for most sequence processing tasks. However, the self-attention mechanism often used in Transformers requires large time windows for each computation step and thus makes them less suitable for…

Neural and Evolutionary Computing · Computer Science 2023-03-22 Nathan Leroux , Jan Finkbeiner , Emre Neftci

The communication between data-generating devices is partially responsible for a growing portion of the world's power consumption. Thus reducing communication is vital, both, from an economical and an ecological perspective. For machine…

Machine Learning · Computer Science 2020-09-28 Lukas Heppe , Michael Kamp , Linara Adilova , Danny Heinrich , Nico Piatkowski , Katharina Morik