English
Related papers

Related papers: Synheart Emotion: Privacy-Preserving On-Device Emo…

200 papers

Emotion recognition from speech plays a vital role in the development of empathetic human-computer interaction systems. This paper presents a comparative analysis of lightweight transformer-based models, DistilHuBERT and PaSST, by…

Sound · Computer Science 2025-11-04 Lucky Onyekwelu-Udoka , Md Shafiqul Islam , Md Shahedul Hasan

Implementing automated emotion recognition on mobile devices could provide an accessible diagnostic and therapeutic tool for those who struggle to recognize emotion, including children with developmental behavioral conditions such as…

Machine Learning · Computer Science 2021-08-27 Agnik Banerjee , Peter Washington , Cezmi Mutlu , Aaron Kline , Dennis P. Wall

With recent developments in smart technologies, there has been a growing focus on the use of artificial intelligence and machine learning for affective computing to further enhance the user experience through emotion recognition. Typically,…

Machine Learning · Computer Science 2020-08-26 Kyle Ross , Paul Hungler , Ali Etemad

Micro-gestures are unconsciously performed body gestures that can convey the emotion states of humans and start to attract more research attention in the fields of human behavior understanding and affective computing as an emerging topic.…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Zhaoqiang Xia , Hexiang Huang , Haoyu Chen , Xiaoyi Feng , Guoying Zhao

This paper discusses the benefits of incorporating multimodal data for improving latent emotion recognition accuracy, focusing on micro-expression (ME) and physiological signals (PS). The proposed approach presents a novel multimodal…

Computer Vision and Pattern Recognition · Computer Science 2023-08-24 Liangfei Zhang , Yifei Qian , Ognjen Arandjelovic , Anthony Zhu

Human motion characteristics are used to monitor the progression of neurological diseases and mood disorders. Since perceptions of emotions are also interleaved with body posture and movements, emotion recognition from human gait can be…

Computer Vision and Pattern Recognition · Computer Science 2021-08-30 Matthew Malek-Podjaski , Fani Deligianni

The integration of emotional intelligence in machines is an important step in advancing human-computer interaction. This demands the development of reliable end-to-end emotion recognition systems. However, the scarcity of public affective…

Human-Computer Interaction · Computer Science 2023-06-07 Alireza F. Nia , Vanessa Tang , Gonzalo Maso Talou , Mark Billinghurst

This paper presents an innovative approach to address the problems researchers face in Emotion Aware Recommender Systems (EARS): the difficulty and cumbersome collecting voluminously good quality emotion-tagged datasets and an effective way…

Information Retrieval · Computer Science 2023-05-09 John Kalung Leung , Igor Griva , William G. Kennedy , Jason M. Kinser , Sohyun Park , Seo Young Lee

Emotion prediction is the field of study to understand human emotions. Existing methods focus on modalities like text, audio, facial expressions, etc., which could be private to the user. Emotion can be derived from the subject's…

Signal Processing · Electrical Eng. & Systems 2023-08-25 Dhruv Limbani , Daketi Yatin , Nitish Chaturvedi , Vaishnavi Moorthy , Pushpalatha M , Harichandana BSS , Sumit Kumar

We present a glasses type wearable device to detect emotions from a human face in an unobtrusive manner. The device is designed to gather multi channel responses from the user face naturally and continuously while the user is wearing it.…

Human-Computer Interaction · Computer Science 2024-10-30 Jangho Kwon , Laehyun Kim

Physiological measurements involves observing variables that attribute to the normative functioning of human systems and subsystems directly or indirectly. The measurements can be used to detect affective states of a person with aims such…

Machine Learning · Computer Science 2022-10-31 Nibraas Khan , Nilanjan Sarkar

Transfer learning has been widely used in natural language processing through deep pretrained language models, such as Bidirectional Encoder Representations from Transformers and Universal Sentence Encoder. Despite the great success,…

Information Retrieval · Computer Science 2022-06-15 Maryam Hasan , Elke Rundensteiner , Emmanuel Agu

Automatic detection of emotion has the potential to revolutionize mental health and wellbeing. Recent work has been successful in predicting affect from unimodal electrocardiogram (ECG) data. However, to be immediately relevant for…

Human-Computer Interaction · Computer Science 2019-07-18 Ross Harper , Joshua Southern

Background: Human Emotion Recognition (HER) has been a popular field of study in the past years. Despite the great progresses made so far, relatively little attention has been paid to the use of HER in autism. People with autism are known…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Oresti Banos , Zhoe Comas-González , Javier Medina , Aurora Polo-Rodríguez , David Gil , Jesús Peral , Sandra Amador , Claudia Villalonga

Speech Emotion Recognition (SER) presents a significant yet persistent challenge in human-computer interaction. While deep learning has advanced spoken language processing, achieving high performance on limited datasets remains a critical…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-03 Tai Vu

Detection of human emotions based on facial images in real-world scenarios is a difficult task due to low image quality, variations in lighting, pose changes, background distractions, small inter-class variations, noisy crowd-sourced…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Sahil Naik , Soham Bagayatkar , Pavankumar Singh

There are still many challenges of emotion recognition using physiological data despite the substantial progress made recently. In this paper, we attempted to address two major challenges. First, in order to deal with the sparsely-labeled…

Human-Computer Interaction · Computer Science 2022-11-08 Feng Zhou , Tao Chen , Baiying Lei

Within the field of Humanities, there is a recognized need for educational innovation, as there are currently no reported tools available that enable individuals to interact with their environment to create an enhanced learning experience…

An advanced emotion classification model was developed using a CNN-Transformer architecture for emotion recognition from EEG brain wave signals, effectively distinguishing among three emotional states, positive, neutral and negative. The…

Signal Processing · Electrical Eng. & Systems 2025-11-21 Roman Dolgopolyi , Antonis Chatzipanagiotou

We exploit a self-supervised deep multi-task learning framework for electrocardiogram (ECG) -based emotion recognition. The proposed solution consists of two stages of learning a) learning ECG representations and b) learning to classify…

Signal Processing · Electrical Eng. & Systems 2020-08-11 Pritam Sarkar , Ali Etemad