English
Related papers

Related papers: Transformer-Based Self-Supervised Learning for Emo…

200 papers

Driver emotion recognition plays a crucial role in driver monitoring systems, enhancing human-autonomy interactions and the trustworthiness of Autonomous Driving (AD). Various physiological and behavioural modalities have been explored for…

Machine Learning · Computer Science 2025-03-04 Nastaran Mansourian , Arash Mohammadi , M. Omair Ahmad , M. N. S. Swamy

Transformers, adapted from natural language processing, are emerging as a leading approach for graph representation learning. Contemporary graph transformers often treat nodes or edges as separate tokens. This approach leads to…

Machine Learning · Computer Science 2023-10-04 Zihan Pengmei , Zimu Li , Chih-chan Tien , Risi Kondor , Aaron R. Dinner

Towards practical applications of Electroencephalography (EEG), lightweight acquisition devices garner significant attention. However, EEG channel selection methods are commonly data-sensitive and cannot establish a unified sound paradigm…

Signal Processing · Electrical Eng. & Systems 2025-11-03 Dongdong Li , Zhongliang Zeng , Zhe Wang , Hai Yang

In human interactions, emotion recognition is crucial. For this reason, the topic of computer-vision approaches for automatic emotion recognition is currently being extensively researched. Processing multi-channel electroencephalogram (EEG)…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Joshua Bègue , Mohamed Aymen Labiod , Abdelhamid Melloulk

Speech emotion recognition is a challenging problem because human convey emotions in subtle and complex ways. For emotion recognition on human speech, one can either extract emotion related features from audio signals or employ speech…

Computation and Language · Computer Science 2020-04-06 Haiyang Xu , Hui Zhang , Kun Han , Yun Wang , Yiping Peng , Xiangang Li

Emotion recognition using EEG signals is an emerging area of research due to its broad applicability in BCI. Emotional feelings are hard to stimulate in the lab. Emotions do not last long, yet they need enough context to be perceived and…

Signal Processing · Electrical Eng. & Systems 2022-11-07 Mohammad Asif , Sudhakar Mishra , Majithia Tejas Vinodbhai , Uma Shanker Tiwary

The significance of emotion detection is increasing in education, entertainment, and various other domains. We are developing a system that can identify and transform facial expressions into emojis to provide immediate feedback.The project…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Abhilash Khuntia , Shubham Kale

Electrocardiogram (ECG) signals are widely shared across multiple clinical applications for diagnosis, health monitoring, and biometric authentication. While valuable for healthcare, they also carry unique biometric identifiers that pose…

Signal Processing · Electrical Eng. & Systems 2025-03-19 Ziyu Wang , Elahe Khatibi , Kianoosh Kazemi , Iman Azimi , Sanaz Mousavi , Shaista Malik , Amir M. Rahmani

In the fields of affective computing (AC) and brain-machine interface (BMI), the analysis of physiological and behavioral signals to discern individual emotional states has emerged as a critical research frontier. While deep learning-based…

Computer Vision and Pattern Recognition · Computer Science 2025-07-16 Hongyu Chen , Weiming Zeng , Chengcheng Chen , Luhui Cai , Fei Wang , Yuhu Shi , Lei Wang , Wei Zhang , Yueyang Li , Hongjie Yan , Wai Ting Siok , Nizhuan Wang

Microblog, an online-based broadcast medium, is a widely used forum for people to share their thoughts and opinions. Recently, Emotion Recognition (ER) from microblogs is an inspiring research topic in diverse areas. In the machine learning…

Machine Learning · Computer Science 2023-01-10 Md. Ahsan Habib , M. A. H. Akhand , Md. Abdus Samad Kamal

In human contact, emotion is very crucial. Attributes like words, voice intonation, facial expressions, and kinesics can all be used to portray one's feelings. However, brain-computer interface (BCI) devices have not yet reached the level…

Signal Processing · Electrical Eng. & Systems 2023-04-14 Shashank Joshi , Falak Joshi

Studies in the area of neuroscience have revealed the relationship between emotional patterns and brain functional regions, demonstrating that dynamic relationships between different brain regions are an essential factor affecting emotion…

Computer Vision and Pattern Recognition · Computer Science 2021-12-17 Yijin Zhou , Fu Li , Yang Li , Youshuo Ji , Guangming Shi , Wenming Zheng , Lijian Zhang , Yuanfang Chen , Rui Cheng

Electroencephalography provides a non-invasive window into brain activity, offering valuable insights for neurological research, brain-computer interfaces, and clinical diagnostics. However, the development of robust machine learning models…

Signal Processing · Electrical Eng. & Systems 2025-02-26 Chi-Sheng Chen , Ying-Jung Chen , Aidan Hung-Wen Tsai

Throughout the past decade, many studies have classified human emotions using only a single sensing modality such as face video, electroencephalogram (EEG), electrocardiogram (ECG), galvanic skin response (GSR), etc. The results of these…

Human-Computer Interaction · Computer Science 2018-06-22 Siddharth Siddharth , Tzyy-Ping Jung , Terrence J. Sejnowski

Emotion recognition (ER) technology is an integral part for developing innovative applications such as drowsiness detection and health monitoring that plays a pivotal role in contemporary society. This study delves into ER using…

Human-Computer Interaction · Computer Science 2024-02-07 Haseeb ur Rahman Abbasi , Zeeshan Rashid , Muhammad Majid , Syed Muhammad Anwar

Despite the recent progress in speech emotion recognition (SER), state-of-the-art systems are unable to achieve improved performance in cross-language settings. In this paper, we propose a Multimodal Dual Attention Transformer (MDAT) model…

Computation and Language · Computer Science 2023-07-17 Syed Aun Muhammad Zaidi , Siddique Latif , Junaid Qadir

Electroencephalography (EEG) measures the neuronal activities in different brain regions via electrodes. Many existing studies on EEG-based emotion recognition do not fully exploit the topology of EEG channels. In this paper, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2020-05-14 Peixiang Zhong , Di Wang , Chunyan Miao

In the domain of cardiovascular healthcare, the Electrocardiogram (ECG) serves as a critical, non-invasive diagnostic tool. Although recent strides in self-supervised learning (SSL) have been promising for ECG representation learning, these…

Signal Processing · Electrical Eng. & Systems 2023-09-15 Che Liu , Zhongwei Wan , Sibo Cheng , Mi Zhang , Rossella Arcucci

Emotion recognition using electroencephalography (EEG) signals has attracted increasing attention in recent years. However, existing methods often lack generalization in cross-corpus settings, where a model trained on one dataset is…

Human-Computer Interaction · Computer Science 2025-08-01 Qile Liu , Weishan Ye , Lingli Zhang , Zhen Liang

Automatic speech emotion recognition (SER) is a challenging task that plays a crucial role in natural human-computer interaction. One of the main challenges in SER is data scarcity, i.e., insufficient amounts of carefully labeled data to…

Sound · Computer Science 2021-08-17 Sarala Padi , Seyed Omid Sadjadi , Dinesh Manocha , Ram D. Sriram