中文
相关论文

相关论文: Hypercomplex Multimodal Emotion Recognition from E…

200 篇论文

Emotion estimation in music listening is confronting challenges to capture the emotion variation of listeners. Recent years have witnessed attempts to exploit multimodality fusing information from musical contents and physiological signals…

人工智能 · 计算机科学 2016-12-01 Nattapong Thammasan , Ken-ichi Fukui , Masayuki Numao

In order to develop more precise and functional affective applications, it is necessary to achieve a balance between the psychology and the engineering applied to emotions. Signals from the central and peripheral nervous systems have been…

人机交互 · 计算机科学 2019-05-02 Jennifer Sorinas , Jose Manuel Ferrández , Eduardo Fernandez

Emotion recognition has become an important field of research in Human Computer Interactions as we improve upon the techniques for modelling the various aspects of behaviour. With the advancement of technology our understanding of emotions…

人工智能 · 计算机科学 2019-11-11 Samarth Tripathi , Sarthak Tripathi , Homayoon Beigi

Humans are skilled in reading the interlocutor's emotion from multimodal signals, including spoken words, simultaneous speech, and facial expressions. It is still a challenge to effectively decode emotions from the complex interactions of…

机器学习 · 计算机科学 2022-12-20 Feng Qiu , Chengyang Xie , Yu Ding , Wanzeng Kong

Emotional expression underpins natural communication and effective human-computer interaction. We present Emotion Collider (EC-Net), a hyperbolic hypergraph framework for multimodal emotion and sentiment modeling. EC-Net represents modality…

多媒体 · 计算机科学 2026-04-21 Rong Fu , Ziming Wang , Shuo Yin , Haiyun Wei , Kun Liu , Xianda Li , Zeli Su , Simon Fong

EEG is a non-invasive, safe, and low-risk method to record electrophysiological signals inside the brain. Especially with recent technology developments like dry electrodes, consumer-grade EEG devices, and rapid advances in machine…

机器学习 · 计算机科学 2025-06-23 Tri Duc Ly , Gia H. Ngo

Emotion recognition is a topic of significant interest in assistive robotics due to the need to equip robots with the ability to comprehend human behavior, facilitating their effective interaction in our society. Consequently, efficient and…

Recently, emotion recognition based on physiological signals has emerged as a field with intensive research. The utilization of multi-modal, multi-channel physiological signals has significantly improved the performance of emotion…

多媒体 · 计算机科学 2023-08-22 Xinda Li

Traditional psychological evaluations rely heavily on human observation and interpretation, which are prone to subjectivity, bias, fatigue, and inconsistency. To address these limitations, this work presents a multimodal emotion recognition…

人机交互 · 计算机科学 2024-12-25 Kris Kraack

There has been an encouraging progress in the affective states recognition models based on the single-modality signals as electroencephalogram (EEG) signals or peripheral physiological signals in recent years. However, multimodal…

信号处理 · 电气工程与系统科学 2023-06-02 Yuxuan Zhao , Xinyan Cao , Jinlong Lin , Dunshan Yu , Xixin Cao

In this paper, we address the problem of multimodal emotion recognition from multiple physiological signals. We demonstrate that a Transformer-based approach is suitable for this task. In addition, we present how such models may be…

信号处理 · 电气工程与系统科学 2022-12-29 Juan Vazquez-Rodriguez , Grégoire Lefebvre , Julien Cumin , James L Crowley

This paper presents an efficient Multi-scale Transformer-based approach for the task of Emotion recognition from Physiological data, which has gained widespread attention in the research community due to the vast amount of information that…

信号处理 · 电气工程与系统科学 2024-08-28 Tu Vu , Van Thong Huynh , Soo-Hyung Kim

Classifying group-level emotions is a challenging task due to complexity of video, in which not only visual, but also audio information should be taken into consideration. Existing works on multimodal emotion recognition are using bulky…

计算机视觉与模式识别 · 计算机科学 2021-11-12 Lev Evtodienko

This paper proposes a multimodal emotion recognition system based on hybrid fusion that classifies the emotions depicted by speech utterances and corresponding images into discrete classes. A new interpretability technique has been…

计算机视觉与模式识别 · 计算机科学 2023-01-10 Puneet Kumar , Sarthak Malik , Balasubramanian Raman

Emotion recognition has a wide range of applications in human-computer interaction, marketing, healthcare, and other fields. In recent years, the development of deep learning technology has provided new methods for emotion recognition.…

计算与语言 · 计算机科学 2025-01-28 Junwei Feng , Xueyan Fan

Due to the complex nature of human emotions and the diversity of emotion representation methods in humans, emotion recognition is a challenging field. In this research, three input modalities, namely text, audio (speech), and video, are…

人工智能 · 计算机科学 2024-02-13 Minoo Shayaninasab , Bagher Babaali

The research on human emotion under multimedia stimulation based on physiological signals is an emerging field, and important progress has been achieved for emotion recognition based on multi-modal signals. However, it is challenging to…

机器学习 · 计算机科学 2021-08-10 Ziyu Jia , Youfang Lin , Jing Wang , Zhiyang Feng , Xiangheng Xie , Caijie Chen

Physiological Signals are the most reliable form of signals for emotion recognition, as they cannot be controlled deliberately by the subject. Existing review papers on emotion recognition based on physiological signals surveyed only the…

人机交互 · 计算机科学 2022-05-24 Zeeshan Ahmad , Naimul Khan

This paper aims to demonstrate the importance and feasibility of fusing multimodal information for emotion recognition. It introduces a multimodal framework for emotion understanding by fusing the information from visual facial features and…

人工智能 · 计算机科学 2023-06-06 Puneet Kumar , Xiaobai Li

Emotion recognition is an important research direction in artificial intelligence, helping machines understand and adapt to human emotional states. Multimodal electrophysiological(ME) signals, such as EEG, GSR, respiration(Resp), and…

多媒体 · 计算机科学 2023-08-07 Yunfei Guo , Tao Zhang , Wu Huang