中文
相关论文

相关论文: A Comparison of Time-based Models for Multimodal E…

200 篇论文

Multimodal machine learning is an emerging area of research, which has received a great deal of scholarly attention in recent years. Up to now, there are few studies on multimodal Emotion Recognition in Conversation (ERC). Since Graph…

多媒体 · 计算机科学 2023-12-05 Jiang Li , Xiaoping Wang , Guoqing Lv , Zhigang Zeng

Emotion detection from faces is one of the machine learning problems needed for human-computer interaction. The variety of methods used is enormous, which motivated an in-depth review of articles and scientific studies. Three of the most…

计算机视觉与模式识别 · 计算机科学 2026-01-21 Aleksandra Jamróz , Patrycja Wysocka , Piotr Garbat

Emotion detection is pivotal in human communication, as it significantly influences behavior, relationships, and decision-making processes. This study concentrates on text-based emotion detection by leveraging the GoEmotions dataset, which…

计算与语言 · 计算机科学 2024-11-18 Maliheh Alaeddini

Advancements in spoken language processing have driven the development of spoken language models (SLMs), designed to achieve universal audio understanding by jointly learning text and audio representations for a wide range of tasks.…

计算与语言 · 计算机科学 2025-10-31 Pedro Corrêa , João Lima , Victor Moreno , Lucas Ueda , Paula Dornhofer Paro Costa

Emotions recognition is commonly employed for health assessment. However, the typical metric for evaluation in therapy is based on patient-doctor appraisal. This process can fall into the issue of subjectivity, while also requiring…

人机交互 · 计算机科学 2021-01-21 Jumana Almahmoud , Kruthika Kikkeri

Multimodal Emotion Recognition (MER) focuses on identifying and interpreting emotions from modality-compound inputs. Closely mirroring human cognitive processes in real-world environments, MER has drawn substantial attention from both…

多媒体 · 计算机科学 2026-05-21 Hongrui Zhang , Daiqing Wu , Yangyang Li , Kuien Liu , Yuhui Wang , Yu Zhou , Sicheng Zhao

Human computer interaction has become integral to modern life, driven by advancements in machine learning technologies. Affective computing, in particular, has focused on systems that recognize, interpret, and respond to human emotions,…

信号处理 · 电气工程与系统科学 2025-07-23 Karim Alghoul , Hussein Al Osman , Abdulmotaleb El Saddik

The audio-video based emotion recognition aims to classify a given video into basic emotions. In this paper, we describe our approaches in EmotiW 2019, which mainly explores emotion features and feature fusion strategies for audio and…

计算机视觉与模式识别 · 计算机科学 2020-12-29 Hengshun Zhou , Debin Meng , Yuanyuan Zhang , Xiaojiang Peng , Jun Du , Kai Wang , Yu Qiao

Emotion recognition has become a popular topic of interest, especially in the field of human computer interaction. Previous works involve unimodal analysis of emotion, while recent efforts focus on multi-modal emotion recognition from…

计算与语言 · 计算机科学 2019-03-11 Chan Woo Lee , Kyu Ye Song , Jihoon Jeong , Woo Yong Choi

Understanding individual, group and event level emotions along with contextual information is crucial for analyzing a multi-person social situation. To achieve this, we frame emotion comprehension as the task of predicting fine-grained…

计算机视觉与模式识别 · 计算机科学 2026-01-13 Anubhav Kataria , Surbhi Madan , Shreya Ghosh , Tom Gedeon , Abhinav Dhall

Speech Emotion Recognition (SER) traditionally relies on auditory data analysis for emotion classification. Several studies have adopted different methods for SER. However, existing SER methods often struggle to capture subtle emotional…

声音 · 计算机科学 2026-01-23 HyeYoung Lee , Muhammad Nadeem

Speech emotion recognition is a challenging task because the emotion expression is complex, multimodal and fine-grained. In this paper, we propose a novel multimodal deep learning approach to perform fine-grained emotion recognition from…

声音 · 计算机科学 2021-07-16 Hang Li , Wenbiao Ding , Zhongqin Wu , Zitao Liu

This paper aims to demonstrate the importance and feasibility of fusing multimodal information for emotion recognition. It introduces a multimodal framework for emotion understanding by fusing the information from visual facial features and…

人工智能 · 计算机科学 2023-06-06 Puneet Kumar , Xiaobai Li

Synthesizing realistic data samples is of great value for both academic and industrial communities. Deep generative models have become an emerging topic in various research areas like computer vision and signal processing. Affective…

计算机视觉与模式识别 · 计算机科学 2020-11-10 Noushin Hajarolasvadi , Miguel Arjona Ramírez , Hasan Demirel

Emotion being a subjective thing, leveraging knowledge and science behind labeled data and extracting the components that constitute it, has been a challenging problem in the industry for many years. With the evolution of deep learning in…

计算机视觉与模式识别 · 计算机科学 2017-06-07 Prudhvi Raj Dachapally

Emotion recognition using electroencephalography (EEG) signals has attracted increasing attention in recent years. However, existing methods often lack generalization in cross-corpus settings, where a model trained on one dataset is…

人机交互 · 计算机科学 2025-08-01 Qile Liu , Weishan Ye , Lingli Zhang , Zhen Liang

This paper proposes a system capable of recognizing a speaker's utterance-level emotion through multimodal cues in a video. The system seamlessly integrates multiple AI models to first extract and pre-process multimodal information from the…

人机交互 · 计算机科学 2023-08-29 Sun-Kyung Lee , Jong-Hwan Kim

Automatic emotion recognition (AER) based on enriched multimodal inputs, including text, speech, and visual clues, is crucial in the development of emotionally intelligent machines. Although complex modality relationships have been proven…

多媒体 · 计算机科学 2021-09-16 Shuyun Tang , Zhaojie Luo , Guoshun Nan , Yuichiro Yoshikawa , Ishiguro Hiroshi

While there have been significant advances in detecting emotions from speech and image recognition, emotion detection on text is still under-explored and remained as an active research field. This paper introduces a corpus for text-based…

计算与语言 · 计算机科学 2017-08-16 Sayyed M. Zahiri , Jinho D. Choi

With the increasing popularity of video sharing websites such as YouTube and Facebook, multimodal sentiment analysis has received increasing attention from the scientific community. Contrary to previous works in multimodal sentiment…

机器学习 · 计算机科学 2018-02-06 Minghai Chen , Sen Wang , Paul Pu Liang , Tadas Baltrušaitis , Amir Zadeh , Louis-Philippe Morency