中文
相关论文

相关论文: Dimensional emotion recognition using visual and t…

200 篇论文

In this paper, we present our solutions for emotion recognition in the sub-challenges of Multimodal Emotion Recognition Challenge (MER2024). To mitigate the modal competition issue between audio and text, we adopt an early fusion strategy…

多媒体 · 计算机科学 2024-10-01 Mengying Ge , Mingyang Li , Dongkai Tang , Pengbo Li , Kuo Liu , Shuhao Deng , Songbai Pu , Long Liu , Yang Song , Tao Zhang

Dimensional representations of speech emotions such as the arousal-valence (AV) representation provide a continuous and fine-grained description and control than their categorical counterparts. They have wide applications in tasks such as…

音频与语音处理 · 电气工程与系统科学 2024-02-07 Enting Zhou , You Zhang , Zhiyao Duan

The aim of this research is development of rule based decision model for emotion recognition. This research also proposes using the rules for augmenting inter-corporal recognition accuracy in multimodal systems that use supervised learning…

人机交互 · 计算机科学 2016-07-12 Amol Patwardhan , Gerald Knapp

Technological advancement and its omnipresent connection have pushed humans past the boundaries and limitations of a computer screen, physical state, or geographical location. It has provided a depth of avenues that facilitate…

多媒体 · 计算机科学 2023-11-21 Dayo Samuel Banjo , Connice Trimmingham , Niloofar Yousefi , Nitin Agarwal

Emotion recognition plays a crucial role in various domains of human-robot interaction. In long-term interactions with humans, robots need to respond continuously and accurately, however, the mainstream emotion recognition methods mostly…

人机交互 · 计算机科学 2024-01-23 Zihan Lin , Francisco Cruz , Eduardo Benitez Sandoval

We develop an emotion recognition software for the use with a video conference software for autistic individuals which are unable to recognize emotions properly. It can get an image out of the video stream, detect the emotion in it with the…

计算机视觉与模式识别 · 计算机科学 2024-09-04 Marc Franzen , Michael Stephan Gresser , Tobias Müller , Sebastian Mauser

Affect (emotion) recognition has gained significant attention from researchers in the past decade. Emotion-aware computer systems and devices have many applications ranging from interactive robots, intelligent online tutor to emotion based…

人机交互 · 计算机科学 2016-07-12 Amol Patwardhan , Gerald Knapp

This paper focuses on two key problems for audio-visual emotion recognition in the video. One is the audio and visual streams temporal alignment for feature level fusion. The other one is locating and re-weighting the perception attentions…

计算机视觉与模式识别 · 计算机科学 2016-03-29 Linlin Chao , Jianhua Tao , Minghao Yang , Ya Li , Zhengqi Wen

The proposed model is only for the audio module. All videos in the OMG Emotion Dataset are converted to WAV files. The proposed model makes use of semi-supervised learning for the emotion recognition. A GAN is trained with unsupervised…

声音 · 计算机科学 2018-05-07 Ingryd Pereira , Diego Santos

In emotion recognition, it is difficult to recognize human's emotional states using just a single modality. Besides, the annotation of physiological emotional data is particularly expensive. These two aspects make the building of effective…

人工智能 · 计算机科学 2017-04-26 Changde Du , Changying Du , Jinpeng Li , Wei-long Zheng , Bao-liang Lu , Huiguang He

With the advancement of artificial intelligence and computer vision technologies, multimodal emotion recognition has become a prominent research topic. However, existing methods face challenges such as heterogeneous data fusion and the…

计算机视觉与模式识别 · 计算机科学 2025-02-13 Wei Dai , Dequan Zheng , Feng Yu , Yanrong Zhang , Yaohui Hou

While text-based emotion recognition methods have achieved notable success, real-world dialogue systems often demand a more nuanced emotional understanding than any single modality can offer. Multimodal Emotion Recognition in Conversations…

计算与语言 · 计算机科学 2025-09-10 Chengyan Wu , Yiqiang Cai , Yang Liu , Pengxu Zhu , Yun Xue , Ziwei Gong , Julia Hirschberg , Bolei Ma

In this paper we describe a solution to our entry for the emotion recognition challenge EmotiW 2017. We propose an ensemble of several models, which capture spatial and audio features from videos. Spatial features are captured by…

计算机视觉与模式识别 · 计算机科学 2017-11-15 Boris Knyazev , Roman Shvetsov , Natalia Efremova , Artem Kuharenko

Automated emotion recognition in speech is a long-standing problem. While early work on emotion recognition relied on hand-crafted features and simple classifiers, the field has now embraced end-to-end feature learning and classification…

音频与语音处理 · 电气工程与系统科学 2022-11-10 Ravi Shankar , Abdouh Harouna Kenfack , Arjun Somayazulu , Archana Venkataraman

This paper proposes a process for a classification model for the facial expressions. The proposed process would aid in specific categorisation of children's emotions from 2 emotions namely 'Happy' and 'Sad'. Since the existing emotion…

计算机视觉与模式识别 · 计算机科学 2024-11-13 Sanchayan Vivekananthan

Emotion recognition and generation have emerged as crucial topics in Artificial Intelligence research, playing a significant role in enhancing human-computer interaction within healthcare, customer service, and other fields. Although…

机器学习 · 计算机科学 2025-02-12 Rebecca Mobbs , Dimitrios Makris , Vasileios Argyriou

This paper aims to demonstrate the importance and feasibility of fusing multimodal information for emotion recognition. It introduces a multimodal framework for emotion understanding by fusing the information from visual facial features and…

人工智能 · 计算机科学 2023-06-06 Puneet Kumar , Xiaobai Li

Most automatic emotion recognition systems exploit time-continuous annotations of emotion to provide fine-grained descriptions of spontaneous expressions as observed in real-life interactions. As emotion is rather subjective, its annotation…

声音 · 计算机科学 2022-09-22 Sina Alisamir , Fabien Ringeval , Francois Portet

In this work we tackle the task of video-based visual emotion recognition in the wild. Standard methodologies that rely solely on the extraction of bodily and facial features often fall short of accurate emotion prediction in cases where…

计算机视觉与模式识别 · 计算机科学 2022-02-03 Ioannis Pikoulis , Panagiotis P. Filntisis , Petros Maragos

Multimodal emotion understanding requires effective integration of text, audio, and visual modalities for both discrete emotion recognition and continuous sentiment analysis. We present EGMF, a unified framework combining expert-guided…

计算与语言 · 计算机科学 2026-01-13 Jiaqi Qiao , Xiujuan Xu , Xinran Li , Yu Liu