English
Related papers

Related papers: M3ED: Multi-modal Multi-scene Multi-label Emotiona…

200 papers

In the field of speaker diarization, the development of technology is constrained by two problems: insufficient data resources and poor generalization ability of deep learning models. To address these two problems, firstly, we propose an…

Audio and Speech Processing · Electrical Eng. & Systems 2025-07-01 Shilong Wu

Feeling emotion is a critical characteristic to distinguish people from machines. Among all the multi-modal resources for emotion detection, textual datasets are those containing the least additional information in addition to semantics,…

Computation and Language · Computer Science 2018-05-31 Sheng-Yeh Chen , Chao-Chun Hsu , Chuan-Chun Kuo , Ting-Hao , Huang , Lun-Wei Ku

Social interactions dominate our perceptions of the world and shape our daily behavior by attaching social meaning to acts as simple and spontaneous as gestures, facial expressions, voice, and speech. People mimic and otherwise respond to…

Computer Vision and Pattern Recognition · Computer Science 2026-04-27 Xiang Zhang , Xiaotian Li , Taoyue Wang , Nan Bi , Xin Zhou , Cody Zhou , Zoie Wang , Andrew Yang , Yuming Su , Jeff Cohn , Qiang Ji , Lijun Yin

Understanding emotions in natural language is inherently a multi-dimensional reasoning problem, where multiple affective signals interact through context, interpersonal relations, and situational cues. However, most existing emotion…

Computation and Language · Computer Science 2026-04-02 Hemanth Kotaprolu , Kishan Maharaj , Raey Zhao , Abhijit Mishra , Pushpak Bhattacharyya

In this paper, we introduce the Akan Conversation Emotion (ACE) dataset, the first multimodal emotion dialogue dataset for an African language, addressing the significant lack of resources for low-resource languages in emotion recognition…

Computation and Language · Computer Science 2025-06-04 David Sasu , Zehui Wu , Ziwei Gong , Run Chen , Pengyuan Shi , Lin Ai , Julia Hirschberg , Natalie Schluter

We present our shared task on text-based emotion detection, covering more than 30 languages from seven distinct language families. These languages are predominantly low-resource and are spoken across various continents. The data instances…

Although empathic interaction between counselor and client is fundamental to success in the psychotherapeutic process, there are currently few datasets to aid a computational approach to empathy understanding. In this paper, we construct a…

Computer Vision and Pattern Recognition · Computer Science 2023-05-05 Zhou'an_Zhu , Xin Li , Jicai Pan , Yufei Xiao , Yanan Chang , Feiyi Zheng , Shangfei Wang

The ability to understand emotions is an essential component of human-like artificial intelligence, as emotions greatly influence human cognition, decision making, and social interactions. In addition to emotion recognition in…

Computation and Language · Computer Science 2024-07-09 Fanfan Wang , Heqing Ma , Jianfei Yu , Rui Xia , Erik Cambria

Emotion cause analysis has received considerable attention in recent years. Previous studies primarily focused on emotion cause extraction from texts in news articles or microblogs. It is also interesting to discover emotions and their…

Computation and Language · Computer Science 2021-10-18 Fanfan Wang , Zixiang Ding , Rui Xia , Zhaoyu Li , Jianfei Yu

Understanding emotions accurately is essential for fields like human-computer interaction. Due to the complexity of emotions and their multi-modal nature (e.g., emotions are influenced by facial expressions and audio), researchers have…

Computer Vision and Pattern Recognition · Computer Science 2025-01-17 Qize Yang , Detao Bai , Yi-Xing Peng , Xihan Wei

Multimodal conversation, a crucial form of human communication, carries rich emotional content, making the exploration of the causes of emotions within it a research endeavor of significant importance. However, existing research on the…

Computation and Language · Computer Science 2025-06-05 Lin Wang , Xiaocui Yang , Shi Feng , Daling Wang , Yifei Zhang , Zhitao Zhang

The research of knowledge-driven conversational systems is largely limited due to the lack of dialog data which consist of multi-turn conversations on multiple topics and with knowledge annotations. In this paper, we propose a Chinese…

Computation and Language · Computer Science 2020-04-09 Hao Zhou , Chujie Zheng , Kaili Huang , Minlie Huang , Xiaoyan Zhu

Emotion and personality are central elements in understanding human psychological states. Emotions reflect an individual subjective experiences, while personality reveals relatively stable behavioral and cognitive patterns. Existing…

Computer Vision and Pattern Recognition · Computer Science 2024-11-14 Jingyi Zhou , Senlin Luo , Haofan Chen

Emotion recognition has the potential to play a pivotal role in enhancing human-computer interaction by enabling systems to accurately interpret and respond to human affect. Yet, capturing emotions in face-to-face contexts remains…

Dog emotion recognition plays a crucial role in enhancing human-animal interactions, veterinary care, and the development of automated systems for monitoring canine well-being. However, accurately interpreting dog emotions is challenging…

Computer Vision and Pattern Recognition · Computer Science 2026-02-18 Jinho Baek , Houwei Cao , Kate Blackwell

Speech emotions play a crucial role in human-computer interaction, shaping engagement and context-aware communication. Despite recent advances in spoken dialogue systems, a holistic system for evaluating emotional reasoning is still…

With the development of the Internet, more and more people get accustomed to online shopping. When communicating with customer service, users may express their requirements by means of text, images, and videos, which precipitates the need…

Computation and Language · Computer Science 2021-09-28 Nan Zhao , Haoran Li , Youzheng Wu , Xiaodong He , Bowen Zhou

Emotion-Cause analysis has attracted the attention of researchers in recent years. However, most existing datasets are limited in size and number of emotion categories. They often focus on extracting parts of the document that contain the…

Computation and Language · Computer Science 2024-08-09 Mia Huong Nguyen , Yasith Samaradivakara , Prasanth Sasikumar , Chitralekha Gupta , Suranga Nanayakkara

We present a new large-scale emotion-labeled symbolic music dataset consisting of 12k MIDI songs. To create this dataset, we first trained emotion classification models on the GoEmotions dataset, achieving state-of-the-art results with a…

Audio and Speech Processing · Electrical Eng. & Systems 2023-07-28 Serkan Sulun , Pedro Oliveira , Paula Viana

3D facial animation has attracted considerable attention due to its extensive applications in the multimedia field. Audio-driven 3D facial animation has been widely explored with promising results. However, multi-modal 3D facial animation,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Sijing Wu , Yunhao Li , Yichao Yan , Huiyu Duan , Ziwei Liu , Guangtao Zhai