English
Related papers

Related papers: A dataset of continuous affect annotations and phy…

200 papers

Short-form videos (SVs) have become a vital part of our online routine for acquiring and sharing information. Their multimodal complexity poses new challenges for video analysis, highlighting the need for video emotion analysis (VEA) within…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Xuecheng Wu , Dingkang Yang , Danlei Huang , Xinyi Yin , Yifan Wang , Jia Zhang , Jiayu Nie , Liangyu Fu , Yang Liu , Junxiao Xue , Hadi Amirpour , Wei Zhou

Despite extensive efforts on egocentric video datasets and benchmarks, understanding users' internal states, which is crucial for enabling seamless AI assistant experiences, remains largely overlooked. In this work, we introduce…

Understanding affect is central to anticipating human behavior, yet current egocentric vision benchmarks largely ignore the person's emotional states that shape their decisions and actions. Existing tasks in egocentric perception focus on…

Computer Vision and Pattern Recognition · Computer Science 2026-02-25 Matthias Jammot , Björn Braun , Paul Streli , Rafael Wampfler , Christian Holz

Most automatic emotion recognition systems exploit time-continuous annotations of emotion to provide fine-grained descriptions of spontaneous expressions as observed in real-life interactions. As emotion is rather subjective, its annotation…

Sound · Computer Science 2022-09-22 Sina Alisamir , Fabien Ringeval , Francois Portet

Social media plays an increasing role in our communication with friends and family, and our consumption of information and entertainment. Hence, to design effective ranking functions for posts on social media, it would be useful to predict…

Machine Learning · Computer Science 2022-07-13 Jane Dwivedi-Yu , Alon Y. Halevy

Affective computing has garnered the attention and interest of researchers in recent years, as there is a need for AI systems to better understand and react to human emotions. However, analyzing human emotions, such as mood or stress, is…

Emotion recognition has the potential to play a pivotal role in enhancing human-computer interaction by enabling systems to accurately interpret and respond to human affect. Yet, capturing emotions in face-to-face contexts remains…

Nowadays, short-form videos (SVs) are essential to web information acquisition and sharing in our daily life. The prevailing use of SVs to spread emotions leads to the necessity of conducting video emotion analysis (VEA) towards SVs.…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Xuecheng Wu , Heli Sun , Junxiao Xue , Jiayu Nie , Xiangyan Kong , Ruofan Zhai , Liang He

We present the Moments in Time Dataset, a large-scale human-annotated collection of one million short videos corresponding to dynamic events unfolding within three seconds. Modeling the spatial-audio-temporal dynamics even for actions…

Computer Vision and Pattern Recognition · Computer Science 2019-02-19 Mathew Monfort , Alex Andonian , Bolei Zhou , Kandan Ramakrishnan , Sarah Adel Bargal , Tom Yan , Lisa Brown , Quanfu Fan , Dan Gutfruend , Carl Vondrick , Aude Oliva

Understanding human affect can be used in robotics, marketing, education, human-computer interaction, healthcare, entertainment, autonomous driving, and psychology to enhance decision-making, personalize experiences, and improve emotional…

Human-Computer Interaction · Computer Science 2025-10-02 Helen Schneider , Svetlana Pavlitska , Helen Gremmelmaier , J. Marius Zöllner

In recent years, emotion recognition plays a critical role in applications such as human-computer interaction, mental health monitoring, and sentiment analysis. While datasets for emotion analysis in languages such as English have…

Emotion recognition based on physiological signals is a hot topic and has a wide range of applications, like safe driving, health care and creating a secure society. This paper introduces a physiological dataset PAFEW, which is obtained…

Human-Computer Interaction · Computer Science 2020-02-20 Yang Liu , Tom Gedeon , Sabrina Caldwell , Shouxu Lin , Zi Jin

In recent times, there has been significant interest in the machine recognition of human emotions, due to the suite of applications to which this knowledge can be applied. A number of different modalities, such as speech or facial…

Human-Computer Interaction · Computer Science 2018-03-06 Jonny O'Dwyer , Ronan Flynn , Niall Murray

Decoding emotion from brain activity could unlock a deeper understanding of the human experience. While a number of existing datasets align brain data with speech and with speech transcripts, no datasets have annotated brain data with…

Human-Computer Interaction · Computer Science 2026-01-27 Brian Liu , Oiwi Parker Jones

Recognising expressive behaviours in face videos is a long-standing challenge in Affective Computing. Despite significant advancements in recent years, it still remains a challenge to build a robust and reliable system for naturalistic and…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Mani Kumar Tellamekala , Shashank Jaiswal , Thomas Smith , Timur Alamev , Gary McKeown , Anthony Brown , Michel Valstar

Speech Emotion recognition (SER) in call center conversations has emerged as a valuable tool for assessing the quality of interactions between clients and agents. In contrast to controlled laboratory environments, real-life conversations…

Audio and Speech Processing · Electrical Eng. & Systems 2023-10-05 Yajing Feng , Laurence Devillers

Emotion is essential in spoken communication, yet most existing frameworks in speech emotion modeling rely on predefined categories or low-dimensional continuous attributes, which offer limited expressive capacity. Recent advances in speech…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-07 Tianhua Qi , Wenming Zheng , Björn W. Schuller , Zhaojie Luo , Haizhou Li

In recent years, affective computing and its applications have become a fast-growing research topic. Despite significant advancements, the lack of affective multi-modal datasets remains a major bottleneck in developing accurate emotion…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Joaquim Comas , Alexander Joel Vera , Xavier Vives , Eleonora De Filippi , Alexandre Pereda , Federico Sukno

Affective computing aims to understand and model human emotions for computational systems. Within this field, speech emotion recognition (SER) focuses on predicting emotions conveyed through speech. While early SER systems relied on limited…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-25 Luz Martinez-Lucas , Pravin Mote , Abinay Reddy Naini , Mohammed Abdelwahab , Carlos Busso

Humans modify their facial expressions in order to communicate their internal states and sometimes to mislead observers regarding their true emotional states. Evidence in experimental psychology shows that discriminative facial responses…

Computer Vision and Pattern Recognition · Computer Science 2018-01-10 Kaustubh Kulkarni , Ciprian Adrian Corneanu , Ikechukwu Ofodile , Sergio Escalera , Xavier Baro , Sylwia Hyniewska , Juri Allik , Gholamreza Anbarjafari