English
Related papers

Related papers: VEATIC: Video-based Emotion and Affect Tracking in…

200 papers

Vision-language models (VLMs) show promise as tools for inferring affect from visual stimuli at scale; it is not yet clear how closely their outputs align with human affective ratings. We benchmarked nine VLMs, ranging from state-of-the-art…

We present a method that automatically evaluates emotional response from spontaneous facial activity recorded by a depth camera. The automatic evaluation of emotional response, or affect, is a fascinating challenge with many applications,…

Human-Computer Interaction · Computer Science 2017-01-20 Daniel Hadar

We present a new public dataset with a focus on simulating robotic vision tasks in everyday indoor environments using real imagery. The dataset includes 20,000+ RGB-D images and 50,000+ 2D bounding boxes of object instances densely captured…

Computer Vision and Pattern Recognition · Computer Science 2017-03-07 Phil Ammirato , Patrick Poirson , Eunbyung Park , Jana Kosecka , Alexander C. Berg

Emotion recognition plays a pivotal role in enhancing human-computer interaction, particularly in movie recommendation systems where understanding emotional content is essential. While multimodal approaches combining audio and video have…

Sound · Computer Science 2025-11-25 Xiangrui Xiong , Zhou Zhou , Guocai Nong , Junlin Deng , Ning Wu

Affective interaction is not merely about recognizing emotions; it is an embodied, situated process shaped by context and co-created through interaction. In affective computing, the role of haptic feedback within dynamic emotional exchanges…

Robotics · Computer Science 2025-06-25 Qiaoqiao Ren , Tony Belpaeme

Emotion plays a pivotal role in video-based expression, but existing video generation systems predominantly focus on low-level visual metrics while neglecting affective dimensions. Although emotion analysis has made progress in the visual…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Zongyang Qiu , Bingyuan Wang , Xingbei Chen , Yingqing He , Zeyu Wang

We introduce FindingEmo, a new image dataset containing annotations for 25k images, specifically tailored to Emotion Recognition. Contrary to existing datasets, it focuses on complex scenes depicting multiple people in various naturalistic,…

Computer Vision and Pattern Recognition · Computer Science 2024-06-06 Laurent Mertens , Elahe' Yargholi , Hans Op de Beeck , Jan Van den Stock , Joost Vennekens

Saliency modeling has been an active research area in computer vision for about two decades. Existing state of the art models perform very well in predicting where people look in natural scenes. There is, however, the risk that these models…

Computer Vision and Pattern Recognition · Computer Science 2015-05-15 Ali Borji , Laurent Itti

Human emotions analysis has been the focus of many studies, especially in the field of Affective Computing, and is important for many applications, e.g. human-computer intelligent interaction, stress analysis, interactive games, animations,…

Computer Vision and Pattern Recognition · Computer Science 2020-05-13 Mohammad Rami Koujan , Luma Alharbawee , Giorgos Giannakakis , Nicolas Pugeault , Anastasios Roussos

Human affects are complex paradox and an active research domain in affective computing. Affects are traditionally determined through a self-report based psychometric questionnaire or through facial expression recognition. However, few…

Human-Computer Interaction · Computer Science 2021-02-16 Md. Mahbubur Rahman , Akash Poddar , Md. Golam Rabiul Alam , Samrat Kumar Dey

Emotion recognition has received considerable attention from the Computer Vision community in the last 20 years. However, most of the research focused on analyzing the six basic emotions (e.g. joy, anger, surprise), with a limited work…

Computer Vision and Pattern Recognition · Computer Science 2022-09-13 Mina Bishay , Jay Turcot , Graham Page , Mohammad Mavadati

Existing affective understanding studies have mainly focused on recognizing emotions from images, audio signals, or pre-cliped video clips, where the affective evidence is already given. This passive and clip-centered setting does not fully…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Zhen Zhang , Yuhang Yang , Yunxiang Jiang , Yuhuan Lu , Haifeng Lu , Zheng Lian , Runhao Zeng , Xiping Hu

Affective computing is a field of great interest in many computer vision applications, including video surveillance, behaviour analysis, and human-robot interaction. Most of the existing literature has addressed this field by analysing…

Computer Vision and Pattern Recognition · Computer Science 2020-06-24 Danilo Avola , Luigi Cinque , Alessio Fagioli , Gian Luca Foresti , Cristiano Massaroni

We present the Moments in Time Dataset, a large-scale human-annotated collection of one million short videos corresponding to dynamic events unfolding within three seconds. Modeling the spatial-audio-temporal dynamics even for actions…

Computer Vision and Pattern Recognition · Computer Science 2019-02-19 Mathew Monfort , Alex Andonian , Bolei Zhou , Kandan Ramakrishnan , Sarah Adel Bargal , Tom Yan , Lisa Brown , Quanfu Fan , Dan Gutfruend , Carl Vondrick , Aude Oliva

Automated affective computing in the wild setting is a challenging problem in computer vision. Existing annotated databases of facial expressions in the wild are small and mostly cover discrete emotions (aka the categorical model). There…

Computer Vision and Pattern Recognition · Computer Science 2018-02-06 Ali Mollahosseini , Behzad Hasani , Mohammad H. Mahoor

Understanding human visual attention and saliency is an integral part of vision research. In this context, there is an ever-present need for fresh and diverse benchmark datasets, particularly for insight into special use cases like crowded…

Computer Vision and Pattern Recognition · Computer Science 2019-10-10 Memoona Tahira , Sobas Mehboob , Anis U. Rahman , Omar Arif

Facial expression analysis based on machine learning requires large number of well-annotated data to reflect different changes in facial motion. Publicly available datasets truly help to accelerate research in this area by providing a…

Machine Learning · Computer Science 2023-01-31 Yanfu Yan , Ke Lu , Jian Xue , Pengcheng Gao , Jiayi Lyu

In psychoanalysis, generating interpretations to one's psychological state through visual creations is facing significant demands. The two main tasks of existing studies in the field of computer vision, sentiment/emotion classification and…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Likun Yang , Xiaokun Feng , Xiaotang Chen , Shiyu Zhang , Kaiqi Huang

Modelling interactions between humans and objects in natural environments is central to many applications including gaming, virtual and mixed reality, as well as human behavior analysis and human-robot collaboration. This challenging…

Computer Vision and Pattern Recognition · Computer Science 2022-04-15 Bharat Lal Bhatnagar , Xianghui Xie , Ilya A. Petrov , Cristian Sminchisescu , Christian Theobalt , Gerard Pons-Moll

We address the problem of accurate capture of interactive behaviors between two people in daily scenarios. Most previous works either only consider one person or solely focus on conversational gestures of two people, assuming the body…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Leo Ho , Yinghao Huang , Dafei Qin , Mingyi Shi , Wangpok Tse , Wei Liu , Junichi Yamagishi , Taku Komura