English
Related papers

Related papers: Behaviour4All: in-the-wild Facial Behaviour Analys…

200 papers

This paper describes the 6th Affective Behavior Analysis in-the-wild (ABAW) Competition, which is part of the respective Workshop held in conjunction with IEEE CVPR 2024. The 6th ABAW Competition addresses contemporary challenges in…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Dimitrios Kollias , Panagiotis Tzirakis , Alan Cowen , Stefanos Zafeiriou , Irene Kotsia , Alice Baird , Chris Gagne , Chunchang Shao , Guanyu Hu

Detecting facial action units (AU) is one of the fundamental steps in automatic recognition of facial expression of emotions and cognitive states. Though there have been a variety of approaches proposed for this task, most of these models…

Computer Vision and Pattern Recognition · Computer Science 2019-11-28 Mihee Lee , Ognjen Rudovic , Vladimir Pavlovic , Maja Pantic

The human face plays a central role in social communication, necessitating the use of performant computer vision tools for human-centered applications. We propose Face-LLaVA, a multimodal large language model for face-centered, in-context…

Computer Vision and Pattern Recognition · Computer Science 2025-04-11 Ashutosh Chaubey , Xulang Guan , Mohammad Soleymani

In recent years, Affective Computing and its applications have become a fast-growing research topic. Furthermore, the rise of Deep Learning has introduced significant improvements in the emotion recognition system compared to classical…

Computer Vision and Pattern Recognition · Computer Science 2020-01-22 Joaquim Comas , Decky Aspandi , Xavier Binefa

Learning from synthetic images plays an important role in facial expression recognition task due to the difficulties of labeling the real images, and it is challenging because of the gap between the synthetic images and real images. The…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Xiangyu Miao , Jiahe Wang , Yanan Chang , Yi Wu , Shangfei Wang

Dense facial landmark detection is one of the key elements of face processing pipeline. It is used in virtual face reenactment, emotion recognition, driver status tracking, etc. Early approaches were suitable for facial landmark detection…

Computer Vision and Pattern Recognition · Computer Science 2022-04-26 Kostiantyn Khabarlak , Larysa Koriashkina

In this paper an accurate real-time sequence-based system for representation, recognition, interpretation, and analysis of the facial action units (AUs) and expressions is presented. Our system has the following characteristics: 1)…

Computer Vision and Pattern Recognition · Computer Science 2010-04-06 Mahmoud Khademi , Mohammad Hadi Kiapour , Mohammad T. Manzuri-Shalmani , Ali A. Kiaei

The brain can only be fully understood through the lens of the behavior it generates -- a guiding principle in modern neuroscience research that nevertheless presents significant technical challenges. Many studies capture behavior with…

Neurons and Cognition · Quantitative Biology 2026-03-02 Yanchen Wang , Han Yu , Ari Blau , Yizi Zhang , The International Brain Laboratory , Liam Paninski , Cole Hurwitz , Matt Whiteway

Recent advancements in 2D and multimodal models have achieved remarkable success by leveraging large-scale training on extensive datasets. However, extending these achievements to enable free-form interactions and high-level semantic…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Shijie Zhou , Hui Ren , Yijia Weng , Shuwang Zhang , Zhen Wang , Dejia Xu , Zhiwen Fan , Suya You , Zhangyang Wang , Leonidas Guibas , Achuta Kadambi

Facial expression recognition is a challenging classification task that holds broad application prospects in the field of human-computer interaction. This paper aims to introduce the method we will adopt in the 8th Affective and Behavioral…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Jun Yu , Yang Zheng , Lei Wang , Yongqi Wang , Shengfan Xu

Facial action unit (FAU) intensities are popular descriptors for the analysis of facial behavior. However, FAUs are sparsely represented when only a few are activated at a time. In this study, we explore the possibility of representing the…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Minh Tran , Ellen Bradley , Michelle Matvey , Joshua Woolley , Mohammad Soleymani

The field of animal affective computing is rapidly emerging, and analysis of facial expressions is a crucial aspect. One of the most significant challenges that researchers in the field currently face is the scarcity of high-quality,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-06 George Martvel , Ilan Shimshoni , Anna Zamansky

Most of the existing work on automatic facial expression analysis focuses on discrete emotion recognition, or facial action unit detection. However, facial expressions do not always fall neatly into pre-defined semantic categories. Also,…

Computer Vision and Pattern Recognition · Computer Science 2019-01-11 Raviteja Vemulapalli , Aseem Agarwala

In this paper, we present our solution and experiment result for the Multi-Task Learning Challenge of the 7th Affective Behavior Analysis in-the-wild(ABAW7) Competition. This challenge consists of three tasks: action unit detection, facial…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Xiaodong Li , Wenchao Du , Hongyu Yang

The Facial Action Coding System (FACS) for studying facial expressions is manual and requires significant effort and expertise. This paper explores the use of automated techniques to generate Action Units (AUs) for studying facial…

Computer Vision and Pattern Recognition · Computer Science 2024-06-14 Shivansh Chandra Tripathi , Rahul Garg

This paper describes an approach to the facial action unit (AU) detection. In this work, we present our submission to the Field Affective Behavior Analysis (ABAW) 2021 competition. The proposed method uses the pre-trained JAA model as the…

Computer Vision and Pattern Recognition · Computer Science 2021-07-12 Chenggong Zhang , Juan Song , Qingyang Zhang , Weilong Dong , Ruomeng Ding , Zhilei Liu

This work explores facial expression bias as a security vulnerability of face recognition systems. Despite the great performance achieved by state-of-the-art face recognition systems, the algorithms are still sensitive to a large range of…

Computer Vision and Pattern Recognition · Computer Science 2021-06-21 Alejandro Peña , Ignacio Serna , Aythami Morales , Julian Fierrez , Agata Lapedriza

Dynamic facial expression recognition has many useful applications in social networks, multimedia content analysis, security systems and others. This challenging process must be done under recurrent problems of image illumination and low…

Computer Vision and Pattern Recognition · Computer Science 2020-12-29 Ali Raza Shahid , Sheheryar Khan , Hong Yan

Automated facial identification and facial expression recognition have been topics of active research over the past few decades. Facial and expression recognition find applications in human-computer interfaces, subject tracking, real-time…

Computer Vision and Pattern Recognition · Computer Science 2016-10-25 Sohini Roychowdhury , Michelle Emmons

Human emotions can be inferred from facial expressions. However, the annotations of facial expressions are often highly noisy in common emotion coding models, including categorical and dimensional ones. To reduce human labelling effort on…

Computer Vision and Pattern Recognition · Computer Science 2020-11-25 Siwei Zhang , Zhiwu Huang , Danda Pani Paudel , Luc Van Gool