English
Related papers

Related papers: Choose Settings Carefully: Comparing Action Unit d…

200 papers

Despite being the appearance-based classifier of choice in recent years, relatively few works have examined how much convolutional neural networks (CNNs) can improve performance on accepted expression recognition benchmarks and, more…

Computer Vision and Pattern Recognition · Computer Science 2017-03-17 Pooya Khorrami , Tom Le Paine , Thomas S. Huang

Due to its importance in facial behaviour analysis, facial action unit (AU) detection has attracted increasing attention from the research community. Leveraging the online knowledge distillation framework, we propose the ``FANTrans" method…

Computer Vision and Pattern Recognition · Computer Science 2022-11-14 Jing Yang , Jie Shen , Yiming Lin , Yordan Hristov , Maja Pantic

While the research community appears to have developed a consensus on the methods of acquiring annotated data, design and training of CNNs, many questions still remain to be answered. In this paper, we explore the following questions that…

Computer Vision and Pattern Recognition · Computer Science 2017-09-08 Ankan Bansal , Carlos Castillo , Rajeev Ranjan , Rama Chellappa

Micro-expression (ME) action units (Micro-AUs) provide objective clues for fine-grained genuine emotion analysis. Most existing Micro-AU detection methods learn AU features from the whole facial image/video, which conflicts with the…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Jinsheng Wei , Fengzhou Guo , Yante Li , Haoyu Chen , Guanming Lu , Guoying Zhao

Classifying the behavior of humans or animals from videos is important in biomedical fields for understanding brain function and response to stimuli. Action recognition, classifying activities performed by one or more subjects in a trimmed…

Computer Vision and Pattern Recognition · Computer Science 2023-01-18 Michael Perez , Corey Toler-Franklin

A machine learning configuration refers to a combination of preprocessor, learner, and hyperparameters. Given a set of configurations and a large dataset randomly split into training and testing set, we study how to efficiently select the…

Machine Learning · Computer Science 2018-12-18 Silu Huang , Chi Wang , Bolin Ding , Surajit Chaudhuri

We propose a novel convolutional neural network approach to address the fine-grained recognition problem of multi-view dynamic facial action unit detection. We leverage recent gains in large-scale object recognition by formulating the task…

Computer Vision and Pattern Recognition · Computer Science 2018-08-21 Andres Romero , Juan Leon , Pablo Arbelaez

The Affective Behavior Analysis in-the-wild (ABAW) 2022 Competition gives Affective Computing a large promotion. In this paper, we present our method of AU challenge in this Competition. We use improved IResnet100 as backbone. Then we train…

Computer Vision and Pattern Recognition · Computer Science 2022-03-25 Wenqiang Jiang , Yannan Wu , Fengsheng Qiao , Liyu Meng , Yuanyuan Deng , Chuanhe Liu

Facial action unit (AU) detection remains challenging because it involves heterogeneous, AU-specific uncertainties arising at both the representation and decision stages. Recent methods have improved discriminative feature learning, but…

Computer Vision and Pattern Recognition · Computer Science 2026-04-24 Yuze Li , Zhilei Liu

In this report, we present our solution for the Action Unit (AU) Detection Challenge, in 8th Competition on Affective Behavior Analysis in-the-wild. In order to achieve robust and accurate classification of facial action unit in the wild…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Jun Yu , Yunxiang Zhang , Xilong Lu , Yang Zheng , Yongqi Wang , Lingsi Zhu

In highway scenarios, an alert human driver will typically anticipate early cut-in/cut-out maneuvers of surrounding vehicles using visual cues mainly. Autonomous vehicles must anticipate these situations at an early stage too, to increase…

Computer Vision and Pattern Recognition · Computer Science 2022-04-07 Mahdi Biparva , David Fernández-Llorca , Rubén Izquierdo-Gonzalo , John K. Tsotsos

Machine learning models of visual action recognition are typically trained and tested on data from specific situations where actions are associated with certain objects. It is an open question how action-object associations in the training…

Computer Vision and Pattern Recognition · Computer Science 2022-08-16 Satoshi Tsutsui , Xizi Wang , Guangyuan Weng , Yayun Zhang , David Crandall , Chen Yu

A large amount of recent research has focused on tasks that combine language and vision, resulting in a proliferation of datasets and methods. One such task is action recognition, whose applications include image annotation, scene under-…

Computation and Language · Computer Science 2017-04-25 Spandana Gella , Frank Keller

Action Units (AUs) are geometrically-based atomic facial muscle movements known to produce appearance changes at specific facial locations. Motivated by this observation we propose a novel AU modelling problem that consists of jointly…

Computer Vision and Pattern Recognition · Computer Science 2020-04-15 Ioanna Ntinou , Enrique Sanchez , Adrian Bulat , Michel Valstar , Georgios Tzimiropoulos

One of the key challenges of detecting AI-generated images is spotting images that have been created by previously unseen generative models. We argue that the limited diversity of the training data is a major obstacle to addressing this…

Computer Vision and Pattern Recognition · Computer Science 2025-06-11 Jeongsoo Park , Andrew Owens

Detecting assistance from artificial intelligence is increasingly important as they become ubiquitous across complex tasks such as text generation, medical diagnosis, and autonomous driving. Aid detection is challenging for humans,…

Artificial Intelligence · Computer Science 2025-07-16 Tyler King , Nikolos Gurney , John H. Miller , Volkan Ustun

We provide a detailed analysis of convolutional neural networks which are pre-trained on the task of object detection. To this end, we train detectors on large datasets like OpenImagesV4, ImageNet Localization and COCO. We analyze how well…

Computer Vision and Pattern Recognition · Computer Science 2019-04-12 Hengduo Li , Bharat Singh , Mahyar Najibi , Zuxuan Wu , Larry S. Davis

Facial expressions and actions differ among different individuals at varying degrees of intensity given responses to external stimuli, particularly among those that are neurodivergent. Such behaviors affect people in terms of overall…

Computer Vision and Pattern Recognition · Computer Science 2025-08-25 Manuel Serna-Aguilera , Xuan Bac Nguyen , Han-Seok Seo , Khoa Luu

This paper revisits the standard pretrain-then-finetune paradigm used in computer vision for visual recognition tasks. Typically, state-of-the-art foundation models are pretrained using large scale (weakly) supervised datasets with billions…

Despite the success of deep neural networks on facial action unit (AU) detection, better performance depends on a large number of training images with accurate AU annotations. However, labeling AU is time-consuming, expensive, and…

Computer Vision and Pattern Recognition · Computer Science 2021-05-17 Yong Li , Shiguang Shan