English
Related papers

Related papers: Multi-Order Networks for Action Unit Detection

200 papers

Micro-Expression (ME) is the spontaneous, involuntary movement of a face that can reveal the true feeling. Recently, increasing researches have paid attention to this field combing deep learning techniques. Action units (AUs) are the…

Computer Vision and Pattern Recognition · Computer Science 2020-04-21 Ling Lo , Hong-Xia Xie , Hong-Han Shuai , Wen-Huang Cheng

Weakly supervised temporal action localization aims to detect and localize actions in untrimmed videos with only video-level labels during training. However, without frame-level annotations, it is challenging to achieve localization…

Computer Vision and Pattern Recognition · Computer Science 2021-04-30 Wang Luo , Tianzhu Zhang , Wenfei Yang , Jingen Liu , Tao Mei , Feng Wu , Yongdong Zhang

Extracting and binding salient information from different sensory modalities to determine common features in the environment is a significant challenge in robotics. Here we present MuPNet (Multi-modal Predictive Coding Network), a…

Facial Action Units (AU) is a vital concept in the realm of affective computing, and AU detection has always been a hot research topic. Existing methods suffer from overfitting issues due to the utilization of a large number of learnable…

Computer Vision and Pattern Recognition · Computer Science 2024-07-10 Kaishen Yuan , Zitong Yu , Xin Liu , Weicheng Xie , Huanjing Yue , Jingyu Yang

Due to its importance in facial behaviour analysis, facial action unit (AU) detection has attracted increasing attention from the research community. Leveraging the online knowledge distillation framework, we propose the ``FANTrans" method…

Computer Vision and Pattern Recognition · Computer Science 2022-11-14 Jing Yang , Jie Shen , Yiming Lin , Yordan Hristov , Maja Pantic

The Facial Action Coding System (FACS) encodes the action units (AUs) in facial images, which has attracted extensive research attention due to its wide use in facial expression analysis. Many methods that perform well on automatic facial…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Xuri Ge , Joemon M. Jose , Songpei Xu , Xiao Liu , Hu Han

The automatic intensity estimation of facial action units (AUs) from a single image plays a vital role in facial analysis systems. One big challenge for data-driven AU intensity estimation is the lack of sufficient AU label data. Due to the…

Computer Vision and Pattern Recognition · Computer Science 2020-04-14 Xinhui Song , Tianyang Shi , Tianjia Shao , Yi Yuan , Zunlei Feng , Changjie Fan

Automatic facial behavior analysis has a long history of studies in the intersection of computer vision, physiology and psychology. However it is only recently, with the collection of large-scale datasets and powerful machine learning…

Computer Vision and Pattern Recognition · Computer Science 2020-06-01 Dimitrios Kollias , Viktoriia Sharmanska , Stefanos Zafeiriou

Facial Action Coding System is an important approach of facial expression analysis.This paper describes our submission to the third Affective Behavior Analysis (ABAW) 2022 competition. We proposed a transfomer based model to detect facial…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Lingfeng Wang , Shisen Wang , Jin Qi

Facial expressions are combinations of basic components called Action Units (AU). Recognizing AUs is key for developing general facial expression analysis. In recent years, most efforts in automatic AU recognition have been dedicated to…

Computer Vision and Pattern Recognition · Computer Science 2018-03-26 Ciprian A. Corneanu , Meysam Madadi , Sergio Escalera

This paper describes an approach to the facial action unit (AU) detection. In this work, we present our submission to the Field Affective Behavior Analysis (ABAW) 2021 competition. The proposed method uses the pre-trained JAA model as the…

Computer Vision and Pattern Recognition · Computer Science 2021-07-12 Chenggong Zhang , Juan Song , Qingyang Zhang , Weilong Dong , Ruomeng Ding , Zhilei Liu

Over the past decades the machine and deep learning community has celebrated great achievements in challenging tasks such as image classification. The deep architecture of artificial neural networks together with the plenitude of available…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Jessica Deuschel , Bettina Finzel , Ines Rieger

Current popular online multi-object tracking (MOT) solutions apply single object trackers (SOTs) to capture object motions, while often requiring an extra affinity network to associate objects, especially for the occluded ones. This brings…

Computer Vision and Pattern Recognition · Computer Science 2020-04-06 Junbo Yin , Wenguan Wang , Qinghao Meng , Ruigang Yang , Jianbing Shen

This paper presents a neural network based method Multi-Task Affect Net(MTANet) submitted to the Affective Behavior Analysis in-the-Wild Challenge in FG2020. This method is a multi-task network and based on SE-ResNet modules. By utilizing…

Computer Vision and Pattern Recognition · Computer Science 2020-02-06 Zihang Zhang , Jianping Gu

Facial Action Unit (AU) detection is a crucial task in affective computing and social robotics as it helps to identify emotions expressed through facial expressions. Anatomically, there are innumerable correlations between AUs, which…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Xin Liu , Kaishen Yuan , Xuesong Niu , Jingang Shi , Zitong Yu , Huanjing Yue , Jingyu Yang

In this paper, we propose Two-Stream AMTnet, which leverages recent advances in video-based action representation[1] and incremental action tube generation[2]. Majority of the present action detectors follow a frame-based representation, a…

Computer Vision and Pattern Recognition · Computer Science 2020-04-06 Suman Saha , Gurkirt Singh , Fabio Cuzzolin

Facial micro-expressions (MEs) are involuntary facial motions revealing peoples real feelings and play an important role in the early intervention of mental illness, the national security, and many human-computer interaction systems.…

Computer Vision and Pattern Recognition · Computer Science 2022-08-22 Hanting Li , Mingzhe Sui , Zhaoqing Zhu , Feng Zhao

Facial behavior analysis is a broad topic with various categories such as facial emotion recognition, age, and gender recognition. Many studies focus on individual tasks while the multi-task learning approach is still an open research issue…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Dang-Khanh Nguyen , Sudarshan Pant , Ngoc-Huynh Ho , Guee-Sang Lee , Soo-Huyng Kim , Hyung-Jeong Yang

Facial micro-expressions are spontaneous, brief and subtle facial motions that unveil the underlying, suppressed emotions. Detecting Action Units (AUs) in micro-expressions is crucial because it yields a finer representation of facial…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Huai-Qian Khor , Yante Li , Xingxun Jiang , Guoying Zhao

Detecting action units (AUs) on human faces is challenging because various AUs make subtle facial appearance change over various regions at different scales. Current works have attempted to recognize AUs by emphasizing important regions.…

Computer Vision and Pattern Recognition · Computer Science 2019-08-27 Chen Ma , Li Chen , Junhai Yong