English
Related papers

Related papers: Behaviour4All: in-the-wild Facial Behaviour Analys…

200 papers

While 3D facial animation has made impressive progress, challenges still exist in realizing fine-grained stylized 3D facial expression manipulation due to the lack of appropriate datasets. In this paper, we introduce the AUBlendSet, a 3D…

Computer Vision and Pattern Recognition · Computer Science 2025-07-17 Hao Li , Ju Dai , Feng Zhou , Kaida Ning , Lei Li , Junjun Pan

Using drones to track multiple individuals simultaneously in their natural environment is a powerful approach for better understanding group primate behavior. Previous studies have demonstrated that it is possible to automate the…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Isla Duporge , Maksim Kholiavchenko , Roi Harel , Scott Wolf , Dan Rubenstein , Meg Crofoot , Tanya Berger-Wolf , Stephen Lee , Julie Barreau , Jenna Kline , Michelle Ramirez , Charles Stewart

Analyzing animal and human behavior has long been a challenging task in computer vision. Early approaches from the 1970s to the 1990s relied on hand-crafted edge detection, segmentation, and low-level features such as color, shape, and…

Computer Vision and Pattern Recognition · Computer Science 2026-02-11 Hung-Shuo Chang , Yue-Cheng Yang , Yu-Hsi Chen , Wei-Hsin Chen , Chien-Yao Wang , James C. Liao , Chien-Chang Chen , Hen-Hsen Huang , Hong-Yuan Mark Liao

In this paper, we present the results of the HSE-NN team in the 4th competition on Affective Behavior Analysis in-the-wild (ABAW). The novel multi-task EfficientNet model is trained for simultaneous recognition of facial expressions and…

Computer Vision and Pattern Recognition · Computer Science 2022-10-21 Andrey V. Savchenko

Expression recognition in in-the-wild video data remains challenging due to substantial variations in facial appearance, background conditions, audio noise, and the inherently dynamic nature of human affect. Relying on a single modality,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Junhyeong Byeon , Jeongyeol Kim , Sejoon Lim

In recent years, audio-driven 3D facial animation has gained significant attention, particularly in applications such as virtual reality, gaming, and video conferencing. However, accurately modeling the intricate and subtle dynamics of…

Computer Vision and Pattern Recognition · Computer Science 2023-11-14 Guinan Su , Yanwu Yang , Zhifeng Li

Large Language Models (LLMs) as clinical agents require careful behavioral adaptation. While adept at reactive tasks (e.g., diagnosis reasoning), LLMs often struggle with proactive engagement, like unprompted identification of critical…

Face recognition in collaborative learning videos presents many challenges. In collaborative learning videos, students sit around a typical table at different positions to the recording camera, come and go, move around, get partially or…

Computer Vision and Pattern Recognition · Computer Science 2021-10-27 Phuong Tran , Marios Pattichis , Sylvia Celedón-Pattichis , Carlos LópezLeiva

In the realm of emotion synthesis, the ability to create authentic and nuanced facial expressions continues to gain importance. The GANmut study discusses a recently introduced advanced GAN framework that, instead of relying on predefined…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Maria Surani

Continuous authentication in high-stakes digital environments requires datasets with fine-grained behavioral signals under realistic cognitive and motor demands. But current benchmarks are often limited by small scale, unimodal sensing or…

Cryptography and Security · Computer Science 2026-05-18 Ishpuneet Singh , Gursmeep Kaur , Uday Pratap Singh Atwal , Guramrit Singh , Gurjot Singh , Maninder Singh

Understanding animals' behaviors is significant for a wide range of applications. However, existing animal behavior datasets have limitations in multiple aspects, including limited numbers of animal classes, data samples and provided tasks,…

Computer Vision and Pattern Recognition · Computer Science 2022-06-06 Xun Long Ng , Kian Eng Ong , Qichen Zheng , Yun Ni , Si Yong Yeo , Jun Liu

Facial expressions are the most common universal forms of body language. In the past few years, automatic facial expression recognition (FER) has been an active field of research. However, it is still a challenging task due to different…

Computer Vision and Pattern Recognition · Computer Science 2021-08-23 Rauf Momin , Ali Shan Momin , Khalid Rasheed , Muhammad Saqib

Using intelligent systems to perceive psychological and social behaviors, that is, the underlying affective, cognitive, and pathological states that are manifested through observable behaviors and social interactions, remains a challenge…

Artificial Intelligence · Computer Science 2026-02-13 Keane Ong , Wei Dai , Carol Li , Dewei Feng , Hengzhi Li , Jingyao Wu , Jiaee Cheong , Rui Mao , Gianmarco Mengaldo , Erik Cambria , Paul Pu Liang

Understanding freely moving animal behavior is central to neuroscience, where pose estimation and behavioral understanding form the foundation for linking neural activity to natural actions. Yet both tasks still depend heavily on human…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Jingyang Ke , Weihan Li , Amartya Pradhan , Jeffrey Markowitz , Anqi Wu

This paper describes the proposed methodology, data used and the results of our participation in the ChallengeTrack 2 (Expr Challenge Track) of the Affective Behavior Analysis in-the-wild (ABAW) Competition 2020. In this competition, we…

Computer Vision and Pattern Recognition · Computer Science 2020-10-06 Hafiq Anas , Bacha Rehman , Wee Hong Ong

Computer-use agents (CUAs) automate on-screen work, as illustrated by GPT-5.4 and Claude. Yet their reliability on complex, low-frequency interactions is still poor, limiting user trust. Our analysis of failure cases from advanced models…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Miaosen Zhang , Xiaohan Zhao , Zhihong Tan , Zhou Huoshen , Yijia Fan , Yifan Yang , Kai Qiu , Bei Liu , Justin Wagle , Chenzhong Yin , Mingxi Cheng , Ji Li , Qi Dai , Chong Luo , Xu Yang , Xin Geng , Baining Guo

For computers to recognize human emotions, expression classification is an equally important problem in the human-computer interaction area. In the 3rd Affective Behavior Analysis In-The-Wild competition, the task of expression…

Computer Vision and Pattern Recognition · Computer Science 2022-04-11 Kim Ngan Phan , Hong-Hai Nguyen , Van-Thong Huynh , Soo-Hyung Kim

Humans are arguably innately prepared to comprehend others' emotional expressions from subtle body movements. If robots or computers can be empowered with this capability, a number of robotic applications become possible. Automatically…

Computer Vision and Pattern Recognition · Computer Science 2019-08-21 Yu Luo , Jianbo Ye , Reginald B. Adams, , Jia Li , Michelle G. Newman , James Z. Wang

Facial Emotion Analysis (FEA) plays a crucial role in visual affective computing, aiming to infer a person's emotional state based on facial data. Scientifically, facial expressions (FEs) result from the coordinated movement of facial…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Zhuozhao Hu , Kaishen Yuan , Xin Liu , Zitong Yu , Yuan Zong , Jingang Shi , Huanjing Yue , Jingyu Yang

The development of existing facial coding systems, such as the Facial Action Coding System (FACS), relied on manual examination of facial expression videos for defining Action Units (AUs). To overcome the labor-intensive nature of this…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Shivansh Chandra Tripathi , Rahul Garg