English
Related papers

Related papers: Feature Pyramid Network for Multi-task Affective A…

200 papers

Automatic understanding of human affect using visual signals is of great importance in everyday human-machine interactions. Appraising human emotional states, behaviors and reactions displayed in real-world settings, can be accomplished…

Computer Vision and Pattern Recognition · Computer Science 2019-02-04 Dimitrios Kollias , Panagiotis Tzirakis , Mihalis A. Nicolaou , Athanasios Papaioannou , Guoying Zhao , Björn Schuller , Irene Kotsia , Stefanos Zafeiriou

Local features at neighboring spatial positions in feature maps have high correlation since their receptive fields are often overlapped. Self-attention usually uses the weighted sum (or other functions) with internal elements of each local…

Computer Vision and Pattern Recognition · Computer Science 2018-08-06 Yang Du , Chunfeng Yuan , Bing Li , Lili Zhao , Yangxi Li , Weiming Hu

Human affect recognition is an essential part of natural human-computer interaction. However, current methods are still in their infancy, especially for in-the-wild data. In this work, we introduce our submission to the Affective Behavior…

Computer Vision and Pattern Recognition · Computer Science 2020-11-03 Felix Kuhnke , Lars Rumberg , Jörn Ostermann

Multimodal affective computing, learning to recognize and interpret human affects and subjective information from multiple data sources, is still challenging because: (i) it is hard to extract informative features to represent human affects…

Computation and Language · Computer Science 2018-05-23 Yue Gu , Kangning Yang , Shiyu Fu , Shuhong Chen , Xinyu Li , Ivan Marsic

In this article, the results of our team for the fifth Affective Behavior Analysis in-the-wild (ABAW) competition are presented. The usage of the pre-trained convolutional networks from the EmotiEffNet family for frame-level feature…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Andrey V. Savchenko

Exploiting the relationships between attributes is a key challenge for improving multiple facial attribute recognition. In this work, we are concerned with two types of correlations that are spatial and non-spatial relationships. For the…

Computer Vision and Pattern Recognition · Computer Science 2021-05-31 Zhenghao Chen , Shuhang Gu , Feng Zhu , Jing Xu , Rui Zhao

Recently, some span-based methods have achieved encouraging performances for joint aspect-sentiment analysis, which first extract aspects (aspect extraction) by detecting aspect boundaries and then classify the span-level sentiments…

Computation and Language · Computer Science 2022-08-25 Wei Chen , Jinglong Du , Zhao Zhang , Fuzhen Zhuang , Zhongshi He

This paper describes the third Affective Behavior Analysis in-the-wild (ABAW) Competition, held in conjunction with IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), 2022. The 3rd ABAW Competition is a…

Computer Vision and Pattern Recognition · Computer Science 2022-03-01 Dimitrios Kollias

In domains where computational resources and labeled data are limited, such as in robotics, deep networks with millions of weights might not be the optimal solution. In this paper, we introduce a connectivity scheme for pyramidal…

Computer Vision and Pattern Recognition · Computer Science 2021-03-24 Henrique Siqueira , Pablo Barros , Sven Magg , Cornelius Weber , Stefan Wermter

Among human affective behavior research, facial expression recognition research is improving in performance along with the development of deep learning. However, for improved performance, not only past images but also future images should…

Computer Vision and Pattern Recognition · Computer Science 2021-07-09 Geesung Oh , Euiseok Jeong , Sejoon Lim

We present our contribution to the 7th ABAW challenge at ECCV 2024, by utilizing a Dual-Direction Attention Mixed Feature Network (DDAMFN) for multitask facial expression recognition, we achieve results far beyond the proposed baseline for…

Computer Vision and Pattern Recognition · Computer Science 2024-09-06 Josep Cabacas-Maso , Elena Ortega-Beltrán , Ismael Benito-Altamirano , Carles Ventura

The in-the-wild affective behavior analysis has been an important study. In this paper, we submit our solutions for the 5th Workshop and Competition on Affective Behavior Analysis in-the-wild (ABAW), which includes V-A Estimation, Facial…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Peng Zou , Rui Wang , Kehua Wen , Yasi Peng , Xiao Sun

Analysis of human affect plays a vital role in human-computer interaction (HCI) systems. Due to the difficulty in capturing large amounts of real-life data, most of the current methods have mainly focused on controlled environments, which…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Jun Yu , Zhongpeng Cai , Peng He , Guocheng Xie , Qiang Ling

We present our contribution to the 8th ABAW challenge at CVPR 2025, where we tackle valence-arousal estimation, emotion recognition, and facial action unit detection as three independent challenges. Our approach leverages the well-known…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Josep Cabacas-Maso , Elena Ortega-Beltrán , Ismael Benito-Altamirano , Carles Ventura

This paper proposes a joint multi-task learning algorithm to better predict attributes in images using deep convolutional neural networks (CNN). We consider learning binary semantic attributes through a multi-task CNN model, where each CNN…

Computer Vision and Pattern Recognition · Computer Science 2016-01-05 Abrar H. Abdulnabi , Gang Wang , Jiwen Lu , Kui Jia

Emotion recognition is a critical component of affective computing. Training accurate machine learning models for emotion recognition typically requires a large amount of labeled data. Due to the subtleness and complexity of emotions,…

Machine Learning · Computer Science 2024-12-03 Yifan Xu , Xue Jiang , Dongrui Wu

Multi-task learning aims to improve generalization performance of multiple prediction tasks by appropriately sharing relevant information across them. In the context of deep neural networks, this idea is often realized by hand-designed…

Computer Vision and Pattern Recognition · Computer Science 2016-11-17 Yongxi Lu , Abhishek Kumar , Shuangfei Zhai , Yu Cheng , Tara Javidi , Rogerio Feris

Affective Recommender Systems are an emerging class of intelligent systems that aim to enhance personalization by aligning recommendations with users' affective states. Reflecting a growing interest, a number of surveys have been published…

Information Retrieval · Computer Science 2025-08-29 Tonmoy Hasan , Razvan Bunescu

Numerous social, medical, engineering and biological challenges can be framed as graph-based learning tasks. Here, we propose a new feature based approach to network classification. We show how dynamics on a network can be useful to reveal…

Machine Learning · Statistics 2017-06-01 Leonardo Gutierrez Gomez , Benjamin Chiem , Jean-Charles Delvenne

Multimodal fusion is a significant method for most multimodal tasks. With the recent surge in the number of large pre-trained models, combining both multimodal fusion methods and pre-trained model features can achieve outstanding…

Computer Vision and Pattern Recognition · Computer Science 2024-03-25 Zhuofan Wen , Fengyu Zhang , Siyuan Zhang , Haiyang Sun , Mingyu Xu , Licai Sun , Zheng Lian , Bin Liu , Jianhua Tao