English
Related papers

Related papers: RecruitView: A Multimodal Dataset for Predicting P…

200 papers

Human affective behavior analysis has received much attention in human-computer interaction (HCI). In this paper, we introduce our submission to the CVPR 2022 Competition on Affective Behavior Analysis in-the-wild (ABAW). To fully exploit…

Computer Vision and Pattern Recognition · Computer Science 2022-04-19 Wei Zhang , Feng Qiu , Suzhen Wang , Hao Zeng , Zhimeng Zhang , Rudong An , Bowen Ma , Yu Ding

Though multimodal emotion recognition has achieved significant progress over recent years, the potential of rich synergic relationships across the modalities is not fully exploited. In this paper, we introduce Recursive Joint Cross-Modal…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 R. Gnana Praveen , Jahangir Alam

Visual recognition inside the vehicle cabin leads to safer driving and more intuitive human-vehicle interaction but such systems face substantial obstacles as they need to capture different granularities of driver behaviour while dealing…

Computer Vision and Pattern Recognition · Computer Science 2022-04-12 Alina Roitberg , Kunyu Peng , Zdravko Marinov , Constantin Seibold , David Schneider , Rainer Stiefelhagen

In person re-identification, re-ranking is a crucial step to enhance the overall accuracy by refining the initial ranking of retrieved results. Previous studies have mainly focused on features from single-view images, which can cause view…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Huy Che , Le-Chuong Nguyen , Gia-Nghia Tran , Dinh-Duy Phan , Vinh-Tiep Nguyen

Recent advances at the intersection of reinforcement learning (RL) and visual intelligence have enabled agents that not only perceive complex visual scenes but also reason, generate, and act within them. This survey offers a critical and…

Computer Vision and Pattern Recognition · Computer Science 2025-12-24 Weijia Wu , Chen Gao , Joya Chen , Kevin Qinghong Lin , Qingwei Meng , Yiming Zhang , Yuke Qiu , Hong Zhou , Mike Zheng Shou

Representing human performance at high-fidelity is an essential building block in diverse applications, such as film production, computer games or videoconferencing. To close the gap to production-level quality, we introduce HumanRF, a 4D…

Computer Vision and Pattern Recognition · Computer Science 2023-05-12 Mustafa Işık , Martin Rünz , Markos Georgopoulos , Taras Khakhulin , Jonathan Starck , Lourdes Agapito , Matthias Nießner

The development of facial biometric systems has contributed greatly to the development of the computer vision field. Nowadays, there's always a need to develop a multimodal system that combines multiple biometric traits in an efficient,…

Computer Vision and Pattern Recognition · Computer Science 2024-01-11 Mahmoud Rabea , Hanya Ahmed , Sohaila Mahmoud , Nourhan Sayed

Predicting personality traits automatically has become a challenging problem in computer vision. This paper introduces an innovative multimodal feature learning framework for personality analysis in short video clips. For visual processing,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Kangsheng Wang , Chengwei Ye , Huanzhen Zhang , Linuo Xu , Shuyan Liu

Ensuring fairness and robustness in machine learning models remains a challenge, particularly under domain shifts. We present Face4FairShifts, a large-scale facial image benchmark designed to systematically evaluate fairness-aware learning…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Yumeng Lin , Dong Li , Xintao Wu , Minglai Shao , Xujiang Zhao , Zhong Chen , Chen Zhao

Recent advances in 3D foundation models have led to growing interest in reconstructing humans and their surrounding environments. However, most existing approaches focus on monocular inputs, and extending them to multi-view settings…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Sangmin Kim , Minhyuk Hwang , Geonho Cha , Dongyoon Wee , Jaesik Park

Establishing stable mappings between natural language expressions and visual percepts is a foundational problem for both cognitive science and artificial intelligence. Humans routinely ground linguistic reference in noisy, ambiguous…

Artificial Intelligence · Computer Science 2026-02-24 Joseph Bingham

Motion prediction has been studied in different contexts with models trained on narrow distributions and applied to downstream tasks in human motion prediction and robotics. Simultaneously, recent efforts in scaling video prediction have…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Johnathan Xie , Stefan Stojanov , Cristobal Eyzaguirre , Daniel L. K. Yamins , Jiajun Wu

Integrating diverse data modalities is crucial for enhancing the performance of personalized recommendation systems. Traditional models, which often rely on singular data sources, lack the depth needed to accurately capture the multifaceted…

Information Retrieval · Computer Science 2025-02-18 Luyi Ma , Xiaohan Li , Zezhong Fan , Kai Zhao , Jianpeng Xu , Jason Cho , Praveen Kanumala , Kaushiki Nag , Sushant Kumar , Kannan Achan

Multimodal Emotion Recognition (MER) aims to automatically identify and understand human emotional states by integrating information from various modalities. However, the scarcity of annotated multimodal data significantly hinders the…

Human-Computer Interaction · Computer Science 2024-09-11 Zhixian Zhao , Haifeng Chen , Xi Li , Dongmei Jiang , Lei Xie

This paper explores privacy-compliant group-level emotion recognition ''in-the-wild'' within the EmotiW Challenge 2023. Group-level emotion recognition can be useful in many fields including social robotics, conversational agents,…

Artificial Intelligence · Computer Science 2023-12-12 Anderson Augusma , Dominique Vaufreydaz , Frédérique Letué

Multi-modal learning is a fast growing area in artificial intelligence. It tries to help machines understand complex things by combining information from different sources, like images, text, and audio. By using the strengths of each…

Machine Learning · Computer Science 2025-12-22 Qihang Jin , Enze Ge , Yuhang Xie , Hongying Luo , Junhao Song , Ziqian Bi , Chia Xin Liang , Jibin Guan , Joe Yeong , Xinyuan Song , Junfeng Hao

Cancer diagnosis, prognosis, and therapeutic response predictions are based on morphological information from histology slides and molecular profiles from genomic data. However, most deep learning-based objective outcome prediction and…

Computer Vision and Pattern Recognition · Computer Science 2020-09-04 Richard J. Chen , Ming Y. Lu , Jingwen Wang , Drew F. K. Williamson , Scott J. Rodig , Neal I. Lindeman , Faisal Mahmood

In recent years, predicting Big Five personality traits from multimodal data has received significant attention in artificial intelligence (AI). However, existing computational models often fail to achieve satisfactory performance.…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Bin Tang , Keqi Pan , Miao Zheng , Ning Zhou , Jialu Sui , Dandan Zhu , Cheng-Long Deng , Shu-Guang Kuai

Although multimodal fusion has made significant progress, its advancement is severely hindered by the lack of adequate evaluation benchmarks. Current fusion methods are typically evaluated on a small selection of public datasets, a limited…

Machine Learning · Computer Science 2026-05-07 Leyan Xue , Changqing Zhang , Kecheng Xue , Xiaohong Liu , Guangyu Wang , Zongbo Han

Unconstrained face recognition performance evaluations have traditionally focused on Labeled Faces in the Wild (LFW) dataset for imagery and the YouTubeFaces (YTF) dataset for videos in the last couple of years. Spectacular progress in this…

Computer Vision and Pattern Recognition · Computer Science 2018-02-12 Lin Xiong , Jayashree Karlekar , Jian Zhao , Yi Cheng , Yan Xu , Jiashi Feng , Sugiri Pranata , Shengmei Shen