English
Related papers

Related papers: Learning and Fusing Multimodal Features from and f…

200 papers

Heterogeneous face matching is a challenge issue in face recognition due to large domain difference as well as insufficient pairwise images in different modalities during training. This paper proposes a coupled deep learning (CDL) approach…

Computer Vision and Pattern Recognition · Computer Science 2017-11-17 Xiang Wu , Lingxiao Song , Ran He , Tieniu Tan

When a facial image is blurred, it significantly affects high-level vision tasks such as face recognition. The purpose of facial image deblurring is to recover a clear image from a blurry input image, which can improve the recognition…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Bingnan Wang , Fanjiang Xu , Quan Zheng

In this paper, the multi-task learning of lightweight convolutional neural networks is studied for face identification and classification of facial attributes (age, gender, ethnicity) trained on cropped faces without margins. The necessity…

Computer Vision and Pattern Recognition · Computer Science 2021-10-28 Andrey V. Savchenko

Recent studies have focused on utilizing multi-modal data to develop robust models for facial Action Unit (AU) detection. However, the heterogeneity of multi-modal data poses challenges in learning effective representations. One such…

Computer Vision and Pattern Recognition · Computer Science 2023-08-24 Xiang Zhang , Huiyuan Yang , Taoyue Wang , Xiaotian Li , Lijun Yin

Multimodal fusion frameworks for Human Action Recognition (HAR) using depth and inertial sensor data have been proposed over the years. In most of the existing works, fusion is performed at a single level (feature level or decision level),…

Machine Learning · Computer Science 2019-10-28 Zeeshan Ahmad , Naimul Khan

Multimodal Large Language Models (MLLMs) have made significant advancements in recent years, with visual features playing an increasingly critical role in enhancing model performance. However, the integration of multi-layer visual features…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Junyan Lin , Haoran Chen , Yue Fan , Yingqi Fan , Xin Jin , Hui Su , Jinlan Fu , Xiaoyu Shen

Recent studies have demonstrated advantages of information fusion based on sparsity models for multimodal classification. Among several sparsity models, tree-structured sparsity provides a flexible framework for extraction of…

Computer Vision and Pattern Recognition · Computer Science 2015-02-04 Soheil Bahrampour , Asok Ray , Nasser M. Nasrabadi , Kenneth W. Jenkins

Plastic surgery and disguise variations are two of the most challenging co-variates of face recognition. The state-of-art deep learning models are not sufficiently successful due to the availability of limited training samples. In this…

Computer Vision and Pattern Recognition · Computer Science 2018-11-20 Saksham Suri , Anush Sankaran , Mayank Vatsa , Richa Singh

A number of pattern recognition tasks, \textit{e.g.}, face verification, can be boiled down to classification or clustering of unit length directional feature vectors whose distance can be simply computed by their angle. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2018-01-03 Md. Abul Hasnat , Julien Bohné , Jonathan Milgram , Stéphane Gentric , Liming Chen

The development of facial biometric systems has contributed greatly to the development of the computer vision field. Nowadays, there's always a need to develop a multimodal system that combines multiple biometric traits in an efficient,…

Computer Vision and Pattern Recognition · Computer Science 2024-01-11 Mahmoud Rabea , Hanya Ahmed , Sohaila Mahmoud , Nourhan Sayed

Despite recent advances in face recognition, robust performance remains challenging under large variations in age, pose, and occlusion. A common strategy to address these issues is to guide representation learning with auxiliary supervision…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Ana Dias , João Ribeiro Pinto , Hugo Proença , João C. Neves

Recently, we have seen an increase in the global facial recognition market size. Despite significant advances in face recognition technology with the adoption of convolutional neural networks, there are still open challenges, such as when…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Marcus de Assis Angeloni , Helio Pedrini

Face Attribute Recognition (FAR) plays a crucial role in applications such as person re-identification, face retrieval, and face editing. Conventional multi-task attribute recognition methods often process the entire feature map for feature…

Computer Vision and Pattern Recognition · Computer Science 2026-02-02 Gong Gao , Zekai Wang , Jian Zhao , Ziqi Xie , Xianhui Liu , Weidong Zhao

Visual object tracking remains an active research field in computer vision due to persisting challenges with various problem-specific factors in real-world scenes. Many existing tracking methods based on discriminative correlation filters…

Computer Vision and Pattern Recognition · Computer Science 2021-09-21 Seyed Mojtaba Marvasti-Zadeh , Hossein Ghanei-Yakhdan , Shohreh Kasaei , Kamal Nasrollahi , Thomas B. Moeslund

Biometrics based personal identification is regarded as an effective method for automatically recognizing, with a high confidence a person's identity. A multimodal biometric systems consolidate the evidence presented by multiple biometric…

Computer Vision and Pattern Recognition · Computer Science 2009-09-15 M. Nageshkumar , P. K. Mahesh , M. N. S. Swamy

In this paper, we present an Adaptive Ensemble Learning framework that aims to boost the performance of deep neural networks by intelligently fusing features through ensemble learning techniques. The proposed framework integrates ensemble…

Artificial Intelligence · Computer Science 2023-04-07 Neelesh Mungoli

Multimodal medical image fusion plays an instrumental role in several areas of medical image processing, particularly in disease recognition and tumor detection. Traditional fusion methods tend to process each modality independently before…

Image and Video Processing · Electrical Eng. & Systems 2023-10-11 Lin Liu , Xinxin Fan , Chulong Zhang , Jingjing Dai , Yaoqin Xie , Xiaokun Liang

Person identification (P-ID) under real unconstrained noisy environments is a huge challenge. In multiple-feature learning with Deep Convolutional Neural Networks (DCNNs) or Machine Learning method for large-scale person identification in…

Computer Vision and Pattern Recognition · Computer Science 2019-12-30 Jiajie Ye , Yisheng Guan , Junfa Liu , Xinghong Huang , Hong Zhang

Visual recognition inside the vehicle cabin leads to safer driving and more intuitive human-vehicle interaction but such systems face substantial obstacles as they need to capture different granularities of driver behaviour while dealing…

Computer Vision and Pattern Recognition · Computer Science 2022-04-12 Alina Roitberg , Kunyu Peng , Zdravko Marinov , Constantin Seibold , David Schneider , Rainer Stiefelhagen

In this work, we present a deep learning-based approach for image tampering localization fusion. This approach is designed to combine the outcomes of multiple image forensics algorithms and provides a fused tampering localization map, which…

Computer Vision and Pattern Recognition · Computer Science 2021-05-14 Polychronis Charitidis , Giorgos Kordopatis-Zilos , Symeon Papadopoulos , Ioannis Kompatsiaris