English
Related papers

Related papers: Multimodal Informative ViT: Information Aggregatio…

200 papers

Vision Transformers (ViTs) have shown exceptional performance in vehicle re-identification (ReID) tasks. However, non-square aspect ratios of image or video inputs can negatively impact re-identification accuracy. To address this challenge,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-12 Mei Qiu , Lauren Ann Christopher , Stanley Chien , Lingxi Li

Automatic modulation recognition (AMR) is critical for cognitive radio, spectrum monitoring, and secure wireless communication. However, existing solutions often rely on large labeled datasets or multi-stage training pipelines, which limit…

Computer Vision and Pattern Recognition · Computer Science 2025-09-12 Hossein Ahmadi , Banafsheh Saffari , Sajjad Emdadi Mahdimahalleh , Mohammad Esmaeil Safari , Aria Ahmadi

General-domain large multimodal models (LMMs) have achieved significant advances in various image-text tasks. However, their performance in the Intelligent Traffic Surveillance (ITS) domain remains limited due to the absence of dedicated…

Computer Vision and Pattern Recognition · Computer Science 2025-09-15 Kaikai Zhao , Zhaoxiang Liu , Peng Wang , Xin Wang , Zhicheng Ma , Yajun Xu , Wenjing Zhang , Yibing Nan , Kai Wang , Shiguo Lian

Goal-conditioned navigation models for ground robots trained using supervised learning show promising zero-shot transfer, but their collision-avoidance capability nevertheless degrades under distribution shift, i.e. environmental, robot or…

Robotics · Computer Science 2026-04-22 Louis Dezons , Quentin Picard , Rémi Marsal , François Goulette , David Filliat

Multimodal ophthalmic imaging-based diagnosis integrates color fundus image with optical coherence tomography (OCT) to provide a comprehensive view of ocular pathologies. However, the uneven global distribution of healthcare resources often…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Qinkai Yu , Jianyang Xie , Yitian Zhao , Cheng Chen , Lijun Zhang , Liming Chen , Jun Cheng , Lu Liu , Yalin Zheng , Yanda Meng

Vision Transformer (ViT) is a pioneering deep learning framework that can address real-world computer vision issues, such as image classification and object recognition. Importantly, ViTs are proven to outperform traditional deep learning…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Yuda Bi , Anees Abrol , Zening Fu , Vince Calhoun

Recently, vision transformer (ViT) based multimodal learning methods have been proposed to improve the robustness of face anti-spoofing (FAS) systems. However, there are still no works to explore the fundamental natures (\textit{e.g.},…

Computer Vision and Pattern Recognition · Computer Science 2023-02-14 Zitong Yu , Rizhao Cai , Yawen Cui , Xin Liu , Yongjian Hu , Alex Kot

Vision-language models have been widely explored across a wide range of tasks and achieve satisfactory performance. However, it's under-explored how to consolidate entity understanding through a varying number of images and to align it with…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Wenyi Wu , Qi Li , Wenliang Zhong , Junzhou Huang

Vision Transformers (ViT) have made many breakthroughs in computer vision tasks. However, considerable redundancy arises in the spatial dimension of an input image, leading to massive computational costs. Therefore, We propose a…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Mengzhao Chen , Mingbao Lin , Ke Li , Yunhang Shen , Yongjian Wu , Fei Chao , Rongrong Ji

Infrared-visible object detection aims to achieve robust even full-day object detection by fusing the complementary information of infrared and visible images. However, highly dynamically variable complementary characteristics and commonly…

Computer Vision and Pattern Recognition · Computer Science 2024-03-08 Junjie Guo , Chenqiang Gao , Fangcen Liu , Deyu Meng , Xinbo Gao

Vision Transformers (ViTs) take all the image patches as tokens and construct multi-head self-attention (MHSA) among them. Complete leverage of these image tokens brings redundant computations since not all the tokens are attentive in MHSA.…

Computer Vision and Pattern Recognition · Computer Science 2022-04-15 Youwei Liang , Chongjian Ge , Zhan Tong , Yibing Song , Jue Wang , Pengtao Xie

Multi-modal collaborative perception calls for great attention to enhancing the safety of autonomous driving. However, current multi-modal approaches remain a ``local fusion to communication'' sequence, which fuses multi-modal data locally…

Computer Vision and Pattern Recognition · Computer Science 2026-03-04 Kang Yang , Peng Wang , Lantao Li , Tianci Bu , Chen Sun , Deying Li , Yongcai Wang

Recently, the vision transformer (ViT) has made breakthroughs in image recognition. Its self-attention mechanism (MSA) can extract discriminative labeling information of different pixel blocks to improve image classification accuracy.…

Computer Vision and Pattern Recognition · Computer Science 2022-11-28 Chao Hu , Liqiang Zhu , Weibin Qiu , Weijie Wu

Recently, masked image modeling (MIM) has offered a new methodology of self-supervised pre-training of vision transformers. A key idea of efficient implementation is to discard the masked image patches (or tokens) throughout the target…

Computer Vision and Pattern Recognition · Computer Science 2022-05-31 Xiaosong Zhang , Yunjie Tian , Wei Huang , Qixiang Ye , Qi Dai , Lingxi Xie , Qi Tian

Multimodal regression aims to predict a continuous target from heterogeneous input sources and typically relies on fusion strategies such as early or late fusion. However, existing methods lack principled tools to disentangle and quantify…

Machine Learning · Computer Science 2025-12-29 Zhaozhao Ma , Shujian Yu

Integrating deep learning applications into agricultural IoT systems faces a serious challenge of balancing the high accuracy of Vision Transformers (ViTs) with the efficiency demands of resource-constrained edge devices. Large transformer…

Computer Vision and Pattern Recognition · Computer Science 2025-04-24 Stanley Mugisha , Rashid Kisitu , Florence Tushabe

Unsupervised visible-infrared person re-identification (USL-VI-ReID) endeavors to retrieve pedestrian images of the same identity from different modalities without annotations. While prior work focuses on establishing cross-modality…

Computer Vision and Pattern Recognition · Computer Science 2024-12-09 Lingfeng He , De Cheng , Nannan Wang , Xinbo Gao

Fusing LiDAR and camera information is essential for achieving accurate and reliable 3D object detection in autonomous driving systems. This is challenging due to the difficulty of combining multi-granularity geometric and semantic features…

Computer Vision and Pattern Recognition · Computer Science 2023-03-06 Yang Jiao , Zequn Jie , Shaoxiang Chen , Jingjing Chen , Lin Ma , Yu-Gang Jiang

Model binarization can significantly compress model size, reduce energy consumption, and accelerate inference through efficient bit-wise operations. Although binarizing convolutional neural networks have been extensively studied, there is…

Computer Vision and Pattern Recognition · Computer Science 2023-10-06 Yefei He , Zhenyu Lou , Luoming Zhang , Jing Liu , Weijia Wu , Hong Zhou , Bohan Zhuang

The architecture of Vision Transformers (ViTs), particularly the Multi-head Attention (MHA) mechanism, imposes substantial hardware demands. Deploying ViTs on devices with varying constraints, such as mobile phones, requires multiple models…

Computer Vision and Pattern Recognition · Computer Science 2024-12-06 Janek Haberer , Ali Hojjat , Olaf Landsiedel