English
Related papers

Related papers: Multiscale Vision Transformers meet Bipartite Matc…

200 papers

The input tokens to Vision Transformers carry little semantic meaning as they are defined as regular equal-sized patches of the input image, regardless of its content. However, processing uniform background areas of an image should not…

Computer Vision and Pattern Recognition · Computer Science 2023-09-08 Jakob Drachmann Havtorn , Amelie Royer , Tijmen Blankevoort , Babak Ehteshami Bejnordi

Since their inception, Vision Transformers (ViTs) have emerged as a compelling alternative to Convolutional Neural Networks (CNNs) across a wide spectrum of tasks. ViTs exhibit notable characteristics, including global attention, resilience…

Computer Vision and Pattern Recognition · Computer Science 2024-07-22 Hanan Gani , Nada Saadi , Noor Hussein , Karthik Nandakumar

We address the problem of learning a single model for person re-identification, attribute classification, body part segmentation, and pose estimation. With predictions for these tasks we gain a more holistic understanding of persons, which…

Computer Vision and Pattern Recognition · Computer Science 2020-11-10 Kilian Pfeiffer , Alexander Hermans , István Sárándi , Mark Weber , Bastian Leibe

Transformers exhibit great advantages in handling computer vision tasks. They model image classification tasks by utilizing a multi-head attention mechanism to process a series of patches consisting of split images. However, for complex…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Haichao Zhang , Kuangrong Hao , Witold Pedrycz , Lei Gao , Xuesong Tang , Bing Wei

After their initial success in natural language processing, transformer architectures have rapidly gained traction in computer vision, providing state-of-the-art results for tasks such as image classification, detection, segmentation, and…

Computer Vision and Pattern Recognition · Computer Science 2022-03-21 Hugo Touvron , Matthieu Cord , Alaaeldin El-Nouby , Jakob Verbeek , Hervé Jégou

Vision Transformers (ViTs) have demonstrated strong performance across a range of computer vision tasks by modeling long-range spatial interactions via self-attention. However, channel-wise mixing in ViTs remains static, relying on fixed…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Aon Safdar , Mohamed Saadeldin

Unsupervised domain adaptation object detection (UDAOD) research on Detection Transformer(DETR) mainly focuses on feature alignment and existing methods can be divided into two kinds, each of which has its unresolved issues. One-stage…

Computer Vision and Pattern Recognition · Computer Science 2024-01-19 Weixi Weng , Chun Yuan

Geometric variations of objects, which do not modify the object class, pose a major challenge for object recognition. These variations could be rigid as well as non-rigid transformations. In this paper, we design a framework for training…

Machine Learning · Statistics 2017-12-20 Jiajun Shen , Yali Amit

Visual recognition algorithms are required today to exhibit adaptive abilities. Given a deep model trained on a specific, given task, it would be highly desirable to be able to adapt incrementally to new tasks, preserving scalability as the…

Computer Vision and Pattern Recognition · Computer Science 2018-06-15 Massimiliano Mancini , Elisa Ricci , Barbara Caputo , Samuel Rota Bulò

Accurately detecting lane lines in 3D space is crucial for autonomous driving. Existing methods usually first transform image-view features into bird-eye-view (BEV) by aid of inverse perspective mapping (IPM), and then detect lane lines…

Computer Vision and Pattern Recognition · Computer Science 2023-06-09 Ziye Chen , Kate Smith-Miles , Bo Du , Guoqi Qian , Mingming Gong

We explore the plain, non-hierarchical Vision Transformer (ViT) as a backbone network for object detection. This design enables the original ViT architecture to be fine-tuned for object detection without needing to redesign a hierarchical…

Computer Vision and Pattern Recognition · Computer Science 2022-06-13 Yanghao Li , Hanzi Mao , Ross Girshick , Kaiming He

LiDAR is crucial for robust 3D scene perception in autonomous driving. LiDAR perception has the largest body of literature after camera perception. However, multi-task learning across tasks like detection, segmentation, and motion…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Sambit Mohapatra , Senthil Yogamani , Varun Ravi Kumar , Stefan Milz , Heinrich Gotzig , Patrick Mäder

This report presents a lightweight modification to the DETR-based fusion transformer baseline for the MaCVi 2026 Vision-to-Chart data association challenge. The challenge baseline decoder receives per-buoy queries encoding world-space…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Borja Carrillo-Perez

In this work we propose a novel joint training method for Visual Place Recognition (VPR), which simultaneously learns a global descriptor and a pair classifier for re-ranking. The pair classifier can predict whether a given pair of images…

Robotics · Computer Science 2025-03-04 Stephen Hausler , Peyman Moghadam

We introduce the first multitasking vision transformer adapters that learn generalizable task affinities which can be applied to novel tasks and domains. Integrated into an off-the-shelf vision transformer backbone, our adapters can…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Deblina Bhattacharjee , Sabine Süsstrunk , Mathieu Salzmann

In this paper, we observe two levels of redundancies when applying vision transformers (ViT) for image recognition. First, fixing the number of tokens through the whole network produces redundant features at the spatial level. Second, the…

Computer Vision and Pattern Recognition · Computer Science 2021-08-10 Boyu Chen , Peixia Li , Baopu Li , Chuming Li , Lei Bai , Chen Lin , Ming Sun , Junjie Yan , Wanli Ouyang

Multi-Camera Multi-Target Tracking (MCMT) is a computer vision technique that involves tracking multiple targets simultaneously across multiple cameras. MCMT in urban traffic visual analysis faces great challenges due to the complex and…

Computer Vision and Pattern Recognition · Computer Science 2023-07-07 Jincheng Lu , Xipeng Yang , Jin Ye , Yifu Zhang , Zhikang Zou , Wei Zhang , Xiao Tan

Convolutional Neural Networks (CNNs) and Vision Transformers (ViTs) have led to significant progress in 2D body pose estimation. However, achieving a good balance between accuracy, efficiency, and robustness remains a challenge. For…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Kaleab A. Kinfu , René Vidal

Multi-task visual learning is a critical aspect of computer vision. Current research, however, predominantly concentrates on the multi-task dense prediction setting, which overlooks the intrinsic 3D world and its multi-view consistent…

Computer Vision and Pattern Recognition · Computer Science 2023-10-02 Shuhong Zheng , Zhipeng Bao , Martial Hebert , Yu-Xiong Wang

Unlike the sparse label action detection task, where a single action occurs in each timestamp of a video, in a dense multi-label scenario, actions can overlap. To address this challenging task, it is necessary to simultaneously learn (i)…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Faegheh Sardari , Armin Mustafa , Philip J. B. Jackson , Adrian Hilton