English
Related papers

Related papers: Spatial Entropy as an Inductive Bias for Vision Tr…

200 papers

Recently, Transformers have shown promising performance in various vision tasks. However, the high costs of global self-attention remain challenging for Transformers, especially for high-resolution vision tasks. Inspired by one of the most…

Computer Vision and Pattern Recognition · Computer Science 2023-11-13 Zhemin Zhang , Xun Gong

Visual spatial reasoning (VSR) remains challenging for modern vision-language models (VLMs), despite advances in multimodal architectures. A common strategy is to inject additional information at inference time, such as explicit spatial…

Computation and Language · Computer Science 2026-02-26 Muku Akasaka , Soyeon Caren Han

In recent years, Transformer-based architectures have become the dominant method for Computer Vision applications. While Transformers are explainable and scale well with dataset size, they lack the inductive biases of Convolutional Neural…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Adithya Giri

The advances in deep reinforcement learning recently revived interest in data-driven learning based approaches to navigation. In this paper we propose to learn viewpoint invariant and target invariant visual servoing for local mobile robot…

Computer Vision and Pattern Recognition · Computer Science 2020-03-06 Yimeng Li , Jana Kosecka

Vision Transformers have attracted a lot of attention recently since the successful implementation of Vision Transformer (ViT) on vision tasks. With vision Transformers, specifically the multi-head self-attention modules, networks can…

Computer Vision and Pattern Recognition · Computer Science 2022-10-27 Xiangyu Chen , Ying Qin , Wenju Xu , Andrés M. Bur , Cuncong Zhong , Guanghui Wang

Self-supervised learning converts raw perceptual data such as images to a compact space where simple Euclidean distances measure meaningful variations in data. In this paper, we extend this formulation by adding additional geometric…

Machine Learning · Computer Science 2023-06-27 Sharut Gupta , Joshua Robinson , Derek Lim , Soledad Villar , Stefanie Jegelka

Industrial vision anomaly detection plays a critical role in the advanced intelligent manufacturing process, while some limitations still need to be addressed under such a context. First, existing reconstruction-based methods struggle with…

Computer Vision and Pattern Recognition · Computer Science 2022-11-30 Haiming Yao , Wenyong Yu

Vision transformers (ViT) have been of broad interest in recent theoretical and empirical works. They are state-of-the-art thanks to their attention-based approach, which boosts the identification of key features and patterns within images…

Computer Vision and Pattern Recognition · Computer Science 2023-09-13 Victor Quétu , Marta Milovanovic , Enzo Tartaglione

Self-supervised deep learning methods have leveraged stereo images for training monocular depth estimation. Although these methods show strong results on outdoor datasets such as KITTI, they do not match performance of supervised methods on…

Computer Vision and Pattern Recognition · Computer Science 2021-06-28 Benjamin Keltjens , Tom van Dijk , Guido de Croon

Visual Place Recognition (VPR) localizes a query image by matching it against a database of geo-tagged reference images, making it essential for navigation and mapping in robotics. Although Vision Transformer (ViT) solutions deliver high…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Oliver Grainge , Michael Milford , Indu Bodala , Sarvapali D. Ramchurn , Shoaib Ehsan

Vision transformers (ViTs) have demonstrated remarkable performance in a variety of vision tasks. Despite their promising capabilities, training a ViT requires a large amount of diverse data. Several studies empirically found that using…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Bum Jun Kim , Sang Woo Kim

Deep metric learning aims to construct an embedding space where samples of the same class are close to each other, while samples of different classes are far away from each other. Most existing deep metric learning methods attempt to…

Computer Vision and Pattern Recognition · Computer Science 2023-04-24 Liu Pingping , Liu Zetong , Lang Yijun , Zhou Qiuzhan , Li Qingliang

Textual cues are essential for everyday tasks like buying groceries and using public transport. To develop this assistive technology, we study the TextVQA task, i.e., reasoning about text in images to answer a question. Existing approaches…

Computer Vision and Pattern Recognition · Computer Science 2020-12-24 Yash Kant , Dhruv Batra , Peter Anderson , Alex Schwing , Devi Parikh , Jiasen Lu , Harsh Agrawal

Document-level MT models are still far from satisfactory. Existing work extend translation unit from single sentence to multiple sentences. However, study shows that when we further enlarge the translation unit to a whole document,…

Computation and Language · Computer Science 2021-06-01 Guangsheng Bao , Yue Zhang , Zhiyang Teng , Boxing Chen , Weihua Luo

Self-supervised learning on large-scale Vision Transformers (ViTs) as pre-training methods has achieved promising downstream performance. Yet, how much these pre-training paradigms promote lightweight ViTs' performance is considerably less…

Computer Vision and Pattern Recognition · Computer Science 2023-05-04 Shaoru Wang , Jin Gao , Zeming Li , Xiaoqin Zhang , Weiming Hu

Spatial understanding remains a weakness of Large Vision-Language Models (LVLMs). Existing supervised fine-tuning (SFT) and recent reinforcement learning with verifiable rewards (RLVR) pipelines depend on costly supervision, specialized…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Yuhong Liu , Beichen Zhang , Yuhang Zang , Yuhang Cao , Long Xing , Xiaoyi Dong , Haodong Duan , Dahua Lin , Jiaqi Wang

Learning new classes without forgetting is crucial for real-world applications for a classification model. Vision Transformers (ViT) recently achieve remarkable performance in Class Incremental Learning (CIL). Previous works mainly focus on…

Machine Learning · Computer Science 2023-04-17 Bowen Zheng , Da-Wei Zhou , Han-Jia Ye , De-Chuan Zhan

Vision Transformers (ViT) are competing to replace Convolutional Neural Networks (CNN) for various computer vision tasks in medical imaging such as classification and segmentation. While the vulnerability of CNNs to adversarial attacks is a…

Computer Vision and Pattern Recognition · Computer Science 2022-08-08 Faris Almalik , Mohammad Yaqub , Karthik Nandakumar

Unsupervised localization and segmentation are long-standing robot vision challenges that describe the critical ability for an autonomous robot to learn to decompose images into individual objects without labeled data. These tasks are…

Computer Vision and Pattern Recognition · Computer Science 2023-07-26 Xinyu Zhang , Abdeslam Boularias

It has been observed that visual classification models often rely mostly on the image background, neglecting the foreground, which hurts their robustness to distribution changes. To alleviate this shortcoming, we propose to monitor the…

Computer Vision and Pattern Recognition · Computer Science 2022-06-03 Hila Chefer , Idan Schwartz , Lior Wolf