English
Related papers

Related papers: Learning to Adapt to Position Bias in Vision Trans…

200 papers

Supervised machine learning models and their evaluation strongly depends on the quality of the underlying dataset. When we search for a relevant piece of information it may appear anywhere in a given passage. However, we observe a bias in…

Information Retrieval · Computer Science 2021-01-19 Sebastian Hofstätter , Aldo Lipani , Sophia Althammer , Markus Zlabinger , Allan Hanbury

Visual localization techniques often comprise a hierarchical localization pipeline, with a visual place recognition module used as a coarse localizer to initialize a pose refinement stage. While improving the pose refinement step has been…

Computer Vision and Pattern Recognition · Computer Science 2021-05-10 Ming Xu , Niko Sünderhauf , Michael Milford

In the field of autonomous driving and mobile robotics, there has been a significant shift in the methods used to create Bird's Eye View (BEV) representations. This shift is characterised by using transformers and learning to fuse…

Robotics · Computer Science 2024-10-29 Mehdi Hosseinzadeh , Ian Reid

It is widely accepted that reasoning about object shape is important for object recognition. However, the most powerful object recognition methods today do not explicitly make use of object shape during learning. In this work, motivated by…

Computer Vision and Pattern Recognition · Computer Science 2021-06-22 Stefan Stojanov , Anh Thai , James M. Rehg

Convolution is an equivariant operation, and image position does not affect its result. A recent study shows that the zero-padding employed in convolutional layers of CNNs provides position information to the CNNs. The study further claims…

Image and Video Processing · Electrical Eng. & Systems 2020-05-08 Rito Murase , Masanori Suganuma , Takayuki Okatani

Successful visual navigation depends upon capturing images that contain sufficient useful information. In this letter, we explore a data-driven approach to account for environmental lighting changes, improving the quality of images for use…

Robotics · Computer Science 2022-07-12 Justin Tomasi , Brandon Wagstaff , Steven L. Waslander , Jonathan Kelly

Recurrent models have been dominating the field of neural machine translation (NMT) for the past few years. Transformers \citep{vaswani2017attention}, have radically changed it by proposing a novel architecture that relies on a feed-forward…

Computation and Language · Computer Science 2022-10-25 Joyce Zheng , Mehdi Rezagholizadeh , Peyman Passban

Visual re-localization means using a single image as input to estimate the camera's location and orientation relative to a pre-recorded environment. The highest-scoring methods are "structure based," and need the query camera's intrinsics…

Computer Vision and Pattern Recognition · Computer Science 2021-04-13 Mehmet Ozgur Turkoglu , Eric Brachmann , Konrad Schindler , Gabriel Brostow , Aron Monszpart

Location modeling, or determining where non-existing objects could feasibly appear in a scene, has the potential to benefit numerous computer vision tasks, from automatic object insertion to scene creation in virtual reality. Yet, this…

Computer Vision and Pattern Recognition · Computer Science 2025-10-08 Jooyeol Yun , Davide Abati , Mohamed Omran , Jaegul Choo , Amirhossein Habibian , Auke Wiggers

Masked Image Modeling (MIM) is a promising self-supervised learning approach that enables learning from unlabeled images. Despite its recent success, learning good representations through MIM remains challenging because it requires…

Computer Vision and Pattern Recognition · Computer Science 2024-02-28 Amir Bar , Florian Bordes , Assaf Shocher , Mahmoud Assran , Pascal Vincent , Nicolas Ballas , Trevor Darrell , Amir Globerson , Yann LeCun

Vision transformers (ViTs) have demonstrated remarkable performance in a variety of vision tasks. Despite their promising capabilities, training a ViT requires a large amount of diverse data. Several studies empirically found that using…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Bum Jun Kim , Sang Woo Kim

Learning embeddings that are invariant to the pose of the object is crucial in visual image retrieval and re-identification. The existing approaches for person, vehicle, or animal re-identification tasks suffer from high intra-class…

Computer Vision and Pattern Recognition · Computer Science 2020-08-27 Olga Moskvyak , Frederic Maire , Feras Dayoub , Mahsa Baktashmotlagh

In transformers, the positional encoding (PE) provides essential information that distinguishes the position and order amongst tokens in a sequence. Most prior investigations of PE effects on generalization were tailored to 1D input…

Machine Learning · Computer Science 2025-06-24 Takuya Ito , Luca Cocchi , Tim Klinger , Parikshit Ram , Murray Campbell , Luke Hearne

Deep neural networks often make decisions based on the spurious correlations inherent in the dataset, failing to generalize in an unbiased data distribution. Although previous approaches pre-define the type of dataset bias to prevent the…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Eungyeup Kim , Jihyeon Lee , Jaegul Choo

Fisheye cameras suffer from image distortion while having a large field of view(LFOV). And this fact leads to poor performance on some fisheye vision tasks. One of the solutions is to optimize the current vision algorithm for fisheye…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Dianyi Yang , Jiadong Tang , Yu Gao , Yi Yang , Mengyin Fu

We learn a visual representation that captures information about the camera that recorded a given photo. To do this, we train a multimodal embedding between image patches and the EXIF metadata that cameras automatically insert into image…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Chenhao Zheng , Ayush Shrivastava , Andrew Owens

High-precision vehicle localization with commercial setups is a crucial technique for high-level autonomous driving tasks. Localization with a monocular camera in LiDAR map is a newly emerged approach that achieves promising balance between…

Robotics · Computer Science 2023-05-09 Jinyu Miao , Kun Jiang , Yunlong Wang , Tuopu Wen , Zhongyang Xiao , Zheng Fu , Mengmeng Yang , Maolin Liu , Diange Yang

Image classifiers are information-discarding machines, by design. Yet, how these models discard information remains mysterious. We hypothesize that one way for image classifiers to reach high accuracy is to first zoom to the most…

Computer Vision and Pattern Recognition · Computer Science 2023-10-10 Mohammad Reza Taesiri , Giang Nguyen , Sarra Habchi , Cor-Paul Bezemer , Anh Nguyen

Image classification is a primary task in data analysis where explainable models are crucially demanded in various applications. Although amounts of methods have been proposed to obtain explainable knowledge from the black-box classifiers,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Ruitao Xie , Jingbang Chen , Limai Jiang , Rui Xiao , Yi Pan , Yunpeng Cai

Jointing visual-semantic embeddings (VSE) have become a research hotpot for the task of image annotation, which suffers from the issue of semantic gap, i.e., the gap between images' visual features (low-level) and labels' semantic features…

Computer Vision and Pattern Recognition · Computer Science 2018-08-14 Guibing Guo , Songlin Zhai , Fajie Yuan , Yuan Liu , Xingwei Wang