English
Related papers

Related papers: Monocular Robot Navigation with Self-Supervised Pr…

200 papers

Monocular 6-DoF pose estimation plays an important role in multiple spacecraft missions. Most existing pose estimation approaches rely on single images with static keypoint localisation, failing to exploit valuable temporal information…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Jose Sosa , Dan Pineau , Arunkumar Rathinam , Abdelrahman Shabayek , Djamila Aouada

Existing computer vision research in categorization struggles with fine-grained attributes recognition due to the inherently high intra-class variances and low inter-class variances. SOTA methods tackle this challenge by locating the most…

Computer Vision and Pattern Recognition · Computer Science 2021-07-01 Marcos V. Conde , Kerem Turgutlu

Ensuring safety in autonomous driving is a complex challenge requiring handling unknown objects and unforeseen driving scenarios. We develop multiscale video transformers capable of detecting unknown objects using only motion cues. Video…

Computer Vision and Pattern Recognition · Computer Science 2025-08-21 Leila Cheshmi , Mennatullah Siam

Recent advances in Vision Transformers (ViT) and Stable Diffusion (SD) models with their ability to capture rich semantic features of the image have been used for image correspondence tasks on natural images. In this paper, we examine the…

Sim2Real transfer has gained popularity because it helps transfer from inexpensive simulators to real world. This paper presents a novel system that fuses components in a traditional World Model into a robust system, trained entirely within…

Robotics · Computer Science 2024-03-26 Kiran Lekkala , Chen Liu , Laurent Itti

Pretrain techniques, whether supervised or self-supervised, are widely used in deep learning to enhance model performance. In real-world clinical scenarios, different sets of magnetic resonance (MR) contrasts are often acquired for…

Image and Video Processing · Electrical Eng. & Systems 2025-04-07 Badhan Kumar Das , Gengyan Zhao , Han Liu , Thomas J. Re , Dorin Comaniciu , Eli Gibson , Andreas Maier

Single-stream architectures using Vision Transformer (ViT) backbones show great potential for real-time UAV tracking recently. However, frequent occlusions from obstacles like buildings and trees expose a major drawback: these models often…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 You Wu , Xucheng Wang , Xiangyang Yang , Mengyuan Liu , Dan Zeng , Hengzhou Ye , Shuiwang Li

Reliable obstacle avoidance in industrial settings demands 3D scene understanding, but widely used 2D LiDAR sensors perceive only a single horizontal slice of the environment, missing critical obstacles above or below the scan plane. We…

Robotics · Computer Science 2026-05-05 Jan Finke , Wayne Paul Martis , Adrian Schmelter , Lars Erbach , Christian Jestel , Marvin Wiedemann

Masked image modeling (MIM) pre-training for large-scale vision transformers (ViTs) has enabled promising downstream performance on top of the learned self-supervised ViT features. In this paper, we question if the \textit{extremely simple}…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Jin Gao , Shubo Lin , Shaoru Wang , Yutong Kou , Zeming Li , Liang Li , Congxuan Zhang , Xiaoqin Zhang , Yizheng Wang , Weiming Hu

Self-supervised learning on large-scale Vision Transformers (ViTs) as pre-training methods has achieved promising downstream performance. Yet, how much these pre-training paradigms promote lightweight ViTs' performance is considerably less…

Computer Vision and Pattern Recognition · Computer Science 2023-05-04 Shaoru Wang , Jin Gao , Zeming Li , Xiaoqin Zhang , Weiming Hu

Natural environments such as forests and grasslands are challenging for robotic navigation because of the false perception of rigid obstacles from high grass, twigs, or bushes. In this work, we present Wild Visual Navigation (WVN), an…

Vision Transformers (ViT)s have shown great performance in self-supervised learning of global and local representations that can be transferred to downstream applications. Inspired by these results, we introduce a novel self-supervised…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Yucheng Tang , Dong Yang , Wenqi Li , Holger Roth , Bennett Landman , Daguang Xu , Vishwesh Nath , Ali Hatamizadeh

In robot learning, Vision Transformers (ViTs) are standard for visual perception, yet most methods discard valuable information by using only the final layer's features. We argue this provides an insufficient representation and propose the…

Computer Vision and Pattern Recognition · Computer Science 2026-02-02 Wenhao Li , Chengwei Ma , Weixin Mao

Generating a detailed near-field perceptual model of the environment is an important and challenging problem in both self-driving vehicles and autonomous mobile robotics. A Bird Eye View (BEV) map, providing a panoptic representation, is a…

Computer Vision and Pattern Recognition · Computer Science 2022-06-01 Pramit Dutta , Ganesh Sistu , Senthil Yogamani , Edgar Galván , John McDonald

When it comes to clinical images, automatic segmentation has a wide variety of applications and a considerable diversity of input domains, such as different types of Magnetic Resonance Images (MRIs) and Computerized Tomography (CT) scans.…

Image and Video Processing · Electrical Eng. & Systems 2024-02-28 Matteo Bastico , David Ryckelynck , Laurent Corté , Yannick Tillier , Etienne Decencière

Vision transformers (ViT) usually extract features via forwarding all the tokens in the self-attention layers from top to toe. In this paper, we introduce dynamic token-pass vision transformers (DoViT) for semantic segmentation, which can…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Yuang Liu , Qiang Zhou , Jing Wang , Fan Wang , Jun Wang , Wei Zhang

We propose a novel deep learning framework based on Vision Transformers (ViT) for one-class classification. The core idea is to use zero-centered Gaussian noise as a pseudo-negative class for latent space representation and then train the…

Computer Vision and Pattern Recognition · Computer Science 2022-04-26 Prerana Mukherjee , Chandan Kumar Roy , Swalpa Kumar Roy

The estimation of the orientation of an observed vehicle relative to an Autonomous Vehicle (AV) from monocular camera data is an important building block in estimating its 6 DoF pose. Current Deep Learning based solutions for placing a 3D…

Computer Vision and Pattern Recognition · Computer Science 2021-03-26 Cédric Picron , Punarjay Chakravarty , Tom Roussel , Tinne Tuytelaars

To be effective in unstructured and changing environments, robots must learn to recognize new objects. Deep learning has enabled rapid progress for object detection and segmentation in computer vision; however, this progress comes at the…

Robotics · Computer Science 2020-03-05 Victoria Florence , Jason J. Corso , Brent Griffin

Human vision possesses a special type of visual processing systems called peripheral vision. Partitioning the entire visual field into multiple contour regions based on the distance to the center of our gaze, the peripheral vision provides…

Computer Vision and Pattern Recognition · Computer Science 2022-10-14 Juhong Min , Yucheng Zhao , Chong Luo , Minsu Cho