English
Related papers

Related papers: Learning Synthetic to Real Transfer for Localizati…

200 papers

We introduce a multi-sensor navigation system for autonomous surface vessels (ASV) intended for water-quality monitoring in freshwater lakes. Our mission planner uses satellite imagery as a prior map, formulating offline a mission-level…

Robotics · Computer Science 2024-08-26 Philip Huang , Tony Wang , Florian Shkurti , Timothy D. Barfoot

Localizing an object accurately with respect to a robot is a key step for autonomous robotic manipulation. In this work, we propose to tackle this task knowing only 3D models of the robot and object in the particular case where the scene is…

Computer Vision and Pattern Recognition · Computer Science 2019-02-08 Vianney Loing , Renaud Marlet , Mathieu Aubry

Navigating mobile robots through environments shared with humans is challenging. From the perspective of the robot, humans are dynamic obstacles that must be avoided. These obstacles make the collision-free space nonconvex, which leads to…

Robotics · Computer Science 2023-03-15 O. de Groot , L. Ferranti , D. Gavrila , J. Alonso-Mora

Achieving fully autonomous exploration and navigation remains a critical challenge in robotics, requiring integrated solutions for localisation, mapping, decision-making and motion planning. Existing approaches either rely on strict…

Robotics · Computer Science 2026-04-15 Daria de Tinguy , Tim Verbelen , Emilio Gamba , Bart Dhoedt

Understanding the geometric relationships between objects in a scene is a core capability in enabling both humans and autonomous agents to navigate in new environments. A sparse, unified representation of the scene topology will allow…

Computer Vision and Pattern Recognition · Computer Science 2022-05-18 Zachary Seymour , Niluthpol Chowdhury Mithun , Han-Pang Chiu , Supun Samarasekera , Rakesh Kumar

Mobile manipulation in dynamic environments is challenging due to movable obstacles blocking the robot's path. Traditional methods, which treat navigation and manipulation as separate tasks, often fail in such 'manipulate-to-navigate'…

Robotics · Computer Science 2025-08-19 Yuying Zhang , Joni Pajarinen

Autonomous terrain classification is an important problem in planetary navigation, whether the goal is to identify scientific sites of interest or to traverse treacherous areas safely. Past Martian rovers have relied on human operators to…

Robotics · Computer Science 2023-10-04 Anja Sheppard , Katherine A. Skinner

Current visual navigation systems often treat the environment as static, lacking the ability to adaptively interact with obstacles. This limitation leads to navigation failure when encountering unavoidable obstructions. In response, we…

Robotics · Computer Science 2024-08-13 Philipp Schoch , Fan Yang , Yuntao Ma , Stefan Leutenegger , Marco Hutter , Quentin Leboutet

Deep networks devour millions of precisely annotated images to build their complex and powerful representations. Unfortunately, tasks like autonomous driving have virtually no real-world training data. Repeatedly crashing a car into a tree…

Computer Vision and Pattern Recognition · Computer Science 2025-11-03 Brady Zhou , Nimit Kalra , Philipp Krähenbühl

Real world visual navigation requires robots to operate in unfamiliar, human-occupied dynamic environments. Navigation around humans is especially difficult because it requires anticipating their future motion, which can be quite…

Robotics · Computer Science 2021-02-16 Varun Tolani , Somil Bansal , Aleksandra Faust , Claire Tomlin

Trajectory planning in autonomous driving is highly dependent on predicting the emergent behavior of other road users. Learning-based methods are currently showing impressive results in simulation-based challenges, with transformer-based…

Machine Learning · Computer Science 2024-08-08 Lars Ullrich , Alex McMaster , Knut Graichen

Simulations are attractive environments for training agents as they provide an abundant source of data and alleviate certain safety concerns during the training process. But the behaviours developed by agents in simulation are often…

Robotics · Computer Science 2018-09-21 Xue Bin Peng , Marcin Andrychowicz , Wojciech Zaremba , Pieter Abbeel

Navigation functions provide both path and motion planning, which can be used to ensure obstacle avoidance and convergence in the sphere world. When dealing with complex and realistic scenarios, constructing a transformation to the sphere…

Robotics · Computer Science 2022-10-04 Li Fan , Jianchang Liu , Wenle Zhang , Peng Xu

Recent work has presented embodied agents that can navigate to point-goal targets in novel indoor environments with near-perfect accuracy. However, these agents are equipped with idealized sensors for localization and take deterministic…

Computer Vision and Pattern Recognition · Computer Science 2020-09-08 Samyak Datta , Oleksandr Maksymets , Judy Hoffman , Stefan Lee , Dhruv Batra , Devi Parikh

The surge of deep-space probes makes it unsustainable to navigate them with standard radiometric tracking. Self-driving interplanetary satellites represent a solution to this problem. In this work, a full vision-based navigation algorithm…

Computer Vision and Pattern Recognition · Computer Science 2024-06-19 Eleonora Andreis , Paolo Panicucci , Francesco Topputo

As robots increasingly enter human-centered environments, they must not only be able to navigate safely around humans, but also adhere to complex social norms. Humans often rely on non-verbal communication through gestures and facial…

The key to achieving autonomous driving lies in topology-aware perception, the structured understanding of the driving environment with an emphasis on lane topology and road semantics. This survey systematically reviews four core research…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Yixiao Chen , Ruining Yang , Xin Chen , Jia He , Dongliang Xu , Yue Yao

Autonomous surface vessels (ASV) represent a promising technology to automate water-quality monitoring of lakes. In this work, we use satellite images as a coarse map and plan sampling routes for the robot. However, inconsistency between…

Robotics · Computer Science 2023-05-01 Yizhou Huang , Hamza Dugmag , Timothy D. Barfoot , Florian Shkurti

This thesis presents a solution that enables aerial robots to reason about surrounding wind flow fields in real time using on board sensors and embedded flight hardware. The core novelty of this research is the fusion of range measurements…

Robotics · Computer Science 2026-04-02 Spencer Folk

Visual Semantic Navigation (VSN) is the ability of a robot to learn visual semantic information for navigating in unseen environments. These VSN models are typically tested in those virtual environments where they are trained, mainly using…