English
Related papers

Related papers: Online Learning for Obstacle Avoidance

200 papers

In this paper, we present an online reinforcement learning algorithm for constrained Markov decision processes with a safety constraint. Despite the necessary attention of the scientific community, considering stochastic stopping time, the…

Machine Learning · Computer Science 2024-03-26 Abhijit Mazumdar , Rafal Wisniewski , Manuela L. Bujorianu

Real-world evaluation of perception-based planning models for robotic systems, such as autonomous vehicles, can be safely and inexpensively conducted offline, i.e. by computing model prediction error over a pre-collected validation dataset…

Robotics · Computer Science 2025-11-11 Animikh Aich , Adwait Kulkarni , Eshed Ohn-Bar

Online motion planning is a challenging problem for intelligent robots moving in dense environments with dynamic obstacles, e.g., crowds. In this work, we propose a novel approach for optimal and safe online motion planning with minimal…

Artificial Intelligence · Computer Science 2025-01-17 Lorenzo Bonanni , Daniele Meli , Alberto Castellini , Alessandro Farinelli

Multi-objective Markov decision processes are a special kind of multi-objective optimization problem that involves sequential decision making while satisfying the Markov property of stochastic processes. Multi-objective reinforcement…

Machine Learning · Computer Science 2023-08-22 Sherif Abdelfattah , Kathryn Kasmarik , Jiankun Hu

We consider the adaptive routing problem in multihop wireless networks. The link states are assumed to be random variables drawn from unknown distributions, independent and identically distributed across links and time. This model has…

Networking and Internet Architecture · Computer Science 2022-04-08 Omer Amar , Kobi Cohen

The design of online algorithms has tended to focus on algorithms with worst-case guarantees, e.g., bounds on the competitive ratio. However, it is well-known that such algorithms are often overly pessimistic, performing sub-optimally on…

Data Structures and Algorithms · Computer Science 2020-12-11 Ali Zeynali , Bo Sun , Mohammad Hajiesmaili , Adam Wierman

In this paper we propose a model-based approach to the design of online optimization algorithms, with the goal of improving the tracking of the solution trajectory (trajectories) w.r.t. state-of-the-art methods. We focus first on quadratic…

Optimization and Control · Mathematics 2023-07-24 Nicola Bastianello , Ruggero Carli , Sandro Zampieri

We present an extensive study of the key problem of online learning where algorithms are allowed to abstain from making predictions. In the adversarial setting, we show how existing online algorithms and guarantees can be adapted to this…

Machine Learning · Computer Science 2019-11-15 Corinna Cortes , Giulia DeSalvo , Claudio Gentile , Mehryar Mohri , Scott Yang

This paper introduces a graph-based, potential-guided method for path planning problems in unknown environments, where obstacles are unknown until the robots are in close proximity to the obstacle locations. Inspired by optimal transport…

Optimization and Control · Mathematics 2019-09-26 Haoyan Zhai , Magnus Egerstedt , Haomin Zhou

In this dissertation we study statistical and online learning problems from an optimization viewpoint.The dissertation is divided into two parts : I. We first consider the question of learnability for statistical learning problems in the…

Machine Learning · Computer Science 2012-04-19 Karthik Sridharan

Robotic systems must be able to quickly and robustly make decisions when operating in uncertain and dynamic environments. While Reinforcement Learning (RL) can be used to compute optimal policies with little prior knowledge about the…

Robotics · Computer Science 2016-09-13 Yunpeng Pan , Xinyan Yan , Evangelos Theodorou , Byron Boots

Collision-free navigation in cluttered environments with static and dynamic obstacles is essential for many multi-robot tasks. Dynamic obstacles may also be interactive, i.e., their behavior varies based on the behavior of other entities.…

Robotics · Computer Science 2024-05-21 Baskın Şenbaşlar , Gaurav S. Sukhatme

Obstacle avoidance from monocular images is a challenging problem for robots. Though multi-view structure-from-motion could build 3D maps, it is not robust in textureless environments. Some learning based methods exploit human demonstration…

Robotics · Computer Science 2017-05-01 Shichao Yang , Sandeep Konam , Chen Ma , Stephanie Rosenthal , Manuela Veloso , Sebastian Scherer

We investigate robust model-free reinforcement learning algorithms designed for environments that may be dynamic or even adversarial. Traditional state-based policies often struggle to accommodate the challenges imposed by the presence of…

Machine Learning · Computer Science 2023-11-02 Udaya Ghai , Arushi Gupta , Wenhan Xia , Karan Singh , Elad Hazan

To obtain a near-optimal policy with fewer interactions in Reinforcement Learning (RL), a promising approach involves the combination of offline RL, which enhances sample efficiency by leveraging offline datasets, and online RL, which…

Machine Learning · Computer Science 2024-11-18 Xiaoyu Wen , Xudong Yu , Rui Yang , Haoyuan Chen , Chenjia Bai , Zhen Wang

This paper presents a novel learning-based approach for online estimation of maximal safe sets for local trajectory planning in unknown static environments. The neural representation of a set is used as the terminal set constraint for a…

Robotics · Computer Science 2025-07-17 Bojan Derajić , Mohamed-Khalil Bouzidi , Sebastian Bernhard , Wolfgang Hönig

Real-time control is an essential aspect of safe robot operation in the real world with dynamic objects. We present a framework for the analysis of object-aware controllers, methods for altering a robot's motion to anticipate and avoid…

Robotics · Computer Science 2025-10-29 Caleb Escobedo , Nataliya Nechyporenko , Shreyas Kadekodi , Alessandro Roncone

Unmanned Aerial Vehicles need an online path planning capability to move in high-risk missions in unknown and complex environments to complete them safely. However, many algorithms reported in the literature may not return reliable…

This paper presents a solution for the problem of optimal planning for a robot in a collaborative human-robot team, where the human supervisor is intermittently available to assist the robot in completing tasks more quickly. Specifically,…

Robotics · Computer Science 2023-07-11 Abhinav Dahiya , Stephen L. Smith

Model-based offline optimization with dynamics-aware policy provides a new perspective for policy learning and out-of-distribution generalization, where the learned policy could adapt to different dynamics enumerated at the training stage.…

Machine Learning · Computer Science 2022-06-09 Chengxing Jia , Hao Yin , Chenxiao Gao , Tian Xu , Lei Yuan , Zongzhang Zhang , Yang Yu