English
Related papers

Related papers: Learning When to Trust a Dynamics Model for Planni…

200 papers

Trajectory planning tasks for non-holonomic or collaborative systems are naturally modeled by state spaces with non-Euclidean metrics. However, existing proofs of convergence for sample-based motion planners only consider the setting of…

Robotics · Computer Science 2023-06-29 Anton Lukyanenko , Damoon Soudbakhsh

Large scale dynamical systems (e.g. many nonlinear coupled differential equations) can often be summarized in terms of only a few state variables (a few equations), a trait that reduces complexity and facilitates exploration of behavioral…

In this paper, we present an innovative risk-bounded motion planning methodology for stochastic multi-agent systems. For this methodology, the disturbance, noise, and model uncertainty are considered; and a velocity obstacle method is…

Robotics · Computer Science 2022-02-22 Xiaoxue Zhang , Jun Ma , Zilong Cheng , Masayoshi Tomizuka , Tong Heng Lee

Dyna-style model-based reinforcement learning contains two phases: model rollouts to generate sample for policy learning and real environment exploration using current policy for dynamics model learning. However, due to the complex…

Machine Learning · Computer Science 2024-01-02 Xiyao Wang , Ruijie Zheng , Yanchao Sun , Ruonan Jia , Wichayaporn Wongkamjan , Huazhe Xu , Furong Huang

While modern policy optimization methods can do complex manipulation from sensory data, they struggle on problems with extended time horizons and multiple sub-goals. On the other hand, task and motion planning (TAMP) methods scale to long…

Robotics · Computer Science 2021-12-08 Michael James McDonald , Dylan Hadfield-Menell

Machine learning systems are often used in settings where individuals adapt their features to obtain a desired outcome. In such settings, strategic behavior leads to a sharp loss in model performance in deployment. In this work, we aim to…

Machine Learning · Computer Science 2021-06-11 Yatong Chen , Jialu Wang , Yang Liu

In this paper, we consider the learning of a Reduced-Order Linear Parameter-Varying Model (ROLPVM) of a nonlinear dynamical system based on data. This is achieved by a two-step procedure. In the first step, we learn a projection to a lower…

Systems and Control · Electrical Eng. & Systems 2024-05-21 Patrick J. W. Koelewijn , Rajiv Sing , Peter Seiler , Roland Tóth

The state space dynamics representation is the most general approach for nonlinear systems and often chosen for system identification. During training, the state trajectory can deform significantly leading to poor data coverage of the state…

Machine Learning · Computer Science 2025-07-11 Hermann Klein , Max Heinz Herkersdorf , Oliver Nelles

The reinforcement learning algorithms that focus on how to compute the gradient and choose next actions, are effectively improved the performance of the agents. However, these algorithms are environment-agnostic. This means that the…

Machine Learning · Computer Science 2023-11-28 Pouya Parsa , Raoof Zare Moayedi , Mohammad Bornosi , Mohammad Mahdi Bejani

Manipulation tasks often require a robot to adjust its sensorimotor skills based on the state it finds itself in. Taking peg-in-hole as an example: once the peg is aligned with the hole, the robot should push the peg downwards. While high…

Robotics · Computer Science 2022-03-07 Toki Migimatsu , Wenzhao Lian , Jeannette Bohg , Stefan Schaal

In many reinforcement learning (RL) applications, we want policies that reach desired states and then keep the controlled system within an acceptable region around the desired states over an indefinite period of time. This latter objective…

Machine Learning · Computer Science 2024-05-28 Brahma S. Pavse , Matthew Zurek , Yudong Chen , Qiaomin Xie , Josiah P. Hanna

This paper focuses on the identification of dynamical systems with tailor-made model structures, where neural networks are used to approximate uncertain components and domain knowledge is retained, if available. These model structures are…

Machine Learning · Computer Science 2021-10-29 Marco Forgione , Dario Piga

Autonomous navigation through unknown environments is a challenging task that entails real-time localization, perception, planning, and control. UAVs with this capability have begun to emerge in the literature with advances in lightweight…

Robotics · Computer Science 2019-06-18 Jesus Tordesillas , Brett T. Lopez , John Carter , John Ware , Jonathan P. How

The study of model bias and variance with respect to decision boundaries is critically important in supervised classification. There is generally a tradeoff between the two, as fine-tuning of the decision boundary of a classification model…

Machine Learning · Computer Science 2020-02-25 Matthew Almeida , Wei Ding , Scott Crouter , Ping Chen

In model-based reinforcement learning, planning with an imperfect model of the environment has the potential to harm learning progress. But even when a model is imperfect, it may still contain information that is useful for planning. In…

Machine Learning · Computer Science 2021-03-09 Zaheer Abbas , Samuel Sokota , Erin J. Talvitie , Martha White

We investigate robust model-free reinforcement learning algorithms designed for environments that may be dynamic or even adversarial. Traditional state-based policies often struggle to accommodate the challenges imposed by the presence of…

Machine Learning · Computer Science 2023-11-02 Udaya Ghai , Arushi Gupta , Wenhan Xia , Karan Singh , Elad Hazan

Navigating safely in dynamic human environments is crucial for mobile service robots, and social navigation is a key aspect of this process. In this paper, we proposed an integrative approach that combines motion prediction and trajectory…

Robotics · Computer Science 2024-11-05 Thanh Nguyen Canh , Xiem HoangVan , Nak Young Chong

Training robot manipulation policies is a challenging and open problem in robotics and artificial intelligence. In this paper we propose a novel and compact state representation based on the rewards predicted from an image-based task…

Robotics · Computer Science 2021-12-13 Cédérick Mouliets , Isabelle Ferrané , Heriberto Cuayáhuitl

The utilization of model checking has been suggested as a formal verification technique for analyzing critical systems. However, the primary challenge in applying to complex systems is state space explosion problem. To address this issue,…

Logic in Computer Science · Computer Science 2023-08-08 Mohammadsadegh Mohaghegh , Khayyam Salehi

Hamilton Jacobi (HJ) Reachability is a formal verification tool widely used in robotic safety analysis. Given a target set as unsafe states, a dynamical system is guaranteed not to enter the target under the worst-case disturbance if it…

Optimization and Control · Mathematics 2020-03-18 Anjian Li , Mo Chen