English
Related papers

Related papers: Improving Model-Based Control and Active Explorati…

200 papers

The problem of coverage control, i.e., of coordinating multiple agents to optimally cover an area, arises in various applications. However, coverage applications face two major challenges: (1) dealing with nonlinear dynamics while…

Systems and Control · Electrical Eng. & Systems 2024-04-01 Rahel Rickenbach , Johannes Köhler , Anna Scampicchio , Melanie N. Zeilinger , Andrea Carron

Robots must make and break contact with the environment to perform useful tasks, but planning and control through contact remains a formidable challenge. In this work, we achieve real-time contact-implicit model predictive control with a…

Robotics · Computer Science 2025-05-06 Vince Kurtz , Alejandro Castro , Aykut Özgün Önol , Hai Lin

We study the problem of safe learning and exploration in sequential control problems. The goal is to safely collect data samples from operating in an environment, in order to learn to achieve a challenging control goal (e.g., an agile…

Machine Learning · Computer Science 2020-06-30 Anqi Liu , Guanya Shi , Soon-Jo Chung , Anima Anandkumar , Yisong Yue

In imitation learning, an agent learns how to behave in an environment with an unknown cost function by mimicking expert demonstrations. Existing imitation learning algorithms typically involve solving a sequence of planning or…

Machine Learning · Computer Science 2016-06-17 Jonathan Ho , Jayesh K. Gupta , Stefano Ermon

Mathematical models simulate various events under different conditions, enabling an early overview of the system to be implemented in practice, reducing the waste of resources and in less time. In project optimization, these models play a…

Optimization and Control · Mathematics 2021-05-11 Gustavo Barbosa Libotte , Fran Sérgio Lobato , Francisco Duarte Moura Neto , Gustavo Mendes Platt

Uncertainty estimation is an essential step in the evaluation of the robustness for deep learning models in computer vision, especially when applied in risk-sensitive areas. However, most state-of-the-art deep learning models either fail to…

Computer Vision and Pattern Recognition · Computer Science 2022-01-12 Lu Mi , Hao Wang , Yonglong Tian , Hao He , Nir Shavit

This paper presents a novel model-reference reinforcement learning control method for uncertain autonomous surface vehicles. The proposed control combines a conventional control method with deep reinforcement learning. With the conventional…

Systems and Control · Electrical Eng. & Systems 2021-06-17 Qingrui Zhang , Wei Pan , Vasso Reppa

This paper investigates the automatic exploration problem under the unknown environment, which is the key point of applying the robotic system to some social tasks. The solution to this problem via stacking decision rules is impossible to…

Robotics · Computer Science 2020-07-24 Haoran Li , Qichao Zhang , Dongbin Zhao

Besides parametric uncertainties and disturbances, the unmodeled dynamics and time delay at the input are often present in practical systems, which cannot be ignored in some cases. This paper aims to solve output feedback tracking control…

Systems and Control · Computer Science 2020-03-10 Quan Quan , Hai Lin , Kai-Yuan Cai

Existing well investigated Predictive Process Monitoring techniques typically construct a predictive model based on past process executions, and then use it to predict the future of new ongoing cases, without the possibility of updating it…

Machine Learning · Computer Science 2023-10-26 Williams Rizzi , Chiara Di Francescomarino , Chiara Ghidini , Fabrizio Maria Maggi

In model-based reinforcement learning, planning with an imperfect model of the environment has the potential to harm learning progress. But even when a model is imperfect, it may still contain information that is useful for planning. In…

Machine Learning · Computer Science 2021-03-09 Zaheer Abbas , Samuel Sokota , Erin J. Talvitie , Martha White

Offline reinforcement learning enables agents to leverage large pre-collected datasets of environment transitions to learn control policies, circumventing the need for potentially expensive or unsafe online data collection. Significant…

Machine Learning · Computer Science 2022-03-17 Cong Lu , Philip J. Ball , Jack Parker-Holder , Michael A. Osborne , Stephen J. Roberts

Traffic prediction is a crucial topic because of its broad scope of applications in the transportation domain. Recently, various studies have achieved promising results. However, most studies assume the prediction locations have complete or…

Machine Learning · Computer Science 2024-02-07 Hao Mei , Junxian Li , Zhiming Liang , Guanjie Zheng , Bin Shi , Hua Wei

The effects of model parameter uncertainty on traffic flow control problems have recently drawn research attention. While the uncertainty in fundamental diagram related parameters has been investigated in the past, few articles have focused…

Optimization and Control · Mathematics 2021-03-09 Hao Liu , Christian Claudel , Randy Machemehl , Kenneth A. Perrine

Increasingly demanding performance requirements for dynamical systems motivates the adoption of nonlinear and adaptive control techniques. One challenge is the nonlinearity of the resulting closed-loop system complicates verification that…

Systems and Control · Computer Science 2017-10-03 John F. Quindlen , Ufuk Topcu , Girish Chowdhary , Jonathan P. How

Adaptive exploration methods propose ways to learn complex policies via alternating between exploration and exploitation. An important question for such methods is to determine the appropriate moment to switch between exploration and…

Artificial Intelligence · Computer Science 2026-02-11 Leonidas Bakopoulos , Georgios Chalkiadakis

We study the robustness of system estimation to parametric perturbations in system dynamics and initial conditions. We define the problem of sensitivity-based parametric uncertainty quantification in dynamical system estimation. The main…

Systems and Control · Electrical Eng. & Systems 2025-09-09 Ayush Pandey

In this paper, we present a robotic model-based reinforcement learning method that combines ideas from model identification and model predictive control. We use a feature-based representation of the dynamics that allows the dynamics model…

Machine Learning · Computer Science 2016-03-16 Christopher Xie , Sachin Patil , Teodor Moldovan , Sergey Levine , Pieter Abbeel

Agents in real-world scenarios like automated driving deal with uncertainty in their environment, in particular due to perceptual uncertainty. Although, reinforcement learning is dedicated to autonomous decision-making under uncertainty…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Natalie Grabowsky , Annika Mütze , Joshua Wendland , Nils Jansen , Matthias Rottmann

Stochastic Model Predictive Control has proved to be an efficient method to plan trajectories in uncertain environments, e.g., for autonomous vehicles. Chance constraints ensure that the probability of collision is bounded by a predefined…

Systems and Control · Electrical Eng. & Systems 2021-05-17 Tim Brüdigam , Fulvio di Luzio , Lucia Pallottino , Dirk Wollherr , Marion Leibold