English
Related papers

Related papers: Online inverse reinforcement learning with unknown…

200 papers

In this work we address the problem of the online robust control of nonlinear dynamical systems perturbed by disturbance. We study the problem of attenuation of the total cost over a duration $T$ in response to the disturbances. We consider…

Systems and Control · Electrical Eng. & Systems 2022-09-14 Deepan Muthirayan , Pramod P. Khargonekar

Agents in real-world scenarios like automated driving deal with uncertainty in their environment, in particular due to perceptual uncertainty. Although, reinforcement learning is dedicated to autonomous decision-making under uncertainty…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Natalie Grabowsky , Annika Mütze , Joshua Wendland , Nils Jansen , Matthias Rottmann

Multi-agent learning is a promising method to simulate aggregate competitive behaviour in finance. Learning expert agents' reward functions through their external demonstrations is hence particularly relevant for subsequent design of…

Machine Learning · Computer Science 2019-06-13 Jacobo Roa-Vicens , Cyrine Chtourou , Angelos Filos , Francisco Rullan , Yarin Gal , Ricardo Silva

We approach the fundamental problem of obstacle avoidance for robotic systems via the lens of online learning. In contrast to prior work that either assumes worst-case realizations of uncertainty in the environment or a stationary…

Robotics · Computer Science 2023-11-07 David Snyder , Meghan Booker , Nathaniel Simon , Wenhan Xia , Daniel Suo , Elad Hazan , Anirudha Majumdar

This paper investigates online identification and prediction for nonlinear stochastic dynamical systems. In contrast to offline learning methods, we develop online algorithms that learn unknown parameters from a single trajectory. A key…

Systems and Control · Electrical Eng. & Systems 2025-04-07 Lantian Zhang , Silun Zhang

In this paper, we propose an online learning-based predictive control (LPC) approach designed for nonlinear systems that lack explicit system dynamics. Unlike traditional model predictive control (MPC) algorithms that rely on known system…

Optimization and Control · Mathematics 2025-03-17 Yuanqing Zhang , Huanshui Zhang

Predicting the motion of a mobile agent from a third-person perspective is an important component for many robotics applications, such as autonomous navigation and tracking. With accurate motion prediction of other agents, robots can plan…

Robotics · Computer Science 2018-10-18 Yanfu Zhang , Wenshan Wang , Rogerio Bonatti , Daniel Maturana , Sebastian Scherer

Applying reinforcement learning to robotic systems poses a number of challenging problems. A key requirement is the ability to handle continuous state and action spaces while remaining within a limited time and resource budget.…

Machine Learning · Computer Science 2020-06-29 Benjamin van Niekerk , Andreas Damianou , Benjamin Rosman

Inferring the intent of an intelligent agent from demonstrations and subsequently predicting its behavior, is a critical task in many collaborative settings. A common approach to solve this problem is the framework of inverse reinforcement…

Machine Learning · Computer Science 2021-10-05 Samuel Tesfazgi , Armin Lederer , Sandra Hirche

The increasing adoption of Reinforcement Learning in safety-critical systems domains such as autonomous vehicles, health, and aviation raises the need for ensuring their safety. Existing safety mechanisms such as adversarial training,…

Machine Learning · Computer Science 2021-11-11 Paulina Stevia Nouwou Mindom , Amin Nikanjam , Foutse Khomh , John Mullins

This paper proposes a novel online data-driven adaptive control for unknown linear time-varying systems. Initialized with an empirical feedback gain, the algorithm periodically updates this gain based on the data collected over a short time…

Systems and Control · Electrical Eng. & Systems 2024-01-31 Shenyu Liu , Kaiwen Chen , Jaap Eising

We study offline reinforcement learning problems with a long-run average reward objective. The state-action pairs generated by any fixed behavioral policy thus follow a Markov chain, and the {\em empirical} state-action-next-state…

Optimization and Control · Mathematics 2025-03-18 Mengmeng Li , Daniel Kuhn , Tobias Sutter

Handling regime shifts and non-stationary time series in deep learning systems presents a significant challenge. In the case of online learning, when new information is introduced, it can disrupt previously stored data and alter the model's…

Machine Learning · Computer Science 2025-06-17 Matteo Benati , Alessandro Londei , Denise Lanzieri , Vittorio Loreto

Motion planning under uncertainty is one of the main challenges in developing autonomous driving vehicles. In this work, we focus on the uncertainty in sensing and perception, resulted from a limited field of view, occlusions, and sensing…

Robotics · Computer Science 2021-10-05 Kasra Rezaee , Peyman Yadmellat , Simon Chamorro

In Imitation Learning (IL), utilizing suboptimal and heterogeneous demonstrations presents a substantial challenge due to the varied nature of real-world data. However, standard IL algorithms consider these datasets as homogeneous, thereby…

Machine Learning · Computer Science 2024-12-16 Mark Beliaev , Ramtin Pedarsani

Identifying the dynamic properties of manipulated objects is essential for safe and accurate robot control. Most methods rely on low noise force torque sensors, long exciting signals, and solving nonlinear optimization problems, making the…

Robotics · Computer Science 2024-08-22 Donghoon Baek , Bo Peng , Saurabh Gupta , Joao Ramos

Deep reinforcement learning has great potential to acquire complex, adaptive behaviors for autonomous agents automatically. However, the underlying neural network polices have not been widely deployed in real-world applications, especially…

Robotics · Computer Science 2020-06-04 Tingxiang Fan , Pinxin Long , Wenxi Liu , Jia Pan , Ruigang Yang , Dinesh Manocha

Reinforcement learning (RL) is promising for complicated stochastic nonlinear control problems. Without using a mathematical model, an optimal controller can be learned from data evaluated by certain performance criteria through…

Systems and Control · Electrical Eng. & Systems 2020-11-16 Minghao Han , Yuan Tian , Lixian Zhang , Jun Wang , Wei Pan

In this paper, we formulate inverse reinforcement learning (IRL) as an expert-learner interaction whereby the optimal performance intent of an expert or target agent is unknown to a learner agent. The learner observes the states and…

Machine Learning · Computer Science 2023-01-06 Wenqian Xue , Bosen Lian , Jialu Fan , Tianyou Chai , Frank L. Lewis

This paper presents a novel model-reference reinforcement learning control method for uncertain autonomous surface vehicles. The proposed control combines a conventional control method with deep reinforcement learning. With the conventional…

Systems and Control · Electrical Eng. & Systems 2021-06-17 Qingrui Zhang , Wei Pan , Vasso Reppa