English
Related papers

Related papers: Failure-Aware Iterative Learning of State-Control …

200 papers

Model-free or learning-based control, in particular, reinforcement learning (RL), is expected to be applied for complex robotic tasks. Traditional RL requires a policy to be optimized is state-dependent, that means, the policy is a kind of…

Machine Learning · Computer Science 2022-08-09 Taisuke Kobayashi , Kenta Yoshizawa

We present a method for incremental modeling and time-varying control of unknown nonlinear systems. The method combines elements of evolving intelligence, granular machine learning, and multi-variable control. We propose a State-Space…

Systems and Control · Electrical Eng. & Systems 2021-02-19 Daniel Leite , Pedro Coutinho , Iury Bessa , Murilo Camargos , Luiz Cordovil Junior , Reinaldo Palhares

Estimating statistical uncertainties allows autonomous agents to communicate their confidence during task execution and is important for applications in safety-critical domains such as autonomous driving. In this work, we present the…

Machine Learning · Computer Science 2019-05-09 Yuchen Cui , David Isele , Scott Niekum , Kikuo Fujimura

In this paper we introduce a new unsupervised reinforcement learning method for discovering the set of intrinsic options available to an agent. This set is learned by maximizing the number of different states an agent can reliably reach, as…

Machine Learning · Computer Science 2016-11-23 Karol Gregor , Danilo Jimenez Rezende , Daan Wierstra

This paper employs a policy iteration reinforcement learning (RL) method to study continuous-time linear-quadratic mean-field control problems in infinite horizon. The drift and diffusion terms in the dynamics involve the states, the…

Optimization and Control · Mathematics 2024-11-05 Na Li , Xun Li , Zuo Quan Xu

Various spacecraft have sensors that repeatedly perform a prescribed scanning maneuver, and one may want high precision. Iterative Learning Control (ILC) records previous run tracking error, adjusts the next run command, aiming for zero…

Systems and Control · Electrical Eng. & Systems 2023-08-01 Richard W. Longman , Shuo Liu , Tarek A. Elsharhawy

We propose an iterative approach for designing Robust Learning Model Predictive Control (LMPC) policies for a class of nonlinear systems with additive, unmodelled dynamics. The nominal dynamics are assumed to be difference flat, i.e., the…

Systems and Control · Electrical Eng. & Systems 2023-03-23 Siddharth H. Nair , Francesco Borrelli

The sudden onset of deleterious and oscillatory dynamics (often called instabilities) is a known challenge in many fluid, plasma, and aerospace systems. These dynamics are difficult to address because they are nonlinear, chaotic, and are…

Machine Learning · Computer Science 2024-05-31 John W. Brooks , Christine M. Greve

Due to the distinct objectives and multipath utilization mechanisms between the communication module and radar module, the system design of integrated sensing and communication (ISAC) necessitates two types of channel state information…

Signal Processing · Electrical Eng. & Systems 2024-09-26 Jie Chen , Xianbin Wang

It is shown that static error fields (EFs) can severely limit the maximum rotation frequency achievable in mode entrainment by applied rotating fields. It is also shown that the rotation non-uniformities caused by an EF can be used to…

Plasma Physics · Physics 2019-05-01 Wilkie Choi , Francesco Volpe

This paper proposes an inverse optimal control method which enables a robot to incrementally learn a control objective function from a collection of trajectory segments. By saying incrementally, it means that the collection of trajectory…

Robotics · Computer Science 2022-02-03 Zihao Liang , Wanxin Jin , Shaoshuai Mou

Being able to quickly adapt to changes in dynamics is paramount in model-based control for object manipulation tasks. In order to influence fast adaptation of the inverse dynamics model's parameters, data efficiency is crucial. Given…

Robotics · Computer Science 2022-11-28 Kristen Morse , Neha Das , Yixin Lin , Austin S. Wang , Akshara Rai , Franziska Meier

We consider the setting of iterative learning control, or model-based policy learning in the presence of uncertain, time-varying dynamics. In this setting, we propose a new performance metric, planning regret, which replaces the standard…

Machine Learning · Computer Science 2021-03-01 Naman Agarwal , Elad Hazan , Anirudha Majumdar , Karan Singh

A Learning Model Predictive Controller (LMPC) for linear system in presented. The proposed controller is an extension of the LMPC [1] and it aims to decrease the computational burden. The control scheme is reference-free and is able to…

Optimization and Control · Mathematics 2019-10-31 Ugo Rosolia , Francesco Borrelli

This work presents a novel Learning Model Predictive Control (LMPC) strategy for autonomous racing at the handling limit that can iteratively explore and learn unknown dynamics in high-speed operational domains. We start from existing LMPC…

Robotics · Computer Science 2024-08-22 Haoru Xue , Edward L. Zhu , John M. Dolan , Francesco Borrelli

We present a stochastic model predictive control (MPC) method for linear discrete-time systems subject to possibly unbounded and correlated additive stochastic disturbance sequences. Chance constraints are treated in analogy to robust MPC…

Systems and Control · Computer Science 2019-01-23 Lukas Hewing , Kim P. Wabersich , Melanie N. Zeilinger

In this paper, we have proposed a resilient reinforcement learning method for discrete-time linear systems with unknown parameters, under denial-of-service (DoS) attacks. The proposed method is based on policy iteration that learns the…

Systems and Control · Electrical Eng. & Systems 2024-09-13 Sayan Chakraborty , Weinan Gao , Kyriakos G. Vamvoudakis , Zhong-Ping Jiang

This work investigates the challenge of ensuring safety guarantees in the presence of uncontrollable agents, whose behaviors are stochastic and depend on both their own and the system's states. We present a neural model predictive control…

Systems and Control · Electrical Eng. & Systems 2026-04-21 Shuqi Wang , Mingyang Feng , Yu Chen , Yue Gao , Xiang Yin

Effective navigation intelligence relies on long-term memory to support both immediate generalization and sustained adaptation. However, existing approaches face a dilemma: modular systems rely on explicit mapping but lack flexibility,…

Machine Learning · Computer Science 2026-03-26 Zhiyuan Chen , Yuxuan Zhong , Fan Wang , Bo Yu , Pengtao Shao , Shaoshan Liu , Ning Ding

This paper investigates adaptive model predictive control (MPC) for a class of constrained linear systems with unknown model parameters. This is also posed as the dual control problem consisting of system identification and regulation. We…

Optimization and Control · Mathematics 2020-11-24 Kunwu Zhang , Yang Shi