English
Related papers

Related papers: Reinforcement Control with Hierarchical Backpropag…

200 papers

This paper discusses learning a structured feedback control to obtain sufficient robustness to exogenous inputs for linear dynamic systems with unknown state matrix. The structural constraint on the controller is necessary for many…

Systems and Control · Electrical Eng. & Systems 2021-02-23 Sayak Mukherjee , Thanh Long Vu

This paper proposes a framework for adaptively learning a feedback linearization-based tracking controller for an unknown system using discrete-time model-free policy-gradient parameter update rules. The primary advantage of the scheme over…

Machine Learning · Computer Science 2020-04-07 Tyler Westenbroek , Eric Mazumdar , David Fridovich-Keil , Valmik Prabhu , Claire J. Tomlin , S. Shankar Sastry

An iterative learning based economic model predictive controller (ILEMPC) is proposed for repetitive tasks in this paper. Compared with existing works, the initial feasible trajectory of the proposed ILEMPC is not restricted to be…

Systems and Control · Computer Science 2018-02-13 Yushen Long , Lihua Xie , Shuai Liu

Nonlinear optimal control problems are often solved with numerical methods that require knowledge of system's dynamics which may be difficult to infer, and that carry a large computational cost associated with iterative calculations. We…

Machine Learning · Computer Science 2019-03-08 Ekaterina Abramova , Luke Dickens , Daniel Kuhn , Aldo Faisal

Health-aware control (HAC) has emerged as one of the domains where control synthesis is sought based upon the failure prognostics of system/component or the Remaining Useful Life (RUL) predictions of critical components. The fact that…

Artificial Intelligence · Computer Science 2020-10-20 Mayank Shekhar Jha , Philippe Weber , Didier Theilliol , Jean-Christophe Ponsart , Didier Maquin

According to cognitive psychology and related disciplines, the development of complex problem-solving behaviour in biological agents depends on hierarchical cognitive mechanisms. Hierarchical reinforcement learning is a promising…

Artificial Intelligence · Computer Science 2022-08-19 Manfred Eppe , Christian Gumbsch , Matthias Kerzel , Phuong D. H. Nguyen , Martin V. Butz , Stefan Wermter

Intelligent agents must be able to think fast and slow to perform elaborate manipulation tasks. Reinforcement Learning (RL) has led to many promising results on a range of challenging decision-making tasks. However, in real-world robotics,…

Robotics · Computer Science 2021-10-22 Maximilian Ulmer , Elie Aljalbout , Sascha Schwarz , Sami Haddadin

Most existing dialogue systems are user-driven, primarily designed to fulfill user requests. However, in many critical real-world scenarios, a conversational agent must proactively extract information to achieve its own objectives rather…

Computation and Language · Computer Science 2026-05-18 Xubo Lin , Zezhi Deng , Shihao Wang , Grace Hui Yang , Yang Deng

This paper presents an Impedance Primitive-augmented hierarchical reinforcement learning framework for efficient robotic manipulation in sequential contact tasks. We leverage this hierarchical structure to sequentially execute behavior…

Robotics · Computer Science 2025-08-28 Amin Berjaoui Tahmaz , Ravi Prakash , Jens Kober

We consider the problem of robust and adaptive model predictive control (MPC) of a linear system, with unknown parameters that are learned along the way (adaptive), in a critical setting where failures must be prevented (robust). This…

Machine Learning · Computer Science 2020-10-22 Edouard Leurent , Denis Efimov , Odalric-Ambrym Maillard

Inverse reinforcement learning (IRL) aims to learn a reward function and a corresponding policy that best fit the demonstrated trajectories of an expert. However, current IRL works cannot learn incrementally from an ongoing trajectory…

Machine Learning · Computer Science 2025-07-24 Shicheng Liu , Minghui Zhu

Many real-world control problems involve both discrete decision variables - such as the choice of control modes, gear switching or digital outputs - as well as continuous decision variables - such as velocity setpoints, control gains or…

Class-Incremental Learning aims to update a deep classifier to learn new categories while maintaining or improving its accuracy on previously observed classes. Common methods to prevent forgetting previously learned classes include…

Machine Learning · Computer Science 2024-07-02 Elif Ceren Gok Yildirim , Murat Onur Yildirim , Mert Kilickaya , Joaquin Vanschoren

Learning to flexibly follow task instructions in dynamic environments poses interesting challenges for reinforcement learning agents. We focus here on the problem of learning control flow that deviates from a strict step-by-step execution…

Machine Learning · Computer Science 2021-06-30 Ethan A. Brooks , Janarthanan Rajendran , Richard L. Lewis , Satinder Singh

Human beings learn and accumulate hierarchical knowledge over their lifetime. This knowledge is associated with previous concepts for consolidation and hierarchical construction. However, current incremental learning methods lack the…

Computer Vision and Pattern Recognition · Computer Science 2021-10-25 Kai Wang , Xialei Liu , Luis Herranz , Joost van de Weijer

Reinforcement Learning (RL) techniques have drawn great attention in many challenging tasks, but their performance deteriorates dramatically when applied to real-world problems. Various methods, such as domain randomization, have been…

Machine Learning · Computer Science 2022-08-05 Wangyang Yue , Yuan Zhou , Xiaochuan Zhang , Yuchen Hua , Zhiyuan Wang , Guang Kou

Solving long-horizon goal-conditioned tasks remains a significant challenge in reinforcement learning (RL). Hierarchical reinforcement learning (HRL) addresses this by decomposing tasks into more manageable sub-tasks, but the automatic…

Machine Learning · Computer Science 2025-09-09 Yang Yu

In this paper, we propose a novel Reinforcement Learning approach for solving the Active Information Acquisition problem, which requires an agent to choose a sequence of actions in order to acquire information about a process of interest…

Machine Learning · Computer Science 2019-10-25 Heejin Jeong , Brent Schlotfeldt , Hamed Hassani , Manfred Morari , Daniel D. Lee , George J. Pappas

Collocated adaptive control of underactuated systems is still a main concern for the control community, all the more so because the collocated dynamics is no longer linear with respect to the constant base parameters. This work extends and…

Systems and Control · Computer Science 2014-05-21 Francesco Romano , Daniele Pucci , Francesco Nori

Humans have the ability to deviate from their natural behavior when necessary, which is a cognitive process called response inhibition. Similar approaches have independently received increasing attention in recent years for ensuring the…

Systems and Control · Electrical Eng. & Systems 2023-10-04 Armin Lederer , Erfaun Noorani , John S. Baras , Sandra Hirche