English
Related papers

Related papers: Improving the performance of Learned Controllers i…

200 papers

Gradient boosted trees are competition-winning, general-purpose, non-parametric regressors, which exploit sequential model fitting and gradient descent to minimize a specific loss function. The most popular implementations are tailored to…

Machine Learning · Computer Science 2022-08-23 Lorenzo Nespoli , Vasco Medici

Decision trees are renowned for their ability to achieve high predictive performance while remaining interpretable, especially on tabular data. Traditionally, they are constructed through recursive algorithms, where they partition the data…

Machine Learning · Computer Science 2024-08-27 Yufan Zhuang , Liyuan Liu , Chandan Singh , Jingbo Shang , Jianfeng Gao

One of the main features of adaptive systems is an oscillatory convergence that exacerbates with the speed of adaptation. Recently it has been shown that Closed-loop Reference Models (CRMs) can result in improved transient performance over…

Systems and Control · Computer Science 2013-10-04 Travis E. Gibson , Anuradha M. Annaswamy , Eugene Lavretsky

A fundamental question in neuroscience is how the brain creates an internal model of the world to guide actions using sequences of ambiguous sensory information. This is naturally formulated as a reinforcement learning problem under partial…

Machine Learning · Computer Science 2020-11-02 Minhae Kwon , Saurabh Daptardar , Paul Schrater , Xaq Pitkow

Value functions are a central component of deep reinforcement learning (RL). These functions, parameterized by neural networks, are trained using a mean squared error regression objective to match bootstrapped target values. However,…

The best-performing models in ML are not interpretable. If we can explain why they outperform, we may be able to replicate these mechanisms and obtain both interpretability and performance. One example are decision trees and their…

Machine Learning · Statistics 2023-02-09 Hugh Panton , Gavin Leech , Laurence Aitchison

We study the problem of policy repair for learning-based control policies in safety-critical settings. We consider an architecture where a high-performance learning-based control policy (e.g. one trained as a neural network) is paired with…

Artificial Intelligence · Computer Science 2020-08-19 Weichao Zhou , Ruihan Gao , BaekGyu Kim , Eunsuk Kang , Wenchao Li

Motivated by perception-based control problems in autonomous systems, this paper addresses the problem of developing feedback controllers to regulate the inputs and the states of a dynamical system to optimal solutions of an optimization…

Systems and Control · Electrical Eng. & Systems 2023-10-17 Liliaokeawawa Cothren , Gianluca Bianchin , Sarah Dean , Emiliano Dall'Anese

In Reinforcement Learning (abbreviated as RL), an agent interacts with the environment via a set of possible actions, and a reward is generated from some unknown distribution. The task here is to find an optimal set of actions such that the…

Machine Learning · Computer Science 2025-07-21 Aditi Anand , Suman Banerjee , Dildar Ali

In this paper, we propose a generic framework for devising an adaptive approximation scheme for value function approximation in reinforcement learning, which introduces multiscale approximation. The two basic ingredients are multiresolution…

Machine Learning · Computer Science 2019-08-26 Tao Li , Quanyan Zhu

We consider a class of learning problem of point estimation for modeling high-dimensional nonlinear functions, whose learning dynamics is guided by model training dataset, while the estimated parameter in due course provides an acceptable…

Optimization and Control · Mathematics 2024-10-29 Getachew K. Befekadu

We study the distributed detection problem in a balanced binary relay tree, where the leaves of the tree are sensors generating binary messages. The root of the tree is a fusion center that makes the overall decision. Every other node in…

Information Theory · Computer Science 2012-10-17 Zhenliang Zhang , Edwin K. P. Chong , Ali Pezeshki , William Moran , Stephen D. Howard

We propose a hybrid combination of active inference and behavior trees (BTs) for reactive action planning and execution in dynamic environments, showing how robotic tasks can be formulated as a free-energy minimization problem. The proposed…

Robotics · Computer Science 2022-11-28 Corrado Pezzato , Carlos Hernandez Corbato , Stefan Bonhof , Martijn Wisse

Industrial robots can solve very complex tasks in controlled environments, but modern applications require robots able to operate in unpredictable surroundings as well. An increasingly popular reactive policy architecture in robotics is…

Robotics · Computer Science 2021-03-17 Jonathan Styrud , Matteo Iovino , Mikael Norrlöf , Mårten Björkman , Christian Smith

In several applications of automatic diagnosis and active learning a central problem is the evaluation of a discrete function by adaptively querying the values of its variables until the values read uniquely determine the value of the…

Data Structures and Algorithms · Computer Science 2014-07-29 Ferdinando Cicalese , Eduardo Laber , Aline Medeiros Saettler

Learned models of the environment provide reinforcement learning (RL) agents with flexible ways of making predictions about the environment. In particular, models enable planning, i.e. using more computation to improve value functions or…

Machine Learning · Computer Science 2021-10-26 Gregory Farquhar , Kate Baumli , Zita Marinho , Angelos Filos , Matteo Hessel , Hado van Hasselt , David Silver

In this theoretical paper we are concerned with the problem of learning a value function by a smooth general function approximator, to solve a deterministic episodic control problem in a large continuous state space. It is shown that…

Machine Learning · Computer Science 2011-01-04 Michael Fairbank , Eduardo Alonso

In this work, we use optimal control to change the behavior of a deep reinforcement learning policy by optimizing directly in the policy's latent space. We hypothesize that distinct behavioral patterns, termed behavioral modes, can be…

Machine Learning · Computer Science 2024-06-05 Sindre Benjamin Remman , Bjørn Andreas Kristiansen , Anastasios M. Lekkas

Real-world control applications in complex and uncertain environments require adaptability to handle model uncertainties and robustness against disturbances. This paper presents an online, output-feedback, critic-only, model-based…

Systems and Control · Electrical Eng. & Systems 2023-04-04 Tochukwu Elijah Ogri , S. M. Nahid Mahmud , Zachary I. Bell , Rushikesh Kamalapurkar

People are often confronted with problems whose complexity exceeds their cognitive capacities. To deal with this complexity, individuals and managers can break complex problems down into a series of subgoals. Which subgoals are most…

Artificial Intelligence · Computer Science 2023-02-07 Nishad Singhi , Florian Mohnert , Ben Prystawski , Falk Lieder