中文
相关论文

相关论文: An Efficient Off-Policy Reinforcement Learning Alg…

200 篇论文

This paper applies a reinforcement learning (RL) method to solve infinite horizon continuous-time stochastic linear quadratic problems, where drift and diffusion terms in the dynamics may depend on both the state and control. Based on…

最优化与控制 · 数学 2021-09-17 Na Li , Xun Li , Jing Peng , Zuo Quan Xu

In recent years, stabilizing unknown dynamical systems has became a critical problem in control systems engineering. Addressing this for linear time-invariant (LTI) systems is an essential fist step towards solving similar problems for more…

最优化与控制 · 数学 2025-08-08 Xinpei Zhang , Guangyan Jia

We consider the reinforcement learning (RL) problem with general utilities which consists in maximizing a function of the state-action occupancy measure. Beyond the standard cumulative reward RL setting, this problem includes as particular…

机器学习 · 计算机科学 2023-06-06 Anas Barakat , Ilyas Fatkhullin , Niao He

In offline reinforcement learning, a policy needs to be learned from a single pre-collected dataset. Typically, policies are thus regularized during training to behave similarly to the data generating policy, by adding a penalty based on a…

机器学习 · 计算机科学 2021-07-13 Phillip Swazinna , Steffen Udluft , Daniel Hein , Thomas Runkler

We study the problem of teaching via demonstrations in sequential decision-making tasks. In particular, we focus on the situation when the teacher has no access to the learner's model and policy, and the feedback from the learner is limited…

机器学习 · 计算机科学 2023-09-19 Rustam Zayanov , Francisco S. Melo , Manuel Lopes

Policy gradient methods in reinforcement learning update policy parameters by taking steps in the direction of an estimated gradient of policy value. In this paper, we consider the statistically efficient estimation of policy gradients from…

机器学习 · 统计学 2020-02-21 Nathan Kallus , Masatoshi Uehara

We consider the problem of off-policy evaluation for reinforcement learning, where the goal is to estimate the expected reward of a target policy $\pi$ using offline data collected by running a logging policy $\mu$. Standard…

机器学习 · 计算机科学 2020-07-09 Ming Yin , Yu-Xiang Wang

In this paper, the inverse reinforcement learning (IRL) problem is addressed to reconstruct the unknown cost function underlying an observed optimal policy in a model-free manner, whose online adaptation with completely off-policy system…

最优化与控制 · 数学 2025-11-20 Yibei Li , Yuexin Cao , Zhixin Liu , Lihua Xie

A key task in Artificial Intelligence is learning effective policies for controlling agents in unknown environments to optimize performance measures. Off-policy learning methods, like Q-learning, allow learners to make optimal decisions…

人工智能 · 计算机科学 2025-10-27 Mingxuan Li , Junzhe Zhang , Elias Bareinboim

This paper studies the data-driven synthesis of linear quadratic integral (LQI) controllers for continuous-time systems. The objective is to achieve optimal state-feedback control with integral action for reference tracking using only…

系统与控制 · 电气工程与系统科学 2026-04-17 Armin Gießler , Pol Jané-Soneira , Sören Hohmann

This work presents a technique for learning systems, where the learning process is guided by knowledge of the physics of the system. In particular, we solve the problem of the two-point boundary optimal control problem of linear…

系统与控制 · 电气工程与系统科学 2021-05-03 Vasanth Reddy , Hoda Eldardiry , Almuatazbellah Boker

The primary goal of reinforcement learning is to develop decision-making policies that prioritize optimal performance without considering risk or safety. In contrast, safe reinforcement learning aims to mitigate or avoid unsafe states. This…

机器学习 · 计算机科学 2024-09-13 Zahra Shahrooei , Ali Baheri

Traditional reinforcement learning lacks the ability to provide stability guarantees. More recent algorithms learn Lyapunov functions alongside the control policies to ensure stable learning. However, the current self-learned Lyapunov…

系统与控制 · 电气工程与系统科学 2026-01-19 Sarvan Gill , Daniela Constantinescu

We discuss the problem of decentralized multi-agent reinforcement learning (MARL) in this work. In our setting, the global state, action, and reward are assumed to be fully observable, while the local policy is protected as privacy by each…

多智能体系统 · 计算机科学 2021-11-02 Kuo Li , Qing-Shan Jia

This paper concerns the problem of learning control policies for an unknown linear dynamical system to minimize a quadratic cost function. We present a method, based on convex optimization, that accomplishes this task robustly: i.e., we…

最优化与控制 · 数学 2019-06-05 Jack Umenberger , Mina Ferizbegovic , Thomas B. Schön , Håkan Hjalmarsson

We consider the problem of building a state representation model in a continual fashion. As the environment changes, the aim is to efficiently compress the sensory state's information without losing past knowledge. The learned features are…

机器学习 · 计算机科学 2018-12-12 Hugo Caselles-Dupré , Michael Garcia-Ortiz , David Filliat

We study the problem of off-policy value evaluation in reinforcement learning (RL), where one aims to estimate the value of a new policy based on data collected by a different policy. This problem is often a critical step when applying RL…

机器学习 · 计算机科学 2016-05-27 Nan Jiang , Lihong Li

Effectively leveraging large, previously collected datasets in reinforcement learning (RL) is a key challenge for large-scale real-world applications. Offline RL algorithms promise to learn effective policies from previously-collected,…

机器学习 · 计算机科学 2020-08-20 Aviral Kumar , Aurick Zhou , George Tucker , Sergey Levine

Conventional reinforcement learning (RL) methods can successfully solve a wide range of sequential decision problems. However, learning policies that can generalize predictably across multiple tasks in a setting with non-Markovian reward…

机器学习 · 计算机科学 2024-06-04 Guillermo Infante , David Kuric , Anders Jonsson , Vicenç Gómez , Herke van Hoof

In this paper, we will deal with a Linear Quadratic Optimal Control problem with unknown dynamics. As a modeling assumption, we will suppose that the knowledge that an agent has on the current system is represented by a probability…

最优化与控制 · 数学 2022-01-13 Andrea Pesare , Michele Palladino , Maurizio Falcone