English
Related papers

Related papers: State-free Reinforcement Learning

200 papers

We adapt reinforcement learning (RL) methods for continuous control to bridge the gap between complete ignorance and perfect knowledge of the environment. Our method, Partial Knowledge Least Squares Policy Iteration (PLSPI), takes…

Systems and Control · Electrical Eng. & Systems 2024-03-27 Shuyuan Wang , Philip D. Loewen , Nathan P. Lawrence , Michael G. Forbes , R. Bhushan Gopaluni

Reinforcement Learning (RL) has emerged as an efficient method of choice for solving complex sequential decision making problems in automatic control, computer science, economics, and biology. In this paper we present a model-free RL…

Logic in Computer Science · Computer Science 2019-09-13 Mohammadhosein Hasanbeig , Yiannis Kantaros , Alessandro Abate , Daniel Kroening , George J. Pappas , Insup Lee

Reinforcement learning (RL) has been shown to learn sophisticated control policies for complex tasks including games, robotics, heating and cooling systems and text generation. The action-perception cycle in RL, however, generally assumes…

Machine Learning · Computer Science 2024-04-22 Colin Bellinger , Mark Crowley , Isaac Tamblyn

We study Reinforcement Learning (RL) in environments with large state spaces, where function approximation is required for sample-efficient learning. Departing from a long history of prior work, we consider the weakest possible form of…

Machine Learning · Computer Science 2025-04-09 Akshay Krishnamurthy , Gene Li , Ayush Sekhari

This work studies reinforcement learning in the Sim-to-Real setting, in which an agent is first trained on a number of simulators before being deployed in the real world, with the aim of decreasing the real-world sample complexity…

Machine Learning · Computer Science 2019-10-28 Yuren Zhong , Aniket Anand Deshmukh , Clayton Scott

The Rubiks Cube, with its vast state space and sparse reward structure, presents a significant challenge for reinforcement learning (RL) due to the difficulty of reaching rewarded states. Previous research addressed this by propagating…

Machine Learning · Computer Science 2024-12-02 Yicheng Lin , Siyu Liang

We present a set of model-free, reduced-dimensional reinforcement learning (RL) based optimal control designs for linear time-invariant singularly perturbed (SP) systems. We first present a state-feedback and output-feedback based RL…

Systems and Control · Electrical Eng. & Systems 2021-02-08 Sayak Mukherjee , He Bai , Aranya Chakrabortty

Penetration testing (pentesting) involves performing a controlled attack on a computer system in order to assess it's security. Although an effective method for testing security, pentesting requires highly skilled practitioners and…

Cryptography and Security · Computer Science 2019-05-16 Jonathon Schwartz , Hanna Kurniawati

We consider the problem of reinforcement learning (RL) with unbounded state space motivated by the classical problem of scheduling in a queueing network. Traditional policies as well as error metric that are designed for finite, bounded or…

Machine Learning · Computer Science 2020-06-09 Devavrat Shah , Qiaomin Xie , Zhi Xu

There have been many recent advances on provably efficient Reinforcement Learning (RL) in problems with rich observation spaces. However, all these works share a strong realizability assumption about the optimal value function of the true…

Machine Learning · Computer Science 2021-06-23 Christoph Dann , Yishay Mansour , Mehryar Mohri , Ayush Sekhari , Karthik Sridharan

Reinforcement learning (RL) algorithms based on high-dimensional function approximation have achieved tremendous empirical success in large-scale problems with an enormous number of states. However, most analysis of such algorithms gives…

Machine Learning · Computer Science 2022-02-17 Jihao Long , Jiequn Han , Weinan E

Stabilizing a dynamical system is a fundamental problem that serves as a cornerstone for many complex tasks in the field of control systems. The problem becomes challenging when the system model is unknown. Among the Reinforcement Learning…

Systems and Control · Electrical Eng. & Systems 2026-01-30 Ankang Zhang , Ming Chi , Xiaoling Wang , Lintao Ye

Model-free deep reinforcement learning (RL) agents can learn an effective policy directly from repeated interactions with a black-box environment. However in practice, the algorithms often require large amounts of training experience to…

Machine Learning · Computer Science 2020-05-29 Parth Chadha

In safe Reinforcement Learning (RL), safety cost is typically defined as a function dependent on the immediate state and actions. In practice, safety constraints can often be non-Markovian due to the insufficient fidelity of state…

Machine Learning · Computer Science 2024-05-07 Siow Meng Low , Akshat Kumar

In this paper, we propose a fast reinforcement learning (RL) control algorithm that enables online control of large-scale networked dynamic systems. RL is an effective way of designing model-free linear quadratic regulator (LQR) controllers…

Systems and Control · Electrical Eng. & Systems 2020-09-16 Tomonori Sadamoto , Aranya Chakrabortty , Jun-ichi Imura

Motivated by real-world settings where data collection and policy deployment -- whether for a single agent or across multiple agents -- are costly, we study the problem of on-policy single-agent reinforcement learning (RL) and federated RL…

Machine Learning · Statistics 2026-03-11 Haochen Zhang , Zhong Zheng , Lingzhou Xue

State representation learning aims at learning compact representations from raw observations in robotics and control applications. Approaches used for this objective are auto-encoders, learning forward models, inverse dynamics or learning…

Machine Learning · Computer Science 2018-10-11 Antonin Raffin , Ashley Hill , René Traoré , Timothée Lesort , Natalia Díaz-Rodríguez , David Filliat

This paper proposes a new method to drastically speed up deep reinforcement learning (deep RL) training for problems that have the property of state-action permissibility (SAP). Two types of permissibility are defined under SAP. The first…

Machine Learning · Computer Science 2022-10-31 Sahisnu Mazumder , Bing Liu , Shuai Wang , Yingxuan Zhu , Xiaotian Yin , Lifeng Liu , Jian Li

In this work, we present a new model-free and off-policy reinforcement learning (RL) algorithm, that is capable of finding a near-optimal policy with state-action observations from arbitrary behavior policies. Our algorithm, called the…

Optimization and Control · Mathematics 2025-07-21 Narim Jeong , Donghwan Lee , Niao He

Recent work has shown that, under certain assumptions, zero-shot reinforcement learning (RL) methods can generalise to any unseen task in an environment after reward-free pre-training. Access to Markov states is one such assumption, yet, in…

Machine Learning · Computer Science 2025-06-19 Scott Jeen , Tom Bewley , Jonathan M. Cullen