English
Related papers

Related papers: ProSpec RL: Plan Ahead, then Execute

200 papers

Reinforcement learning suffers from limitations in real practices primarily due to the number of required interactions with virtual environments. It results in a challenging problem because we are implausible to obtain a local optimal…

Machine Learning · Computer Science 2024-10-28 Qizhen Wu , Kexin Liu , Lei Chen

Intelligent agents rely heavily on prior experience when learning a new task, yet most modern reinforcement learning (RL) approaches learn every task from scratch. One approach for leveraging prior knowledge is to transfer skills learned on…

Machine Learning · Computer Science 2020-10-23 Karl Pertsch , Youngwoon Lee , Joseph J. Lim

In this paper we consider self-supervised representation learning to improve sample efficiency in reinforcement learning (RL). We propose a forward prediction objective for simultaneously learning embeddings of states and action sequences.…

Machine Learning · Computer Science 2020-01-15 William Whitney , Rajat Agarwal , Kyunghyun Cho , Abhinav Gupta

Reinforcement Learning (RL) is a general framework concerned with an agent that seeks to maximize rewards in an environment. The learning typically happens through trial and error using explorative methods, such as epsilon-greedy. There are…

Machine Learning · Computer Science 2022-10-06 Per-Arne Andersen , Morten Goodwin , Ole-Christoffer Granmo

We consider the problem of curriculum design for reinforcement learning (RL) agents in contextual multi-task settings. Existing techniques on automatic curriculum design typically require domain-specific hyperparameter tuning or have…

Machine Learning · Computer Science 2023-04-26 Georgios Tzannetos , Bárbara Gomes Ribeiro , Parameswaran Kamalaruban , Adish Singla

In an unfamiliar setting, a model-based reinforcement learning agent can be limited by the accuracy of its world model. In this work, we present a novel, training-free approach to improving the performance of such agents separately from…

Machine Learning · Computer Science 2024-02-26 Martin Benfeghoul , Umais Zahid , Qinghai Guo , Zafeirios Fountas

Planning methods can solve temporally extended sequential decision making problems by composing simple behaviors. However, planning requires suitable abstractions for the states and transitions, which typically need to be designed by hand.…

Machine Learning · Computer Science 2019-11-20 Soroush Nasiriany , Vitchyr H. Pong , Steven Lin , Sergey Levine

Model-predictive-control (MPC) offers an optimal control technique to establish and ensure that the total operation cost of multi-energy systems remains at a minimum while fulfilling all system constraints. However, this method presumes an…

Traditional control theory-based methods require tailored engineering for each system and constant fine-tuning. In power plant control, one often needs to obtain a precise representation of the system dynamics and carefully design the…

Systems and Control · Electrical Eng. & Systems 2024-09-21 Yixuan Sun , Sami Khairy , Richard B. Vilim , Rui Hu , Akshay J. Dave

Modern recommender systems aim to improve user experience. As reinforcement learning (RL) naturally fits this objective -- maximizing an user's reward per session -- it has become an emerging topic in recommender systems. Developing…

Information Retrieval · Computer Science 2022-06-16 Xin Xin , Tiago Pimentel , Alexandros Karatzoglou , Pengjie Ren , Konstantina Christakopoulou , Zhaochun Ren

Deep Reinforcement Learning (DRL) has become a popular method for solving control problems in power systems. Conventional DRL encourages the agent to explore various policies encoded in a neural network (NN) with the goal of maximizing the…

Systems and Control · Electrical Eng. & Systems 2024-10-28 Tong Wu , Anna Scaglione , Daniel Arnold

Model predictive control allows solving complex control tasks with control and state constraints. However, an optimal control problem must be solved in real-time to predict the future system behavior, which is hardly possible on embedded…

Systems and Control · Electrical Eng. & Systems 2023-04-13 Jan Olucak , Walter Fichter , Torbjørn Cunis

Most provably-efficient learning algorithms introduce optimism about poorly-understood states and actions to encourage exploration. We study an alternative approach for efficient exploration, posterior sampling for reinforcement learning…

Machine Learning · Statistics 2013-12-30 Ian Osband , Daniel Russo , Benjamin Van Roy

Everything else being equal, simpler models should be preferred over more complex ones. In reinforcement learning (RL), simplicity is typically quantified on an action-by-action basis -- but this timescale ignores temporal regularities,…

Machine Learning · Computer Science 2023-05-29 Tankred Saanum , Noémi Éltető , Peter Dayan , Marcel Binz , Eric Schulz

Many sequential decision-making problems that are currently automated, such as those in manufacturing or recommender systems, operate in an environment where there is either little uncertainty, or zero risk of catastrophe. As companies and…

Machine Learning · Computer Science 2023-04-04 Marc Rigter

Advanced large language model agents typically adopt self-reflection for improving performance, where agents iteratively analyze past actions to correct errors. However, existing reflective approaches are inherently retrospective: agents…

Artificial Intelligence · Computer Science 2026-02-10 Hanyu Wang , Yuanpu Cao , Lu Lin , Jinghui Chen

Reinforcement Learning (RL) has proven a stunning ability to learn optimal policies from data without any prior knowledge on the process. The main drawback of RL is that it is typically very difficult to guarantee stability and safety. On…

Systems and Control · Electrical Eng. & Systems 2020-05-12 Mario Zanon , Vyacheslav Kungurtsev , Sébastien Gros

Modern power systems are experiencing a variety of challenges driven by renewable energy, which calls for developing novel dispatch methods such as reinforcement learning (RL). Evaluation of these methods as well as the RL agents are…

Systems and Control · Electrical Eng. & Systems 2022-09-22 Zekuan Yu , Guangchun Ruan , Xinyue Wang , Guanglun Zhang , Yiliu He , Haiwang Zhong

Deep reinforcement learning (DRL) breaks through the bottlenecks of traditional reinforcement learning (RL) with the help of the perception capability of deep learning and has been widely applied in real-world problems.While model-free RL,…

Machine Learning · Computer Science 2022-11-28 Tingting Zhao , Ying Wang , Wei Sun , Yarui Chen , Gang Niub , Masashi Sugiyama

Action-conditioned robot world models generate future video frames of the manipulated scene given a robot action sequence, offering a promising alternative for simulating tasks that are difficult to model with traditional physics engines.…

Robotics · Computer Science 2026-03-27 Jai Bardhan , Patrik Drozdik , Josef Sivic , Vladimir Petrik