English
Related papers

Related papers: Neural Episodic Control with State Abstraction

200 papers

Accuracy and generalization of dynamics models is key to the success of model-based reinforcement learning (MBRL). As the complexity of tasks increases, so does the sample inefficiency of learning accurate dynamics models. However, many…

Machine Learning · Computer Science 2021-06-08 Manan Tomar , Amy Zhang , Roberto Calandra , Matthew E. Taylor , Joelle Pineau

Reinforcement Learning (RL) is a well-established framework for sequential decision-making in complex environments. However, state-of-the-art Deep RL (DRL) algorithms typically require large training datasets and often struggle to…

Artificial Intelligence · Computer Science 2026-04-13 Celeste Veronese , Alessandro Farinelli , Daniele Meli

Reinforcement learning (RL) has driven breakthroughs in AI, from game-play to scientific discovery and AI alignment. However, its broader applicability remains limited by challenges such as low data efficiency and poor generalizability.…

Artificial Intelligence · Computer Science 2025-06-03 Xidong Yang , Wenhao Li , Junjie Sheng , Chuyun Shen , Yun Hua , Xiangfeng Wang

Decision-making in complex, continuous multi-task environments is often hindered by the difficulty of obtaining accurate models for planning and the inefficiency of learning purely from trial and error. While precise environment dynamics…

Machine Learning · Computer Science 2025-03-20 Jeff Jewett , Sandhya Saisubramanian

Exploratory data analytics (EDA) is a sequential decision making process where analysts choose subsequent queries that might lead to some interesting insights based on the previous queries and corresponding results. Data processing systems…

Machine Learning · Computer Science 2022-12-14 Shaddy Garg , Subrata Mitra , Tong Yu , Yash Gadhia , Arjun Kashettiwar

How to improve the ability of scene representation is a key issue in vision-oriented decision-making applications, and current approaches usually learn task-relevant state representations within visual reinforcement learning to address this…

Artificial Intelligence · Computer Science 2024-10-24 Dayang Liang , Jinyang Lai , Yunlong Liu

Deep reinforcement learning (DRL) algorithms require substantial samples and computational resources to achieve higher performance, which restricts their practical application and poses challenges for further development. Given the…

Machine Learning · Computer Science 2024-03-13 Yanxiao Zhao , Yangge Qian , Tianyi Wang , Jingyang Shan , Xiaolin Qin

Distribution system state estimation (DSSE) is paramount for effective state monitoring and control. However, stochastic outputs of renewables and asynchronous streaming of multi-rate measurements in practical systems largely degrade the…

Systems and Control · Electrical Eng. & Systems 2023-10-23 Ying Zhang , Junbo Zhao , Di Shi , Sungjoo Chung

Reinforcement learning (RL) algorithms have made huge progress in recent years by leveraging the power of deep neural networks (DNN). Despite the success, deep RL algorithms are known to be sample inefficient, often requiring many rounds of…

Machine Learning · Computer Science 2018-05-22 Zichuan Lin , Tianqi Zhao , Guangwen Yang , Lintao Zhang

State abstraction optimizes decision-making by ignoring irrelevant environmental information in reinforcement learning with rich observations. Nevertheless, recent approaches focus on adequate representational capacities resulting in…

Artificial Intelligence · Computer Science 2023-04-25 Xianghua Zeng , Hao Peng , Angsheng Li , Chunyang Liu , Lifang He , Philip S. Yu

While the rapid progress of deep learning fuels end-to-end reinforcement learning (RL), direct application, especially in high-dimensional space like robotic scenarios still suffers from low sample efficiency. Therefore State Representation…

Deep reinforcement learning (DRL) has become a powerful tool for complex decision-making in machine learning and AI. However, traditional methods often assume perfect action execution, overlooking the uncertainties and deviations between an…

Robotics · Computer Science 2025-07-02 Oren Fivel , Matan Rudman , Kobi Cohen

Controlling continuous-time dynamical systems is generally a two step process: first, identify or model the system dynamics with differential equations, then, minimize the control objectives to achieve optimal control function and optimal…

Artificial Intelligence · Computer Science 2024-04-23 Cheng Chi

Deep learning is formulated as a discrete-time optimal control problem. This allows one to characterize necessary conditions for optimality and develop training algorithms that do not rely on gradients with respect to the trainable…

Machine Learning · Computer Science 2018-06-05 Qianxiao Li , Shuji Hao

While conventional reinforcement learning focuses on designing agents that can perform one task, meta-learning aims, instead, to solve the problem of designing agents that can generalize to different tasks (e.g., environments, obstacles,…

Machine Learning · Computer Science 2021-09-06 Xiaowu Sun , Wael Fatnassi , Ulices Santa Cruz , Yasser Shoukry

This article proposes a model-based deep reinforcement learning (DRL) method to design emergency control strategies for short-term voltage stability problems in power systems. Recent advances show promising results in model-free DRL-based…

Systems and Control · Electrical Eng. & Systems 2022-12-07 Ramij R. Hossain , Tianzhixi Yin , Yan Du , Renke Huang , Jie Tan , Wenhao Yu , Yuan Liu , Qiuhua Huang

The recent breakthroughs of deep reinforcement learning (DRL) technique in Alpha Go and playing Atari have set a good example in handling large state and actions spaces of complicated control problems. The DRL technique is comprised of (i)…

Artificial Intelligence · Computer Science 2017-10-12 Hongjia Li , Tianshu Wei , Ao Ren , Qi Zhu , Yanzhi Wang

In reinforcement learning, agents collect state information and rewards through environmental interactions, essential for policy refinement. This process is notably time-consuming, especially in complex robotic simulations and real-world…

Robotics · Computer Science 2024-10-18 Ke Duan , Kai Yang , Houde Liu , Xueqian Wang

Recent studies show that deep reinforcement learning (DRL) agents tend to overfit to the task on which they were trained and fail to adapt to minor environment changes. To expedite learning when transferring to unseen tasks, we propose a…

Artificial Intelligence · Computer Science 2024-02-22 Guy Azran , Mohamad H. Danesh , Stefano V. Albrecht , Sarah Keren

Physics-based character animation has become a fundamental approach for synthesizing realistic, physically plausible motions. While current data-driven deep reinforcement learning (DRL) methods can synthesize complex skills, they struggle…

Artificial Intelligence · Computer Science 2026-04-08 Zhiquan Wang , Bedrich Benes