English
Related papers

Related papers: Neural Episodic Control with State Abstraction

200 papers

Deep reinforcement learning (DRL) may explore infeasible actions during training and execution. Existing approaches assume a symbol grounding function that maps high-dimensional states to consistent symbolic representations and a manually…

Artificial Intelligence · Computer Science 2026-02-12 Shuai Han , Mehdi Dastani , Shihan Wang

The aim of this study is to discover new active-flow-control (AFC) techniques for separation mitigation in a two-dimensional NACA 0012 airfoil at a Reynolds number of 3000. To find these AFC strategies, a framework consisting of a…

Dynamic spectrum access (DSA) is regarded as an effective and efficient technology to share radio spectrum among different networks. As a secondary user (SU), a DSA device will face two critical problems: avoiding causing harmful…

Machine Learning · Computer Science 2018-10-30 Hao-Hsuan Chang , Hao Song , Yang Yi , Jianzhong Zhang , Haibo He , Lingjia Liu

Cellular automata and their differentiable counterparts, Neural Cellular Automata (NCA), are highly expressive and capable of surprisingly complex behaviors. This paper explores how NCAs perform when applied to tasks requiring precise…

Neural and Evolutionary Computing · Computer Science 2025-12-03 Kevin Xu , Risto Miikkulainen

One of the main goals of reinforcement learning (RL) is to provide a~way for physical machines to learn optimal behavior instead of being programmed. However, effective control of the machines usually requires fine time discretization. The…

Machine Learning · Computer Science 2022-07-12 Jakub Łyskawa , Paweł Wawrzyński

In this paper, we present a learning-based nonlinear model predictive controller (NMPC) using an original reinforcement learning (RL) method to learn the optimal weights of the NMPC scheme, for which two methods are proposed. Firstly, the…

Systems and Control · Electrical Eng. & Systems 2025-04-23 Amine Salaje , Thomas Chevet , Nicolas Langlois

In the training process of Deep Reinforcement Learning (DRL), agents require repetitive interactions with the environment. With an increase in training volume and model complexity, it is still a challenging problem to enhance data…

Machine Learning · Computer Science 2024-05-15 Jingwen Wang , Dehui Du , Yida Li , Yiyang Li , Yikang Chen

The application of Deep Reinforcement Learning (DRL) to inventory management is an emerging field. However, traditional DRL algorithms, originally developed for diverse domains such as game-playing and robotics, may not be well-suited for…

Machine Learning · Computer Science 2025-06-04 Tarkan Temizöz , Christina Imdahl , Remco Dijkman , Douniel Lamghari-Idrissi , Willem van Jaarsveld

We propose an adversarial deep reinforcement learning (ADRL) algorithm for high-dimensional stochastic control problems. Inspired by the information relaxation duality, ADRL reformulates the control problem as a min-max optimization between…

Optimization and Control · Mathematics 2025-07-03 Nan Chen , Mengzhou Liu , Xiaoyan Wang , Nanyi Zhang

Reinforcement learning (RL) is currently one of the most prominent methods for optimizing dynamical systems, with breakthrough results across various fields. The framework is based on the concept of a Markov decision process (MDP), leading…

Optimization and Control · Mathematics 2025-11-17 Rene Carmona , Mathieu Lauriere

We aim to develop off-policy DRL algorithms that not only exceed state-of-the-art performance but are also simple and minimalistic. For standard continuous control benchmarks, Soft Actor-Critic (SAC), which employs entropy maximization,…

Machine Learning · Computer Science 2020-12-08 Che Wang , Yanqiu Wu , Quan Vuong , Keith Ross

Continuous-time reinforcement learning (CTRL) provides a principled framework for sequential decision-making in environments where interactions evolve continuously over time. Despite its empirical success, the theoretical understanding of…

Machine Learning · Computer Science 2025-05-22 Runze Zhao , Yue Yu , Adams Yiyue Zhu , Chen Yang , Dongruo Zhou

Cellular reprogramming, the artificial transformation of one cell type into another, has been attracting increasing research attention due to its therapeutic potential for complex diseases. However, identifying effective reprogramming…

Machine Learning · Computer Science 2025-11-18 Andrzej Mizera , Jakub Zarzycki

Recurrent neural networks (RNNs) are difficult to train on sequence processing tasks, not only because input noise may be amplified through feedback, but also because any inaccuracy in the weights has similar consequences as input noise. We…

Neural and Evolutionary Computing · Computer Science 2018-05-29 Michael C. Mozer , Denis Kazakov , Robert V. Lindsey

In many real-world problems, the learning agent needs to learn a problem's abstractions and solution simultaneously. However, most such abstractions need to be designed and refined by hand for different problems and domains of application.…

Machine Learning · Computer Science 2022-12-09 Mehdi Dadvar , Rashmeet Kaur Nayyar , Siddharth Srivastava

Robotic systems driven by artificial muscles present unique challenges due to the nonlinear dynamics of actuators and the complex designs of mechanical structures. Traditional model-based controllers often struggle to achieve desired…

Robotics · Computer Science 2025-08-12 Jiyue Tao , Yunsong Zhang , Sunil Kumar Rajendran , Feitian Zhang

Sampled environment transitions are a critical input to deep reinforcement learning (DRL) algorithms. Current DRL benchmarks often allow for the cheap and easy generation of large amounts of samples such that perceived progress in DRL does…

Machine Learning · Computer Science 2021-02-10 Florian E. Dorner

Many physical AI tasks are governed by implicit equilibrium: an agent actuates a subset of degrees of freedom (boundary DoFs), while the remaining free DoFs settle by minimizing a total potential energy. Even seemingly basic tasks such as…

Robotics · Computer Science 2026-05-06 Dezhong Tong , Jiawen Wang , Hengyi Zhou , Yinglong Shen , Xiaonan Huang , M. Khalid Jawed

Reinforcement learning has long struggled with poor sample efficiency. One promising approach to mitigate this problem is leveraging group-invariant Markov Decision Processes ($G$-invariant MDPs). Existing works in this direction have…

Machine Learning · Computer Science 2026-05-25 Shuai Zhen , Yifan Zhang , Yuling Wang , Yanhua Yu

Most existing neural network-based approaches for solving stochastic optimal control problems using the associated backward dynamic programming principle rely on the ability to simulate the underlying state variables. However, in some…

Machine Learning · Statistics 2024-01-30 Christian Yeo