English
Related papers

Related papers: Neural Episodic Control with State Abstraction

200 papers

Unmanned aerial vehicles (UAVs) have been widely used in military warfare. In this paper, we formulate the autonomous motion control (AMC) problem as a Markov decision process (MDP) and propose an advanced deep reinforcement learning (DRL)…

Artificial Intelligence · Computer Science 2022-07-05 Zijian Hu , Xiaoguang Gao , Kaifang Wan , Qianglong Wang , Yiwei Zhai

Predicting stochastic cellular dynamics as emerging from the mechanistic models of molecular interactions is a long-standing challenge in systems biology: low-level chemical reaction network (CRN) models give raise to a highly-dimensional…

Molecular Networks · Quantitative Biology 2020-02-06 Tatjana Petrov , Denis Repin

Model-free deep reinforcement learning (RL) algorithms have been widely used for a range of complex control tasks. However, slow convergence and sample inefficiency remain challenging problems in RL, especially when handling continuous and…

Machine Learning · Computer Science 2021-12-07 Wenjie Shi , Shiji Song , Hui Wu , Ya-Chu Hsu , Cheng Wu , Gao Huang

In the Dynamic Resource Allocation (DRA) problem, an administrator has to allocate a limited amount of resources to the nodes of a network in order to reduce a diffusion process (DP) (e.g. an epidemic). In this paper we propose a…

Social and Information Networks · Computer Science 2020-06-15 Mathilde Fekom , Nicolas Vayatis , Argyris Kalogeratos

A critical and challenging problem in reinforcement learning is how to learn the state-action value function from the experience replay buffer and simultaneously keep sample efficiency and faster convergence to a high quality solution. In…

Machine Learning · Computer Science 2018-04-25 Weichao Li , Fuxian Huang , Xi Li , Gang Pan , Fei Wu

Although deep reinforcement learning (RL) has been successfully applied to a variety of robotic control tasks, it's still challenging to apply it to real-world tasks, due to the poor sample efficiency. Attempting to overcome this…

Robotics · Computer Science 2021-03-09 Junfan Lin , Zhongzhan Huang , Keze Wang , Xiaodan Liang , Weiwei Chen , Liang Lin

Under the Dynamic Resource Allocation (DRA) model, an administrator has the mission to allocate dynamically a limited budget of resources to the nodes of a network in order to reduce a diffusion process (DP) (e.g. an epidemic). The standard…

Systems and Control · Electrical Eng. & Systems 2019-09-24 Mathilde Fekom , Nicolas Vayatis , Argyris Kalogeratos

Simulation-based design space exploration (DSE) aims to efficiently optimize high-dimensional structured designs under complex constraints and expensive evaluation costs. Existing approaches, including heuristic and multi-step reinforcement…

Machine Learning · Computer Science 2025-06-05 Yifeng Xiao , Yurong Xu , Ning Yan , Masood Mortazavi , Pierluigi Nuzzo

Real-world sequential decision-making often involves parameterized action spaces that require both, decisions regarding discrete actions and decisions about continuous action parameters governing how an action is executed. Existing…

Artificial Intelligence · Computer Science 2026-04-27 Rashmeet Kaur Nayyar , Naman Shah , Siddharth Srivastava

Deep Reinforcement Learning (DRL) has recently been proposed as a methodology to discover complex Active Flow Control (AFC) strategies [Rabault, J., Kuchta, M., Jensen, A., Reglade, U., & Cerardi, N. (2019): "Artificial neural networks…

Computational Physics · Physics 2019-10-23 Jean Rabault , Alexander Kuhnle

Reinforcement Learning (RL) has achieved remarkable success in various continuous control tasks, such as robot manipulation and locomotion. Different to mainstream RL which makes decisions at individual steps, recent studies have…

Machine Learning · Computer Science 2025-03-07 Buqing Nie , Yangqing Fu , Yue Gao

Intelligent Cyber-Physical Systems (ICPS) represent a specialized form of Cyber-Physical System (CPS) that incorporates intelligent components, notably Convolutional Neural Networks (CNNs) and Deep Reinforcement Learning (DRL), to undertake…

Machine Learning · Computer Science 2024-05-28 Jihui Nie , Dehui Du , Jiangnan Zhao

Neural Cellular Automata (NCAs) are bio-inspired dynamical systems in which identical cells iteratively apply a learned local update rule to self-organize into complex patterns, exhibiting regeneration, robustness, and spontaneous dynamics.…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Ehsan Pajouheshgar , Yitao Xu , Ali Abbasi , Alexander Mordvintsev , Wenzel Jakob , Sabine Süsstrunk

This paper considers a class of reinforcement learning problems, which involve systems with two types of states: stochastic and pseudo-stochastic. In such systems, stochastic states follow a stochastic transition kernel while the…

Machine Learning · Computer Science 2023-11-09 Honghao Wei , Xin Liu , Weina Wang , Lei Ying

We consider a typical heterogeneous network (HetNet), in which multiple access points (APs) are deployed to serve users by reusing the same spectrum band. Since different APs and users may cause severe interference to each other, advanced…

Information Theory · Computer Science 2020-08-11 Lin Zhang , Ying-Chang Liang

Deep Reinforcement Learning (DRL) has become a popular method for solving control problems in power systems. Conventional DRL encourages the agent to explore various policies encoded in a neural network (NN) with the goal of maximizing the…

Systems and Control · Electrical Eng. & Systems 2024-10-28 Tong Wu , Anna Scaglione , Daniel Arnold

We address the synthesis of control policies for unknown discrete-time stochastic dynamical systems to satisfy temporal logic objectives. We present a data-driven, abstraction-based control framework that integrates online learning with…

Computer Science and Game Theory · Computer Science 2026-04-14 Irmak Sağlam , Mahdi Nazeri , Alessandro Abate , Sadegh Soudjani , Anne-Kathrin Schmuck

Deep brain stimulation (DBS) is an established intervention for Parkinson's disease (PD), but conventional open-loop systems lack adaptability, are energy-inefficient due to continuous stimulation, and provide limited personalization to…

Machine Learning · Computer Science 2025-07-10 Harsh Ravivarapu , Gaurav Bagwe , Xiaoyong Yuan , Chunxiu Yu , Lan Zhang

Prevailing network control strategies, which rely on static shortest-path logic, suffer from catastrophic "stress concentration" on critical nodes. This paper introduces the System Relaxation Algorithm (SRA), a new control paradigm inspired…

Networking and Internet Architecture · Computer Science 2025-09-23 Zhiyuan Ren , Zhiliang Shuai , Wenchi Cheng

Robust and high-precision quantum control is crucial but challenging for scalable quantum computation and quantum information processing. Traditional adiabatic control suffers severe limitations on gate performance imposed by…