English
Related papers

Related papers: Improved Exploring Starts by Kernel Density Estima…

200 papers

Early Classification of Time Series (ECTS) has been recognized as an important problem in many areas where decisions have to be taken as soon as possible, before the full data availability, while time pressure increases. Numerous ECTS…

Machine Learning · Computer Science 2025-02-11 Aurélien Renault , Alexis Bondu , Antoine Cornuéjols , Vincent Lemaire

A promising technique for exploration is to maximize the entropy of visited state distribution, i.e., state entropy, by encouraging uniform coverage of visited state space. While it has been effective for an unsupervised setup, it tends to…

Machine Learning · Computer Science 2024-08-12 Dongyoung Kim , Jinwoo Shin , Pieter Abbeel , Younggyo Seo

We investigate the reconfigurable intelligent surface (RIS) assisted downlink secure transmission where only the statistical channel of eavesdropper is available. To handle the stochastic ergodic secrecy rate (ESR) maximization problem, a…

Information Theory · Computer Science 2025-11-18 Cen Liu , Chang Tian , Peixi Liu

Reinforcement learning (RL) struggles to scale to large, combinatorial action spaces common in many real-world problems. This paper introduces a novel framework for training discrete diffusion models as highly effective policies in these…

Machine Learning · Computer Science 2026-05-21 Haitong Ma , Ofir Nabati , Aviv Rosenberg , Bo Dai , Oran Lang , Craig Boutilier , Na Li , Shie Mannor , Lior Shani , Guy Tenneholtz

Effective agent exploration remains a core challenge in reinforcement learning (RL) for complex discrete state-space environments, particularly under partial observability. This paper presents a decoupled hierarchical RL framework…

Machine Learning · Computer Science 2025-06-04 Qingyu Xiao , Yuanlin Chang , Youtian Du

Existing Deep Reinforcement Learning (DRL) algorithms suffer from sample inefficiency. Generally, episodic control-based approaches are solutions that leverage highly-rewarded past experiences to improve sample efficiency of DRL algorithms.…

Machine Learning · Computer Science 2023-02-21 Zhuo Li , Derui Zhu , Yujing Hu , Xiaofei Xie , Lei Ma , Yan Zheng , Yan Song , Yingfeng Chen , Jianjun Zhao

Efficiently tackling multiple tasks within complex environment, such as those found in robot manipulation, remains an ongoing challenge in robotics and an opportunity for data-driven solutions, such as reinforcement learning (RL).…

Robotics · Computer Science 2024-04-03 Carlos Plou , Ana C. Murillo , Ruben Martinez-Cantin

This study proposes a safe and sample-efficient reinforcement learning (RL) framework to address two major challenges in developing applicable RL algorithms: satisfying safety constraints and efficiently learning with limited samples. To…

Machine Learning · Computer Science 2023-03-28 Hongyi Chen , Changliu Liu

We present a method for enabling Reinforcement Learning of motor control policies for complex skills such as dexterous manipulation. We posit that a key difficulty for training such policies is the difficulty of exploring the problem state…

DBSCAN is widely used in many scientific and engineering fields because of its simplicity and practicality. However, due to its high sensitivity parameters, the accuracy of the clustering result depends heavily on practical experience. In…

Machine Learning · Computer Science 2022-08-10 Ruitong Zhang , Hao Peng , Yingtong Dou , Jia Wu , Qingyun Sun , Jingyi Zhang , Philip S. Yu

Recent work has shown that reinforcement learning (RL) is a promising approach to control dynamical systems described by partial differential equations (PDE). This paper shows how to use RL to tackle more general PDE control problems that…

Machine Learning · Computer Science 2018-06-20 Yangchen Pan , Amir-massoud Farahmand , Martha White , Saleh Nabi , Piyush Grover , Daniel Nikovski

Reinforcement Learning (RL) is a popular machine learning paradigm where intelligent agents interact with the environment to fulfill a long-term goal. Driven by the resurgence of deep learning, Deep RL (DRL) has witnessed great success over…

Machine Learning · Computer Science 2025-09-01 Yunpeng Qing , Shunyu Liu , Jie Song , Yang Zhou , Kaixuan Chen , Huiqiong Wang , Mingli Song

Skill-based reinforcement learning (RL) has emerged as a promising strategy to leverage prior knowledge for accelerated robot learning. Skills are typically extracted from expert demonstrations and are embedded into a latent space from…

Robotics · Computer Science 2022-11-07 Krishan Rana , Ming Xu , Brendan Tidd , Michael Milford , Niko Sünderhauf

Learning quantum states is a crucial task for realizing quantum information technology. Recently, neural approaches have emerged as promising methods for learning quantum states. We propose a meta-learning model that utilizes reinforcement…

Quantum Physics · Physics 2025-08-06 Jeongwoo Jae , Jeonghoon Hong , Jinho Choo , Yeong-Dae Kwon

In this paper, we address the challenges of online Continual Learning (CL) by introducing a density distribution-based learning framework. CL, especially the Class Incremental Learning, enables adaptation to new test distributions while…

Machine Learning · Computer Science 2023-11-27 Shilin Zhang , Jiahui Wang

Load shedding has been one of the most widely used and effective emergency control approaches against voltage instability. With increased uncertainties and rapidly changing operational conditions in power systems, existing methods have…

Systems and Control · Electrical Eng. & Systems 2020-12-08 Renke Huang , Yujiao Chen , Tianzhixi Yin , Xinya Li , Ang Li , Jie Tan , Wenhao Yu , Yuan Liu , Qiuhua Huang

Reinforcement learning (RL) can be used to tune data-driven (economic) nonlinear model predictive controllers ((e)NMPCs) for optimal performance in a specific control task by optimizing the dynamic model or parameters in the policy's…

Machine Learning · Computer Science 2025-05-14 Daniel Mayfrank , Mehmet Velioglu , Alexander Mitsos , Manuel Dahmen

Reinforcement learning often needs to deal with the exponential growth of states and actions when exploring optimal control in high-dimensional spaces (often known as the curse of dimensionality). In this work, we address this issue by…

Machine Learning · Computer Science 2023-06-23 Yining Li , Peizhong Ju , Ness Shroff

Reinforcement learning (RL) is a powerful approach for robot learning. However, model-free RL (MFRL) requires a large number of environment interactions to learn successful control policies. This is due to the noisy RL training updates and…

Robotics · Computer Science 2025-02-28 Maria Krinner , Elie Aljalbout , Angel Romero , Davide Scaramuzza

Diversity in demonstration selection is critical for enhancing model generalization by enabling broader coverage of structures and concepts. Constructing appropriate demonstration sets remains a key research challenge. This paper introduces…

Artificial Intelligence · Computer Science 2025-05-27 Xubin Wang , Jianfei Wu , Yichen Yuan , Deyu Cai , Mingzhe Li , Weijia Jia