中文
相关论文

相关论文: VASE: Variational Assorted Surprise Exploration fo…

200 篇论文

Anomaly detection in time series data is important for applications in finance, healthcare, sensor networks, and industrial monitoring. Traditional methods usually struggle with limited labeled data, high false-positive rates, and…

机器学习 · 计算机科学 2025-09-01 Bahareh Golchin , Banafsheh Rekabdar , Kunpeng Liu

Robots that are trained to perform a task in a fixed environment often fail when facing unexpected changes to the environment due to a lack of exploration. We propose a principled way to adapt the policy for better exploration in changing…

机器人学 · 计算机科学 2019-05-10 Xingyu Lin , Pengsheng Guo , Carlos Florensa , David Held

Detecting anomalies in multivariate time series is essential for monitoring complex industrial systems, where high dimensionality, limited labeled data, and subtle dependencies between sensors cause significant challenges. This paper…

机器学习 · 计算机科学 2025-11-18 Bahareh Golchin , Banafsheh Rekabdar

Sparse deep learning aims to address the challenge of huge storage consumption by deep neural networks, and to recover the sparse structure of target functions. Although tremendous empirical successes have been achieved, most sparse deep…

机器学习 · 统计学 2020-11-17 Jincheng Bai , Qifan Song , Guang Cheng

We study reinforcement learning (RL) problems in which agents observe the reward or transition realizations at their current state before deciding which action to take. Such observations are available in many applications, including…

机器学习 · 计算机科学 2024-10-22 Nadav Merlis

Typical models of learning assume incremental estimation of continuously-varying decision variables like expected rewards. However, this class of models fails to capture more idiosyncratic, discrete heuristics and strategies that people and…

机器学习 · 计算机科学 2024-02-27 Carlos G. Correa , Thomas L. Griffiths , Nathaniel D. Daw

This paper addresses the problem of maintaining safety during training in Reinforcement Learning (RL), such that the safety constraint violations are bounded at any point during learning. In a variety of RL applications the safety of the…

机器学习 · 计算机科学 2023-12-19 Rohan Mitta , Hosein Hasanbeig , Jun Wang , Daniel Kroening , Yiannis Kantaros , Alessandro Abate

Exploration strategy design is one of the challenging problems in reinforcement learning~(RL), especially when the environment contains a large state space or sparse rewards. During exploration, the agent tries to discover novel areas or…

机器学习 · 计算机科学 2019-06-07 Xiao Ma , Shen-Yi Zhao , Wu-Jun Li

Reinforcement learning involves agents interacting with an environment to complete tasks. When rewards provided by the environment are sparse, agents may not receive immediate feedback on the quality of actions that they take, thereby…

多智能体系统 · 计算机科学 2022-02-22 Baicen Xiao , Bhaskar Ramasubramanian , Radha Poovendran

Recent advancements in deep reinforcement learning (RL) have demonstrated notable progress in sample efficiency, spanning both model-based and model-free paradigms. Despite the identification and mitigation of specific bottlenecks in prior…

机器学习 · 计算机科学 2024-04-02 Yibo Wang , Jiang Zhao

Effective and intelligent exploration has been an unresolved problem for reinforcement learning. Most contemporary reinforcement learning relies on simple heuristic strategies such as $\epsilon$-greedy exploration or adding Gaussian noise…

机器学习 · 计算机科学 2025-12-19 Muhammad Usama , Dong Eui Chang

Efficient exploration remains one of the longstanding problems of deep reinforcement learning. Instead of depending solely on extrinsic rewards from the environments, existing methods use intrinsic rewards to enhance exploration. However,…

机器学习 · 计算机科学 2024-12-09 SuMin Oh , WanSoo Kim , HyunJin Kim

Reward machines are an established tool for dealing with reinforcement learning problems in which rewards are sparse and depend on complex sequences of actions. However, existing algorithms for learning reward machines assume an overly…

机器学习 · 计算机科学 2025-10-20 Jan Corazza , Ivan Gavran , Daniel Neider

Deep reinforcement learning has made significant progress in the field of continuous control, such as physical control and autonomous driving. However, it is challenging for a reinforcement model to learn a policy for each task sequentially…

机器学习 · 计算机科学 2019-06-24 Fengda Zhu , Xiaojun Chang , Runhao Zeng , Mingkui Tan

Reinforcement Learning (RL) of contact-rich manipulation tasks has yielded impressive results in recent years. While many studies in RL focus on varying the observation space or reward model, few efforts focused on the choice of action…

Improving sample efficiency is central to Reinforcement Learning (RL), especially in environments where the rewards are sparse. Some recent approaches have proposed to specify reward functions as manually designed or learned reward…

机器学习 · 计算机科学 2024-01-26 Shuai Han , Mehdi Dastani , Shihan Wang

The challenges for non-intrusive methods for Polynomial Chaos modeling lie in the computational efficiency and accuracy under a limited number of model simulations. These challenges can be addressed by enforcing sparsity in the series…

机器学习 · 统计学 2020-06-24 Panagiotis Tsilifis , Iason Papaioannou , Daniel Straub , Fabio Nobile

Positive affect has been linked to increased interest, curiosity and satisfaction in human learning. In reinforcement learning, extrinsic rewards are often sparse and difficult to define, intrinsically motivated learning can help address…

计算机视觉与模式识别 · 计算机科学 2021-04-06 Dean Zadok , Daniel McDuff , Ashish Kapoor

Reinforcement learning (RL) is one of the three basic paradigms of machine learning. It has demonstrated impressive performance in many complex tasks like Go and StarCraft, which is increasingly involved in smart manufacturing and…

机器学习 · 计算机科学 2022-06-03 Mingqi Yuan

Posterior Sampling for Reinforcement Learning (PSRL) is a well-known algorithm that augments model-based reinforcement learning (MBRL) algorithms with Thompson sampling. PSRL maintains posterior distributions of the environment transition…

机器学习 · 计算机科学 2025-01-17 Siddharth Aravindan , Dixant Mittal , Wee Sun Lee