English
Related papers

Related papers: Switching Isotropic and Directional Exploration wi…

200 papers

Algorithms that tackle deep exploration -- an important challenge in reinforcement learning -- have relied on epistemic uncertainty representation through ensembles or other hypermodels, exploration bonuses, or visitation count…

Machine Learning · Computer Science 2021-02-24 Vikranth Dwaracherla , Benjamin Van Roy

In search of a simple baseline for Deep Reinforcement Learning in locomotion tasks, we propose a model-free open-loop strategy. By leveraging prior knowledge and the elegance of simple oscillators to generate periodic joint motions, it…

Robotics · Computer Science 2024-03-05 Antonin Raffin , Olivier Sigaud , Jens Kober , Alin Albu-Schäffer , João Silvério , Freek Stulp

Feature transformation aims to generate new pattern-discriminative feature space from original features to improve downstream machine learning (ML) task performances. However, the discrete search space for the optimal feature explosively…

Machine Learning · Computer Science 2023-09-26 Dongjie Wang , Meng Xiao , Min Wu , Pengfei Wang , Yuanchun Zhou , Yanjie Fu

We study the use of randomized value functions to guide deep exploration in reinforcement learning. This offers an elegant means for synthesizing statistically and computationally efficient exploration with common practical approaches to…

Machine Learning · Statistics 2019-09-25 Ian Osband , Benjamin Van Roy , Daniel Russo , Zheng Wen

We introduce two approaches for combining neural evolution strategy (NES) and proximal policy optimization (PPO): parameter transfer and parameter space noise. Parameter transfer is a PPO agent with parameters transferred from a NES agent.…

Machine Learning · Computer Science 2019-06-17 Lianjiang Li , Yunrong Yang , Bingna Li

Evolution strategies (ES) are a family of black-box optimization algorithms able to train deep neural networks roughly as well as Q-learning and policy gradient methods on challenging deep reinforcement learning (RL) problems, but are much…

Artificial Intelligence · Computer Science 2018-10-31 Edoardo Conti , Vashisht Madhavan , Felipe Petroski Such , Joel Lehman , Kenneth O. Stanley , Jeff Clune

We consider the generic approach of using an experience memory to help exploration by adapting a restart distribution. That is, given the capacity to reset the state with those corresponding to the agent's past observations, we help…

Machine Learning · Computer Science 2020-08-19 Arash Tavakoli , Vitaly Levdik , Riashat Islam , Christopher M. Smith , Petar Kormushev

Deep learning has emerged as a powerful framework for analyzing biomolecular dynamics trajectories, enabling efficient representations that capture essential system dynamics and facilitate mechanistic studies. We propose a neural network…

Biomolecules · Quantitative Biology 2025-11-25 Guanghong Zuo

Energy-efficient mapless navigation is crucial for mobile robots as they explore unknown environments with limited on-board resources. Although the recent deep reinforcement learning (DRL) approaches have been successfully applied to…

Neural and Evolutionary Computing · Computer Science 2020-08-04 Guangzhi Tang , Neelesh Kumar , Konstantinos P. Michmizos

Efficient and effective learning is one of the ultimate goals of the deep reinforcement learning (DRL), although the compromise has been made in most of the time, especially for the application of robot manipulations. Learning is always…

Machine Learning · Computer Science 2020-03-06 Yongle Luo , Kun Dong , Lili Zhao , Zhiyong Sun , Chao Zhou , Bo Song

Directed exploration strategies for reinforcement learning are critical for learning an optimal policy in a minimal number of interactions with the environment. Many algorithms use optimism to direct exploration, either through visitation…

Machine Learning · Computer Science 2021-04-07 Raksha Kumaraswamy , Matthew Schlegel , Adam White , Martha White

Reinforcement learning is a powerful learning paradigm that has spearheaded progress in numerous domains. Its core promise lies in learning through high-level goals without the need for granular labels. However, it still remains elusive in…

Deep learning-based methods deliver state-of-the-art performance for solving inverse problems that arise in computational imaging. These methods can be broadly divided into two groups: (1) learn a network to map measurements to the signal…

Image and Video Processing · Electrical Eng. & Systems 2023-10-11 Nebiyou Yismaw , Ulugbek S. Kamilov , M. Salman Asif

We present a map-less path planning algorithm based on Deep Reinforcement Learning (DRL) for mobile robots navigating in unknown environment that only relies on 40-dimensional raw laser data and odometry information. The planner is trained…

Robotics · Computer Science 2020-02-12 Nicolò Botteghi , Beril Sirmacek , Khaled A. A. Mustafa , Mannes Poel , Stefano Stramigioli

Reinforcement Learning (RL) agents often struggle with inefficient exploration, particularly in environments with sparse rewards. Traditional exploration strategies can lead to slow learning and suboptimal performance because agents fail to…

Machine Learning · Computer Science 2026-03-31 Gaurav Chaudhary , Laxmidhar Behera , Washim Uddin Mondal

Robots that are trained to perform a task in a fixed environment often fail when facing unexpected changes to the environment due to a lack of exploration. We propose a principled way to adapt the policy for better exploration in changing…

Robotics · Computer Science 2019-05-10 Xingyu Lin , Pengsheng Guo , Carlos Florensa , David Held

Myopic exploration policies such as epsilon-greedy, softmax, or Gaussian noise fail to explore efficiently in some reinforcement learning tasks and yet, they perform well in many others. In fact, in practice, they are often selected as the…

Machine Learning · Computer Science 2022-06-22 Christoph Dann , Yishay Mansour , Mehryar Mohri , Ayush Sekhari , Karthik Sridharan

Goal-conditioned reinforcement learning (RL) is an interesting extension of the traditional RL framework, where the dynamic environment and reward sparsity can cause conventional learning algorithms to fail. Reward shaping is a practical…

Machine Learning · Computer Science 2023-07-18 Hongyu Ding , Yuanze Tang , Qing Wu , Bo Wang , Chunlin Chen , Zhi Wang

Generative diffusion models (DM) have been extensively utilized in image super-resolution (ISR). Most of the existing methods adopt the denoising loss from DDPMs for model optimization. We posit that introducing reward feedback learning to…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Xiaopeng Sun , Qinwei Lin , Yu Gao , Yujie Zhong , Chengjian Feng , Dengjie Li , Zheng Zhao , Jie Hu , Lin Ma

In the last few years, the research activity around reinforcement learning tasks formulated over environments with sparse rewards has been especially notable. Among the numerous approaches proposed to deal with these hard exploration…

Machine Learning · Computer Science 2022-11-22 Alain Andres , Esther Villar-Rodriguez , Javier Del Ser