中文
相关论文

相关论文: Maximum State Entropy Exploration using Predecesso…

200 篇论文

Reinforcement learning (RL) has been successfully applied to solve the problem of finding obstacle-free paths for autonomous agents operating in stochastic and uncertain environments. However, when the underlying stochastic dynamics of the…

机器学习 · 计算机科学 2024-10-29 Sheryl Paul , Jyotirmoy V. Deshmukh

Entropy maximization and free energy minimization are general physical principles for modeling the dynamics of various physical systems. Notable examples include modeling decision-making within the brain using the free-energy principle,…

In this paper, we propose SEA, a novel approach for active robot exploration through semantic map prediction and a reinforcement learning-based hierarchical exploration policy. Unlike existing learning-based methods that rely on one-step…

机器人学 · 计算机科学 2025-12-12 Hongyu Ding , Xinyue Liang , Yudong Fang , You Wu , Jieqi Shi , Jing Huo , Wenbin Li , Jing Wu , Yu-Kun Lai , Yang Gao

One of the challenges in online reinforcement learning (RL) is that the agent needs to trade off the exploration of the environment and the exploitation of the samples to optimize its behavior. Whether we optimize for regret, sample…

机器学习 · 计算机科学 2021-11-19 Jean Tarbouriech , Matteo Pirotta , Michal Valko , Alessandro Lazaric

Efficient exploration remains a challenging research problem in reinforcement learning, especially when an environment contains large state spaces, deceptive local optima, or sparse rewards. To tackle this problem, we present a…

人工智能 · 计算机科学 2018-10-30 Zhang-Wei Hong , Tzu-Yun Shann , Shih-Yang Su , Yi-Hsiang Chang , Chun-Yi Lee

In order to compute near-optimal policies with policy-gradient algorithms, it is common in practice to include intrinsic exploration terms in the learning objective. Although the effectiveness of these terms is usually justified by an…

机器学习 · 计算机科学 2025-08-21 Adrien Bolland , Gaspard Lambrechts , Damien Ernst

Unsupervised Reinforcement Learning (RL) provides a promising paradigm for learning useful behaviors via reward-free per-training. Existing methods for unsupervised RL mainly conduct empowerment-driven skill discovery or entropy-based…

机器学习 · 计算机科学 2024-05-28 Chenjia Bai , Rushuai Yang , Qiaosheng Zhang , Kang Xu , Yi Chen , Ting Xiao , Xuelong Li

The budgeted information gathering problem - where a robot with a fixed fuel budget is required to maximize the amount of information gathered from the world - appears in practice across a wide range of applications in autonomous…

机器人学 · 计算机科学 2016-11-15 Sanjiban Choudhury , Ashish Kapoor , Gireeja Ranade , Debadeepta Dey

Exploration is critical to a reinforcement learning agent's performance in its given environment. Prior exploration methods are often based on using heuristic auxiliary predictions to guide policy behavior, lacking a mathematically-grounded…

机器学习 · 计算机科学 2020-03-02 Lisa Lee , Benjamin Eysenbach , Emilio Parisotto , Eric Xing , Sergey Levine , Ruslan Salakhutdinov

We study the exploration problem in episodic MDPs with rich observations generated from a small number of latent states. Under certain identifiability assumptions, we demonstrate how to estimate a mapping from the observations to latent…

机器学习 · 计算机科学 2021-09-10 Simon S. Du , Akshay Krishnamurthy , Nan Jiang , Alekh Agarwal , Miroslav Dudík , John Langford

Traditional information theory provides a valuable foundation for Reinforcement Learning, particularly through representation learning and entropy maximization for agent exploration. However, existing methods primarily concentrate on…

机器学习 · 计算机科学 2024-10-10 Xianghua Zeng , Hao Peng , Angsheng Li

Reinforcement Learning (RL) agents often struggle with inefficient exploration, particularly in environments with sparse rewards. Traditional exploration strategies can lead to slow learning and suboptimal performance because agents fail to…

机器学习 · 计算机科学 2026-03-31 Gaurav Chaudhary , Laxmidhar Behera , Washim Uddin Mondal

The exploration \& exploitation dilemma poses significant challenges in reinforcement learning (RL). Recently, curiosity-based exploration methods achieved great success in tackling hard-exploration problems. However, they necessitate…

机器学习 · 计算机科学 2024-12-06 Yiran Wang , Chenshu Liu , Yunfan Li , Sanae Amani , Bolei Zhou , Lin F. Yang

Collaborative multiple robots for unknown environment exploration have become mainstream due to their remarkable performance and efficiency. However, most existing methods assume perfect robots' communication during exploration, which is…

机器人学 · 计算机科学 2025-05-30 Khattiya Pongsirijinda , Zhiqiang Cao , Billy Pik Lik Lau , Ran Liu , Chau Yuen , U-Xuan Tan

Representation learning and unsupervised skill discovery can allow robots to acquire diverse and reusable behaviors without the need for task-specific rewards. In this work, we use unsupervised reinforcement learning to learn a latent…

机器人学 · 计算机科学 2024-10-11 Vassil Atanassov , Wanming Yu , Alexander Luis Mitchell , Mark Nicholas Finean , Ioannis Havoutis

The infamous exploration-exploitation dilemma is one of the oldest and most important problems in reinforcement learning (RL). Deliberate and effective exploration is necessary for RL agents to succeed in most environments. However, until…

人工智能 · 计算机科学 2017-10-09 Suraj Narayanan Sasikumar

Solving sparse reward tasks through exploration is one of the major challenges in deep reinforcement learning, especially in three-dimensional, partially-observable environments. Critically, the algorithm proposed in this article uses a…

人工智能 · 计算机科学 2021-06-18 Gabriele Libardi , Gianni De Fabritiis

State-of-the-art navigation methods leverage a spatial memory to generalize to new environments, but their occupancy maps are limited to capturing the geometric structures directly observed by the agent. We propose occupancy anticipation,…

计算机视觉与模式识别 · 计算机科学 2020-08-26 Santhosh K. Ramakrishnan , Ziad Al-Halah , Kristen Grauman

Visual exploration of high-dimensional real-valued datasets is a fundamental task in exploratory data analysis (EDA). Existing methods use predefined criteria to choose the representation of data. There is a lack of methods that (i) elicit…

机器学习 · 统计学 2021-11-08 Kai Puolamäki , Emilia Oikarinen , Bo Kang , Jefrey Lijffijt , Tijl De Bie

Successor-style representations have many advantages for reinforcement learning: for example, they can help an agent generalize from past experience to new goals, and they have been proposed as explanations of behavioral and neural data…

机器学习 · 计算机科学 2021-03-17 Kianté Brantley , Soroush Mehri , Geoffrey J. Gordon