中文
相关论文

相关论文: Exploration in Approximate Hyper-State Space for M…

200 篇论文

Effective exploration in reinforcement learning requires not only tracking where an agent has been, but also understanding how the agent perceives and represents the world. To learn powerful representations, an agent should actively explore…

机器学习 · 计算机科学 2026-04-21 Faisal Mohamed , Catherine Ji , Benjamin Eysenbach , Glen Berseth

Imitation learning allows agents to learn complex behaviors from demonstrations. However, learning a complex vision-based task may require an impractical number of demonstrations. Meta-imitation learning is a promising approach towards…

Multi-agent reinforcement learning (MARL) algorithms often struggle to find strategies close to Pareto optimal Nash Equilibrium, owing largely to the lack of efficient exploration. The problem is exacerbated in sparse-reward settings,…

机器学习 · 计算机科学 2024-05-03 Zhicheng Zhang , Yancheng Liang , Yi Wu , Fei Fang

Solving tasks with sparse rewards is one of the most important challenges in reinforcement learning. In the single-agent setting, this challenge is addressed by introducing intrinsic rewards that motivate agents to explore unseen regions of…

机器学习 · 计算机科学 2021-05-25 Shariq Iqbal , Fei Sha

We consider the problem of reinforcement learning under safety requirements, in which an agent is trained to complete a given task, typically formalized as the maximization of a reward signal over time, while concurrently avoiding…

We seek to align agent behavior with a user's objectives in a reinforcement learning setting with unknown dynamics, an unknown reward function, and unknown unsafe states. The user knows the rewards and unsafe states, but querying the user…

计算机与社会 · 计算机科学 2021-03-26 Siddharth Reddy , Anca D. Dragan , Sergey Levine , Shane Legg , Jan Leike

Achieving effective test-time scaling requires models to engage in In-Context Exploration -- the intrinsic ability to generate, verify, and refine multiple reasoning hypotheses within a single continuous context. Grounded in State Coverage…

计算与语言 · 计算机科学 2026-02-13 Futing Wang , Jianhao Yan , Yun Luo , Ganqu Cui , Zhi Wang , Xiaoye Qu , Yue Zhang , Yu Cheng , Tao Lin

Reinforcement Learning has suffered from poor reward specification, and issues for reward hacking even in simple enough domains. Preference Based Reinforcement Learning attempts to solve the issue by utilizing binary feedbacks on queried…

人工智能 · 计算机科学 2023-02-20 Mudit Verma , Subbarao Kambhampati

Imitation learning is an effective alternative approach to learn a policy when the reward function is sparse. In this paper, we consider a challenging setting where an agent and an expert use different actions from each other. We assume…

机器学习 · 计算机科学 2019-08-27 Konrad Zolna , Negar Rostamzadeh , Yoshua Bengio , Sungjin Ahn , Pedro O. Pinheiro

The broader application of reinforcement learning (RL) is limited by challenges including data efficiency, generalization capability, and ability to learn in sparse-reward environments. Meta-learning has emerged as a promising approach to…

机器学习 · 计算机科学 2026-03-05 Octavio Pappalardo , Rodrigo Ramele , Juan Miguel Santos

Learning complex robot behavior through interactions with the environment necessitates principled exploration. Effective strategies should prioritize exploring regions of the state-action space that maximize rewards, with optimistic…

机器学习 · 计算机科学 2025-03-12 Jasmine Bayrooti , Carl Henrik Ek , Amanda Prorok

Sparse reward environments are known to be challenging for reinforcement learning agents. In such environments, efficient and scalable exploration is crucial. Exploration is a means by which an agent gains information about the environment.…

机器学习 · 计算机科学 2023-10-11 Jacob Chmura , Hasham Burhani , Xiao Qi Shi

We consider the problem of exploration in meta reinforcement learning. Two new meta reinforcement learning algorithms are suggested: E-MAML and E-$\text{RL}^2$. Results are presented on a novel environment we call `Krazy World' and a set of…

人工智能 · 计算机科学 2019-01-15 Bradly C. Stadie , Ge Yang , Rein Houthooft , Xi Chen , Yan Duan , Yuhuai Wu , Pieter Abbeel , Ilya Sutskever

Reward shaping is one of the most effective methods to tackle the crucial yet challenging problem of credit assignment in Reinforcement Learning (RL). However, designing shaping functions usually requires much expert knowledge and…

机器学习 · 计算机科学 2019-01-29 Haosheng Zou , Tongzheng Ren , Dong Yan , Hang Su , Jun Zhu

Successfully navigating a complex environment to obtain a desired outcome is a difficult task, that up to recently was believed to be capable only by humans. This perception has been broken down over time, especially with the introduction…

机器学习 · 计算机科学 2019-11-12 Joshua Hare

Reinforcement learning usually uses the feedback rewards of environmental to train agents. But the rewards in the actual environment are sparse, and even some environments will not rewards. Most of the current methods are difficult to get…

机器学习 · 计算机科学 2020-01-13 Kai Jiang , XiaoLong Qin

Efficient exploration is an unsolved problem in Reinforcement Learning which is usually addressed by reactively rewarding the agent for fortuitously encountering novel situations. This paper introduces an efficient active exploration…

机器学习 · 计算机科学 2019-06-17 Pranav Shyam , Wojciech Jaśkowski , Faustino Gomez

Reinforcement learning (RL) agents improve through trial-and-error, but when reward is sparse and the agent cannot discover successful action sequences, learning stagnates. This has been a notable problem in training deep RL agents to…

人工智能 · 计算机科学 2018-02-27 Evan Zheran Liu , Kelvin Guu , Panupong Pasupat , Tianlin Shi , Percy Liang

In reinforcement learning (RL), different reward functions can define the same optimal policy but result in drastically different learning performance. For some, the agent gets stuck with a suboptimal behavior, and for others, it solves the…

机器学习 · 计算机科学 2025-02-25 Grigorii Veviurko , Wendelin Böhmer , Mathijs de Weerdt

Decision-making in complex, continuous multi-task environments is often hindered by the difficulty of obtaining accurate models for planning and the inefficiency of learning purely from trial and error. While precise environment dynamics…

机器学习 · 计算机科学 2025-03-20 Jeff Jewett , Sandhya Saisubramanian