English
Related papers

Related papers: Improving Intrinsic Exploration with Language Abst…

200 papers

Reinforcement learning with verifiable rewards (RLVR) has emerged as a powerful paradigm for enhancing the reasoning capabilities of large language models (LLMs). Unlike traditional RL approaches, RLVR leverages rule-based feedback to guide…

Computation and Language · Computer Science 2025-08-19 Jia Deng , Jie Chen , Zhipeng Chen , Daixuan Cheng , Fei Bai , Beichen Zhang , Yinqian Min , Yanzipeng Gao , Wayne Xin Zhao , Ji-Rong Wen

Efficient exploration remains a challenging problem in reinforcement learning, especially for tasks where extrinsic rewards from environments are sparse or even totally disregarded. Significant advances based on intrinsic motivation show…

Machine Learning · Computer Science 2024-04-03 Chenjia Bai , Peng Liu , Kaiyu Liu , Lingxiao Wang , Yingnan Zhao , Lei Han

In online reinforcement learning (RL), efficient exploration remains particularly challenging in high-dimensional environments with sparse rewards. In low-dimensional environments, where tabular parameterization is possible, count-based…

Machine Learning · Computer Science 2021-06-21 Tianjun Zhang , Paria Rashidinejad , Jiantao Jiao , Yuandong Tian , Joseph Gonzalez , Stuart Russell

Reinforcement learning (RL) methods usually treat reward functions as black boxes. As such, these methods must extensively interact with the environment in order to discover rewards and optimal policies. In most RL applications, however,…

Machine Learning · Computer Science 2022-01-19 Rodrigo Toro Icarte , Toryn Q. Klassen , Richard Valenzano , Sheila A. McIlraith

Agentic retrieval-augmented generation (RAG) systems enable large language models (LLMs) to solve complex tasks through multi-step interaction with external retrieval tools. However, such multi-step interaction often involves redundant…

Artificial Intelligence · Computer Science 2026-04-21 Jingbo Sun , Wenyue Chong , Songjun Tu , Qichao Zhang , Yaocheng Zhang , Jiajun Chai , Xiaohan Wang , Wei Lin , Guojun Yin , Dongbin Zhao

Natural language can offer a concise and human-interpretable means of specifying reinforcement learning (RL) tasks. The ability to extract rewards from a language instruction can enable the development of robotic systems that can learn from…

Machine Learning · Computer Science 2025-12-15 Alexey Zakharov , Shimon Whiteson

Positive affect has been linked to increased interest, curiosity and satisfaction in human learning. In reinforcement learning, extrinsic rewards are often sparse and difficult to define, intrinsically motivated learning can help address…

Computer Vision and Pattern Recognition · Computer Science 2021-04-06 Dean Zadok , Daniel McDuff , Ashish Kapoor

Autonomous exploration in complex multi-agent reinforcement learning (MARL) with sparse rewards critically depends on providing agents with effective intrinsic motivation. While artificial curiosity offers a powerful self-supervised signal,…

Machine Learning · Computer Science 2026-02-24 Yiyuan Pan , Zhe Liu , Hesheng Wang

Designing effective auxiliary rewards for cooperative multi-agent systems remains challenging, as misaligned incentives can induce suboptimal coordination, particularly when sparse task rewards provide insufficient grounding for coordinated…

Machine Learning · Computer Science 2026-04-07 Dogan Urgun , Gokhan Gungor

RL-based techniques can be employed to search for prompts that, when fed into a target language model, maximize a set of user-specified reward functions. However, in many target applications, the natural reward functions are in tension with…

Computation and Language · Computer Science 2025-06-10 Yasaman Jafari , Dheeraj Mekala , Rose Yu , Taylor Berg-Kirkpatrick

How to best explore in domains with sparse, delayed, and deceptive rewards is an important open problem for reinforcement learning (RL). This paper considers one such domain, the recently-proposed multi-agent benchmark of Pommerman. This…

Machine Learning · Computer Science 2019-07-30 Chao Gao , Bilal Kartal , Pablo Hernandez-Leal , Matthew E. Taylor

Autonomous 3D environment exploration is a fundamental task for various applications such as navigation. The goal of exploration is to investigate a new environment and build its occupancy map efficiently. In this paper, we propose a new…

Artificial Intelligence · Computer Science 2021-11-03 Liu Juncheng , McCane Brendan , Mills Steven

Reward design is a critical part of the application of reinforcement learning, the performance of which strongly depends on how well the reward signal frames the goal of the designer and how well the signal assesses progress in reaching…

Machine Learning · Computer Science 2022-08-01 Yixiang Wang , Yujing Hu , Feng Wu , Yingfeng Chen

Balancing exploration and exploitation is a central goal in reinforcement learning (RL). Despite recent advances in enhancing large language model (LLM) reasoning, most methods lean toward exploitation, and increasingly encounter…

Computation and Language · Computer Science 2025-11-11 Daixuan Cheng , Shaohan Huang , Xuekai Zhu , Bo Dai , Wayne Xin Zhao , Zhenliang Zhang , Furu Wei

Exploration is a crucial and distinctive aspect of reinforcement learning (RL) that remains a fundamental open problem. Several methods have been proposed to tackle this challenge. Commonly used methods inject random noise directly into the…

Machine Learning · Computer Science 2024-11-06 Sebastian Griesbach , Carlo D'Eramo

Exploration is critical for deep reinforcement learning in complex environments with high-dimensional observations and sparse rewards. To address this problem, recent approaches proposed to leverage intrinsic rewards to improve exploration,…

Machine Learning · Computer Science 2022-11-11 Mingqi Yuan , Bo Li , Xin Jin , Wenjun Zeng

The exploration-exploitation dilemma in reinforcement learning (RL) is a fundamental challenge to efficient RL algorithms. Existing algorithms for finite state and action discounted RL problems address this by assuming sufficient…

Machine Learning · Computer Science 2025-12-09 Caleb Ju , Guanghui Lan

This paper studies reward-agnostic exploration in reinforcement learning (RL) -- a scenario where the learner is unware of the reward functions during the exploration stage -- and designs an algorithm that improves over the state of the…

Machine Learning · Computer Science 2024-05-24 Gen Li , Yuling Yan , Yuxin Chen , Jianqing Fan

Whereas machine learning models typically learn language by directly training on language tasks (e.g., next-word prediction), language emerges in human children as a byproduct of solving non-language tasks (e.g., acquiring food). Motivated…

Computation and Language · Computer Science 2023-06-16 Evan Zheran Liu , Sahaana Suri , Tong Mu , Allan Zhou , Chelsea Finn

Recent studies demonstrated that large language models (LLMs) can excel in many tasks via in-context learning (ICL). However, recent works show that ICL-prompted models tend to produce inaccurate results when presented with adversarial…

Computation and Language · Computer Science 2024-05-21 Xuanli He , Yuxiang Wu , Oana-Maria Camburu , Pasquale Minervini , Pontus Stenetorp