English
Related papers

Related papers: Disentangling Exploration of Large Language Models…

200 papers

In the incentivized exploration model, a principal aims to explore and learn over time by interacting with a sequence of self-interested agents. It has been recently understood that the main challenge in designing incentive-compatible…

Computer Science and Game Theory · Computer Science 2025-06-03 Benjamin Schiffer , Mark Sellke

Solving tasks with sparse rewards is one of the most important challenges in reinforcement learning. In the single-agent setting, this challenge is addressed by introducing intrinsic rewards that motivate agents to explore unseen regions of…

Machine Learning · Computer Science 2021-05-25 Shariq Iqbal , Fei Sha

This work presents an exploration and imitation-learning-based agent capable of state-of-the-art performance in playing text-based computer games. Text-based computer games describe their world to the player through natural language and…

Understanding user intents from UI interaction trajectories remains a challenging, yet crucial, frontier in intelligent agent development. While massive, datacenter-based, multi-modal large language models (MLLMs) possess greater capacity…

Artificial Intelligence · Computer Science 2025-09-17 Danielle Cohen , Yoni Halpern , Noam Kahlon , Joel Oren , Omri Berkovitch , Sapir Caduri , Ido Dagan , Anatoly Efros

Reinforcement learning (RL) has demonstrated strong potential in training large language models (LLMs) capable of complex reasoning for real-world problem solving. More recently, RL has been leveraged to create sophisticated LLM-based…

Computation and Language · Computer Science 2025-05-22 Bowen Jin , Jinsung Yoon , Priyanka Kargupta , Sercan O. Arik , Jiawei Han

To rapidly learn a new task, it is often essential for agents to explore efficiently -- especially when performance matters from the first timestep. One way to learn such behaviour is via meta-learning. Many existing methods however rely on…

Machine Learning · Computer Science 2021-06-11 Luisa Zintgraf , Leo Feng , Cong Lu , Maximilian Igl , Kristian Hartikainen , Katja Hofmann , Shimon Whiteson

In the information era, how learners find, evaluate, and effectively use information has become a challenging issue, especially with the added complexity of large language models (LLMs) that have further confused learners in their…

Information Retrieval · Computer Science 2025-01-07 Yiming Luo , Patrick Cheong-Iao Pang , Shanton Chang

Autonomous artificial agents must be able to learn behaviors in complex environments without humans to design tasks and rewards. Designing these functions for each environment is not feasible, thus, motivating the development of intrinsic…

Machine Learning · Computer Science 2025-02-20 Alana Santana , Paula P. Costa , Esther L. Colombini

Reinforcement learning (RL) agents are particularly hard to train when rewards are sparse. One common solution is to use intrinsic rewards to encourage agents to explore their environment. However, recent intrinsic exploration methods often…

Machine Learning · Computer Science 2022-11-23 Jesse Mu , Victor Zhong , Roberta Raileanu , Minqi Jiang , Noah Goodman , Tim Rocktäschel , Edward Grefenstette

Recent works have proven that intricate cooperative behaviors can emerge in agents trained using meta reinforcement learning on open ended task distributions using self-play. While the results are impressive, we argue that self-play and…

Multiagent Systems · Computer Science 2024-05-08 Richard Bornemann , Gautier Hamon , Eleni Nisioti , Clément Moulin-Frier

The exploration-exploitation trade-off is central to sequential decision-making and black-box optimization, yet how Large Language Models (LLMs) reason about and manage this trade-off remains poorly understood. Unlike Bayesian Optimization,…

Machine Learning · Computer Science 2026-04-01 Andrea Carbonati , Mohammadsina Almasi , Hadis Anahideh

Integrating language models into robotic exploration frameworks improves performance in unmapped environments by providing the ability to reason over semantic groundings, contextual cues, and temporal states. The proposed method employs…

Robotics · Computer Science 2024-06-26 Harel Biggie , Patrick Cooper , Doncey Albin , Kristen Such , Christoffer Heckman

Numerous past works have tackled the problem of task-driven navigation. But, how to effectively explore a new environment to enable a variety of down-stream tasks has received much less attention. In this work, we study how agents can…

Robotics · Computer Science 2019-03-06 Tao Chen , Saurabh Gupta , Abhinav Gupta

Exploration in environments with sparse rewards has been a persistent problem in reinforcement learning (RL). Many tasks are natural to specify with a sparse reward, and manually shaping a reward function can result in suboptimal…

Machine Learning · Computer Science 2018-02-27 Ashvin Nair , Bob McGrew , Marcin Andrychowicz , Wojciech Zaremba , Pieter Abbeel

Understanding the behavior of deep reinforcement learning (DRL) agents -particularly as task and agent sophistication increase- requires more than simple comparison of reward curves, yet standard methods for behavioral analysis remain…

Artificial Intelligence · Computer Science 2025-12-02 Riley Simmons-Edler , Ryan P. Badman , Felix Baastad Berg , Raymond Chua , John J. Vastola , Joshua Lunger , William Qian , Kanaka Rajan

A major challenge in reinforcement learning is exploration, when local dithering methods such as epsilon-greedy sampling are insufficient to solve a given task. Many recent methods have proposed to intrinsically motivate an agent to seek…

Machine Learning · Computer Science 2021-01-15 Riley Simmons-Edler , Ben Eisner , Daniel Yang , Anthony Bisulco , Eric Mitchell , Sebastian Seung , Daniel Lee

In the era of deep reinforcement learning, making progress is more complex, as the collected experience must be compressed into a deep model for future exploitation and sampling. Many papers have shown that training a deep learning policy…

Machine Learning · Computer Science 2025-08-05 Glen Berseth

Large Language Models (LLMs) are powerful reasoners in natural language, but their actions are typically confined to outputting vocabulary tokens. As a result, interactions with external environments -- such as symbolic operators or…

Machine Learning · Computer Science 2025-10-20 Zhongqi Yue , Weishi Wang , Yundaichuan Zhan , Juncheng Li , Daniel Dahlmeier , Fredrik D. Johansson

This paper investigates the automatic exploration problem under the unknown environment, which is the key point of applying the robotic system to some social tasks. The solution to this problem via stacking decision rules is impossible to…

Robotics · Computer Science 2020-07-24 Haoran Li , Qichao Zhang , Dongbin Zhao

Learning optimal policies in sparse rewards settings is difficult as the learning agent has little to no feedback on the quality of its actions. In these situations, a good strategy is to focus on exploration, hopefully leading to the…

Machine Learning · Computer Science 2023-09-28 Giuseppe Paolo , Miranda Coninx , Alban Laflaquière , Stephane Doncieux