English
Related papers

Related papers: Cell-Free Latent Go-Explore

200 papers

Motivated by the prevailing paradigm of using unsupervised learning for efficient exploration in reinforcement learning (RL) problems [tang2017exploration,bellemare2016unifying], we investigate when this paradigm is provably efficient. We…

Machine Learning · Computer Science 2020-12-02 Fei Feng , Ruosong Wang , Wotao Yin , Simon S. Du , Lin F. Yang

Despite the close connection between exploration and sample efficiency, most state of the art reinforcement learning algorithms include no considerations for exploration beyond maximizing the entropy of the policy. In this work we address…

Effective exploration is a key challenge in reinforcement learning for large language models: discovering high-quality trajectories within a limited sampling budget from the vast natural language sequence space. Existing methods face…

Machine Learning · Computer Science 2026-02-17 Yiran Guo , Zhongjian Qiao , Yingqi Xie , Jie Liu , Dan Ye , Ruiqing Zhang , Shuang Qiu , Lijie Xu

Reinforcement learning (RL) is ubiquitous in the development of modern AI systems. However, state-of-the-art RL agents require extensive, and potentially unsafe, interactions with their environments to learn effectively. These limitations…

Machine Learning · Computer Science 2025-08-01 Yarden As , Bhavya Sukhija , Lenart Treven , Carmelo Sferrazza , Stelian Coros , Andreas Krause

We propose a new method for event extraction (EE) task based on an imitation learning framework, specifically, inverse reinforcement learning (IRL) via generative adversarial network (GAN). The GAN estimates proper rewards according to the…

Computation and Language · Computer Science 2018-04-24 Tongtao Zhang , Heng Ji

We study the autonomous exploration (AX) problem proposed by Lim & Auer (2012). In this setting, the objective is to discover a set of $\epsilon$-optimal policies reaching a set $\mathcal{S}_L^{\rightarrow}$ of incrementally…

Machine Learning · Computer Science 2023-02-09 Liyu Chen , Andrea Tirinzoni , Alessandro Lazaric , Matteo Pirotta

Exploration is essential in reinforcement learning, particularly in environments where external rewards are sparse. Here we focus on exploration with intrinsic rewards, where the agent transiently augments the external rewards with…

Machine Learning · Computer Science 2024-01-26 Changmin Yu , Neil Burgess , Maneesh Sahani , Samuel J. Gershman

Latent learning, classically theorized by Tolman, shows that biological agents (e.g., rats) can acquire internal representations of their environment without rewards, enabling rapid adaptation once rewards are introduced. In contrast, from…

Machine Learning · Computer Science 2026-02-02 Jian Xiong , Jingbo Zhou , Zihan Zhou , Yixiong Xiao , Le Zhang , Jingyong Ye , Rui Qian , Yang Zhou , Dejing Dou

Efficient exploration is one of the main challenges in reinforcement learning (RL). Most existing sample-efficient algorithms assume the existence of a single reward function during exploration. In many practical scenarios, however, there…

Machine Learning · Computer Science 2020-06-18 Xuezhou Zhang , Yuzhe ma , Adish Singla

Mastering multiple tasks through exploration and learning in an environment poses a significant challenge in reinforcement learning (RL). Unsupervised RL has been introduced to address this challenge by training policies with intrinsic…

Machine Learning · Computer Science 2024-07-02 Junkai Zhang , Weitong Zhang , Dongruo Zhou , Quanquan Gu

The rapid progress of large language models (LLMs) has sparked growing interest in building Artificial General Intelligence (AGI) within Graphical User Interface (GUI) environments. However, existing GUI agents based on LLMs or…

Artificial Intelligence · Computer Science 2025-05-27 Runliang Niu , Jinglong Ji , Yi Chang , Qi Wang

A burgeoning area within reinforcement learning (RL) is the design of sequential decision-making agents centered around large language models (LLMs). While autonomous decision-making agents powered by modern LLMs could facilitate numerous…

Machine Learning · Computer Science 2026-02-10 Dilip Arumugam , Thomas L. Griffiths

Recent vision-language models (VLMs) achieve remarkable reasoning through reinforcement learning (RL), which provides a feasible solution for realizing continuous self-evolving large vision-language models (LVLMs) in the era of experience.…

Artificial Intelligence · Computer Science 2025-12-09 Tingyu Li , Zheng Sun , Jingxuan Wei , Siyuan Li , Conghui He , Lijun Wu , Cheng Tan

Symbolic regression (SR) seeks closed-form mathematical expressions that fit observed data. Neural SR methods amortize the search by training an encoder to map observations directly to expressions in a single pass, but this amortized…

Machine Learning · Computer Science 2026-05-27 Xieting Chu , Sriram Vishwanath , Vijay Ganesh

Large Language Models (LLMs) are rapidly saturating existing benchmarks, necessitating new open-ended evaluations. We introduce the Factorio Learning Environment (FLE), based on the game of Factorio, that tests agents in long-term planning,…

Multiagent Systems · Computer Science 2025-03-14 Jack Hopkins , Mart Bakler , Akbir Khan

Reinforcement Learning (RL) is a general framework concerned with an agent that seeks to maximize rewards in an environment. The learning typically happens through trial and error using explorative methods, such as epsilon-greedy. There are…

Machine Learning · Computer Science 2022-10-06 Per-Arne Andersen , Morten Goodwin , Ole-Christoffer Granmo

We consider the problem of exploration in meta reinforcement learning. Two new meta reinforcement learning algorithms are suggested: E-MAML and E-$\text{RL}^2$. Results are presented on a novel environment we call `Krazy World' and a set of…

Artificial Intelligence · Computer Science 2019-01-15 Bradly C. Stadie , Ge Yang , Rein Houthooft , Xi Chen , Yan Duan , Yuhuai Wu , Pieter Abbeel , Ilya Sutskever

Enabling reinforcement learning (RL) agents to leverage a knowledge base while learning from experience promises to advance RL in knowledge intensive domains. However, it has proven difficult to leverage knowledge that is not manually…

Artificial Intelligence · Computer Science 2022-05-03 Niklas Höpner , Ilaria Tiddi , Herke van Hoof

How can artificial agents learn to solve many diverse tasks in complex visual environments in the absence of any supervision? We decompose this question into two problems: discovering new goals and learning to reliably achieve them. We…

Machine Learning · Computer Science 2021-10-19 Russell Mendonca , Oleh Rybkin , Kostas Daniilidis , Danijar Hafner , Deepak Pathak

Exploration in reinforcement learning (RL) remains an open challenge. RL algorithms rely on observing rewards to train the agent, and if informative rewards are sparse the agent learns slowly or may not learn at all. To improve exploration…

Machine Learning · Computer Science 2024-11-12 Simone Parisi , Alireza Kazemipour , Michael Bowling