English
Related papers

Related papers: Bridging the Gap between Reinforcement Learning an…

200 papers

In most real-world reinforcement learning applications, state information is only partially observable, which breaks the Markov decision process assumption and leads to inferior performance for algorithms that conflate observations with…

Machine Learning · Computer Science 2024-06-12 Hongming Zhang , Tongzheng Ren , Chenjun Xiao , Dale Schuurmans , Bo Dai

Reinforcement learning (RL) has emerged as a key paradigm for aligning and optimizing large language models (LLMs). Standard approaches treat the LLM as the policy and apply RL directly over the full vocabulary space. However, this…

Machine Learning · Computer Science 2026-02-17 Jing-Cheng Pang , Liang Lu , Xian Tang , Kun Jiang , Sijie Wu , Kai Zhang , Xubin Li

We consider a challenging theoretical problem in offline reinforcement learning (RL): obtaining sample-efficiency guarantees with a dataset lacking sufficient coverage, under only realizability-type assumptions for the function…

Machine Learning · Computer Science 2022-06-16 Jinglin Chen , Nan Jiang

Robust reinforcement learning (RL) is to find a policy that optimizes the worst-case performance over an uncertainty set of MDPs. In this paper, we focus on model-free robust RL, where the uncertainty set is defined to be centering at a…

Machine Learning · Computer Science 2021-10-29 Yue Wang , Shaofeng Zou

The success of Reinforcement Learning (RL) heavily relies on the ability to learn robust representations from the observations of the environment. In most cases, the representations learned purely by the reinforcement learning loss can…

Machine Learning · Computer Science 2024-02-12 Somjit Nath , Rushiv Arora , Samira Ebrahimi Kahou

Large Language Models (LLMs) encapsulate an extensive amount of world knowledge, and this has enabled their application in various domains to improve the performance of a variety of Natural Language Processing (NLP) tasks. This has also…

Artificial Intelligence · Computer Science 2024-04-30 Sina Gholamian , Domingo Huh

Deep reinforcement-learning methods have achieved remarkable performance on challenging control tasks. Observations of the resulting behavior give the impression that the agent has constructed a generalized representation that supports…

Machine Learning · Computer Science 2018-12-12 Sam Witty , Jun Ki Lee , Emma Tosch , Akanksha Atrey , Michael Littman , David Jensen

While large language models (LLMs) excel at factual recall, the real challenge lies in knowledge application. A gap persists between their ability to answer complex questions and their effectiveness in performing tasks that require that…

Computation and Language · Computer Science 2026-01-21 Siyang Wu , Honglin Bao , Nadav Kunievsky , James A. Evans

To overcome the curses of dimensionality and modeling of Dynamic Programming (DP) methods to solve Markov Decision Process (MDP) problems, Reinforcement Learning (RL) methods are adopted in practice. Contrary to traditional RL algorithms…

Machine Learning · Computer Science 2021-08-24 Arghyadip Roy , Vivek Borkar , Abhay Karandikar , Prasanna Chaporkar

We consider the problem of sequential recommendations, where at each step an agent proposes some slate of $N$ distinct items to a user from a much larger catalog of size $K>>N$. The user has unknown preferences towards the recommendations…

Machine Learning · Computer Science 2022-09-07 Anastasios Giovanidis

Learning representations for pixel-based control has garnered significant attention recently in reinforcement learning. A wide range of methods have been proposed to enable efficient learning, leading to sample complexities similar to those…

Machine Learning · Computer Science 2021-11-16 Manan Tomar , Utkarsh A. Mishra , Amy Zhang , Matthew E. Taylor

Reinforcement learning solely from an agent's self-generated data is often believed to be infeasible for learning on real robots, due to the amount of data needed. However, if done right, agents learning from real data can be surprisingly…

Reinforcement learning (RL) is a classical tool to solve network control or policy optimization problems in unknown environments. The original Q-learning suffers from performance and complexity challenges across very large networks. Herein,…

Machine Learning · Computer Science 2024-09-02 Talha Bozkus , Urbashi Mitra

Explaining the behaviour of intelligent agents learned by reinforcement learning (RL) to humans is challenging yet crucial due to their incomprehensible proprioceptive states, variational intermediate goals, and resultant unpredictability.…

Machine Learning · Computer Science 2023-11-07 Wenhao Lu , Xufeng Zhao , Sven Magg , Martin Gromniak , Mengdi Li , Stefan Wermter

Visual Reinforcement Learning is a popular and powerful framework that takes full advantage of the Deep Learning breakthrough. It is known that variations in input domains (e.g., different panorama colors due to seasonal changes) or task…

Machine Learning · Computer Science 2025-02-19 Antonio Pio Ricciardi , Valentino Maiorca , Luca Moschella , Riccardo Marin , Emanuele Rodolà

We propose a novel approach for class incremental online learning in a limited data setting. This problem setting is challenging because of the following constraints: (1) Classes are given incrementally, which necessitates a class…

Machine Learning · Computer Science 2021-06-15 Mohammed Asad Karim , Vinay Kumar Verma , Pravendra Singh , Vinay Namboodiri , Piyush Rai

One major limitation to the applicability of Reinforcement Learning (RL) to many practical domains is the large number of samples required to learn an optimal policy. To address this problem and improve learning efficiency, we consider a…

Machine Learning · Computer Science 2023-08-07 Roberto Cipollone , Giuseppe De Giacomo , Marco Favorito , Luca Iocchi , Fabio Patrizi

Not having access to compact and meaningful representations is known to significantly increase the complexity of reinforcement learning (RL). For this reason, it can be useful to perform state representation learning (SRL) before tackling…

Machine Learning · Computer Science 2022-02-16 Astrid Merckling , Nicolas Perrin-Gilbert , Alex Coninx , Stéphane Doncieux

Recently deep reinforcement learning has achieved tremendous success in wide ranges of applications. However, it notoriously lacks data-efficiency and interpretability. Data-efficiency is important as interacting with the environment is…

Machine Learning · Computer Science 2021-06-23 Duo Xu , Faramarz Fekri

Many real-world problems come with action spaces represented as feature vectors. Although high-dimensional control is a largely unsolved problem, there has recently been progress for modest dimensionalities. Here we report on a successful…

Artificial Intelligence · Computer Science 2015-12-17 Peter Sunehag , Richard Evans , Gabriel Dulac-Arnold , Yori Zwols , Daniel Visentin , Ben Coppin