English
Related papers

Related papers: A Generalized Bootstrap Target for Value-Learning,…

200 papers

This paper proposes an advantage estimation approach based on data augmentation for policy optimization. Unlike using data augmentation on the input to learn value and policy function as existing methods use, our method uses data…

Machine Learning · Computer Science 2022-10-17 Md Masudur Rahman , Yexiang Xue

Training a neural network (NN) typically relies on some type of curve-following method, such as gradient descent (GD) (and stochastic gradient descent (SGD)), ADADELTA, ADAM or limited memory algorithms. Convergence for these algorithms…

Machine Learning · Computer Science 2023-05-08 Michael A Kouritzin , Stephen Styles , Beatrice-Helen Vritsiou

Temporal difference methods enable efficient estimation of value functions in reinforcement learning in an incremental fashion, and are of broader interest because they correspond learning as observed in biological systems. Standard value…

Machine Learning · Computer Science 2019-07-11 Brendan Bennett , Wesley Chung , Muhammad Zaheer , Vincent Liu

Temporal difference (TD) learning is a fundamental algorithm for estimating value functions in reinforcement learning. Recent finite-time analyses of TD with linear function approximation quantify its theoretical convergence rate. However,…

Machine Learning · Computer Science 2026-03-04 Yunxiang Li , Mark Schmidt , Reza Babanezhad , Sharan Vaswani

The recent emergence of reinforcement learning has created a demand for robust statistical inference methods for the parameter estimates computed using these algorithms. Existing methods for statistical inference in online learning are…

Machine Learning · Statistics 2022-06-29 Pratik Ramprasad , Yuantong Li , Zhuoran Yang , Zhaoran Wang , Will Wei Sun , Guang Cheng

In many finite horizon episodic reinforcement learning (RL) settings, it is desirable to optimize for the undiscounted return - in settings like Atari, for instance, the goal is to collect the most points while staying alive in the long…

Machine Learning · Computer Science 2019-05-28 Joshua Romoff , Peter Henderson , Ahmed Touati , Emma Brunskill , Joelle Pineau , Yann Ollivier

In reinforcement learning, temporal difference-based algorithms can be sample-inefficient: for instance, with sparse rewards, no learning occurs until a reward is observed. This can be remedied by learning richer objects, such as a model of…

Machine Learning · Computer Science 2021-01-19 Léonard Blier , Corentin Tallec , Yann Ollivier

We propose a new approach to value function approximation which combines linear temporal difference reinforcement learning with subspace identification. In practical applications, reinforcement learning (RL) is complicated by the fact that…

Machine Learning · Computer Science 2015-03-17 Byron Boots , Geoffrey J. Gordon

Given a dataset on actions and resulting long-term rewards, a direct estimation approach fits value functions that minimize prediction error on the training data. Temporal difference learning (TD) methods instead fit value functions by…

Machine Learning · Computer Science 2024-02-15 David Cheikhi , Daniel Russo

In this paper, we seek to develop a versatile test-time adaptation (TTA) objective for a variety of tasks - classification and regression across image-, object-, and pixel-level predictions. We achieve this through a self-bootstrapping…

Computer Vision and Pattern Recognition · Computer Science 2025-04-14 Shuaicheng Niu , Guohao Chen , Peilin Zhao , Tianyi Wang , Pengcheng Wu , Zhiqi Shen

Temporal difference (TD) learning is one of the main foundations of modern reinforcement learning. This paper studies the use of TD(0), a canonical TD algorithm, to estimate the value function of a given policy from a batch of data. In this…

Machine Learning · Computer Science 2020-08-18 Brahma Pavse , Ishan Durugkar , Josiah Hanna , Peter Stone

The goal of this manuscript is to conduct a controltheoretic analysis of Temporal Difference (TD) learning algorithms. TD-learning serves as a cornerstone in the realm of reinforcement learning, offering a methodology for approximating the…

Artificial Intelligence · Computer Science 2023-09-12 Donghwan Lee , Do Wan Kim

Foundation models compress a large amount of information in a single, large neural network, which can then be queried for individual tasks. There are strong parallels between this widespread framework and offline goal-conditioned…

Machine Learning · Computer Science 2026-05-14 Marco Bagatella , Mert Albaba , Jonas Hübotter , Georg Martius , Andreas Krause

In reinforcement learning, the advantage function is critical for policy improvement, but is often extracted from a learned Q-function. A natural question is: Why not learn the advantage function directly? In this work, we introduce…

Machine Learning · Computer Science 2024-09-04 Yunhao Tang , Rémi Munos , Mark Rowland , Michal Valko

A key question in reinforcement learning is how an intelligent agent can generalize knowledge across different inputs. By generalizing across different inputs, information learned for one input can be immediately reused for improving…

Machine Learning · Computer Science 2020-10-06 Lucas Lehnert , Michael L. Littman

Since the earliest days of reinforcement learning, the workhorse method for assigning credit to actions over time has been temporal-difference (TD) learning, which propagates credit backward timestep-by-timestep. This approach suffers when…

Machine Learning · Computer Science 2021-02-25 David Raposo , Sam Ritter , Adam Santoro , Greg Wayne , Theophane Weber , Matt Botvinick , Hado van Hasselt , Francis Song

One goal of general intelligence is to learn novel information without overwriting prior learning. The utility of learning without forgetting (CF) is twofold: first, the system can return to previously learned tasks after learning something…

Machine Learning · Computer Science 2021-10-01 Rachel A. StClair , William Edward Hahn , Elan Barenholtz

We propose Ephemeral Value Adjusments (EVA): a means of allowing deep reinforcement learning agents to rapidly adapt to experience in their replay buffer. EVA shifts the value predicted by a neural network with an estimate of the value…

Machine Learning · Computer Science 2018-10-19 Steven Hansen , Pablo Sprechmann , Alexander Pritzel , André Barreto , Charles Blundell

Sample efficiency and risk-awareness are central to the development of practical reinforcement learning (RL) for complex decision-making. The former can be addressed by transfer learning and the latter by optimizing some utility function of…

Machine Learning · Computer Science 2021-06-01 Michael Gimelfarb , André Barreto , Scott Sanner , Chi-Guhn Lee

We study policy evaluation problems in multi-task reinforcement learning (RL) under a low-rank representation setting. In this setting, we are given $N$ learning tasks where the corresponding value function of these tasks lie in an…

Machine Learning · Computer Science 2025-03-05 Yitao Bai , Sihan Zeng , Justin Romberg , Thinh T. Doan