English
Related papers

Related papers: An Empirical Evaluation of True Online TD({\lambda…

200 papers

We consider online reinforcement learning in episodic Markov decision process (MDP) with unknown transition function and stochastic rewards drawn from some fixed but unknown distribution. The learner aims to learn the optimal policy and…

Machine Learning · Computer Science 2024-03-12 Vincent Leon , S. Rasoul Etesami

We present Q-chunking, a simple yet effective recipe for improving reinforcement learning (RL) algorithms for long-horizon, sparse-reward tasks. Our recipe is designed for the offline-to-online RL setting, where the goal is to leverage an…

Machine Learning · Computer Science 2026-05-12 Qiyang Li , Zhiyuan Zhou , Sergey Levine

In this paper, we propose a new algorithm for the estimation of multiple time delays (TDs). Since a TD is a fundamental spatial cue for sensor array signal processing techniques, many methods for estimating it have been studied. Most of…

Signal Processing · Electrical Eng. & Systems 2022-03-24 Kouei Yamaoka , Yukoh Wakabayashi , Nobutaka Ono

Online optimization has emerged as powerful tool in large scale optimization. In this paper, we introduce efficient online algorithms based on the alternating directions method (ADM). We introduce a new proof technique for ADM in the batch…

Machine Learning · Computer Science 2012-07-03 Huahua Wang , Arindam Banerjee

Existing high-dimensional online learning methods often face the challenge that their error bounds, or per-batch sample sizes, diverge as the number of data batches increases. To address this issue, we propose an asynchronous decomposition…

Machine Learning · Statistics 2026-03-24 Shixiang Liu , Zhifan Li , Hanming Yang , Jianxin Yin

Online learning algorithms for dynamical systems provide finite time guarantees for control in the presence of sequentially revealed cost functions. We pose the classical linear quadratic tracking problem in the framework of online…

Systems and Control · Electrical Eng. & Systems 2024-10-18 Aren Karapetyan , Diego Bolliger , Anastasios Tsiamis , Efe C. Balta , John Lygeros

The goal of this paper is to study a distributed version of the gradient temporal-difference (GTD) learning algorithm for a class of multi-agent Markov decision processes (MDPs). The temporal-difference (TD) learning is a reinforcement…

Optimization and Control · Mathematics 2020-04-29 Donghwan Lee , Jianghai Hu

A digital twin is a surrogate model that has the main feature to mirror the original process behavior. Associating the dynamical process with a digital twin model of reduced complexity has the significant advantage to map the dynamics with…

Numerical Analysis · Mathematics 2024-03-19 Diana Alina Bistrian , Omer San , Ionel Michael Navon

Temporal difference (TD) learning is a cornerstone reinforcement learning (RL) method for policy evaluation, where the goal is to estimate the value function of a Markov decision process under a fixed policy. While a substantial body of…

Machine Learning · Computer Science 2026-02-02 Donghwan Lee , Do Wan Kim

Unifying seemingly disparate algorithmic ideas to produce better performing algorithms has been a longstanding goal in reinforcement learning. As a primary example, TD($\lambda$) elegantly unifies one-step TD prediction with Monte Carlo…

Artificial Intelligence · Computer Science 2018-06-13 Kristopher De Asis , J. Fernando Hernandez-Garcia , G. Zacharias Holland , Richard S. Sutton

Thompson sampling (TS) has emerged as a robust technique for contextual bandit problems. However, TS requires posterior inference and optimization for action generation, prohibiting its use in many online platforms where latency and ease of…

Machine Learning · Computer Science 2024-07-23 Hongseok Namkoong , Samuel Daulton , Eytan Bakshy

Real-time prediction plays a vital role in various control systems, such as traffic congestion control and wireless channel resource allocation. In these scenarios, the predictor usually needs to track the evolution of the latent…

Optimization and Control · Mathematics 2024-08-14 Zhenting Luan , Defeng Sun , Haoning Wang , Liping Zhang

To overcome the curse of dimensionality and curse of modeling in Dynamic Programming (DP) methods for solving classical Markov Decision Process (MDP) problems, Reinforcement Learning (RL) algorithms are popular. In this paper, we consider…

Machine Learning · Computer Science 2018-11-29 Arghyadip Roy , Vivek Borkar , Abhay Karandikar , Prasanna Chaporkar

While there are convergence guarantees for temporal difference (TD) learning when using linear function approximators, the situation for nonlinear models is far less understood, and divergent examples are known. Here we take a first step…

Machine Learning · Computer Science 2020-02-12 David Brandfonbrener , Joan Bruna

The recursive least-squares (RLS) algorithm is one of the most well-known algorithms used in adaptive filtering, system identification and adaptive control. Its popularity is mainly due to its fast convergence speed, which is considered to…

Machine Learning · Computer Science 2011-06-06 H. He , D. Hu , X. Xu

In this paper, we provide a unified analysis of temporal difference learning algorithms with linear function approximators by exploiting their connections to Markov jump linear systems (MJLS). We tailor the MJLS theory developed in the…

Machine Learning · Computer Science 2019-11-06 Bin Hu , Usman Ahmed Syed

Selecting the optimal recommender via online exploration-exploitation is catching increasing attention where the traditional A/B testing can be slow and costly, and offline evaluations are prone to the bias of history data. Finding the…

Information Retrieval · Computer Science 2022-03-29 Da Xu , Chuanwei Ruan , Evren Korpeoglu , Sushant Kumar , Kannan Achan

Recurrent Neural Networks (RNNs) are useful in temporal sequence tasks. However, training RNNs involves dense matrix multiplications which require hardware that can support a large number of arithmetic operations and memory accesses.…

Machine Learning · Computer Science 2023-12-18 Xi Chen , Chang Gao , Zuowen Wang , Longbiao Cheng , Sheng Zhou , Shih-Chii Liu , Tobi Delbruck

Temporal difference methods enable efficient estimation of value functions in reinforcement learning in an incremental fashion, and are of broader interest because they correspond learning as observed in biological systems. Standard value…

Machine Learning · Computer Science 2019-07-11 Brendan Bennett , Wesley Chung , Muhammad Zaheer , Vincent Liu

We uncover a fairly general principle in online learning: If regret can be (approximately) expressed as a function of certain "sufficient statistics" for the data sequence, then there exists a special Burkholder function that 1) can be used…

Machine Learning · Computer Science 2018-03-22 Dylan J. Foster , Alexander Rakhlin , Karthik Sridharan