English
Related papers

Related papers: Truncating Temporal Differences: On the Efficient …

200 papers

The backpropagation method has enabled transformative uses of neural networks. Alternatively, for energy-based models, local learning methods involving only nearby neurons offer benefits in terms of decentralized training, and allow for the…

Disordered Systems and Neural Networks · Physics 2025-01-30 Martin J. Falk , Adam T. Strupp , Benjamin Scellier , Arvind Murugan

Recent advancements in feature representation and dimension reduction have highlighted their crucial role in enhancing the efficacy of predictive modeling. This work introduces TemporalPaD, a novel end-to-end deep learning framework…

Machine Learning · Computer Science 2024-09-30 Xuechen Mu , Zhenyu Huang , Kewei Li , Haotian Zhang , Xiuli Wang , Yusi Fan , Kai Zhang , Fengfeng Zhou

TD-learning is a foundation reinforcement learning (RL) algorithm for value prediction. Critical to the accuracy of value predictions is the quality of state representations. In this work, we consider the question: how does end-to-end…

Machine Learning · Computer Science 2023-05-31 Yunhao Tang , Rémi Munos

Deep reinforcement learning algorithms that learn policies by trial-and-error must learn from limited amounts of data collected by actively interacting with the environment. While many prior works have shown that proper regularization…

Machine Learning · Computer Science 2023-04-21 Qiyang Li , Aviral Kumar , Ilya Kostrikov , Sergey Levine

There is a long history of using meta learning as representation learning, specifically for determining the relevance of inputs. In this paper, we examine an instance of meta-learning in which feature relevance is learned by adapting step…

Machine Learning · Computer Science 2019-03-11 Alex Kearney , Vivek Veeriah , Jaden Travnik , Patrick M. Pilarski , Richard S. Sutton

We quantify the efficiency of temporal difference (TD) learning over the direct, or Monte Carlo (MC), estimator for policy evaluation in reinforcement learning, with an emphasis on estimation of quantities related to rare events. Policy…

Machine Learning · Computer Science 2025-01-17 Xiaoou Cheng , Jonathan Weare

The recent emergence of reinforcement learning has created a demand for robust statistical inference methods for the parameter estimates computed using these algorithms. Existing methods for statistical inference in online learning are…

Machine Learning · Statistics 2022-06-29 Pratik Ramprasad , Yuantong Li , Zhuoran Yang , Zhaoran Wang , Will Wei Sun , Guang Cheng

Value function approximation is a crucial module for policy evaluation in reinforcement learning when the state space is large or continuous. The present paper takes a generative perspective on policy evaluation via temporal-difference (TD)…

Machine Learning · Statistics 2021-12-03 Qin Lu , Georgios B. Giannakis

Integral to recent successes in deep reinforcement learning has been a class of temporal difference methods that use infrequently updated target values for policy evaluation in a Markov Decision Process. Yet a complete theoretical…

Machine Learning · Computer Science 2023-08-15 Mattie Fellows , Matthew J. A. Smith , Shimon Whiteson

Accurate value estimates are important for off-policy reinforcement learning. Algorithms based on temporal difference learning typically are prone to an over- or underestimation bias building up over time. In this paper, we propose a…

Machine Learning · Computer Science 2022-10-24 Nicolai Dorka , Tim Welschehold , Joschka Boedecker , Wolfram Burgard

In this paper we extend temporal difference policy evaluation algorithms to performance criteria that include the variance of the cumulative reward. Such criteria are useful for risk management, and are important in domains such as finance…

Machine Learning · Computer Science 2013-10-15 Aviv Tamar , Dotan Di Castro , Shie Mannor

We introduce Test-Time Discovery (TTD) as a novel task that addresses class shifts during testing, requiring models to simultaneously identify emerging categories while preserving previously learned ones. A key challenge in TTD is…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Fan Lyu , Tianle Liu , Zhang Zhang , Fuyuan Hu , Liang Wang

Reinforcement learning has been successful across several applications in which agents have to learn to act in environments with sparse feedback. However, despite this empirical success there is still a lack of theoretical understanding of…

Machine Learning · Statistics 2023-11-08 Blake Bordelon , Paul Masset , Henry Kuo , Cengiz Pehlevan

This paper proposes a new reinforcement learning with hyperbolic discounting. Combining a new temporal difference error with the hyperbolic discounting in recursive manner and reward-punishment framework, a new scheme to learn the optimal…

Machine Learning · Computer Science 2021-06-04 Taisuke Kobayashi

Reward engineering is an important aspect of reinforcement learning. Whether or not the user's intentions can be correctly encapsulated in the reward function can significantly impact the learning outcome. Current methods rely on manually…

Artificial Intelligence · Computer Science 2017-09-28 Xiao Li , Yao Ma , Calin Belta

This paper addresses the problem of learning control policies for mobile robots, modeled as unknown Markov Decision Processes (MDPs), that are tasked with temporal logic missions, such as sequencing, coverage, or surveillance. The MDP…

Robotics · Computer Science 2022-07-13 Yiannis Kantaros

We study the policy evaluation problem in multi-agent reinforcement learning. In this problem, a group of agents works cooperatively to evaluate the value function for the global discounted accumulative reward problem, which is composed of…

Optimization and Control · Mathematics 2019-06-04 Thinh T. Doan , Siva Theja Maguluri , Justin Romberg

We establish novel and general high-dimensional concentration inequalities and Berry-Esseen bounds for vector-valued martingales induced by Markov chains. We apply these results to analyze the performance of the Temporal Difference (TD)…

Machine Learning · Statistics 2026-05-22 Weichen Wu , Yuting Wei , Alessandro Rinaldo

We consider reinforcement learning with performance evaluated by a dynamic risk measure. We construct a projected risk-averse dynamic programming equation and study its properties. Then we propose risk-averse counterparts of the methods of…

Optimization and Control · Mathematics 2020-03-03 Umit Kose , Andrzej Ruszczynski

Ensuring that reinforcement learning (RL) controllers satisfy safety and reliability constraints in real-world settings remains challenging: state-avoidance and constrained Markov decision processes often fail to capture trajectory-level…

Machine Learning · Computer Science 2026-04-06 Alper Kamil Bozkurt , Calin Belta , Ming C. Lin