中文
相关论文

相关论文: Weber-Fechner Law in Temporal Difference learning …

200 篇论文

Our understanding of reinforcement learning (RL) has been shaped by theoretical and empirical results that were obtained decades ago using tabular representations and linear function approximators. These results suggest that RL methods that…

机器学习 · 计算机科学 2018-06-05 Artemij Amiranashvili , Alexey Dosovitskiy , Vladlen Koltun , Thomas Brox

Temporal difference learning (TD) is a simple iterative algorithm used to estimate the value function corresponding to a given policy in a Markov decision process. Although TD is one of the most widely used algorithms in reinforcement…

机器学习 · 计算机科学 2018-11-07 Jalaj Bhandari , Daniel Russo , Raghav Singal

Reinforcement learning (RL) has been recognized as a powerful tool for robot control tasks. RL typically employs reward functions to define task objectives and guide agent learning. However, since the reward function serves the dual purpose…

机器学习 · 计算机科学 2025-12-10 Zhao Yu , Xiuping Wu , Liangjun Ke

Robot control using reinforcement learning has become popular, but its learning process generally terminates halfway through an episode for safety and time-saving reasons. This study addresses the problem of the most popular exception…

机器人学 · 计算机科学 2026-02-25 Taisuke Kobayashi

Reinforcement learning (RL) commonly relies on scalar rewards with limited ability to express temporal, conditional, or safety-critical goals, and can lead to reward hacking. Temporal logic expressible via the more general class of…

人工智能 · 计算机科学 2025-11-26 Dominik Wagner , Leon Witzman , Luke Ong

Developments in reinforcement learning (RL) have allowed algorithms to achieve impressive performance in highly complex, but largely static problems. In contrast, biological learning seems to value efficiency of adaptation to a…

人工智能 · 计算机科学 2022-05-20 Eric Chalmers , Artur Luczak

Reinforcement learning (RL) offers significant promise for machinery fault detection (MFD). However, most existing RL-based MFD approaches do not fully exploit RL's sequential decision-making strengths, often treating MFD as a simple…

机器学习 · 计算机科学 2026-02-27 Dhiraj Neupane , Richard Dazeley , Mohamed Reda Bouadjenek , Sunil Aryal

Reward models are central to both reinforcement learning (RL) with language models and inference-time verification. However, existing reward models often lack temporal consistency, leading to ineffective policy updates and unstable RL…

机器学习 · 计算机科学 2025-09-30 Dan Zhang , Min Cai , Jonathan Light , Ziniu Hu , Yisong Yue , Jie Tang

This paper studies tabular reinforcement learning (RL) in the hybrid setting, which assumes access to both an offline dataset and online interactions with the unknown environment. A central question boils down to how to efficiently utilize…

机器学习 · 计算机科学 2023-05-18 Gen Li , Wenhao Zhan , Jason D. Lee , Yuejie Chi , Yuxin Chen

Follow-The-Regularized-Leader (FTRL) is known as an effective and versatile approach in online learning, where appropriate choice of the learning rate is crucial for smaller regret. To this end, we formulate the problem of adjusting FTRL's…

机器学习 · 计算机科学 2024-03-12 Shinji Ito , Taira Tsuchiya , Junya Honda

Reinforcement learning (RL) algorithms allow artificial agents to improve their selection of actions to increase rewarding experiences in their environments. Temporal Difference (TD) Learning -- a model-free RL method -- is a leading…

机器学习 · 计算机科学 2019-09-05 Jacob Rafati , David C. Noelle

This paper explores continuous-time control synthesis for target-driven navigation to satisfy complex high-level tasks expressed as linear temporal logic (LTL). We propose a model-free framework using deep reinforcement learning (DRL) where…

机器人学 · 计算机科学 2023-03-17 Mingyu Cai , Makai Mann , Zachary Serlin , Kevin Leahy , Cristian-Ioan Vasile

The growing literature of Federated Learning (FL) has recently inspired Federated Reinforcement Learning (FRL) to encourage multiple agents to federatively build a better decision-making policy without sharing raw trajectories. Despite its…

机器学习 · 计算机科学 2022-11-04 Flint Xiaofeng Fan , Yining Ma , Zhongxiang Dai , Wei Jing , Cheston Tan , Bryan Kian Hsiang Low

Solving a reinforcement learning (RL) problem poses two competing challenges: fitting a potentially discontinuous value function, and generalizing well to new observations. In this paper, we analyze the learning dynamics of temporal…

机器学习 · 计算机科学 2022-06-07 Clare Lyle , Mark Rowland , Will Dabney , Marta Kwiatkowska , Yarin Gal

Standard reinforcement learning (RL) optimizes policies for reward but imposes few constraints on how decisions evolve over time. As a result, policies may achieve high performance while exhibiting temporally incoherent behavior such as…

机器学习 · 计算机科学 2026-04-24 Sukesh Subaharan

The effectiveness of reinforcement learning (RL) agents in continuous control robotics tasks is mainly dependent on the design of the underlying reward function, which is highly prone to reward hacking. A misalignment between the reward…

Techniques based on Reinforcement Learning (RL) are increasingly being used to design control policies for robotic systems. RL fundamentally relies on state-based reward functions to encode desired behavior of the robot and bad reward…

机器人学 · 计算机科学 2020-11-11 Parv Kapoor , Anand Balakrishnan , Jyotirmoy V. Deshmukh

The problem of Reinforcement Learning (RL) in an unknown nonlinear dynamical system is equivalent to the search for an optimal feedback law utilizing the simulations/ rollouts of the dynamical system. Most RL techniques search over a…

机器学习 · 计算机科学 2022-03-25 Ran Wang , Karthikeya S. Parunandi , Aayushman Sharma , Raman Goyal , Suman Chakravorty

As a distributed learning paradigm, Federated Learning (FL) faces the communication bottleneck issue due to many rounds of model synchronization and aggregation. Heterogeneous data further deteriorates the situation by causing slow…

机器学习 · 计算机科学 2024-05-24 Zhijie Xie , S. H. Song

This paper addresses the problem of learning optimal control policies for systems with uncertain dynamics and high-level control objectives specified as Linear Temporal Logic (LTL) formulas. Uncertainty is considered in the workspace…

机器人学 · 计算机科学 2024-10-17 Yiannis Kantaros , Jun Wang