中文
相关论文

相关论文: Temporal Regularization in Markov Decision Process

200 篇论文

To overcome the curses of dimensionality and modeling of Dynamic Programming (DP) methods to solve Markov Decision Process (MDP) problems, Reinforcement Learning (RL) methods are adopted in practice. Contrary to traditional RL algorithms…

机器学习 · 计算机科学 2021-08-24 Arghyadip Roy , Vivek Borkar , Abhay Karandikar , Prasanna Chaporkar

Inverse reinforcement learning aims to infer the reward function that explains expert behavior observed through trajectories of state--action pairs. A long-standing difficulty in classical IRL is the non-uniqueness of the recovered reward:…

机器学习 · 统计学 2025-12-09 Denis Belomestny , Alexey Naumov , Sergey Samsonov

Offline reinforcement learning (RL) aims to learn an effective policy from a static dataset. To alleviate extrapolation errors, existing studies often uniformly regularize the value function or policy updates across all states. However, due…

机器学习 · 计算机科学 2025-05-27 Qin-Wen Luo , Ming-Kun Xie , Ye-Wen Wang , Sheng-Jun Huang

In recent years, a variety of tasks have been accomplished by deep reinforcement learning (DRL). However, when applying DRL to tasks in a real-world environment, designing an appropriate reward is difficult. Rewards obtained via actual…

机器学习 · 计算机科学 2023-10-04 Kanata Suzuki , Tetsuya Ogata

This study investigates behavior-targeted attacks on reinforcement learning and their countermeasures. Behavior-targeted attacks aim to manipulate the victim's behavior as desired by the adversary through adversarial interventions in state…

机器学习 · 计算机科学 2026-02-18 Shojiro Yamabe , Kazuto Fukuchi , Jun Sakuma

Temporal difference (TD) methods constitute a class of methods for learning predictions in multi-step prediction problems, parameterized by a recency factor lambda. Currently the most important application of these methods is to temporal…

人工智能 · 计算机科学 2008-02-03 P. Cichosz

This paper surveys the field of reinforcement learning from a computer-science perspective. It is written to be accessible to researchers familiar with machine learning. Both the historical basis of the field and a broad selection of…

人工智能 · 计算机科学 2014-11-17 L. P. Kaelbling , M. L. Littman , A. W. Moore

Mode-dependent architectural components (layers that behave differently during training and evaluation, such as Batch Normalization or dropout) are commonly used in visual reinforcement learning but can destabilize on-policy optimization.…

机器学习 · 计算机科学 2026-02-06 Mohamad Mohamad , Francesco Ponzio , Xavier Descombes

Policy regularization methods such as maximum entropy regularization are widely used in reinforcement learning to improve the robustness of a learned policy. In this paper, we show how this robustness arises from hedging against worst-case…

We propose and analyze a regularization approach for structured prediction problems. We characterize a large class of loss functions that allows to naturally embed structured outputs in a linear space. We exploit this fact to design…

机器学习 · 计算机科学 2017-07-31 Carlo Ciliberto , Alessandro Rudi , Lorenzo Rosasco

Recently regular decision processes have been proposed as a well-behaved form of non-Markov decision process. Regular decision processes are characterised by a transition function and a reward function that depend on the whole history,…

人工智能 · 计算机科学 2022-05-19 Alessandro Ronca , Giuseppe De Giacomo

Deep reinforcement learning algorithms have shown an impressive ability to learn complex control policies in high-dimensional tasks. However, despite the ever-increasing performance on popular benchmarks, policies learned by deep…

机器学习 · 计算机科学 2020-01-22 Jesse Farebrother , Marlos C. Machado , Michael Bowling

One of the main goals of reinforcement learning (RL) is to provide a~way for physical machines to learn optimal behavior instead of being programmed. However, effective control of the machines usually requires fine time discretization. The…

机器学习 · 计算机科学 2022-07-12 Jakub Łyskawa , Paweł Wawrzyński

Sequential decision making, commonly formalized as Markov Decision Process (MDP) optimization, is a important challenge in artificial intelligence. Two key approaches to this problem are reinforcement learning (RL) and planning. This paper…

机器学习 · 计算机科学 2022-04-01 Thomas M. Moerland , Joost Broekens , Aske Plaat , Catholijn M. Jonker

Inverse Reinforcement Learning (IRL) aims to facilitate a learner's ability to imitate expert behavior by acquiring reward functions that explain the expert's decisions. Regularized IRL applies strongly convex regularizers to the learner's…

机器学习 · 计算机科学 2020-12-04 Wonseok Jeon , Chen-Yang Su , Paul Barde , Thang Doan , Derek Nowrouzezahrai , Joelle Pineau

Delays are inherent to most dynamical systems. Besides shifting the process in time, they can significantly affect their performance. For this reason, it is usually valuable to study the delay and account for it. Because they are dynamical…

机器学习 · 计算机科学 2023-09-21 Pierre Liotet

Reinforcement learning has exceeded human-level performance in game playing AI with deep learning methods according to the experiments from DeepMind on Go and Atari games. Deep learning solves high dimension input problems which stop the…

机器学习 · 计算机科学 2019-09-12 Yue Zheng

Reinforcement learning (RL) depends critically on the choice of reward functions used to capture the de- sired behavior and constraints of a robot. Usually, these are handcrafted by a expert designer and represent heuristics for relatively…

人工智能 · 计算机科学 2017-03-03 Xiao Li , Cristian-Ioan Vasile , Calin Belta

Multimodal machine learning has gained significant attention in recent years due to its potential for integrating information from multiple modalities to enhance learning and decision-making processes. However, it is commonly observed that…

机器学习 · 计算机科学 2025-09-12 Sahiti Yerramilli , Jayant Sravan Tamarapalli , Jonathan Francis , Eric Nyberg

Despite the numerous advances, reinforcement learning remains away from widespread acceptance for autonomous controller design as compared to classical methods due to lack of ability to effectively tackle the reality gap. The reliance on…

机器学习 · 计算机科学 2024-09-23 Narendra Patwardhan , Zequn Wang