中文
相关论文

相关论文: Predecessor Features

200 篇论文

Reinforcement Learning algorithms aim to learn optimal control strategies through iterative interactions with an environment. A critical element in this process is the experience replay buffer, which stores past experiences, allowing the…

机器学习 · 计算机科学 2025-01-31 Hoda Yamani , Yuning Xing , Lee Violet C. Ong , Bruce A. MacDonald , Henry Williams

Reinforcement learning (RL) can be formulated as a sequence modeling problem, where models predict future actions based on historical state-action-reward sequences. Current approaches typically require long trajectory sequences to model the…

机器学习 · 计算机科学 2024-12-23 Hemant Kumawat , Saibal Mukhopadhyay

Continual learning of new knowledge over time is one desirable capability for intelligent systems to recognize more and more classes of objects. Without or with very limited amount of old data stored, an intelligent system often…

计算机视觉与模式识别 · 计算机科学 2021-04-29 Zhuoyun Li , Changhong Zhong , Sijia Liu , Ruixuan Wang , Wei-Shi Zheng

Successor-style representations have many advantages for reinforcement learning: for example, they can help an agent generalize from past experience to new goals, and they have been proposed as explanations of behavioral and neural data…

机器学习 · 计算机科学 2021-03-17 Kianté Brantley , Soroush Mehri , Geoffrey J. Gordon

Reinforcement learning (RL) presents a promising framework to learn policies through environment interaction, but often requires an infeasible amount of interaction data to solve complex tasks from sparse rewards. One direction includes…

机器学习 · 计算机科学 2024-05-07 Stone Tao , Arth Shukla , Tse-kai Chan , Hao Su

Episodic self-imitation learning, a novel self-imitation algorithm with a trajectory selection module and an adaptive loss function, is proposed to speed up reinforcement learning. Compared to the original self-imitation learning algorithm,…

人工智能 · 计算机科学 2020-11-30 Tianhong Dai , Hengyan Liu , Anil Anthony Bharath

In continual learning, model needs to continually learn a feature extractor and classifier on a sequence of tasks. This paper focuses on how to learn a classifier based on a pretrained feature extractor under continual learning setting. We…

机器学习 · 计算机科学 2023-02-24 Ziheng Li , Shibo Jie , Zhi-Hong Deng

In many real-world scenarios, data to train machine learning models becomes available over time. Unfortunately, these models struggle to continually learn new concepts without forgetting what has been learnt in the past. This phenomenon is…

计算与语言 · 计算机科学 2023-01-16 Beyza Ermis , Giovanni Zappella , Martin Wistuba , Aditya Rawal , Cedric Archambeau

Temporal point process is an expressive tool for modeling event sequences over time. In this paper, we take a reinforcement learning view whereby the observed sequences are assumed to be generated from a mixture of latent policies. The…

机器学习 · 计算机科学 2019-07-01 Weichang Wu , Junchi Yan , Xiaokang Yang , Hongyuan Zha

We consider the problem of reinforcement learning under safety requirements, in which an agent is trained to complete a given task, typically formalized as the maximization of a reward signal over time, while concurrently avoiding…

The unsupervised Pretraining method has been widely used in aiding human action recognition. However, existing methods focus on reconstructing the already present frames rather than generating frames which happen in future.In this paper, We…

计算机视觉与模式识别 · 计算机科学 2017-12-13 Yu Runsheng , Shi Zhenyu , Ma Qiongxiong , Qing Laiyun

We propose a probabilistic framework to directly insert prior knowledge in reinforcement learning (RL) algorithms by defining the behaviour policy as a Bayesian posterior distribution. Such a posterior combines task specific information…

机器学习 · 计算机科学 2018-10-02 Michalis K. Titsias , Sotirios Nikoloutsopoulos

Preference-based learning of reward functions, where the reward function is learned using comparison data, has been well studied for complex robotic tasks such as autonomous driving. Existing algorithms have focused on learning reward…

机器人学 · 计算机科学 2021-03-05 Sydney M. Katz , Amir Maleki , Erdem Bıyık , Mykel J. Kochenderfer

In this paper, we introduce a fresh perspective on the challenges of credit assignment and policy evaluation. First, we delve into the nuances of eligibility traces and explore instances where their updates may result in unexpected credit…

机器学习 · 计算机科学 2023-12-21 Dhawal Gupta , Scott M. Jordan , Shreyas Chaudhari , Bo Liu , Philip S. Thomas , Bruno Castro da Silva

Replaying past experiences has proven to be a highly effective approach for averting catastrophic forgetting in supervised continual learning. However, some crucial factors are still largely ignored, making it vulnerable to serious failure,…

机器学习 · 计算机科学 2023-11-21 Tiantian Zhang , Kevin Zehua Shen , Zichuan Lin , Bo Yuan , Xueqian Wang , Xiu Li , Deheng Ye

This paper describes an application of reinforcement learning to the mention detection task. We define a novel action-based formulation for the mention detection task, in which a model can flexibly revise past labeling decisions by grouping…

计算与语言 · 计算机科学 2017-03-14 Georgiana Dinu , Wael Hamza , Radu Florian

Current approaches for explaining machine learning models fall into two distinct classes: antecedent event influence and value attribution. The former leverages training instances to describe how much influence a training point exerts on a…

机器学习 · 计算机科学 2019-01-30 Umang Bhatt , Pradeep Ravikumar , Jose M. F. Moura

Deep neural networks are often considered opaque systems, prompting the need for explainability methods to improve trust and accountability. Existing approaches typically attribute test-time predictions either to input features (e.g.,…

计算机视觉与模式识别 · 计算机科学 2025-10-13 Aziz Bacha , Thomas George

Early Classification of Time Series (ECTS) has been recognized as an important problem in many areas where decisions have to be taken as soon as possible, before the full data availability, while time pressure increases. Numerous ECTS…

机器学习 · 计算机科学 2025-02-11 Aurélien Renault , Alexis Bondu , Antoine Cornuéjols , Vincent Lemaire

Recent advances in reinforcement-learning research have demonstrated impressive results in building algorithms that can out-perform humans in complex tasks. Nevertheless, creating reinforcement-learning systems that can build abstractions…

机器学习 · 计算机科学 2022-11-08 Lucas Lehnert , Michael J. Frank , Michael L. Littman