English
Related papers

Related papers: Temporally Extended Successor Representations

200 papers

This paper presents a novel method for introducing time into discrete and continuous spatial representations used in mobile robotics, by modelling long-term, pseudo-periodic variations caused by human activities. Unlike previous approaches,…

Robotics · Computer Science 2026-03-16 Tomas Krajnik , Tomas Vintr , Sergi Molina , Jaime P. Fentanes , Grzegorz Cielniak , Tom Duckett

In this work, we evaluate the effectiveness of representation learning approaches for decision making in visually complex environments. Representation learning is essential for effective reinforcement learning (RL) from high-dimensional…

Machine Learning · Computer Science 2022-04-26 Jun Yamada , Karl Pertsch , Anisha Gunjal , Joseph J. Lim

Hierarchical abstractions, also known as options -- a type of temporally extended action (Sutton et. al. 1999) that enables a reinforcement learning agent to plan at a higher level, abstracting away from the lower-level details. In this…

Artificial Intelligence · Computer Science 2017-11-22 Daniel J. Mankowitz , Aviv Tamar , Shie Mannor

In this paper, we study representation learning for multi-task decision-making in non-stationary environments. We consider the framework of sequential linear bandits, where the agent performs a series of tasks drawn from distinct sets…

Machine Learning · Computer Science 2022-04-19 Yuzhen Qin , Tommaso Menara , Samet Oymak , ShiNung Ching , Fabio Pasqualetti

Dynamic representation learning plays a pivotal role in understanding the evolution of linguistic content over time. On this front both context and time dynamics as well as their interplay are of prime importance. Current approaches model…

Computation and Language · Computer Science 2024-10-23 Talia Tseriotou , Adam Tsakalidis , Maria Liakata

We study the problem of representational transfer in RL, where an agent first pretrains in a number of source tasks to discover a shared representation, which is subsequently used to learn a good policy in a \emph{target task}. We propose a…

Machine Learning · Computer Science 2023-02-23 Alekh Agarwal , Yuda Song , Wen Sun , Kaiwen Wang , Mengdi Wang , Xuezhou Zhang

In this paper, we propose an adaptive event-triggered reinforcement learning control for continuous-time nonlinear systems, subject to bounded uncertainties, characterized by complex interactions. Specifically, the proposed method is…

Machine Learning · Computer Science 2024-10-01 Umer Siddique , Abhinav Sinha , Yongcan Cao

We propose a novel deep structured learning framework for event temporal relation extraction. The model consists of 1) a recurrent neural network (RNN) to learn scoring functions for pair-wise relations, and 2) a structured support vector…

Computation and Language · Computer Science 2019-09-26 Rujun Han , I-Hung Hsu , Mu Yang , Aram Galstyan , Ralph Weischedel , Nanyun Peng

Multiagent reinforcement learning (MARL) is commonly considered to suffer from non-stationary environments and exponentially increasing policy space. It would be even more challenging when rewards are sparse and delayed over long…

Learning procedural-aware video representations is a key step towards building agents that can reason about and execute complex tasks. Existing methods typically address this problem by aligning visual content with textual descriptions at…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Jinghan Zhao , Yifei Huang , Feng Lu

Temporal abstraction in reinforcement learning is the ability of an agent to learn and use high-level behaviors, called options. The option-critic architecture provides a gradient-based end-to-end learning method to construct options. We…

Machine Learning · Computer Science 2022-01-11 Raviteja Chunduru , Doina Precup

Reinforcement Learning (RL) has achieved remarkable success in various continuous control tasks, such as robot manipulation and locomotion. Different to mainstream RL which makes decisions at individual steps, recent studies have…

Machine Learning · Computer Science 2025-03-07 Buqing Nie , Yangqing Fu , Yue Gao

In order to model the evolution of user preference, we should learn user/item embeddings based on time-ordered item purchasing sequences, which is defined as Sequential Recommendation (SR) problem. Existing methods leverage sequential…

Information Retrieval · Computer Science 2021-08-24 Ziwei Fan , Zhiwei Liu , Jiawei Zhang , Yun Xiong , Lei Zheng , Philip S. Yu

Transfer in reinforcement learning refers to the notion that generalization should occur not only within a task but also across tasks. We propose a transfer framework for the scenario where the reward function changes between tasks but the…

Artificial Intelligence · Computer Science 2018-04-13 André Barreto , Will Dabney , Rémi Munos , Jonathan J. Hunt , Tom Schaul , Hado van Hasselt , David Silver

Deep reinforcement learning (RL) agents that exist in high-dimensional state spaces, such as those composed of images, have interconnected learning burdens. Agents must learn an action-selection policy that completes their given task, which…

Machine Learning · Computer Science 2021-10-12 Trevor McInroe , Lukas Schäfer , Stefano V. Albrecht

Correlated time series analysis plays an important role in many real-world industries. Learning an efficient representation of this large-scale data for further downstream tasks is necessary but challenging. In this paper, we propose a…

Machine Learning · Computer Science 2023-06-21 Luxuan Wang , Lei Bai , Ziyue Li , Rui Zhao , Fugee Tsung

Model-based reinforcement learning (RL) has proven to be a data efficient approach for learning control tasks but is difficult to utilize in domains with complex observations such as images. In this paper, we present a method for learning…

Machine Learning · Computer Science 2019-06-25 Marvin Zhang , Sharad Vikram , Laura Smith , Pieter Abbeel , Matthew J. Johnson , Sergey Levine

Trajectory representation learning is a fundamental task for applications in fields including smart city, and urban planning, as it facilitates the utilization of trajectory data (e.g., vehicle movements) for various downstream…

Machine Learning · Computer Science 2025-01-03 Stefan Schestakov , Simon Gottschalk

Reinforcement learning can train policies that effectively perform complex tasks. However for long-horizon tasks, the performance of these methods degrades with horizon, often necessitating reasoning over and chaining lower-level skills.…

Machine Learning · Computer Science 2022-03-31 Dhruv Shah , Peng Xu , Yao Lu , Ted Xiao , Alexander Toshev , Sergey Levine , Brian Ichter

Sample efficiency and risk-awareness are central to the development of practical reinforcement learning (RL) for complex decision-making. The former can be addressed by transfer learning and the latter by optimizing some utility function of…

Machine Learning · Computer Science 2021-06-01 Michael Gimelfarb , André Barreto , Scott Sanner , Chi-Guhn Lee