中文
相关论文

相关论文: Hierarchical Successor Representation for Robust T…

200 篇论文

In reinforcement learning, temporal difference-based algorithms can be sample-inefficient: for instance, with sparse rewards, no learning occurs until a reward is observed. This can be remedied by learning richer objects, such as a model of…

机器学习 · 计算机科学 2021-01-19 Léonard Blier , Corentin Tallec , Yann Ollivier

One of the biggest challenges to modern deep reinforcement learning (DRL) algorithms is sample efficiency. Many approaches learn a world model in order to train an agent entirely in imagination, eliminating the need for direct environment…

人工智能 · 计算机科学 2024-02-20 Paul Mattes , Rainer Schlosser , Ralf Herbrich

In this paper, we propose to exploit the rich hierarchical features of deep convolutional neural networks to improve the accuracy and robustness of visual tracking. Deep neural networks trained on object recognition datasets consist of…

计算机视觉与模式识别 · 计算机科学 2018-08-14 Chao Ma , Jia-Bin Huang , Xiaokang Yang , Ming-Hsuan Yang

High-dimensional time series prediction is needed in applications as diverse as demand forecasting and climatology. Often, such applications require methods that are both highly scalable, and deal with noisy data in terms of corruptions or…

机器学习 · 计算机科学 2016-02-18 Hsiang-Fu Yu , Nikhil Rao , Inderjit S. Dhillon

In goal-conditioned hierarchical reinforcement learning (HRL), a high-level policy specifies a subgoal for the low-level policy to reach. Effective HRL hinges on a suitable subgoal represen tation function, abstracting state space into…

Learning policies for complex tasks that require multiple different skills is a major challenge in reinforcement learning (RL). It is also a requirement for its deployment in real-world scenarios. This paper proposes a novel framework for…

人工智能 · 计算机科学 2017-12-21 Tianmin Shu , Caiming Xiong , Richard Socher

Generative models have fundamentally reshaped the landscape of decision-making, reframing the problem from pure scalar reward maximization to high-fidelity trajectory generation and distribution matching. This paradigm shift addresses…

In real-world applications with large state and action spaces, reinforcement learning (RL) typically employs function approximations to represent core components like the policies, value functions, and dynamics models. Although powerful…

机器学习 · 计算机科学 2026-01-29 Chenxiao Gao , Haotian Sun , Na Li , Dale Schuurmans , Bo Dai

Many applications of imitation learning require the agent to generate the full distribution of behaviour observed in the training data. For example, to evaluate the safety of autonomous vehicles in simulation, accurate and diverse behaviour…

Decision-making in complex, continuous multi-task environments is often hindered by the difficulty of obtaining accurate models for planning and the inefficiency of learning purely from trial and error. While precise environment dynamics…

机器学习 · 计算机科学 2025-03-20 Jeff Jewett , Sandhya Saisubramanian

Hierarchical Temporal Memory is a new machine learning algorithm intended to mimic the working principle of neocortex, part of the human brain, which is responsible for learning, classification, and making predictions. Although many works…

新兴技术 · 计算机科学 2017-09-26 Timur Ibrayev , Ulan Myrzakhan , Olga Krestinskaya , Aidana Irmanova , Alex Pappachen James

Accurately predicting the behavior of complex dynamical systems, characterized by high-dimensional multivariate time series(MTS) in interconnected sensor networks, is crucial for informed decision-making in various applications to minimize…

A fundamental aspect of behaviour is the ability to encode salient features of experience in memory and use these memories, in combination with current sensory information, to predict the best action for each situation such that long-term…

神经与进化计算 · 计算机科学 2021-06-25 Stephen Kelly , Tatiana Voegerl , Wolfgang Banzhaf , Cedric Gondro

Table structure recognition (TSR) aims to convert tabular images into a machine-readable format, where a visual encoder extracts image features and a textual decoder generates table-representing tokens. Existing approaches use classic…

计算机视觉与模式识别 · 计算机科学 2023-11-10 ShengYun Peng , Seongmin Lee , Xiaojing Wang , Rajarajeswari Balasubramaniyan , Duen Horng Chau

Low-rank structure is a common implicit assumption in many modern reinforcement learning (RL) algorithms. For instance, reward-free and goal-conditioned RL methods often presume that the successor measure admits a low-rank representation.…

机器学习 · 计算机科学 2025-11-06 Bastien Dubail , Stefan Stojanovic , Alexandre Proutière

Transformative innovations in model architectures have introduced hierarchical embedding augmentation as a means to redefine the representation of tokens through multi-level semantic structures, offering enhanced adaptability to complex…

计算与语言 · 计算机科学 2025-08-11 Derek Yotheringhay , Alistair Kirkland , Humphrey Kirkbride , Josiah Whitesteeple

Recommender Systems (RS) are fundamental to modern online services. While most existing approaches optimize for short-term engagement, recent work has begun to explore reinforcement learning (RL) to model long-term user value. However,…

信息检索 · 计算机科学 2026-02-26 Minmao Wang , Xingchen Liu , Shijie Yi , Likang Wu , Hongke Zhao , Fei Pan , Qingpeng Cai , Peng Jiang

Recent advances in hierarchical policy learning highlight the advantages of decomposing systems into high-level and low-level agents, enabling efficient long-horizon reasoning and precise fine-grained control. However, the interface between…

机器人学 · 计算机科学 2025-02-24 Haibo Zhao , Dian Wang , Yizhe Zhu , Xupeng Zhu , Owen Howell , Linfeng Zhao , Yaoyao Qian , Robin Walters , Robert Platt

Hierarchical Reinforcement Learning (HRL) exploits temporal abstraction to solve large Markov Decision Processes (MDP) and provide transferable subtask policies. In this paper, we introduce an off-policy HRL algorithm: Hierarchical Q-value…

人工智能 · 计算机科学 2016-03-30 Tiancheng Zhao , Mohammad Gowayyed

Representations are crucial for a robot to learn effective navigation policies. Recent work has shown that mid-level perceptual abstractions, such as depth estimates or 2D semantic segmentation, lead to more effective policies when provided…

机器人学 · 计算机科学 2022-05-09 Zachary Ravichandran , Lisa Peng , Nathan Hughes , J. Daniel Griffith , Luca Carlone