English
Related papers

Related papers: TD-JEPA: Latent-predictive Representations for Zer…

200 papers

Continual reinforcement learning must balance retention with adaptation, yet many methods still rely on \emph{single-model preservation}, committing to one evolving policy as the main reusable solution across tasks. Even when a previously…

Machine Learning · Computer Science 2026-04-20 Lute Lillo , Nick Cheney

Building deep learning models that can reason about their environment requires capturing its underlying dynamics. Joint-Embedded Predictive Architectures (JEPA) provide a promising framework to model such dynamics by learning…

Machine Learning · Computer Science 2026-01-06 Matthieu Destrade , Oumayma Bounou , Quentin Le Lidec , Jean Ponce , Yann LeCun

Model-based reinforcement learning (MBRL) agents operating in high-dimensional observation spaces, such as Dreamer, rely on learning abstract representations for effective planning and control. Existing approaches typically employ…

Machine Learning · Computer Science 2026-04-15 Michael Hauri , Friedemann Zenke

This paper explores feature prediction as a stand-alone objective for unsupervised learning from video and introduces V-JEPA, a collection of vision models trained solely using a feature prediction objective, without the use of pretrained…

Computer Vision and Pattern Recognition · Computer Science 2024-04-15 Adrien Bardes , Quentin Garrido , Jean Ponce , Xinlei Chen , Michael Rabbat , Yann LeCun , Mahmoud Assran , Nicolas Ballas

We investigate the explainability of Reinforcement Learning (RL) policies from a temporal perspective, focusing on the sequence of future outcomes associated with individual actions. In RL, value functions compress information about rewards…

Machine Learning · Computer Science 2025-01-08 Franco Ruggeri , Alessio Russo , Rafia Inam , Karl Henrik Johansson

World models learned from high-dimensional visual observations allow agents to make decisions and plan directly in latent space, avoiding pixel-level reconstruction. However, recent latent predictive architectures (JEPAs), including the…

Machine Learning · Computer Science 2026-02-25 Leonardo F. Toso , Davit Shadunts , Yunyang Lu , Nihal Sharma , Donglin Zhan , Nam H. Nguyen , James Anderson

Data-driven model predictive control has two key advantages over model-free methods: a potential for improved sample efficiency through model learning, and better performance as computational budget for planning increases. However, it is…

Machine Learning · Computer Science 2022-07-21 Nicklas Hansen , Xiaolong Wang , Hao Su

A key question in reinforcement learning is how an intelligent agent can generalize knowledge across different inputs. By generalizing across different inputs, information learned for one input can be immediately reused for improving…

Machine Learning · Computer Science 2020-10-06 Lucas Lehnert , Michael L. Littman

Data-efficient reinforcement learning (RL) in continuous state-action spaces using very high-dimensional observations remains a key challenge in developing fully autonomous systems. We consider a particularly important instance of this…

Artificial Intelligence · Computer Science 2015-10-12 John-Alexander M. Assael , Niklas Wahlström , Thomas B. Schön , Marc Peter Deisenroth

This article proposes a collision risk anticipation method based on short-term prediction of the agents position. A Long Short-Term Memory (LSTM) model, trained on past trajectories, is used to estimate the next position of each robot. This…

Artificial Intelligence · Computer Science 2025-08-12 Olivier Poulet , Frédéric Guinand , François Guérin

The ability to plan into the future while utilizing only raw high-dimensional observations, such as images, can provide autonomous agents with broad capabilities. Visual model-based reinforcement learning (RL) methods that plan future…

Machine Learning · Computer Science 2021-08-10 Oleh Rybkin , Chuning Zhu , Anusha Nagabandi , Kostas Daniilidis , Igor Mordatch , Sergey Levine

This paper studies the control synthesis of motion planning subject to uncertainties. The uncertainties are considered in robot motions and environment properties, giving rise to the probabilistic labeled Markov decision process (PL-MDP). A…

Robotics · Computer Science 2023-01-31 Mingyu Cai , Shaoping Xiao , Zhijun Li , Zhen Kan

We present a temporally extended variation of the successor representation, which we term t-SR. t-SR captures the expected state transition dynamics of temporally extended actions by constructing successor representations over primitive…

Machine Learning · Computer Science 2022-09-27 Matthew J. Sargent , Peter J. Bentley , Caswell Barry , William de Cothi

Deep reinforcement learning (DRL) provides a promising way for learning navigation in complex autonomous driving scenarios. However, identifying the subtle cues that can indicate drastically different outcomes remains an open problem with…

Machine Learning · Computer Science 2021-03-25 Xiaobai Ma , Jiachen Li , Mykel J. Kochenderfer , David Isele , Kikuo Fujimura

Estimating value functions is a core component of reinforcement learning algorithms. Temporal difference (TD) learning algorithms use bootstrapping, i.e. they update the value function toward a learning target using value estimates at…

Machine Learning · Computer Science 2022-01-07 Anthony GX-Chen , Veronica Chelu , Blake A. Richards , Joelle Pineau

Learning good representations of historical contexts is one of the core challenges of reinforcement learning (RL) in partially observable environments. While self-predictive auxiliary tasks have been shown to improve performance in fully…

Machine Learning · Computer Science 2025-03-11 Jeongyeol Kwon , Liu Yang , Robert Nowak , Josiah Hanna

We present an end-to-end Reinforcement Learning(RL) framework for robotic manipulation tasks, using a robust and efficient keypoints representation. The proposed method learns keypoints from camera images as the state representation,…

Robotics · Computer Science 2022-02-15 Tianying Wang , En Yen Puang , Marcus Lee , Yan Wu , Wei Jing

Visual model-based RL methods typically encode image observations into low-dimensional representations in a manner that does not eliminate redundant information. This leaves them susceptible to spurious variations -- changes in…

Machine Learning · Computer Science 2023-10-26 Chuning Zhu , Max Simchowitz , Siri Gadipudi , Abhishek Gupta

Trajectory prediction is a challenging problem that requires considering interactions among multiple actors and the surrounding environment. While data-driven approaches have been used to address this complex problem, they suffer from…

Computer Vision and Pattern Recognition · Computer Science 2024-03-18 Daehee Park , Jaeseok Jeong , Sung-Hoon Yoon , Jaewoo Jeong , Kuk-Jin Yoon

Vision-Language-Action (VLA) models excel in robotic manipulation but are constrained by their heavy reliance on expert demonstrations, leading to demonstration bias and limiting performance. Reinforcement learning (RL) is a vital…

Robotics · Computer Science 2025-12-02 Senyu Fei , Siyin Wang , Li Ji , Ao Li , Shiduo Zhang , Liming Liu , Jinlong Hou , Jingjing Gong , Xianzhong Zhao , Xipeng Qiu