English
Related papers

Related papers: Unifying Model-Free Efficiency and Model-Based Rep…

200 papers

Quadrupeds have gained rapid advancement in their capability of traversing across complex terrains. The adoption of deep Reinforcement Learning (RL), transformers and various knowledge transfer techniques can greatly reduce the sim-to-real…

Robotics · Computer Science 2025-08-05 Dikai Liu , Tianwei Zhang , Jianxiong Yin , Simon See

Modern representation learning methods often struggle to adapt quickly under non-stationarity because they suffer from catastrophic forgetting and decaying plasticity. Such problems prevent learners from fast adaptation since they may…

Machine Learning · Computer Science 2023-04-28 Mohamed Elsayed , A. Rupam Mahmood

Unsupervised pre-training has shown great success in skeleton-based action understanding recently. Existing works typically train separate modality-specific models, then integrate the multi-modal information for action understanding by a…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Shengkai Sun , Daizong Liu , Jianfeng Dong , Xiaoye Qu , Junyu Gao , Xun Yang , Xun Wang , Meng Wang

We present a scalable framework for cross-embodiment humanoid robot control by learning a shared latent representation that unifies motion across humans and diverse humanoid platforms, including single-arm, dual-arm, and legged humanoid…

Robotics · Computer Science 2026-01-23 Yashuai Yan , Dongheui Lee

Building deep reinforcement learning (RL) agents that find a good policy with few samples has proven notoriously challenging. To achieve sample efficiency, recent work has explored updating neural networks with large numbers of gradient…

Machine Learning · Computer Science 2025-04-04 Claas A Voelcker , Marcel Hussing , Eric Eaton , Amir-massoud Farahmand , Igor Gilitschenski

Deep latent variable models have achieved significant empirical successes in model-based reinforcement learning (RL) due to their expressiveness in modeling complex transition dynamics. On the other hand, it remains unclear theoretically…

Machine Learning · Computer Science 2023-03-08 Tongzheng Ren , Chenjun Xiao , Tianjun Zhang , Na Li , Zhaoran Wang , Sujay Sanghavi , Dale Schuurmans , Bo Dai

Reinforcement learning (RL) tackles sequential decision-making problems by creating agents that interacts with their environment. However, existing algorithms often view these problem as static, focusing on point estimates for model…

Machine Learning · Statistics 2024-03-21 Frank Shih , Faming Liang

We address the problem of learning reusable state representations from streaming high-dimensional observations. This is important for areas like Reinforcement Learning (RL), which yields non-stationary data distributions during training. We…

Machine Learning · Computer Science 2020-10-08 Rika Antonova , Maksim Maydanskiy , Danica Kragic , Sam Devlin , Katja Hofmann

In embodied intelligence, the embodiment gap between robotic and human hands brings significant challenges for learning from human demonstrations. Although some studies have attempted to bridge this gap using reinforcement learning, they…

In this paper, we show that the performance of a learnt generative model is closely related to the model's ability to accurately represent the inferred \textbf{latent data distribution}, i.e. its topology and structural properties. We…

Computer Vision and Pattern Recognition · Computer Science 2020-09-02 Shuyu Lin , Ronald Clark

The recent focus and release of pre-trained models have been a key components to several advancements in many fields (e.g. Natural Language Processing and Computer Vision), as a matter of fact, pre-trained models learn disparate latent…

Machine Learning · Computer Science 2025-07-11 Elia Piccoli , Malio Li , Giacomo Carfì , Vincenzo Lomonaco , Davide Bacciu

Reinforcement learning is concerned with identifying reward-maximizing behaviour policies in environments that are initially unknown. State-of-the-art reinforcement learning approaches, such as deep Q-networks, are model-free and learn to…

Artificial Intelligence · Computer Science 2017-08-18 Felix Leibfried , Nate Kushman , Katja Hofmann

Data efficiency is a key challenge for deep reinforcement learning. We address this problem by using unlabeled data to pretrain an encoder which is then finetuned on a small amount of task-specific data. To encourage learning…

While a general embodied agent must function as a unified system, current methods are built on isolated models for understanding, world modeling, and control. This fragmentation prevents unifying multimodal generative capabilities and…

Computer Vision and Pattern Recognition · Computer Science 2025-12-29 Hongzhe Bi , Hengkai Tan , Shenghao Xie , Zeyuan Wang , Shuhe Huang , Haitian Liu , Ruowen Zhao , Yao Feng , Chendong Xiang , Yinze Rong , Hongyan Zhao , Hanyu Liu , Zhizhong Su , Lei Ma , Hang Su , Jun Zhu

A major challenge in modern reinforcement learning (RL) is efficient control of dynamical systems from high-dimensional sensory observations. Learning controllable embedding (LCE) is a promising approach that addresses this challenge by…

Machine Learning · Computer Science 2020-06-25 Brandon Cui , Yinlam Chow , Mohammad Ghavamzadeh

We propose a novel approach to addressing two fundamental challenges in Model-based Reinforcement Learning (MBRL): the computational expense of repeatedly finding a good policy in the learned model, and the objective mismatch between model…

Machine Learning · Computer Science 2023-03-02 Anirudh Vemula , Yuda Song , Aarti Singh , J. Andrew Bagnell , Sanjiban Choudhury

We introduce DreamerAD, the first latent world model framework that enables efficient reinforcement learning for autonomous driving by compressing diffusion sampling from 100 steps to 1 - achieving 80x speedup while maintaining visual…

Meta-reinforcement learning (RL) addresses the problem of sample inefficiency in deep RL by using experience obtained in past tasks for a new task to be solved. However, most meta-RL methods require partially or fully on-policy data, i.e.,…

Artificial Intelligence · Computer Science 2021-01-07 Takahisa Imagawa , Takuya Hiraoka , Yoshimasa Tsuruoka

We propose a new approach to value function approximation which combines linear temporal difference reinforcement learning with subspace identification. In practical applications, reinforcement learning (RL) is complicated by the fact that…

Machine Learning · Computer Science 2015-03-17 Byron Boots , Geoffrey J. Gordon

Model-Free Reinforcement Learning (RL) algorithms either learn how to map states to expected rewards or search for policies that can maximize a certain performance function. Model-Based algorithms instead, aim to learn an approximation of…

Machine Learning · Computer Science 2024-11-19 Juan Cardenas-Cartagena , Massimiliano Falzari , Marco Zullich , Matthia Sabatelli