English
Related papers

Related papers: Hitting Time Isomorphism for Multi-Stage Planning …

200 papers

How to extract as much learning signal from each trajectory data has been a key problem in reinforcement learning (RL), where sample inefficiency has posed serious challenges for practical applications. Recent works have shown that using…

Machine Learning · Computer Science 2022-02-07 Hiroki Furuta , Yutaka Matsuo , Shixiang Shane Gu

For imitation learning algorithms to scale to real-world challenges, they must handle high-dimensional observations, offline learning, and policy-induced covariate-shift. We propose DITTO, an offline imitation learning algorithm which…

Machine Learning · Computer Science 2025-03-24 Branton DeMoss , Paul Duckworth , Jakob Foerster , Nick Hawes , Ingmar Posner

The problem of identifying geometric structure in data is a cornerstone of (unsupervised) learning. As a result, Geometric Representation Learning has been widely applied across scientific and engineering domains. In this work, we…

Machine Learning · Computer Science 2025-06-03 Imran Nasim , Melanie Weber

Model-based offline reinforcement learning (MORL) aims to learn a policy by exploiting a dynamics model derived from an existing dataset. Applying conservative quantification to the dynamics model, most existing works on MORL generate…

Machine Learning · Computer Science 2025-05-06 Shenghong He

Designing continuous trajectories whose time-averaged occupancy provably matches a prescribed spatial density (the \emph{ergodic coverage} problem) is central to UAV-assisted data collection and sensing, robotic exploration, and mobile…

Machine Learning · Computer Science 2026-05-14 Ehsan Aghazadeh , Masoud Malekzadeh , Ahmad Ghasemi , Hossein Pishro-Nik

Multi-Task Learning (MTL) seeks to boost statistical power and learning efficiency by discovering structure shared across related tasks. State-of-the-art MTL representation methods, however, usually treat the latent representation matrix as…

Machine Learning · Statistics 2025-05-07 Aoran Chen , Yang Feng

Imitation learning (IL) is widely used for motion planning in autonomous driving due to its data efficiency and access to real-world driving data. For safe and robust real-world driving, IL-based planning requires capturing the complex…

Robotics · Computer Science 2026-03-16 Junyong Yun , Jungho Kim , ByungHyun Lee , Dongyoung Lee , Sehwan Choi , Seunghyeop Nam , Kichun Jo , Jun Won Choi

It has been a challenge to learning skills for an agent from long-horizon unannotated demonstrations. Existing approaches like Hierarchical Imitation Learning(HIL) are prone to compounding errors or suboptimal solutions. In this paper, we…

Machine Learning · Computer Science 2021-06-14 Mingxuan Jing , Wenbing Huang , Fuchun Sun , Xiaojian Ma , Tao Kong , Chuang Gan , Lei Li

In-context learning (ICL) enables task adaptation at inference time by conditioning on demonstrations rather than updating model parameters. Although recent time-series foundation models incorporate contextual conditioning, retrieval, or…

Machine Learning · Computer Science 2026-05-15 Anish Saha , Konstantin Shmakov

We introduce a general framework for visual forecasting, which directly imitates visual sequences without additional supervision. As a result, our model can be applied at several semantic levels and does not require any domain knowledge or…

Computer Vision and Pattern Recognition · Computer Science 2017-08-22 Kuo-Hao Zeng , William B. Shen , De-An Huang , Min Sun , Juan Carlos Niebles

Imitation learning (IL) enables agents to mimic expert behaviors. Most previous IL techniques focus on precisely imitating one policy through mass demonstrations. However, in many applications, what humans require is the ability to perform…

Machine Learning · Computer Science 2023-10-10 Xiong-Hui Chen , Junyin Ye , Hang Zhao , Yi-Chen Li , Haoran Shi , Yu-Yan Xu , Zhihao Ye , Si-Hang Yang , Anqi Huang , Kai Xu , Zongzhang Zhang , Yang Yu

Homing and navigation are fundamental behaviors in biological systems that enable agents to reliably reach a target under uncertainty. We present a Reinforcement Learning (RL) framework to model adaptive homing in continuous two-dimensional…

Soft Condensed Matter · Physics 2026-02-10 Riya Singh , Pratikshya Jena , Anish Kumar , Shradha Mishra

Practical Imitation Learning (IL) systems rely on large human demonstration datasets for successful policy learning. However, challenges lie in maintaining the quality of collected data and addressing the suboptimal nature of some…

Robotics · Computer Science 2025-05-07 Sachit Kuhar , Shuo Cheng , Shivang Chopra , Matthew Bronars , Danfei Xu

While imitation learning (IL) has enabled successful visual navigation in many common environments, IL policies are prone to unpredictable failures under out-of-distribution (OOD) scenarios. This necessitates failure-resilient policies,…

Robotics · Computer Science 2026-05-19 Zishuo Wang , Joel Loo , David Hsu

Online imitation learning (IL) is an algorithmic framework that leverages interactions with expert policies for efficient policy optimization. Here policies are optimized by performing online learning on a sequence of loss functions that…

Machine Learning · Computer Science 2021-02-23 Xinyan Yan , Byron Boots , Ching-An Cheng

This work introduces Transformer-based Off-Policy Episodic Reinforcement Learning (TOP-ERL), a novel algorithm that enables off-policy updates in the ERL framework. In ERL, policies predict entire action trajectories over multiple time…

Machine Learning · Computer Science 2025-03-18 Ge Li , Dong Tian , Hongyi Zhou , Xinkai Jiang , Rudolf Lioutikov , Gerhard Neumann

To achieve autonomy in a priori unknown real-world scenarios, agents should be able to: i) act from high-dimensional sensory observations (e.g., images), ii) learn from past experience to adapt and improve, and iii) be capable of long…

Robotics · Computer Science 2022-12-12 Onur Beker , Mohammad Mohammadi , Amir Zamir

Discrete motion tokenization has recently enabled Large Language Models (LLMs) to serve as versatile backbones for motion understanding and motion-language reasoning. However, existing pipelines typically decouple motion quantization from…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Zhankai Ye , Bofan Li , Yukai Jin , Shuoqiu Li , Wei Wang , Yanfu Zhang , Shangqian Gao , Xin Liu

In tasks aiming for long-term returns, planning becomes essential. We study generative modeling for planning with datasets repurposed from offline reinforcement learning. Specifically, we identify temporal consistency in the absence of…

Machine Learning · Computer Science 2025-08-19 Deqian Kong , Dehong Xu , Minglu Zhao , Bo Pang , Jianwen Xie , Andrew Lizarraga , Yuhao Huang , Sirui Xie , Ying Nian Wu

In offline imitation learning (IL), we generally assume only a handful of expert trajectories and a supplementary offline dataset from suboptimal behaviors to learn the expert policy. While it is now common to minimize the divergence…

Machine Learning · Computer Science 2024-01-19 Hee-Jun Ahn , Seong-Woong Shim , Byung-Jun Lee