English
Related papers

Related papers: MobILE: Model-Based Imitation Learning From Observ…

200 papers

This work handles the inverse reinforcement learning (IRL) problem where only a small number of demonstrations are available from a demonstrator for each high-dimensional task, insufficient to estimate an accurate reward function. Observing…

Artificial Intelligence · Computer Science 2017-10-16 Kun Li , Joel W. Burdick

Model-based reinforcement learning promises strong sample efficiency but often underperforms in practice due to compounding model error, unimodal world models that average over multi-modal dynamics, and overconfident predictions that bias…

Machine Learning · Computer Science 2026-04-07 Mehran Aghabozorgi , Alireza Moazeni , Yanshu Zhang , Ke Li

Augmenting reinforcement learning with imitation learning is often hailed as a method by which to improve upon learning from scratch. However, most existing methods for integrating these two techniques are subject to several strong…

Machine Learning · Computer Science 2020-07-23 Brahma S. Pavse , Faraz Torabi , Josiah P. Hanna , Garrett Warnell , Peter Stone

Behavior Foundation Models (BFMs) enable scalable imitation learning (IL) by pretraining task-agnostic representations that can be rapidly adapted to new tasks. However, existing BFMs assume fixed environment dynamics, limiting their…

Machine Learning · Computer Science 2026-05-19 Rishabh Agrawal , Rahul Jain , Ashutosh Nayyar

Some imitation learning methods combine behavioural cloning with self-supervision to infer actions from state pairs. However, most rely on a large number of expert trajectories to increase generalisation and human intervention to capture…

Machine Learning · Computer Science 2024-07-23 Nathan Gavenski , Juarez Monteiro , Felipe Meneguzzi , Michael Luck , Odinaldo Rodrigues

Individual mobility prediction plays a key role in urban transport, enabling personalized service recommendations and effective travel management. It is widely modeled by data-driven methods such as machine learning, deep learning, as well…

Computation and Language · Computer Science 2026-03-03 Zhenlin Qin , Leizhen Wang , Yancheng Ling , Francisco Camara Pereira , Zhenliang Ma

Distribution shift in imitation learning refers to the problem that the agent cannot plan proper actions for a state that has not been visited during the training. This problem can be largely attributed to the inherently narrow state-action…

Robotics · Computer Science 2026-05-26 Hyung-Suk Yoon , Seung-Woo Seo

We study offline imitation learning (IL) when part of the decision-relevant state is observed only through noisy measurements and the distribution may change between training and deployment. Such settings induce spurious state-action…

Machine Learning · Computer Science 2026-02-02 Shi Bo , AmirEmad Ghassami

Model-based controllers on real robots require accurate knowledge of the system dynamics to perform optimally. For complex dynamics, first-principles modeling is not sufficiently precise, and data-driven approaches can be leveraged to learn…

Robotics · Computer Science 2021-05-17 Weixuan Zhang , Marco Tognon , Lionel Ott , Roland Siegwart , Juan Nieto

Mixed Integer Linear Programming (MILP) is essential for modeling complex decision-making problems but faces challenges in computational tractability and requires expert formulation. Current deep learning approaches for MILP focus on…

Machine Learning · Computer Science 2025-02-24 Sirui Li , Janardhan Kulkarni , Ishai Menache , Cathy Wu , Beibin Li

Imitation Learning (IL) is a widely used framework for learning imitative behavior from demonstrations. It is especially appealing for solving complex real-world tasks where handcrafting reward function is difficult, or when the goal is to…

Machine Learning · Computer Science 2024-01-17 Chenran Li , Chen Tang , Haruki Nishimura , Jean Mercat , Masayoshi Tomizuka , Wei Zhan

Integer linear programs (ILPs) are commonly employed to model diverse practical problems such as scheduling and planning. Recently, machine learning techniques have been utilized to solve ILPs. A straightforward idea is to train a model via…

Optimization and Control · Mathematics 2025-01-08 Qian Chen , Tianjian Zhang , Linxin Yang , Qingyu Han , Akang Wang , Ruoyu Sun , Xiaodong Luo , Tsung-Hui Chang

The proliferation of resourceful mobile devices that store rich, multidimensional and privacy-sensitive user data motivate the design of federated learning (FL), a machine-learning (ML) paradigm that enables mobile devices to produce an ML…

Networking and Internet Architecture · Computer Science 2021-01-07 Christodoulos Pappas , Dimitris Chatzopoulos , Spyros Lalis , Manolis Vavalis

A challenge in robot grasping is to achieve task-grasping which is to select a grasp that is advantageous to the success of tasks before and after grasps. One of the frameworks to address this difficulty is Learning-from-Observation (LfO),…

Robotics · Computer Science 2022-03-03 Daichi Saito , Kazuhiro Sasabuchi , Naoki Wake , Jun Takamatsu , Hideki Koike , Katsushi Ikeuchi

We study the problem of learning from aggregate observations where supervision signals are given to sets of instances instead of individual instances, while the goal is still to predict labels of unseen individuals. A well-known example is…

Machine Learning · Statistics 2021-01-08 Yivan Zhang , Nontawat Charoenphakdee , Zhenguo Wu , Masashi Sugiyama

We present a new algorithm for imitation learning in infinite horizon linear MDPs dubbed ILARL which greatly improves the bound on the number of trajectories that the learner needs to sample from the environment. In particular, we remove…

Machine Learning · Computer Science 2024-08-26 Luca Viano , Stratis Skoulakis , Volkan Cevher

Existing imitation learning (IL) methods such as inverse reinforcement learning (IRL) usually have a double-loop training process, alternating between learning a reward function and a policy and tend to suffer long training time and high…

Machine Learning · Computer Science 2022-06-13 Siwei Chen , Xiao Ma , Zhongwen Xu

Reproducing realistic collective behaviors presents a captivating yet formidable challenge. Traditional rule-based methods rely on hand-crafted principles, limiting motion diversity and realism in generated collective behaviors. Recent…

Graphics · Computer Science 2025-04-02 Yifan Wu , Zhiyang Dou , Yuko Ishiwaka , Shun Ogawa , Yuke Lou , Wenping Wang , Lingjie Liu , Taku Komura

Imitation learning (IL) from a state-based reinforcement learning (RL) policy is a common approach to overcome the curse of dimensionality in complex and high-dimensional observation spaces prevalent in robotics. This paper addresses the…

Machine Learning · Computer Science 2026-05-28 Meraj Mammadov , Pedro Zuidberg Dos Martires , Johannes Andreas Stork

The goal of imitation learning (IL) is to learn a good policy from high-quality demonstrations. However, the quality of demonstrations in reality can be diverse, since it is easier and cheaper to collect demonstrations from a mix of experts…

Machine Learning · Computer Science 2019-09-17 Voot Tangkaratt , Bo Han , Mohammad Emtiyaz Khan , Masashi Sugiyama