English
Related papers

Related papers: VILD: Variational Imitation Learning with Diverse-…

200 papers

Imitation learning is well-suited for robotic tasks where it is difficult to directly program the behavior or specify a cost for optimal control. In this work, we propose a method for learning the reward function (and the corresponding…

Machine Learning · Computer Science 2021-01-01 Tianwei Ni , Harshit Sikchi , Yufei Wang , Tejus Gupta , Lisa Lee , Benjamin Eysenbach

The majority of language model training builds on imitation learning. It covers pretraining, supervised fine-tuning, and affects the starting conditions for reinforcement learning from human feedback (RLHF). The simplicity and scalability…

Invariance learning methods aim to learn invariant features in the hope that they generalize under distributional shifts. Although many tasks are naturally characterized by continuous domains, current invariance learning techniques…

Machine Learning · Computer Science 2024-04-24 Yong Lin , Fan Zhou , Lu Tan , Lintao Ma , Jiameng Liu , Yansu He , Yuan Yuan , Yu Liu , James Zhang , Yujiu Yang , Hao Wang

Incremental Learning (IL) is useful when artificial systems need to deal with streams of data and do not have access to all data at all times. The most challenging setting requires a constant complexity of the deep model and an incremental…

Computer Vision and Pattern Recognition · Computer Science 2020-09-01 Eden Belouadah , Adrian Popescu , Ioannis Kanellos

In Large Visual Language Models (LVLMs), the efficacy of In-Context Learning (ICL) remains limited by challenges in cross-modal interactions and representation disparities. To overcome these challenges, we introduce a novel Visual…

Computer Vision and Pattern Recognition · Computer Science 2024-02-20 Yucheng Zhou , Xiang Li , Qianning Wang , Jianbing Shen

Imitation by observation is an approach for learning from expert demonstrations that lack action information, such as videos. Recent approaches to this problem can be placed into two broad categories: training dynamics models that aim to…

Machine Learning · Computer Science 2019-05-21 Ashley D. Edwards , Charles L. Isbell

Class-incremental learning (CIL) has been widely studied under the setting of starting from a small number of classes (base classes). Instead, we explore an understudied real-world setting of CIL that starts with a strong model pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2022-09-13 Tz-Ying Wu , Gurumurthy Swaminathan , Zhizhong Li , Avinash Ravichandran , Nuno Vasconcelos , Rahul Bhotika , Stefano Soatto

In this paper, we focus on single-demonstration imitation learning (IL), a practical approach for real-world applications where acquiring multiple expert demonstrations is costly or infeasible and the ground truth reward function is not…

Machine Learning · Computer Science 2024-07-09 Chia-Cheng Chiang , Li-Cheng Lan , Wei-Fang Sun , Chien Feng , Cho-Jui Hsieh , Chun-Yi Lee

We study Imitation Learning (IL) from Observations alone (ILFO) in large-scale MDPs. While most IL algorithms rely on an expert to directly provide actions to the learner, in this setting the expert only supplies sequences of observations.…

Machine Learning · Computer Science 2019-06-12 Wen Sun , Anirudh Vemula , Byron Boots , J. Andrew Bagnell

Limited data has become a major bottleneck in scaling up offline imitation learning (IL). In this paper, we propose enhancing IL performance under limited expert data by introducing a pre-training stage that learns dynamics representations,…

Robotics · Computer Science 2025-08-21 Haitong Ma , Bo Dai , Zhaolin Ren , Yebin Wang , Na Li

The planning problem constitutes a fundamental aspect of the autonomous driving framework. Recent strides in representation learning have empowered vehicles to comprehend their surrounding environments, thereby facilitating the integration…

Diffusion models excel at generative modeling (e.g., text-to-image) but sampling requires multiple denoising network passes, limiting practicality. Efforts such as progressive distillation or consistency distillation have shown promise by…

Machine Learning · Computer Science 2025-04-01 Risheek Garrepalli , Shweta Mahajan , Munawar Hayat , Fatih Porikli

Learning diverse and high-performance behaviors from a limited set of demonstrations is a grand challenge. Traditional imitation learning methods usually fail in this task because most of them are designed to learn one specific behavior…

Machine Learning · Computer Science 2025-04-07 Xingrui Yu , Zhenglin Wan , David Mark Bossens , Yueming Lyu , Qing Guo , Ivor W. Tsang

Class-incremental learning (CIL) with pre-trained models (PTMs) faces a critical trade-off between efficient adaptation and long-term stability. While analytic learning enables rapid, recursive closed-form updates, its efficacy is often…

Machine Learning · Computer Science 2026-05-08 Binyu Zhao , Wei Zhang , Xingrui Yu , Zhaonian Zou , Ivor Tsang

Despite the empirical success of knowledge distillation, current state-of-the-art methods are computationally expensive to train, which makes them difficult to adopt in practice. To address this problem, we introduce two distinct…

Computer Vision and Pattern Recognition · Computer Science 2022-10-10 Roy Miles , Adrian Lopez Rodriguez , Krystian Mikolajczyk

Consider an imitation learning problem that the imitator and the expert have different dynamics models. Most of the current imitation learning methods fail because they focus on imitating actions. We propose a novel state alignment-based…

Machine Learning · Computer Science 2019-11-26 Fangchen Liu , Zhan Ling , Tongzhou Mu , Hao Su

Human demonstration data is often ambiguous and incomplete, motivating imitation learning approaches that also exhibit reliable planning behavior. A common paradigm to perform planning-from-demonstration involves learning a reward function…

Imitation Learning (IL) is a sample efficient paradigm for robot learning using expert demonstrations. However, policies learned through IL suffer from state distribution shift at test time, due to compounding errors in action prediction…

Robotics · Computer Science 2023-11-07 Suneel Belkhale , Yuchen Cui , Dorsa Sadigh

Multiple instance learning (MIL) is concerned with learning from sets (bags) of objects (instances), where the individual instance labels are ambiguous. In this setting, supervised learning cannot be applied directly. Often, specialized MIL…

Machine Learning · Statistics 2014-12-04 Veronika Cheplygina , David M. J. Tax , Marco Loog

Imitation learning techniques have been shown to be highly effective in real-world control scenarios, such as robotics. However, these approaches not only suffer from compounding error issues but also require human experts to provide…

Robotics · Computer Science 2025-02-21 Yigit Korkmaz , Erdem Bıyık