English
Related papers

Related papers: IIFL: Implicit Interactive Fleet Learning from Het…

200 papers

Imitation learning is the task of replicating expert policy from demonstrations, without access to a reward function. This task becomes particularly challenging when the expert exhibits a mixture of behaviors. Prior work has introduced…

Machine Learning · Computer Science 2022-05-10 Arash Vahabpour , Tianyi Wang , Qiujing Lu , Omead Pooladzandi , Vwani Roychowdhury

Inverse Reinforcement Learning (IRL) is a powerful set of techniques for imitation learning that aims to learn a reward function that rationalizes expert demonstrations. Unfortunately, traditional IRL methods suffer from a computational…

Machine Learning · Computer Science 2024-01-31 Gokul Swamy , Sanjiban Choudhury , J. Andrew Bagnell , Zhiwei Steven Wu

Contrastive Learning (CL) has been proved to be a powerful self-supervised approach for a wide range of domains, including computer vision and graph representation learning. However, the incremental learning issue of CL has rarely been…

Machine Learning · Computer Science 2023-01-31 Cheng Ji , Jianxin Li , Hao Peng , Jia Wu , Xingcheng Fu , Qingyun Sun , Phillip S. Yu

Behavior Foundation Models (BFMs) enable scalable imitation learning (IL) by pretraining task-agnostic representations that can be rapidly adapted to new tasks. However, existing BFMs assume fixed environment dynamics, limiting their…

Machine Learning · Computer Science 2026-05-19 Rishabh Agrawal , Rahul Jain , Ashutosh Nayyar

eXplanation Based Learning (XBL) is a form of Interactive Machine Learning (IML) that provides a model refining approach via user feedback collected on model explanations. Although the interactivity of XBL promotes model transparency, XBL…

Machine Learning · Computer Science 2023-07-13 Misgina Tsighe Hagos , Kathleen M. Curran , Brian Mac Namee

In-context imitation learning enables robots to adapt to new tasks from a small number of demonstrations without additional training. However, existing approaches typically condition only on state-action trajectories and lack explicit…

Robotics · Computer Science 2026-03-10 Toan Nguyen , Weiduo Yuan , Songlin Wei , Hui Li , Daniel Seita , Yue Wang

In-context learning (ICL) is a type of prompting where a transformer model operates on a sequence of (input, output) examples and performs inference on-the-fly. In this work, we formalize in-context learning as an algorithm learning problem…

Machine Learning · Computer Science 2023-02-07 Yingcong Li , M. Emrullah Ildiz , Dimitris Papailiopoulos , Samet Oymak

We present an algorithm for Inverse Reinforcement Learning (IRL) from expert state observations only. Our approach decouples reward modelling from policy learning, unlike state-of-the-art adversarial methods which require updating the…

Machine Learning · Computer Science 2022-05-20 Wei-Di Chang , Juan Camilo Gamboa Higuera , Scott Fujimoto , David Meger , Gregory Dudek

As a promising paradigm federated Learning (FL) is widely used in privacy-preserving machine learning, which allows distributed devices to collaboratively train a model while avoiding data transmission among clients. Despite its immense…

Machine Learning · Computer Science 2023-08-29 Jinglong Shen , Xiucheng Wang , Nan Cheng , Longfei Ma , Conghao Zhou , Yuan Zhang

Federated learning (FL) has been proposed to enable distributed learning on Artificial Intelligence Internet of Things (AIoT) devices with guarantees of high-level data privacy. Since random initial models in FL can easily result in…

Machine Learning · Computer Science 2024-09-06 Pengyu Zhang , Yingbo Zhou , Ming Hu , Xian Wei , Mingsong Chen

Imitation learning frameworks that learn robot control policies from demonstrators' motions via hand-mounted demonstration interfaces have attracted increasing attention. However, due to differences in physical characteristics between…

Robotics · Computer Science 2026-02-18 Kei Takahashi , Hikaru Sasaki , Takamitsu Matsubara

This paper concerns imitation learning (IL) (i.e, the problem of learning to mimic expert behaviors from demonstrations) in cooperative multi-agent systems. The learning problem under consideration poses several challenges, characterized by…

Machine Learning · Computer Science 2023-10-11 The Viet Bui , Tien Mai , Thanh Hong Nguyen

Federated Learning (FL) is a learning paradigm that protects privacy by keeping client data on edge devices. However, optimizing FL in practice can be difficult due to the diversity and heterogeneity of the learning system. Despite recent…

Machine Learning · Computer Science 2023-02-21 Yongxin Guo , Tao Lin , Xiaoying Tang

Pre-trained large language models based on Transformers have demonstrated remarkable in-context learning (ICL) abilities. With just a few demonstration examples, the models can implement new tasks without any parameter updates. However, it…

Machine Learning · Computer Science 2024-11-04 Ruifeng Ren , Yong Liu

Transformer-based models have demonstrated remarkable reasoning abilities, but the mechanisms underlying relational reasoning remain poorly understood. We investigate how transformers perform \textit{transitive inference}, a classic…

Machine Learning · Computer Science 2026-05-12 Jesse Geerts , Andrew Liu , Stephanie Chan , Claudia Clopath , Kimberly Stachenfeld

Behavior Cloning (BC) is a widely adopted visual imitation learning method in robot manipulation. Current BC approaches often enhance generalization by leveraging large datasets and incorporating additional visual and textual modalities to…

Robotics · Computer Science 2025-05-14 Shuanghao Bai , Wanqi Zhou , Pengxiang Ding , Wei Zhao , Donglin Wang , Badong Chen

High-quality and representative data is essential for both Imitation Learning (IL)- and Reinforcement Learning (RL)-based motion planning tasks. For real robots, it is challenging to collect enough qualified data either as demonstrations…

Robotics · Computer Science 2023-06-13 Sha Luo , Lambert Schomaker

Continual learning aims to provide intelligent agents that are capable of learning continually a sequence of tasks, building on previously learned knowledge. A key challenge in this learning paradigm is catastrophically forgetting…

Machine Learning · Computer Science 2021-01-18 Ghada Sokar , Decebal Constantin Mocanu , Mykola Pechenizkiy

Wearable sensor-based human activity recognition (HAR) has been a research focus in the field of ubiquitous and mobile computing for years. In recent years, many deep models have been applied to HAR problems. However, deep learning methods…

Signal Processing · Electrical Eng. & Systems 2020-12-16 Yujiao Hao , Boyu Wang , Rong Zheng

Often times in imitation learning (IL), the environment we collect expert demonstrations in and the environment we want to deploy our learned policy in aren't exactly the same (e.g. demonstrations collected in simulation but deployment in…

Neural and Evolutionary Computing · Computer Science 2024-06-19 Silvia Sapora , Gokul Swamy , Chris Lu , Yee Whye Teh , Jakob Nicolaus Foerster