English
Related papers

Related papers: Quantifying Generalisation in Imitation Learning

200 papers

The pursuit of general-purpose robotics has yielded impressive foundation models, yet simulation-based benchmarking remains a bottleneck due to rapid performance saturation and a lack of true generalization testing. Existing benchmarks…

While robot learning has demonstrated promising results for enabling robots to automatically acquire new skills, a critical challenge in deploying learning-based systems is scale: acquiring enough data for the robot to effectively…

Reinforcement learning has recently experienced increased prominence in the machine learning community. There are many approaches to solving reinforcement learning problems with new techniques developed constantly. When solving problems…

Machine Learning · Computer Science 2020-12-14 Belinda Stapelberg , Katherine M. Malan

A crucial aspect in reliable machine learning is to design a deployable system in generalizing new related but unobserved environments. Domain generalization aims to alleviate such a prediction gap between the observed and unseen…

Machine Learning · Computer Science 2021-06-01 Changjian Shui , Boyu Wang , Christian Gagné

For many evaluation metrics commonly used as benchmarks for unconditional image generation, trivially memorizing the training set attains a better score than models which are considered state-of-the-art; we consider this problematic. We…

Machine Learning · Computer Science 2020-01-14 Ishaan Gulrajani , Colin Raffel , Luke Metz

Multi-modal learning has achieved remarkable success by integrating information from various modalities, achieving superior performance in tasks like recognition and retrieval compared to uni-modal approaches. However, real-world scenarios…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Xiaohao Liu , Xiaobo Xia , Zhuo Huang , See-Kiong Ng , Tat-Seng Chua

Imitation learning often needs a large demonstration set in order to handle the full range of situations that an agent might find itself in during deployment. However, collecting expert demonstrations can be expensive. Recent work in…

Imitation learning stands at a crossroads: despite decades of progress, current imitation learning agents remain sophisticated memorisation machines, excelling at replay but failing when contexts shift or goals evolve. This paper argues…

Artificial Intelligence · Computer Science 2026-02-24 Nathan Gavenski , Felipe Meneguzzi , Odinaldo Rodrigues

While current benchmark reinforcement learning (RL) tasks have been useful to drive progress in the field, they are in many ways poor substitutes for learning with real-world data. By testing increasingly complex RL algorithms on…

Machine Learning · Computer Science 2018-11-16 Amy Zhang , Yuxin Wu , Joelle Pineau

A crucial factor for successful human and AI interaction is the ability of language models or chatbots to follow human instructions precisely. A common feature of instructions are output constraints like ``only answer with yes or no" or…

Computation and Language · Computer Science 2025-11-12 Valentina Pyatkin , Saumya Malik , Victoria Graf , Hamish Ivison , Shengyi Huang , Pradeep Dasigi , Nathan Lambert , Hannaneh Hajishirzi

The question of whether deep neural networks are good at generalising beyond their immediate training experience is of critical importance for learning-based approaches to AI. Here, we consider tests of out-of-sample generalisation that…

Artificial Intelligence · Computer Science 2020-02-20 Felix Hill , Andrew Lampinen , Rosalia Schneider , Stephen Clark , Matthew Botvinick , James L. McClelland , Adam Santoro

Imitation learning has been commonly applied to solve different tasks in isolation. This usually requires either careful feature engineering, or a significant number of samples. This is far from what we desire: ideally, robots should be…

Artificial Intelligence · Computer Science 2017-12-06 Yan Duan , Marcin Andrychowicz , Bradly C. Stadie , Jonathan Ho , Jonas Schneider , Ilya Sutskever , Pieter Abbeel , Wojciech Zaremba

Self-supervised learning and data augmentation have significantly reduced the performance gap between state and image-based reinforcement learning agents in continuous control tasks. However, it is still unclear whether current techniques…

Machine Learning · Computer Science 2020-12-01 Jake Grigsby , Yanjun Qi

To build general-purpose artificial intelligence systems that can deal with unknown variables across unknown domains, we need benchmarks that measure how well these systems perform on tasks they have never seen before. A prerequisite for…

Artificial Intelligence · Computer Science 2022-05-25 Gautham Venkatasubramanian , Sibesh Kar , Abhimanyu Singh , Shubham Mishra , Dushyant Yadav , Shreyansh Chandak

The ability for a machine learning model to cope with differences in training and deployment conditions--e.g. in the presence of distribution shift or the generalization to new classes altogether--is crucial for real-world use cases.…

Machine Learning · Computer Science 2023-12-14 Jenny Hamer , Eleni Triantafillou , Bart van Merriënboer , Stefan Kahl , Holger Klinck , Tom Denton , Vincent Dumoulin

Generalizing control policies to novel embodiments remains a fundamental challenge in enabling scalable and transferable learning in robotics. While prior works have explored this in locomotion, a systematic study in the context of…

Robotics · Computer Science 2025-05-22 Meenal Parakh , Alexandre Kirchmeyer , Beining Han , Jia Deng

Active learning agents typically employ a query selection algorithm which solely considers the agent's learning objectives. However, this may be insufficient in more realistic human domains. This work uses imitation learning to enable an…

Machine Learning · Computer Science 2019-07-02 Kalesha Bullard , Yannick Schroecker , Sonia Chernova

Machine Learning Interatomic Potentials play a fundamental role in computational chemistry and materials science, enabling applications from molecular dynamics simulations to drug design and materials discovery. While recent approaches can…

Machine Learning · Computer Science 2026-05-12 Amir Masoud Nourollah , Irtaza Khalid , Stefano Leoni , Steven Schockaert

Imitation learning is an effective approach for training game-playing agents and, consequently, for efficient game production. However, generalization - the ability to perform well in related but unseen scenarios - is an essential…

Machine Learning · Computer Science 2024-04-09 Derek Yadgaroff , Alessandro Sestini , Konrad Tollmar , Ayca Ozcelikkale , Linus Gisslén

Imitation Learning is a sequential task where the learner tries to mimic an expert's action in order to achieve the best performance. Several algorithms have been proposed recently for this task. In this project, we aim at proposing a wide…

Machine Learning · Statistics 2018-01-22 Alexandre Attia , Sharone Dayan