English
Related papers

Related papers: Quantifying Generalisation in Imitation Learning

200 papers

Vision-Language-Action (VLA) models empower robots to understand and execute tasks described by natural language instructions. However, a key challenge lies in their ability to generalize beyond the specific environments and conditions they…

A major problem in machine learning is that of inductive bias: how to choose a learner's hypothesis space so that it is large enough to contain a solution to the problem being learnt, yet small enough to ensure reliable generalization from…

Artificial Intelligence · Computer Science 2011-06-02 J. Baxter

Imitation learning enables agents to reuse and adapt the hard-won expertise of others, offering a solution to several key challenges in learning behavior. Although it is easy to observe behavior in the real-world, the underlying actions may…

Machine Learning · Computer Science 2021-07-09 Andrew Jaegle , Yury Sulsky , Arun Ahuja , Jake Bruce , Rob Fergus , Greg Wayne

Meta-learning researchers face two fundamental issues in their empirical work: prototyping and reproducibility. Researchers are prone to make mistakes when prototyping new algorithms and tasks because modern meta-learning methods rely on…

Machine Learning · Computer Science 2020-08-31 Sébastien M. R. Arnold , Praateek Mahajan , Debajyoti Datta , Ian Bunner , Konstantinos Saitas Zarkias

We consider problems of making sequences of decisions to accomplish tasks, interacting via the medium of language. These problems are often tackled with reinforcement learning approaches. We find that these models do not generalize well…

Computation and Language · Computer Science 2020-10-07 Xusen Yin , Ralph Weischedel , Jonathan May

Symbolic planning is a powerful technique to solve complex tasks that require long sequences of actions and can equip an intelligent agent with complex behavior. The downside of this approach is the necessity for suitable symbolic…

Artificial Intelligence · Computer Science 2025-04-25 Daniel Tanneberg , Michael Gienger

There is an ongoing and dedicated effort to estimate bounds on the generalization error of deep learning models, coupled with an increasing interest with practical metrics that can be used to experimentally evaluate a model's ability to…

Machine Learning · Computer Science 2024-09-04 Mengqing Huang , Hongchuan Yu , Jianjun Zhang

Imitation learning has emerged as a powerful paradigm in robot manipulation, yet its generalization capability remains constrained by object-specific dependencies in limited expert demonstrations. To address this challenge, we propose…

Robotics · Computer Science 2025-06-27 Zhuochen Miao , Jun Lv , Hongjie Fang , Yang Jin , Cewu Lu

Learning to use tools to solve a variety of tasks is an innate ability of humans and has been observed of animals in the wild. However, the underlying mechanisms that are required to learn to use tools are abstract and widely contested in…

Neural and Evolutionary Computing · Computer Science 2019-07-04 Sam Wenke , Dan Saunders , Mike Qiu , Jim Fleming

Imitation based robot learning has recently gained significant attention in the robotics field due to its theoretical potential for transferability and generalizability. However, it remains notoriously costly, both in terms of hardware and…

Robotics · Computer Science 2024-09-19 Jiahuan Yan , Zhouyang Hong , Yu Zhao , Yu Tian , Yunxin Liu , Travis Davies , Luhui Hu

We propose a general framework for interactively learning models, such as (binary or non-binary) classifiers, orderings/rankings of items, or clusterings of data points. Our framework is based on a generalization of Angluin's equivalence…

Data Structures and Algorithms · Computer Science 2017-10-17 Ehsan Emamjomeh-Zadeh , David Kempe

Model-based reinforcement learning (MBRL) is widely seen as having the potential to be significantly more sample efficient than model-free RL. However, research in model-based RL has not been very standardized. It is fairly common for…

Recent advances in deep reinforcement learning (deep RL) enable researchers to solve challenging control problems, from simulated environments to real-world robotic tasks. However, deep RL algorithms are known to be sensitive to the problem…

Robotics · Computer Science 2023-02-01 Joanne Taery Kim , Sehoon Ha

Complex, long-horizon planning and its combinatorial nature pose steep challenges for learning-based agents. Difficulties in such settings are exacerbated in low data regimes where over-fitting stifles generalization and compounding errors…

Machine Learning · Computer Science 2023-06-23 Joey Hejna , Pieter Abbeel , Lerrel Pinto

Learning models that gracefully handle distribution shifts is central to research on domain generalization, robust optimization, and fairness. A promising formulation is domain-invariant learning, which identifies the key issue of learning…

Machine Learning · Computer Science 2021-07-16 Elliot Creager , Jörn-Henrik Jacobsen , Richard Zemel

Approximate learning machines have become popular in the era of small devices, including quantised, factorised, hashed, or otherwise compressed predictors, and the quest to explain and guarantee good generalisation abilities for such…

Machine Learning · Computer Science 2022-03-16 Andrew J. Turner , Ata Kabán

In-context learning (ICL) empowers generative models to address new tasks effectively and efficiently on the fly, without relying on any artificially crafted optimization techniques. In this paper, we study extending ICL to address a…

Artificial Intelligence · Computer Science 2024-09-13 Fan Wang , Chuan Lin , Yang Cao , Yu Kang

This work studies deep metric learning under small to medium scale data as we believe that better generalization could be a contributing factor to the improvement of previous fine-grained image retrieval methods; it should be considered…

Computer Vision and Pattern Recognition · Computer Science 2018-12-11 Nam Vo , James Hays

A machine learning model that generalizes well should obtain low errors on unseen test examples. Thus, if we know how to optimally perturb training examples to account for test examples, we may achieve better generalization performance.…

Machine Learning · Computer Science 2022-02-15 Hae Beom Lee , Taewook Nam , Eunho Yang , Sung Ju Hwang

Due to the realization that deep reinforcement learning algorithms trained on high-dimensional tasks can strongly overfit to their training environments, there have been several studies that investigated the generalization performance of…

Machine Learning · Computer Science 2020-07-06 Safa Alver , Doina Precup