English
Related papers

Related papers: Generalization Capability for Imitation Learning

200 papers

Deep reinforcement learning (RL) can acquire complex behaviors from low-level inputs, such as images. However, real-world applications of such methods require generalizing to the vast variability of the real world. Deep networks are known…

Machine Learning · Computer Science 2017-03-13 Chelsea Finn , Tianhe Yu , Justin Fu , Pieter Abbeel , Sergey Levine

As shown in recent research, deep neural networks can perfectly fit randomly labeled data, but with very poor accuracy on held out data. This phenomenon indicates that loss functions such as cross-entropy are not a reliable indicator of…

Machine Learning · Statistics 2019-06-13 Yiding Jiang , Dilip Krishnan , Hossein Mobahi , Samy Bengio

When an autonomous robot learns how to execute actions, it is of interest to know if and when the execution policy can be generalised to variations of the learning scenarios. This can inform the robot about the necessity of additional…

Robotics · Computer Science 2021-07-21 Alex Mitrevski , Paul G. Plöger , Gerhard Lakemeyer

We consider a problem of learning the reward and policy from expert examples under unknown dynamics. Our proposed method builds on the framework of generative adversarial networks and introduces the empowerment-regularized maximum-entropy…

Machine Learning · Computer Science 2019-02-26 Ahmed H. Qureshi , Byron Boots , Michael C. Yip

Imitation based robot learning has recently gained significant attention in the robotics field due to its theoretical potential for transferability and generalizability. However, it remains notoriously costly, both in terms of hardware and…

Robotics · Computer Science 2024-09-19 Jiahuan Yan , Zhouyang Hong , Yu Zhao , Yu Tian , Yunxin Liu , Travis Davies , Luhui Hu

The natural world is abundant with concepts expressed via visual, acoustic, tactile, and linguistic modalities. Much of the existing progress in multimodal learning, however, focuses primarily on problems where the same set of modalities…

Machine Learning · Computer Science 2020-12-08 Paul Pu Liang , Peter Wu , Liu Ziyin , Louis-Philippe Morency , Ruslan Salakhutdinov

Practitioners in diverse fields such as healthcare, economics and education are eager to apply machine learning to improve decision making. The cost and impracticality of performing experiments and a recent monumental increase in electronic…

Machine Learning · Computer Science 2023-08-01 Fredrik D. Johansson , Uri Shalit , Nathan Kallus , David Sontag

The utilization of broad datasets has proven to be crucial for generalization for a wide range of fields. However, how to effectively make use of diverse multi-task data for novel downstream tasks still remains a grand challenge in…

Robotics · Computer Science 2023-04-19 Kuan Fang , Patrick Yin , Ashvin Nair , Homer Walke , Gengchen Yan , Sergey Levine

One of the principal scientific challenges in deep learning is explaining generalization, i.e., why the particular way the community now trains networks to achieve small training error also leads to small error on held-out data from the…

One fundamental goal in any learning algorithm is to mitigate its risk for overfitting. Mathematically, this requires that the learning algorithm enjoys a small generalization risk, which is defined either in expectation or in probability.…

Machine Learning · Computer Science 2016-10-04 Ibrahim Alabdulmohsin

While reinforcement learning provides an appealing formalism for learning individual skills, a general-purpose robotic system must be able to master an extensive repertoire of behaviors. Instead of learning a large collection of skills…

Robotics · Computer Science 2019-10-28 Ashvin Nair , Shikhar Bahl , Alexander Khazatsky , Vitchyr Pong , Glen Berseth , Sergey Levine

Behavior cloning has shown promise for robot manipulation, but real-world demonstrations are costly to acquire at scale. While simulated data offers a scalable alternative, particularly with advances in automated demonstration generation,…

Robotics · Computer Science 2026-01-19 Shuo Cheng , Liqian Ma , Zhenyang Chen , Ajay Mandlekar , Caelan Garrett , Danfei Xu

Cooperation information sharing is important to theories of human learning and has potential implications for machine learning. Prior work derived conditions for achieving optimal Cooperative Inference given strong, relatively restrictive…

Machine Learning · Computer Science 2019-02-15 Pei Wang , Pushpi Paranamana , Patrick Shafto

Employing machine learning models in the real world requires collecting large amounts of data, which is both time consuming and costly to collect. A common approach to circumvent this is to leverage existing, similar data-sets with large…

Computer Vision and Pattern Recognition · Computer Science 2020-09-07 Michael Lomnitz , Zigfried Hampel-Arias , Nina Lopatina , Felipe A. Mejia

Human perception of the empirical world involves recognizing the diverse appearances, or 'modalities', of underlying objects. Despite the longstanding consideration of this perspective in philosophy and cognitive science, the study of…

Machine Learning · Computer Science 2023-12-19 Zhou Lu

Domain generalization is the problem of machine learning when the training data and the test data come from different data domains. We present a simple theoretical model of learning to generalize across domains in which there is a…

Machine Learning · Computer Science 2020-02-14 Vikas K. Garg , Adam Kalai , Katrina Ligett , Zhiwei Steven Wu

In reinforcement learning, state representations are used to tractably deal with large problem spaces. State representations serve both to approximate the value function with few parameters, but also to generalize to newly encountered…

Machine Learning · Computer Science 2022-03-02 Charline Le Lan , Stephen Tu , Adam Oberman , Rishabh Agarwal , Marc G. Bellemare

The widespread use of diffusion models has led to an abundance of AI-generated data, raising concerns about model collapse -- a phenomenon in which recursive iterations of training on synthetic data lead to performance degradation. Prior…

Machine Learning · Computer Science 2025-12-29 Lianghe Shi , Meng Wu , Huijie Zhang , Zekai Zhang , Molei Tao , Qing Qu

Deep learning models have lately shown great performance in various fields such as computer vision, speech recognition, speech translation, and natural language processing. However, alongside their state-of-the-art performance, it is still…

Machine Learning · Computer Science 2019-04-09 Daniel Jakubovitz , Raja Giryes , Miguel R. D. Rodrigues

Performing supervised learning from the data synthesized by using Generative Adversarial Networks (GANs), dubbed GAN-synthetic data, has two important applications. First, GANs may generate more labeled training data, which may help improve…

Machine Learning · Computer Science 2019-05-30 Fu-Chieh Chang , Hao-Jen Wang , Chun-Nan Chou , Edward Y. Chang