English
Related papers

Related papers: Data augmentation for efficient learning from para…

200 papers

Power-law scaling indicates that large-scale training with uniform sampling is prohibitively slow. Active learning methods aim to increase data efficiency by prioritizing learning on the most relevant examples. Despite their appeal, these…

Artificial Intelligence · Computer Science 2024-10-17 Talfan Evans , Shreya Pathak , Hamza Merzic , Jonathan Schwarz , Ryutaro Tanno , Olivier J. Henaff

Data collection has become an increasingly important problem in robotic manipulation, yet there still lacks much understanding of how to effectively collect data to facilitate broad generalization. Recent works on large-scale robotic data…

Robotics · Computer Science 2024-05-22 Jensen Gao , Annie Xie , Ted Xiao , Chelsea Finn , Dorsa Sadigh

Imitation learning algorithms learn a policy from demonstrations of expert behavior. We show that, for deterministic experts, imitation learning can be done by reduction to reinforcement learning with a stationary reward. Our theoretical…

Machine Learning · Statistics 2022-03-16 Kamil Ciosek

Previous attempts for data augmentation are designed manually, and the augmentation policies are dataset-specific. Recently, an automatic data augmentation approach, named AutoAugment, is proposed using reinforcement learning. AutoAugment…

Machine Learning · Computer Science 2018-11-13 Mingyang Geng , Kele Xu , Bo Ding , Huaimin Wang , Lei Zhang

Inspired by the principle of deliberate practice in human learning, we propose Deliberate Practice for Synthetic Data Generation (DP), a novel framework that improves sample efficiency through dynamic synthetic data generation. Prior work…

We introduce a novel setup for low-resource task-oriented semantic parsing which incorporates several constraints that may arise in real-world scenarios: (1) lack of similar datasets/models from a related domain, (2) inability to sample…

Computation and Language · Computer Science 2022-05-19 Kevin Yang , Olivia Deng , Charles Chen , Richard Shin , Subhro Roy , Benjamin Van Durme

The ability of artificial agents to increment their capabilities when confronted with new data is an open challenge in artificial intelligence. The main challenge faced in such cases is catastrophic forgetting, i.e., the tendency of neural…

Machine Learning · Computer Science 2020-12-16 Eden Belouadah , Adrian Popescu , Ioannis Kanellos

Imitation learning is an effective alternative approach to learn a policy when the reward function is sparse. In this paper, we consider a challenging setting where an agent and an expert use different actions from each other. We assume…

Machine Learning · Computer Science 2019-08-27 Konrad Zolna , Negar Rostamzadeh , Yoshua Bengio , Sungjin Ahn , Pedro O. Pinheiro

Deep reinforcement learning (DRL) is a promising way to achieve human-like autonomous driving. However, the low sample efficiency and difficulty of designing reward functions for DRL would hinder its applications in practice. In light of…

Robotics · Computer Science 2021-10-29 Zhiyu Huang , Jingda Wu , Chen Lv

Behavioral cloning is an imitation learning technique that teaches an agent how to behave through expert demonstrations. Recent approaches use self-supervision of fully-observable unlabeled snapshots of the states to decode state-pairs into…

Machine Learning · Computer Science 2020-08-14 Nathan Gavenski , Juarez Monteiro , Roger Granada , Felipe Meneguzzi , Rodrigo C. Barros

Deep learning models with large learning capacities often overfit to medical imaging datasets. This is because training sets are often relatively small due to the significant time and financial costs incurred in medical data acquisition and…

Computer Vision and Pattern Recognition · Computer Science 2021-03-16 Lok Hin Lee , Yuan Gao , J. Alison Noble

Network weights can be reverse-engineered given enough informative samples of a network's input-output function. In a teacher-student setup, this translates into collecting a dataset of the teacher mapping -- querying the teacher -- and…

Artificial Intelligence · Computer Science 2025-11-26 Alexander Beiser , Flavio Martinelli , Wulfram Gerstner , Johanni Brea

Reading comprehension models often overfit to nuances of training datasets and fail at adversarial evaluation. Training with adversarially augmented dataset improves robustness against those adversarial attacks but hurts generalization of…

Computation and Language · Computer Science 2020-11-18 Adyasha Maharana , Mohit Bansal

Policy gradient (PG) methods are successful approaches to deal with continuous reinforcement learning (RL) problems. They learn stochastic parametric (hyper)policies by either exploring in the space of actions or in the space of parameters.…

Machine Learning · Computer Science 2024-05-31 Alessandro Montenegro , Marco Mussi , Alberto Maria Metelli , Matteo Papini

Offline reinforcement learning (RL) enables policy optimization from fixed datasets, making it suitable for safety-critical applications where online exploration is infeasible. However, these datasets are often contaminated by adversarial…

Machine Learning · Computer Science 2026-05-19 Shriram Karpoora Sundara Pandian , Ali Baheri

Data-driven model predictive control (MPC) has demonstrated significant potential for improving robot control performance in the presence of model uncertainties. However, existing approaches often require extensive offline data collection…

Robotics · Computer Science 2025-10-10 Yu Mei , Xinyu Zhou , Shuyang Yu , Vaibhav Srivastava , Xiaobo Tan

Sampling-based model predictive control (MPC) has found significant success in optimal control problems with non-smooth system dynamics and cost function. Many machine learning-based works proposed to improve MPC by a) learning or…

Machine Learning · Computer Science 2024-01-08 Sungwook Yang , Chaoying Pei , Ran Dai , Chuangchuang Sun

In this paper, we study a novel task that enables partial knowledge transfer from pre-trained models, which we term as Partial Network Cloning (PNC). Unlike prior methods that update all or at least part of the parameters in the target…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Jingwen Ye , Songhua Liu , Xinchao Wang

We study the problem of imitating an expert demonstrator in a discrete-time, continuous state-and-action control system. We show that, even if the dynamics satisfy a control-theoretic property called exponential stability (i.e. the effects…

Machine Learning · Computer Science 2025-07-29 Max Simchowitz , Daniel Pfrommer , Ali Jadbabaie

Reinforcement Learning has suffered from poor reward specification, and issues for reward hacking even in simple enough domains. Preference Based Reinforcement Learning attempts to solve the issue by utilizing binary feedbacks on queried…

Artificial Intelligence · Computer Science 2023-02-20 Mudit Verma , Subbarao Kambhampati