English
Related papers

Related papers: Automatic Data Augmentation for Generalization in …

200 papers

Reinforcement learning (RL) algorithms have proven transformative in a range of domains. To tackle real-world domains, these systems often use neural networks to learn policies directly from pixels or other high-dimensional sensory input.…

Machine Learning · Computer Science 2025-10-02 Nishil Patel , Sebastian Lee , Stefano Sarao Mannelli , Sebastian Goldt , Andrew Saxe

In the Machine Learning research community, there is a consensus regarding the relationship between model complexity and the required amount of data and computation power. In real world applications, these computational requirements are not…

Machine Learning · Computer Science 2022-08-03 Joao Fonseca , Fernando Bacao

Existing automatic data augmentation (DA) methods either ignore updating DA's parameters according to the target model's state during training or adopt update strategies that are not effective enough. In this work, we design a novel data…

Computer Vision and Pattern Recognition · Computer Science 2023-05-11 Xiaogang Xu , Hengshuang Zhao

Handwritten text and scene text suffer from various shapes and distorted patterns. Thus training a robust recognition model requires a large amount of data to cover diversity as much as possible. In contrast to data collection and…

Computer Vision and Pattern Recognition · Computer Science 2020-03-17 Canjie Luo , Yuanzhi Zhu , Lianwen Jin , Yongpan Wang

Deep learning (DL) algorithms have shown significant performance in various computer vision tasks. However, having limited labelled data lead to a network overfitting problem, where network performance is bad on unseen data as compared to…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Teerath Kumar , Alessandra Mileo , Rob Brennan , Malika Bendechache

A key challenge in leveraging data augmentation for neural network training is choosing an effective augmentation policy from a large search space of candidate operations. Properly chosen augmentation policies can lead to significant…

Computer Vision and Pattern Recognition · Computer Science 2019-05-15 Daniel Ho , Eric Liang , Ion Stoica , Pieter Abbeel , Xi Chen

Existing domain generalization aims to learn a generalizable model to perform well even on unseen domains. For many real-world machine learning applications, the data distribution often shifts gradually along domain indices. For example, a…

Computer Vision and Pattern Recognition · Computer Science 2023-03-09 Qiuhao Zeng , Wei Wang , Fan Zhou , Charles Ling , Boyu Wang

Random data augmentation is a critical technique to avoid overfitting in training deep neural network models. However, data augmentation and network training are usually treated as two isolated processes, limiting the effectiveness of…

Computer Vision and Pattern Recognition · Computer Science 2018-05-25 Xi Peng , Zhiqiang Tang , Fei Yang , Rogerio Feris , Dimitris Metaxas

Reinforcement Learning (RL) has demonstrated a great potential for automatically solving decision-making problems in complex uncertain environments. RL proposes a computational approach that allows learning through interaction in an…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-11-18 Yisel Garí , David A. Monge , Elina Pacini , Cristian Mateos , Carlos García Garino

Deep reinforcement-learning methods have achieved remarkable performance on challenging control tasks. Observations of the resulting behavior give the impression that the agent has constructed a generalized representation that supports…

Machine Learning · Computer Science 2018-12-12 Sam Witty , Jun Ki Lee , Emma Tosch , Akanksha Atrey , Michael Littman , David Jensen

Deep reinforcement learning (RL) has achieved breakthrough results on many tasks, but agents often fail to generalize beyond the environment they were trained in. As a result, deep RL algorithms that promote generalization are receiving…

Machine Learning · Computer Science 2019-03-18 Charles Packer , Katelyn Gao , Jernej Kos , Philipp Krähenbühl , Vladlen Koltun , Dawn Song

Large Language Model (LLM) based agents have proved their ability to perform complex tasks like humans. However, there is still a large gap between open-sourced LLMs and commercial models like the GPT series. In this paper, we focus on…

Artificial Intelligence · Computer Science 2025-02-25 Dayuan Fu , Keqing He , Yejie Wang , Wentao Hong , Zhuoma Gongque , Weihao Zeng , Wei Wang , Jingang Wang , Xunliang Cai , Weiran Xu

In this paper, we investigate the problem of overfitting in deep reinforcement learning. Among the most common benchmarks in RL, it is customary to use the same environments for both training and testing. This practice offers relatively…

Machine Learning · Computer Science 2019-07-16 Karl Cobbe , Oleg Klimov , Chris Hesse , Taehoon Kim , John Schulman

The industrial application of Deep Reinforcement Learning (DRL) is frequently slowed down because of the inability to generate the experience required to train the models. Collecting data often involves considerable time and economic effort…

Robotics · Computer Science 2025-01-27 Lucía Güitta-López , Jaime Boal , Álvaro J. López-López

In many cases of machine learning, research suggests that the development of training data might have a higher relevance than the choice and modelling of classifiers themselves. Thus, data augmentation methods have been developed to improve…

Computation and Language · Computer Science 2022-07-25 Markus Bayer , Marc-André Kaufhold , Björn Buchhold , Marcel Keller , Jörg Dallmeyer , Christian Reuter

Scaling laws dictate that the performance of AI models is proportional to the amount of available data. Data augmentation is a promising solution to expanding the dataset size. Traditional approaches focused on augmentation using rotation,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Fazle Rahat , M Shifat Hossain , Md Rubel Ahmed , Sumit Kumar Jha , Rickard Ewetz

Data augmentations are useful in closing the sim-to-real domain gap when training on synthetic data. This is because they widen the training data distribution, thus encouraging the model to generalize better to other domains. Many image…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Bram Vanherle , Nick Michiels , Frank Van Reeth

Data augmentation (DA) is a powerful workhorse for bolstering performance in modern machine learning. Specific augmentations like translations and scaling in computer vision are traditionally believed to improve generalization by generating…

Machine Learning · Computer Science 2024-02-29 Chi-Heng Lin , Chiraag Kaushik , Eva L. Dyer , Vidya Muthukumar

Data augmentation refers to a group of techniques whose goal is to battle limited amount of available data to improve model generalization and push sample distribution toward the true distribution. While different augmentation strategies…

Quantitative Methods · Quantitative Biology 2020-06-03 Ruqian Hao , Khashayar Namdar , Lin Liu , Masoom A. Haider , Farzad Khalvati

Data augmentation is a powerful technique to improve performance in applications such as image and text classification tasks. Yet, there is little rigorous understanding of why and how various augmentations work. In this work, we consider a…

Machine Learning · Computer Science 2023-07-28 Sen Wu , Hongyang R. Zhang , Gregory Valiant , Christopher Ré