English
Related papers

Related papers: A Recipe for Unbounded Data Augmentation in Visual…

200 papers

Data augmentation has been proven to be an effective technique for developing machine learning models that are robust to known classes of distributional shifts (e.g., rotations of images), and alignment regularization is a technique often…

Machine Learning · Computer Science 2022-06-07 Haohan Wang , Zeyi Huang , Xindi Wu , Eric P. Xing

Models that perform well on a training domain often fail to generalize to out-of-domain (OOD) examples. Data augmentation is a common method used to prevent overfitting and improve OOD generalization. However, in natural language, it is…

Computation and Language · Computer Science 2020-10-06 Nathan Ng , Kyunghyun Cho , Marzyeh Ghassemi

The generalization gap in reinforcement learning (RL) has been a significant obstacle that prevents the RL agent from learning general skills and adapting to varying environments. Increasing the generalization capacity of the RL systems can…

Machine Learning · Computer Science 2021-12-06 Hanping Zhang , Yuhong Guo

Weak supervision combines the advantages of training on real data with the ability to exploit signal properties. However, training a neural network using weak supervision often requires an excessive amount of signal data, which severely…

High Energy Physics - Phenomenology · Physics 2024-12-23 Zong-En Chen , Cheng-Wei Chiang , Feng-Yang Hsieh

Deep Convolutional Neural Networks have made an incredible progress in many Computer Vision tasks. This progress, however, often relies on the availability of large amounts of the training data, required to prevent over-fitting, which in…

Computer Vision and Pattern Recognition · Computer Science 2023-02-28 Dominik Lewy , Jacek Mańdziuk

In deep reinforcement learning (RL), data augmentation is widely considered as a tool to induce a set of useful priors about semantic consistency and improve sample efficiency and generalization performance. However, even when the prior is…

Machine Learning · Computer Science 2023-03-02 Byungchan Ko , Jungseul Ok

In deep reinforcement learning (RL), data augmentation is widely considered as a tool to induce a set of useful priors about semantic consistency and improve sample efficiency and generalization performance. However, even when the prior is…

Machine Learning · Computer Science 2022-10-21 Byungchan Ko , Jungseul Ok

Domain generalization aim to train models to effectively perform on samples that are unseen and outside of the distribution. Adversarial data augmentation (ADA) is a widely used technique in domain generalization. It enhances the model…

Machine Learning · Computer Science 2024-10-16 Byeong Tak Lee , Joon-myoung Kwon , Yong-Yeon Jo

The ability to jointly learn from multiple modalities, such as text, audio, and visual data, is a defining feature of intelligent systems. While there have been promising advances in designing neural networks to harness multimodal data, the…

Machine Learning · Computer Science 2023-04-25 Zichang Liu , Zhiqiang Tang , Xingjian Shi , Aston Zhang , Mu Li , Anshumali Shrivastava , Andrew Gordon Wilson

Generative data augmentation (GDA) has emerged as a promising technique to alleviate data scarcity in machine learning applications. This thesis presents a comprehensive survey and unified framework of the GDA landscape. We first provide an…

Machine Learning · Computer Science 2024-04-23 Yunhao Chen , Zihui Yan , Yunjie Zhu

Data-Augmentation (DA) is known to improve performance across tasks and datasets. We propose a method to theoretically analyze the effect of DA and study questions such as: how many augmented samples are needed to correctly estimate the…

Machine Learning · Computer Science 2022-02-18 Randall Balestriero , Ishan Misra , Yann LeCun

Offline reinforcement learning (RL) enables policy learning from pre-collected offline datasets, relaxing the need to interact directly with the environment. However, limited by the quality of offline datasets, it generally fails to learn…

Machine Learning · Computer Science 2025-09-03 Xingshuai Huang , Di Wu , Benoit Boulet

In semi-supervised learning (SSL), a technique called consistency regularization (CR) achieves high performance. It has been proved that the diversity of data used in CR is extremely important to obtain a model with high discrimination…

Machine Learning · Computer Science 2020-04-03 Hiroshi Kaizuka

Self-supervised learning (SSL) has potential for effective representation learning in medical imaging, but the choice of data augmentation is critical and domain-specific. It remains uncertain if general augmentation policies suit surgical…

Computer Vision and Pattern Recognition · Computer Science 2024-06-07 Yuning Zhou , Henry Badgery , Matthew Read , James Bailey , Catherine E. Davey

Data augmentations have been widely studied to improve the accuracy and robustness of classifiers. However, the potential of image augmentation in improving GAN models for image synthesis has not been thoroughly investigated in previous…

Machine Learning · Computer Science 2020-06-05 Zhengli Zhao , Zizhao Zhang , Ting Chen , Sameer Singh , Han Zhang

Data augmentation is usually adopted to increase the amount of training data, prevent overfitting and improve the performance of deep models. However, in practice, random data augmentation, such as random image cropping, is low-efficiency…

Computer Vision and Pattern Recognition · Computer Science 2019-03-26 Tao Hu , Honggang Qi , Qingming Huang , Yan Lu

Dynamic Algorithm Configuration (DAC) addresses the challenge of dynamically setting hyperparameters of an algorithm for a diverse set of instances rather than focusing solely on individual tasks. Agents trained with Deep Reinforcement…

Machine Learning · Computer Science 2024-07-19 Carolin Benjamins , Gjorgjina Cenikj , Ana Nikolikj , Aditya Mohan , Tome Eftimov , Marius Lindauer

We introduce AdaAct, a novel optimization algorithm that adjusts learning rates according to activation variance. Our method enhances the stability of neuron outputs by incorporating neuron-wise adaptivity during the training process, which…

Machine Learning · Computer Science 2025-06-11 Hyunseok Seung , Jaewoo Lee , Hyunsuk Ko

Unsupervised Data Augmentation (UDA) is a semi-supervised technique that applies a consistency loss to penalize differences between a model's predictions on (a) observed (unlabeled) examples; and (b) corresponding 'noised' examples produced…

Computation and Language · Computer Science 2020-10-26 David Lowell , Brian E. Howard , Zachary C. Lipton , Byron C. Wallace

Data augmentation is a widely used technique for improving model performance in machine learning, particularly in computer vision and natural language processing. Recently, there has been increasing interest in applying augmentation…

Machine Learning · Computer Science 2023-05-05 Raad Khraishi , Ramin Okhrati