中文
相关论文

相关论文: Automatic Data Augmentation via Invariance-Constra…

200 篇论文

Data augmentation is a major component of many machine learning methods with state-of-the-art performance. Common augmentation strategies work by drawing random samples from a space of transformations. Unfortunately, such sampling…

机器学习 · 计算机科学 2020-11-06 Calvin Luo , Hossein Mobahi , Samy Bengio

Data augmentation is popular in the training of large neural networks; currently, however, there is no clear theoretical comparison between different algorithmic choices on how to use augmented data. In this paper, we take a step in this…

机器学习 · 计算机科学 2022-06-17 Shuo Yang , Yijun Dong , Rachel Ward , Inderjit S. Dhillon , Sujay Sanghavi , Qi Lei

Data augmentation forms the cornerstone of many modern machine learning training pipelines; yet, the mechanisms by which it works are not clearly understood. Much of the research on data augmentation (DA) has focused on improving existing…

机器学习 · 计算机科学 2023-04-13 Damien A. Dablain , Nitesh V. Chawla

Data augmentation is essential to achieve state-of-the-art performance in many deep learning applications. However, the most effective augmentation techniques become computationally prohibitive for even medium-sized datasets. To address…

机器学习 · 计算机科学 2023-07-21 Tian Yu Liu , Baharan Mirzasoleiman

Modern neural networks are over-parameterized and thus rely on strong regularization such as data augmentation and weight decay to reduce overfitting and improve generalization. The dominant form of data augmentation applies invariant…

计算机视觉与模式识别 · 计算机科学 2024-01-25 Yang Liu , Shen Yan , Laura Leal-Taixé , James Hays , Deva Ramanan

Data augmentation is an effective and universal technique for improving generalization performance of deep neural networks. It could enrich diversity of training samples that is essential in medical image segmentation tasks because 1) the…

图像与视频处理 · 电气工程与系统科学 2020-12-29 Ju Xu , Mengzhang Li , Zhanxing Zhu

Automated data augmentation has shown superior performance in image recognition. Existing works search for dataset-level augmentation policies without considering individual sample variations, which are likely to be sub-optimal. On the…

机器学习 · 计算机科学 2020-12-23 Fengwei Zhou , Jiawei Li , Chuanlong Xie , Fei Chen , Lanqing Hong , Rui Sun , Zhenguo Li

Though data augmentation has become a standard component of deep neural network training, the underlying mechanism behind the effectiveness of these techniques remains poorly understood. In practice, augmentation policies are often chosen…

机器学习 · 计算机科学 2020-06-08 Raphael Gontijo-Lopes , Sylvia J. Smullin , Ekin D. Cubuk , Ethan Dyer

Data augmentation, a technique in which a training set is expanded with class-preserving transformations, is ubiquitous in modern machine learning pipelines. In this paper, we seek to establish a theoretical framework for understanding data…

机器学习 · 计算机科学 2019-03-21 Tri Dao , Albert Gu , Alexander J. Ratner , Virginia Smith , Christopher De Sa , Christopher Ré

Data augmentation is a cornerstone of the machine learning pipeline, yet its theoretical underpinnings remain unclear. Is it merely a way to artificially augment the data set size? Or is it about encouraging the model to satisfy certain…

机器学习 · 计算机科学 2022-09-22 Ruoqi Shen , Sébastien Bubeck , Suriya Gunasekar

Data augmentation is an inexpensive way to increase training data diversity and is commonly achieved via transformations of existing data. For tasks such as classification, there is a good case for learning representations of the data that…

声音 · 计算机科学 2021-04-20 Turab Iqbal , Karim Helwani , Arvindh Krishnaswamy , Wenwu Wang

It is observed in the literature that data augmentation can significantly mitigate membership inference (MI) attack. However, in this work, we challenge this observation by proposing new MI attacks to utilize the information of augmented…

机器学习 · 计算机科学 2021-03-01 Da Yu , Huishuai Zhang , Wei Chen , Jian Yin , Tie-Yan Liu

Automated data augmentation, which aims at engineering augmentation policy automatically, recently draw a growing research interest. Many previous auto-augmentation methods utilized a Density Matching strategy by evaluating policies in…

计算机视觉与模式识别 · 计算机科学 2022-07-22 Jianwei Zhang , Dong Li , Lituan Wang , Lei Zhang

Data augmentations play an important role in the recent success of self-supervised learning (SSL). While augmentations are commonly understood to encode invariances between different views into the learned representations, this…

机器学习 · 计算机科学 2025-06-10 Shlomo Libo Feigin , Maximilian Fleissner , Debarghya Ghoshdastidar

Data augmentation is a powerful mechanism in equivariant machine learning, encouraging symmetry by training networks to produce consistent outputs under transformed inputs. Yet, effective augmentation typically requires the underlying…

机器学习 · 计算机科学 2026-02-13 Eduardo Santos-Escriche , Ya-Wei Eileen Lin , Stefanie Jegelka

Data augmentation is widely used for machine learning; however, an effective method to apply data augmentation has not been established even though it includes several factors that should be tuned carefully. One such factor is sample…

机器学习 · 计算机科学 2020-10-30 Tomoumi Takase , Ryo Karakida , Hideki Asoh

Deep artificial neural networks require a large corpus of training data in order to effectively learn, where collection of such training data is often expensive and laborious. Data augmentation overcomes this issue by artificially inflating…

机器学习 · 计算机科学 2017-08-22 Luke Taylor , Geoff Nitschke

In this paper, we explore and compare multiple solutions to the problem of data augmentation in image classification. Previous work has demonstrated the effectiveness of data augmentation through simple techniques, such as cropping,…

计算机视觉与模式识别 · 计算机科学 2017-12-14 Luis Perez , Jason Wang

There has been considerable interest in making Bayesian inference more scalable. In big data settings, most literature focuses on reducing the computing time per iteration, with less focused on reducing the number of iterations needed in…

统计方法学 · 统计学 2017-09-28 Leo L. Duan , James E. Johndrow , David B. Dunson

Synthetic augmentation is increasingly used to mitigate data scarcity in financial machine learning, yet its statistical role remains poorly understood. We formalize synthetic augmentation as a modification of the effective training…

人工智能 · 计算机科学 2026-04-17 Mel Sohm , Charles Dezons , Sami Sellami , Oscar Ninou , Axel Pincon