中文
相关论文

相关论文: Understanding Data Augmentation from a Robustness …

200 篇论文

Image data augmentation constitutes a critical methodology in modern computer vision tasks, since it can facilitate towards enhancing the diversity and quality of training datasets; thereby, improving the performance and robustness of…

Recent works have shown that powerful pre-trained language models (PLM) can be fooled by small perturbations or intentional attacks. To solve this issue, various data augmentation techniques are proposed to improve the robustness of PLMs.…

计算与语言 · 计算机科学 2021-09-14 Kun Zhou , Wayne Xin Zhao , Sirui Wang , Fuzheng Zhang , Wei Wu , Ji-Rong Wen

Adversarial training suffers from robust overfitting, a phenomenon where the robust test accuracy starts to decrease during training. In this paper, we focus on both heuristics-driven and data-driven augmentations as a means to reduce…

计算机视觉与模式识别 · 计算机科学 2021-10-19 Sylvestre-Alvise Rebuffi , Sven Gowal , Dan A. Calian , Florian Stimberg , Olivia Wiles , Timothy Mann

Data augmentation is a popular technique which helps improve generalization capabilities of deep neural networks. It plays a pivotal role in remote-sensing scenarios in which the amount of high-quality ground truth data is limited, and…

计算机视觉与模式识别 · 计算机科学 2019-03-14 Jakub Nalepa , Michal Myller , Michal Kawulok

Machine learning models trained with purely observational data and the principle of empirical risk minimization \citep{vapnik_principles_1992} can fail to generalize to unseen domains. In this paper, we focus on the case where the problem…

机器学习 · 统计学 2020-10-27 Maximilian Ilse , Jakub M. Tomczak , Patrick Forré

Data augmentation, a technique in which a training set is expanded with class-preserving transformations, is ubiquitous in modern machine learning pipelines. In this paper, we seek to establish a theoretical framework for understanding data…

机器学习 · 计算机科学 2019-03-21 Tri Dao , Albert Gu , Alexander J. Ratner , Virginia Smith , Christopher De Sa , Christopher Ré

Visual reinforcement learning (RL), which makes decisions directly from high-dimensional visual inputs, has demonstrated significant potential in various domains. However, deploying visual RL techniques in the real world remains challenging…

计算机视觉与模式识别 · 计算机科学 2024-10-22 Guozheng Ma , Zhen Wang , Zhecheng Yuan , Xueqian Wang , Bo Yuan , Dacheng Tao

Various data augmentation techniques have been recently proposed in image-based deep reinforcement learning (DRL). Although they empirically demonstrate the effectiveness of data augmentation for improving sample efficiency or…

机器学习 · 计算机科学 2024-02-20 Jianshu Hu , Yunpeng Jiang , Paul Weng

Data augmentation is a widely used trick when training deep neural networks: in addition to the original data, properly transformed data are also added to the training set. However, to the best of our knowledge, a clear mathematical…

机器学习 · 统计学 2020-11-10 Shuxiao Chen , Edgar Dobriban , Jane H Lee

Data augmentation is a widely used technique and an essential ingredient in the recent advance in self-supervised representation learning. By preserving the similarity between augmented data, the resulting data representation can improve…

机器学习 · 统计学 2025-01-16 Shulei Wang

Data augmentation has recently emerged as an essential component of modern training recipes for visual recognition tasks. However, data augmentation for video recognition has been rarely explored despite its effectiveness. Few existing…

计算机视觉与模式识别 · 计算机科学 2022-07-01 Taeoh Kim , Jinhyung Kim , Minho Shim , Sangdoo Yun , Myunggu Kang , Dongyoon Wee , Sangyoun Lee

Contextual ranking models have delivered impressive performance improvements over classical models in the document ranking task. However, these highly over-parameterized models tend to be data-hungry and require large amounts of data even…

信息检索 · 计算机科学 2023-11-28 Abhijit Anand , Jurek Leonhardt , Jaspreet Singh , Koustav Rudra , Avishek Anand

Data augmentation is essential when applying Machine Learning in small-data regimes. It generates new samples following the observed data distribution while increasing their diversity and variability to help researchers and practitioners…

机器学习 · 计算机科学 2023-04-10 Audrey Poinsot , Alessandro Leite

Data augmentation has become a standard component of vision pre-trained models to capture the invariance between augmented views. In practice, augmentation techniques that mask regions of a sample with zero/mean values or patches from other…

计算机视觉与模式识别 · 计算机科学 2023-10-31 Shentong Mo , Zhun Sun , Chao Li

A common strategy for improving model robustness is through data augmentations. Data augmentations encourage models to learn desired invariances, such as invariance to horizontal flipping or small changes in color. Recent work has shown…

计算机视觉与模式识别 · 计算机科学 2021-05-28 Hubert Lin , Mitchell van Zuijlen , Sylvia C. Pont , Maarten W. A. Wijntjes , Kavita Bala

Deep neural networks have emerged as very successful tools for image restoration and reconstruction tasks. These networks are often trained end-to-end to directly reconstruct an image from a noisy or corrupted measurement of that image. To…

图像与视频处理 · 电气工程与系统科学 2021-06-30 Zalan Fabian , Reinhard Heckel , Mahdi Soltanolkotabi

This survey presents a comprehensive analysis of data augmentation techniques in human-centric vision tasks, a first of its kind in the field. It delves into a wide range of research areas including person ReID, human parsing, human pose…

计算机视觉与模式识别 · 计算机科学 2024-03-14 Wentao Jiang , Yige Zhang , Shaozhong Zheng , Si Liu , Shuicheng Yan

Contrary to most machine learning models, modern deep artificial neural networks typically include multiple components that contribute to regularization. Despite the fact that some (explicit) regularization techniques, such as weight decay…

计算机视觉与模式识别 · 计算机科学 2020-11-13 Alex Hernández-García , Peter König

Data augmentation has become a de facto component for training high-performance deep image classifiers, but its potential is under-explored for object detection. Noting that most state-of-the-art object detectors benefit from fine-tuning a…

计算机视觉与模式识别 · 计算机科学 2021-03-30 Xiangning Chen , Cihang Xie , Mingxing Tan , Li Zhang , Cho-Jui Hsieh , Boqing Gong

Random data augmentation is a critical technique to avoid overfitting in training deep neural network models. However, data augmentation and network training are usually treated as two isolated processes, limiting the effectiveness of…

计算机视觉与模式识别 · 计算机科学 2018-05-25 Xi Peng , Zhiqiang Tang , Fei Yang , Rogerio Feris , Dimitris Metaxas