English
Related papers

Related papers: Masked Autoencoders are Robust Data Augmentors

200 papers

Representation learning has significantly been developed with the advance of contrastive learning methods. Most of those methods have benefited from various data augmentations that are carefully designated to maintain their identities so…

Computer Vision and Pattern Recognition · Computer Science 2022-01-24 Xiao Wang , Guo-Jun Qi

Deep reinforcement learning (RL) agents often fail to generalize to unseen scenarios, even when they are trained on many instances of semantically similar environments. Data augmentation has recently been shown to improve the sample…

Machine Learning · Computer Science 2021-02-23 Roberta Raileanu , Max Goldstein , Denis Yarats , Ilya Kostrikov , Rob Fergus

In spite of achieving revolutionary successes in machine learning, deep convolutional neural networks have been recently found to be vulnerable to adversarial attacks and difficult to generalize to novel test images with reasonably large…

Computer Vision and Pattern Recognition · Computer Science 2019-03-01 Zhenyu Duan , Martin Renqiang Min , Li Erran Li , Mingbo Cai , Yi Xu , Bingbing Ni

We aim to build image generation models that generalize to new domains from few examples. To this end, we first investigate the generalization properties of classic image generators, and discover that autoencoders generalize extremely well…

Computer Vision and Pattern Recognition · Computer Science 2020-11-30 Davis Wertheimer , Omid Poursaeed , Bharath Hariharan

As the deep learning revolution marches on, self-supervised learning has garnered increasing attention in recent years thanks to its remarkable representation learning ability and the low dependence on labeled data. Among these varied…

Computer Vision and Pattern Recognition · Computer Science 2024-01-10 Siyuan Li , Luyuan Zhang , Zedong Wang , Di Wu , Lirong Wu , Zicheng Liu , Jun Xia , Cheng Tan , Yang Liu , Baigui Sun , Stan Z. Li

Recently deep neural networks have been widely and successfully applied in computer vision tasks and attracted growing interests in medical imaging. One barrier for the application of deep neural networks to medical imaging is the need of…

Computer Vision and Pattern Recognition · Computer Science 2018-07-06 Kuang Gong , Kyungsang Kim , Jianan Cui , Ning Guo , Ciprian Catana , Jinyi Qi , Quanzheng Li

Deformable image registration (alignment) is highly sought after in numerous clinical applications, such as computer aided diagnosis and disease progression analysis. Deep Convolutional Neural Network (DCNN)-based image registration methods…

Image and Video Processing · Electrical Eng. & Systems 2024-05-17 Ruizhe Li , Grazziela Figueredo , Dorothee Auer , Christian Wagner , Xin Chen

Learning from visual observations is a fundamental yet challenging problem in Reinforcement Learning (RL). Although algorithmic advances combined with convolutional neural networks have proved to be a recipe for success, current methods are…

Machine Learning · Computer Science 2020-11-06 Michael Laskin , Kimin Lee , Adam Stooke , Lerrel Pinto , Pieter Abbeel , Aravind Srinivas

Supervised deep learning relies on the assumption that enough training data is available, which presents a problem for its application to several fields, like medical imaging. On the example of a binary image classification task (breast…

Computer Vision and Pattern Recognition · Computer Science 2019-02-22 Lukas Jendele , Ondrej Skopek , Anton S. Becker , Ender Konukoglu

Various data augmentation techniques have been recently proposed in image-based deep reinforcement learning (DRL). Although they empirically demonstrate the effectiveness of data augmentation for improving sample efficiency or…

Machine Learning · Computer Science 2024-02-20 Jianshu Hu , Yunpeng Jiang , Paul Weng

A recurring problem faced when training neural networks is that there is typically not enough data to maximize the generalization capability of deep neural networks(DNN). There are many techniques to address this, including data…

Artificial Intelligence · Computer Science 2017-04-26 Joseph Lemley , Shabab Bazrafkan , Peter Corcoran

Data augmentation (DA) is an essential technique for training state-of-the-art deep learning systems. In this paper, we empirically show data augmentation might introduce noisy augmented examples and consequently hurt the performance on…

Computer Vision and Pattern Recognition · Computer Science 2020-11-25 Chengyue Gong , Dilin Wang , Meng Li , Vikas Chandra , Qiang Liu

Underlying data structures, such as symmetries or invariances to transformations, are often exploited to improve the solution of learning tasks. However, embedding these properties in models or learning algorithms can be challenging and…

Machine Learning · Computer Science 2023-09-19 Ignacio Hounie , Luiz F. O. Chamon , Alejandro Ribeiro

Unsupervised Domain Adaptation (UDA) and domain generalization (DG) are two research areas that aim to tackle the lack of generalization of Deep Neural Networks (DNNs) towards unseen domains. While UDA methods have access to unlabeled…

Computer Vision and Pattern Recognition · Computer Science 2023-04-25 Manuel Schwonberg , Fadoua El Bouazati , Nico M. Schmidt , Hanno Gottschalk

Data augmentation is an essential technique for improving generalization ability of deep learning models. Recently, AutoAugment has been proposed as an algorithm to automatically search for augmentation policies from a dataset and has…

Machine Learning · Computer Science 2020-01-09 Sungbin Lim , Ildoo Kim , Taesup Kim , Chiheon Kim , Sungwoong Kim

Modeling and manufacturing of personalized cranial implants are important research areas that may decrease the waiting time for patients suffering from cranial damage. The modeling of personalized implants may be partially automated by the…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Marek Wodzinski , Kamil Kwarciak , Mateusz Daniol , Daria Hemmerling

Data augmentation techniques play an important role in enhancing the performance of deep learning models. Despite their proven benefits in computer vision tasks, their application in the other domains remains limited. This paper proposes a…

Machine Learning · Computer Science 2024-01-23 Yousef El-Laham , Elizabeth Fons , Dillon Daudert , Svitlana Vyetrenko

Deep learning models have achieved remarkable success in computer vision but still rely heavily on large-scale labeled data and tend to overfit when data is limited or distributions shift. Data augmentation -- particularly mask-based…

Computer Vision and Pattern Recognition · Computer Science 2026-01-16 Shuyin Xia , Fan Chen , Dawei Dai , Meng Yang , Junwei Han , Xinbo Gao , Guoyin Wang

Optimization of image transformation functions for the purpose of data augmentation has been intensively studied. In particular, adversarial data augmentation strategies, which search augmentation maximizing task loss, show significant…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Teppei Suzuki

Neural rendering techniques promise efficient photo-realistic image synthesis while at the same time providing rich control over scene parameters by learning the physical image formation process. While several supervised methods have been…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Hassan Abu Alhaija , Siva Karthik Mustikovela , Justus Thies , Varun Jampani , Matthias Nießner , Andreas Geiger , Carsten Rother