English
Related papers

Related papers: Masked Autoencoders are Robust Data Augmentors

200 papers

Deep learning (DL) algorithms have shown significant performance in various computer vision tasks. However, having limited labelled data lead to a network overfitting problem, where network performance is bad on unseen data as compared to…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Teerath Kumar , Alessandra Mileo , Rob Brennan , Malika Bendechache

In recent years, one of the most popular techniques in the computer vision community has been the deep learning technique. As a data-driven technique, deep model requires enormous amounts of accurately labelled training data, which is often…

Computer Vision and Pattern Recognition · Computer Science 2022-10-10 Zihan Yang , Richard O. Sinnott , James Bailey , Qiuhong Ke

We propose a simple data augmentation technique that can be applied to standard model-free reinforcement learning algorithms, enabling robust learning directly from pixels without the need for auxiliary losses or pre-training. The approach…

Machine Learning · Computer Science 2021-03-09 Ilya Kostrikov , Denis Yarats , Rob Fergus

In recent years, Deep Neural Networks (DNN) have emerged as a practical method for image recognition. The raw data, which contain sensitive information, are generally exploited within the training process. However, when the training process…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Qilong Li , Ji Liu , Yifan Sun , Chongsheng Zhang , Dejing Dou

Deep convolutional neural networks require large amounts of labeled data samples. For many real-world applications, this is a major limitation which is commonly treated by augmentation methods. In this work, we address the problem of…

Computer Vision and Pattern Recognition · Computer Science 2022-08-01 Christoph Reinders , Frederik Schubert , Bodo Rosenhahn

To develop a deep-learning method for achieving fast high-resolution MR elastography from highly undersampled data without the need of high-quality training dataset. We first framed the deep neural network representation as a nonlinear…

Signal Processing · Electrical Eng. & Systems 2026-01-21 Xi Peng

The success of deep learning depends heavily on the availability of large datasets, but in robotic manipulation there are many learning problems for which such datasets do not exist. Collecting these datasets is time-consuming and…

Robotics · Computer Science 2022-07-21 Peter Mitrano , Dmitry Berenson

Data augmentation reduces the generalization error by forcing a model to learn invariant representations given different transformations of the input image. In computer vision, on top of the standard image processing functions, data…

Computer Vision and Pattern Recognition · Computer Science 2021-10-22 Rowel Atienza

In view of the fact that semi- and self-supervised learning share a fundamental principle, effectively modeling knowledge from unlabeled data, various semi-supervised semantic segmentation methods have integrated representative…

Computer Vision and Pattern Recognition · Computer Science 2024-11-15 Yangyang Li , Xuanting Hao , Ronghua Shang , Licheng Jiao

Autoencoders are popular among neural-network-based matrix completion models due to their ability to retrieve potential latent factors from the partially observed matrices. Nevertheless, when training data is scarce their performance is…

Machine Learning · Computer Science 2018-07-06 Duc Minh Nguyen , Evaggelia Tsiligianni , Robert Calderbank , Nikos Deligiannis

In many classification problems, we want a classifier that is robust to a range of non-semantic transformations. For example, a human can identify a dog in a picture regardless of the orientation and pose in which it appears. There is…

Machine Learning · Computer Science 2021-12-20 Scott Mahan , Tim Doster , Henry Kvinge

Deep Convolutional Neural Networks have made an incredible progress in many Computer Vision tasks. This progress, however, often relies on the availability of large amounts of the training data, required to prevent over-fitting, which in…

Computer Vision and Pattern Recognition · Computer Science 2023-02-28 Dominik Lewy , Jacek Mańdziuk

Thousands of people suffer from cranial injuries every year. They require personalized implants that need to be designed and manufactured before the reconstruction surgery. The manual design is expensive and time-consuming leading to…

Image and Video Processing · Electrical Eng. & Systems 2024-06-04 Marek Wodzinski , Daria Hemmerling , Mateusz Daniol

Self-supervised learning excels in learning representations from large amounts of unlabeled data, demonstrating success across multiple data modalities. Yet, extending self-supervised learning to new modalities is non-trivial because the…

Machine Learning · Computer Science 2024-02-23 Johnathan Xie , Yoonho Lee , Annie S. Chen , Chelsea Finn

Deep artificial neural networks require a large corpus of training data in order to effectively learn, where collection of such training data is often expensive and laborious. Data augmentation overcomes this issue by artificially inflating…

Machine Learning · Computer Science 2017-08-22 Luke Taylor , Geoff Nitschke

Recently, anomaly detection and localization in multimedia data have received significant attention among the machine learning community. In real-world applications such as medical diagnosis and industrial defect detection, anomalies only…

Computer Vision and Pattern Recognition · Computer Science 2022-05-16 Chaoqin Huang , Qinwei Xu , Yanfeng Wang , Yu Wang , Ya Zhang

Deep learning has been achieving decent performance in computer vision requiring a large volume of images, however, collecting images is expensive and difficult in many scenarios. To alleviate this issue, many image augmentation algorithms…

Computer Vision and Pattern Recognition · Computer Science 2023-05-31 Mingle Xu , Sook Yoon , Alvaro Fuentes , Dong Sun Park

While image data starts to enjoy the simple-but-effective self-supervised learning scheme built upon masking and self-reconstruction objective thanks to the introduction of tokenization procedure and vision transformer backbone,…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Zhi-Yi Chin , Chieh-Ming Jiang , Ching-Chun Huang , Pin-Yu Chen , Wei-Chen Chiu

Recent Self-Supervised Learning (SSL) methods are able to learn feature representations that are invariant to different data augmentations, which can then be transferred to downstream tasks of interest. However, different downstream tasks…

Machine Learning · Computer Science 2023-03-08 Chen Huang , Hanlin Goh , Jiatao Gu , Josh Susskind

Supervised deep learning methods for segmentation require large amounts of labelled training data, without which they are prone to overfitting, not generalizing well to unseen images. In practice, obtaining a large number of annotations…

Computer Vision and Pattern Recognition · Computer Science 2019-03-01 Krishna Chaitanya , Neerav Karani , Christian Baumgartner , Olivio Donati , Anton Becker , Ender Konukoglu