English
Related papers

Related papers: Improving Model Generalization by Agreement of Lea…

200 papers

In many classification problems, we want a classifier that is robust to a range of non-semantic transformations. For example, a human can identify a dog in a picture regardless of the orientation and pose in which it appears. There is…

Machine Learning · Computer Science 2021-12-20 Scott Mahan , Tim Doster , Henry Kvinge

Data augmentation is a widely used technique and an essential ingredient in the recent advance in self-supervised representation learning. By preserving the similarity between augmented data, the resulting data representation can improve…

Machine Learning · Statistics 2025-01-16 Shulei Wang

Neural networks are prone to overfitting and memorizing data patterns. To avoid over-fitting and enhance their generalization and performance, various methods have been suggested in the literature, including dropout, regularization, label…

Computer Vision and Pattern Recognition · Computer Science 2023-02-08 Humza Naveed , Saeed Anwar , Munawar Hayat , Kashif Javed , Ajmal Mian

Scarcity of training data is one of the prominent problems for deep networks which require large amounts data. Data augmentation is a widely used method to increase the number of training samples and their variations. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2020-12-10 Hilmi Kumdakcı , Cihan Öngün , Alptekin Temizel

We study how effective data augmentation is at capturing the inductive bias of carefully designed network architectures for spatial translation invariance. We evaluate various image classification architectures (antialiased, convolutional,…

Computer Vision and Pattern Recognition · Computer Science 2022-11-15 Suriya Gunasekar

Image-to-image (I2I) translation methods based on generative adversarial networks (GANs) typically suffer from overfitting when limited training data is available. In this work, we propose a data augmentation method (ReMix) to tackle this…

Computer Vision and Pattern Recognition · Computer Science 2021-04-01 Jie Cao , Luanxuan Hou , Ming-Hsuan Yang , Ran He , Zhenan Sun

Q-learning algorithms are appealing for real-world applications due to their data-efficiency, but they are very prone to overfitting and training instabilities when trained from visual observations. Prior work, namely SVEA, finds that…

Machine Learning · Computer Science 2024-07-17 Abdulaziz Almuzairee , Nicklas Hansen , Henrik I. Christensen

Data augmentation (DA) encodes invariance and provides implicit regularization critical to a model's performance in image classification tasks. However, while DA improves average accuracy, recent studies have shown that its impact can be…

Computer Vision and Pattern Recognition · Computer Science 2024-01-04 Polina Kirichenko , Mark Ibrahim , Randall Balestriero , Diane Bouchacourt , Ramakrishna Vedantam , Hamed Firooz , Andrew Gordon Wilson

Generalization of neural networks is crucial for deploying them safely in the real world. Common training strategies to improve generalization involve the use of data augmentations, ensembling and model averaging. In this work, we first…

Machine Learning · Computer Science 2023-06-13 Samyak Jain , Sravanti Addepalli , Pawan Sahu , Priyam Dey , R. Venkatesh Babu

Data augmentation is a dominant method for reducing model overfitting and improving generalization. Most existing data augmentation methods tend to find a compromise in augmenting the data, \textit{i.e.}, increasing the amplitude of…

Computer Vision and Pattern Recognition · Computer Science 2023-10-17 Zehao Wang , Yiwen Guo , Qizhang Li , Guanglei Yang , Wangmeng Zuo

Augmenting data in image space (eg. flipping, cropping etc) and activation space (eg. dropout) are being widely used to regularise deep neural networks and have been successfully applied on several computer vision tasks. Unlike previous…

Computer Vision and Pattern Recognition · Computer Science 2019-07-17 Binod Bhattarai , Rumeysa Bodur , Tae-Kyun Kim

Deep neural networks have been exhibiting splendid accuracies in many of visual pattern classification problems. Many of the state-of-the-art methods employ a technique known as data augmentation at the training stage. This paper addresses…

Computer Vision and Pattern Recognition · Computer Science 2015-05-14 Ikuro Sato , Hiroki Nishimura , Kensuke Yokoi

AutoAugment has been a powerful algorithm that improves the accuracy of many vision tasks, yet it is sensitive to the operator space as well as hyper-parameters, and an improper setting may degenerate network optimization. This paper delves…

Computer Vision and Pattern Recognition · Computer Science 2020-03-26 Longhui Wei , An Xiao , Lingxi Xie , Xin Chen , Xiaopeng Zhang , Qi Tian

Data augmentation refers to a group of techniques whose goal is to battle limited amount of available data to improve model generalization and push sample distribution toward the true distribution. While different augmentation strategies…

Quantitative Methods · Quantitative Biology 2020-06-03 Ruqian Hao , Khashayar Namdar , Lin Liu , Masoom A. Haider , Farzad Khalvati

Convolutional Neural Networks (CNNs) serve as the workhorse of deep learning, finding applications in various fields that rely on images. Given sufficient data, they exhibit the capacity to learn a wide range of concepts across diverse…

Computer Vision and Pattern Recognition · Computer Science 2025-02-27 Saorj Kumar , Prince Asiamah , Oluwatoyin Jolaoso , Ugochukwu Esiowu

Conventional image classifiers are trained by randomly sampling mini-batches of images. To achieve state-of-the-art performance, practitioners use sophisticated data augmentation schemes to expand the amount of training data available for…

Machine Learning · Computer Science 2021-06-23 Renkun Ni , Micah Goldblum , Amr Sharaf , Kezhi Kong , Tom Goldstein

Robot learning methods have the potential for widespread generalization across tasks, environments, and objects. However, these methods require large diverse datasets that are expensive to collect in real-world robotics settings. For robot…

Robotics · Computer Science 2023-02-24 Zoey Chen , Sho Kiami , Abhishek Gupta , Vikash Kumar

Image augmentation is a widely used technique to improve the performance of convolutional neural networks (CNNs). In common image shifting, cropping, flipping, shearing and rotating are used for augmentation. But there are more advanced…

Computer Vision and Pattern Recognition · Computer Science 2019-09-24 Philip May

Data augmentation, a cornerstone technique in deep learning, is crucial in enhancing model performance, especially with scarce labeled data. While traditional techniques are effective, their reliance on hand-crafted methods limits their…

Machine Learning · Computer Science 2024-10-04 Mucong Ding , Bang An , Yuancheng Xu , Anirudh Satheesh , Furong Huang

Data augmentation has been highly effective in narrowing the data gap and reducing the cost for human annotation, especially for tasks where ground truth labels are difficult and expensive to acquire. In face recognition, large pose and…

Computer Vision and Pattern Recognition · Computer Science 2020-10-07 Yifan Xing , Yuanjun Xiong , Wei Xia