English
Related papers

Related papers: Do ImageNet Classifiers Generalize to ImageNet?

200 papers

Yes, and no. We ask whether recent progress on the ImageNet classification benchmark continues to represent meaningful generalization, or whether the community has started to overfit to the idiosyncrasies of its labeling procedure. We…

Computer Vision and Pattern Recognition · Computer Science 2020-06-15 Lucas Beyer , Olivier J. Hénaff , Alexander Kolesnikov , Xiaohua Zhai , Aäron van den Oord

Image classification is a fundamental task in computer vision, and the quest to enhance DNN accuracy without inflating model size or latency remains a pressing concern. We make a couple of advances in this regard, leading to a novel…

Computer Vision and Pattern Recognition · Computer Science 2024-04-23 Hasanul Mahmud , Kevin Desai , Palden Lama , Sushil K. Prasad

Despite their ability to represent highly expressive functions, deep learning models seem to find simple solutions that generalize surprisingly well. Spectral bias -- the tendency of neural networks to prioritize learning low frequency…

Machine Learning · Computer Science 2022-09-30 Sara Fridovich-Keil , Raphael Gontijo-Lopes , Rebecca Roelofs

Since its release, ImageNet-1k dataset has become a gold standard for evaluating model performance. It has served as the foundation for numerous other datasets and training tasks in computer vision. As models have improved in accuracy,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Nikita Kisel , Illia Volkov , Katerina Hanzelkova , Klara Janouskova , Jiri Matas

Studies on benign overfitting provide insights for the success of overparameterized deep learning models. In this work, we examine whether overfitting is truly benign in real-world classification tasks. We start with the observation that a…

Machine Learning · Computer Science 2023-04-04 Kaiyue Wen , Jiaye Teng , Jingzhao Zhang

Today's available datasets in the wild, e.g., from social media and open platforms, present tremendous opportunities and challenges for deep learning, as there is a significant portion of tagged images, but often with noisy, i.e. erroneous,…

Machine Learning · Computer Science 2020-07-14 Amirmasoud Ghiassi , Robert Birke , Rui Han , Lydia Y. Chen

We present a variety of new architectural features and training procedures that we apply to the generative adversarial networks (GANs) framework. We focus on two applications of GANs: semi-supervised learning, and the generation of images…

Machine Learning · Computer Science 2016-06-14 Tim Salimans , Ian Goodfellow , Wojciech Zaremba , Vicki Cheung , Alec Radford , Xi Chen

Neural networks have proven effective at solving difficult problems but designing their architectures can be challenging, even for image classification problems alone. Our goal is to minimize human participation, so we employ evolutionary…

Neural and Evolutionary Computing · Computer Science 2017-06-13 Esteban Real , Sherry Moore , Andrew Selle , Saurabh Saxena , Yutaka Leon Suematsu , Jie Tan , Quoc Le , Alex Kurakin

Image classifiers are typically scored on their test set accuracy, but high accuracy can mask a subtle type of model failure. We find that high scoring convolutional neural networks (CNNs) on popular benchmarks exhibit troubling pathologies…

Machine Learning · Computer Science 2021-12-08 Brandon Carter , Siddhartha Jain , Jonas Mueller , David Gifford

In recent years, deep learning methods have been successfully applied to image classification tasks. Many such deep neural networks exist today that can easily differentiate cats from dogs. One such model is the ResNeXt model that uses a…

Computer Vision and Pattern Recognition · Computer Science 2018-05-23 Saifuddin Hitawala

Data augmentation is a widely adopted technique for avoiding overfitting when training deep neural networks. However, this approach requires domain-specific knowledge and is often limited to a fixed set of hard-coded transformations.…

Machine Learning · Statistics 2021-08-19 Oguz Kaan Yuksel , Sebastian U. Stich , Martin Jaggi , Tatjana Chavdarova

Overfit is a fundamental problem in machine learning in general, and in deep learning in particular. In order to reduce overfit and improve generalization in the classification of images, some employ invariance to a group of…

Machine Learning · Computer Science 2021-02-12 Roee Cates , Daphna Weinshall

Deep object recognition models have been very successful over benchmark datasets such as ImageNet. How accurate and robust are they to distribution shifts arising from natural and synthetic variations in datasets? Prior research on this…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Ali Borji

We prove bounds on the generalization error of convolutional networks. The bounds are in terms of the training loss, the number of parameters, the Lipschitz constant of the loss and the distance from the weights to the initial weights. They…

Machine Learning · Computer Science 2020-04-09 Philip M. Long , Hanie Sedghi

We introduce a new notion of generalization -- Distributional Generalization -- which roughly states that outputs of a classifier at train and test time are close *as distributions*, as opposed to close in just their average error. For…

Machine Learning · Computer Science 2020-10-16 Preetum Nakkiran , Yamini Bansal

Analyzing model performance in various unseen environments is a critical research problem in the machine learning community. To study this problem, it is important to construct a testbed with out-of-distribution test sets that have broad…

Computer Vision and Pattern Recognition · Computer Science 2024-03-14 Xiaoxiao Sun , Xingjian Leng , Zijian Wang , Yang Yang , Zi Huang , Liang Zheng

ConvNets and Imagenet have driven the recent success of deep learning for image classification. However, the marked slowdown in performance improvement combined with the lack of robustness of neural networks to adversarial examples and…

Machine Learning · Computer Science 2018-07-23 Pierre Stock , Moustapha Cisse

The tremendous success of generative models in recent years raises the question whether they can also be used to perform classification. Generative models have been used as adversarially robust classifiers on simple datasets such as MNIST,…

Machine Learning · Statistics 2021-12-14 Roland S. Zimmermann , Lukas Schott , Yang Song , Benjamin A. Dunn , David A. Klindt

Data-augmentation is key to the training of neural networks for image classification. This paper first shows that existing augmentations induce a significant discrepancy between the typical size of the objects seen by the classifier at…

Computer Vision and Pattern Recognition · Computer Science 2022-01-21 Hugo Touvron , Andrea Vedaldi , Matthijs Douze , Hervé Jégou

Deep neural networks are widely used in image classification problems. However, little work addresses how features from different deep neural networks affect the domain adaptation problem. Existing methods often extract deep features from…

Computer Vision and Pattern Recognition · Computer Science 2020-02-10 Youshan Zhang , Brian D. Davison