English
Related papers

Related papers: Proper Reuse of Image Classification Features Impr…

200 papers

This work identifies a simple pre-training mechanism that leads to representations exhibiting better continual and transfer learning. This mechanism -- the repeated resetting of weights in the last layer, which we nickname "zapping" -- was…

Machine Learning · Computer Science 2024-10-22 Lapo Frati , Neil Traft , Jeff Clune , Nick Cheney

Our work addresses the problem of learning to localize objects in an open-world setting, i.e., given the bounding box information of a limited number of object classes during training, the goal is to localize all objects, belonging to both…

Computer Vision and Pattern Recognition · Computer Science 2025-04-25 Ashish Singh , Michael J. Jones , Kuan-Chuan Peng , Anoop Cherian , Moitreya Chatterjee , Erik Learned-Miller

Recently, it was found that many real-world examples without intentional modifications can fool machine learning models, and such examples are called "natural adversarial examples". ImageNet-A is a famous dataset of natural adversarial…

Computer Vision and Pattern Recognition · Computer Science 2021-02-24 Xiao Li , Jianmin Li , Ting Dai , Jie Shi , Jun Zhu , Xiaolin Hu

Transformers have become the dominant model in natural language processing, owing to their ability to pretrain on massive amounts of data, then transfer to smaller, more specific tasks via fine-tuning. The Vision Transformer was the first…

Computer Vision and Pattern Recognition · Computer Science 2020-12-21 Josh Beal , Eric Kim , Eric Tzeng , Dong Huk Park , Andrew Zhai , Dmitry Kislyuk

While the majority of today's object class models provide only 2D bounding boxes, far richer output hypotheses are desirable including viewpoint, fine-grained category, and 3D geometry estimate. However, models trained to provide richer…

Computer Vision and Pattern Recognition · Computer Science 2014-02-18 Bojan Pepik , Michael Stark , Peter Gehler , Bernt Schiele

Object detection models perform well at localizing and classifying objects that they are shown during training. However, due to the difficulty and cost associated with creating and annotating detection datasets, trained models detect a…

Computer Vision and Pattern Recognition · Computer Science 2020-12-01 Ayush Jaiswal , Yue Wu , Pradeep Natarajan , Premkumar Natarajan

Pre-training is a dominant paradigm in computer vision. For example, supervised ImageNet pre-training is commonly used to initialize the backbones of object detection and segmentation models. He et al., however, show a surprising result…

Computer Vision and Pattern Recognition · Computer Science 2020-11-17 Barret Zoph , Golnaz Ghiasi , Tsung-Yi Lin , Yin Cui , Hanxiao Liu , Ekin D. Cubuk , Quoc V. Le

Transfer learning has emerged as a powerful methodology for adapting pre-trained deep neural networks on image recognition tasks to new domains. This process consists of taking a neural network pre-trained on a large feature-rich source…

Machine Learning · Computer Science 2021-04-27 Francisco Utrera , Evan Kravitz , N. Benjamin Erichson , Rajiv Khanna , Michael W. Mahoney

Machine Unlearning is an emerging paradigm for selectively removing the impact of training datapoints from a network. Unlike existing methods that target a limited subset or a single class, our framework unlearns all classes in a single…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Samuele Poppi , Sara Sarto , Marcella Cornia , Lorenzo Baraldi , Rita Cucchiara

Due to object detection's close relationship with video analysis and image understanding, it has attracted much research attention in recent years. Traditional object detection methods are built on handcrafted features and shallow trainable…

Computer Vision and Pattern Recognition · Computer Science 2019-04-17 Zhong-Qiu Zhao , Peng Zheng , Shou-tao Xu , Xindong Wu

Finetuning from a pretrained deep model is found to yield state-of-the-art performance for many vision tasks. This paper investigates many factors that influence the performance in finetuning for object detection. There is a long-tailed…

Computer Vision and Pattern Recognition · Computer Science 2016-04-15 Wanli Ouyang , Xiaogang Wang , Cong Zhang , Xiaokang Yang

Pre-training has been a popular learning paradigm in deep learning era, especially in annotation-insufficient scenario. Better ImageNet pre-trained models have been demonstrated, from the perspective of architecture, by previous research to…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Andong Deng , Xingjian Li , Di Hu , Tianyang Wang , Haoyi Xiong , Chengzhong Xu

Transfer learning is a machine learning technique that uses previously acquired knowledge from a source domain to enhance learning in a target domain by reusing learned weights. This technique is ubiquitous because of its great advantages…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Nermeen Abou Baker , Nico Zengeler , Uwe Handmann

The tremendous success of ImageNet-trained deep features on a wide range of transfer tasks begs the question: what are the properties of the ImageNet dataset that are critical for learning good, general-purpose features? This work provides…

Computer Vision and Pattern Recognition · Computer Science 2016-12-13 Minyoung Huh , Pulkit Agrawal , Alexei A. Efros

In many real-life tasks of application of supervised learning approaches, all the training data are not available at the same time. The examples are lifelong image classification or recognition of environmental objects during interaction of…

Machine Learning · Computer Science 2020-06-15 Miltiadis Poursanidis , Jenny Benois-Pineau , Akka Zemmari , Boris Mansenca , Aymar de Rugy

Multi-label image classification is about predicting a set of class labels that can be considered as orderless sequential data. Transformers process the sequential data as a whole, therefore they are inherently good at set prediction. The…

Computer Vision and Pattern Recognition · Computer Science 2022-05-17 Vacit Oguz Yazici , Joost van de Weijer , Longlong Yu

Object detection is a fundamental task for robots to operate in unstructured environments. Today, there are several deep learning algorithms that solve this task with remarkable performance. Unfortunately, training such systems requires…

Computer Vision and Pattern Recognition · Computer Science 2021-06-30 Federico Ceola , Elisa Maiettini , Giulia Pasquale , Lorenzo Rosasco , Lorenzo Natale

Transfer learning with models pretrained on ImageNet has become a standard practice in computer vision. Transfer learning refers to fine-tuning pretrained weights of a neural network on a downstream task, typically unrelated to ImageNet.…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Xander Coetzer , Arné Schreuder , Anna Sergeevna Bosman

Even though convolutional neural networks can classify objects in images very accurately, it is well known that the attention of the network may not always be on the semantically important regions of the scene. It has been observed that…

Computer Vision and Pattern Recognition · Computer Science 2022-02-10 Maliha Arif , Calvin Yong , Abhijit Mahalanobis

We report on an extensive study of the benefits and limitations of current deep learning approaches to object recognition in robot vision scenarios, introducing a novel dataset used for our investigation. To avoid the biases in currently…

Robotics · Computer Science 2021-08-25 Giulia Pasquale , Carlo Ciliberto , Francesca Odone , Lorenzo Rosasco , Lorenzo Natale