English
Related papers

Related papers: Factors of Transferability for a Generic ConvNet R…

200 papers

Convolutional neural networks (ConvNets) are widely used in real life. People usually use ConvNets which pre-trained on a fixed number of classes. However, for different application scenarios, we usually do not need all of the classes,…

Computer Vision and Pattern Recognition · Computer Science 2020-02-27 Xiaolong Hu , Zhulin An , Chuanguang Yang , Hui Zhu , Kaiqaing Xu , Yongjun Xu

It is now a standard for neural network representations to be trained on large, publicly available datasets, and used for new problems. The reasons for why neural network representations have been so successful for transfer, however, are…

Machine Learning · Computer Science 2022-09-20 Ehsan Imani , Wei Hu , Martha White

Learning image representations with ConvNets by pre-training on ImageNet has proven useful across many visual understanding tasks including object detection, semantic segmentation, and image captioning. Although any image representation can…

Computer Vision and Pattern Recognition · Computer Science 2017-08-18 Du Tran , Jamie Ray , Zheng Shou , Shih-Fu Chang , Manohar Paluri

Convolutional Neural Networks (CNNs) have become the state-of-the-art method to learn from image data. However, recent research shows that they may include a texture and colour bias in their representation, contrary to the intuition that…

Computer Vision and Pattern Recognition · Computer Science 2019-07-31 Francis Brochu

The growing popularity of transfer learning, due to the availability of models pre-trained on vast amounts of data, makes it imperative to understand when the knowledge of these pre-trained models can be transferred to obtain…

Machine Learning · Computer Science 2024-10-30 Akshay Mehra , Yunbei Zhang , Jihun Hamm

We describe the class of convexified convolutional neural networks (CCNNs), which capture the parameter sharing of convolutional neural networks in a convex manner. By representing the nonlinear convolutional filters as vectors in a…

Machine Learning · Computer Science 2016-09-06 Yuchen Zhang , Percy Liang , Martin J. Wainwright

In networks of independent entities that face similar predictive tasks, transfer machine learning enables to re-use and improve neural nets using distributed data sets without the exposure of raw data. As the number of data sets in business…

Machine Learning · Computer Science 2020-03-31 Robin Hirt , Akash Srivastava , Carlos Berg , Niklas Kühl

Despite the large volume of face recognition datasets, there is a significant portion of subjects, of which the samples are insufficient and thus under-represented. Ignoring such significant portion results in insufficient training data.…

Computer Vision and Pattern Recognition · Computer Science 2019-08-20 Xi Yin , Xiang Yu , Kihyuk Sohn , Xiaoming Liu , Manmohan Chandraker

Self-supervised learning is a powerful paradigm for representation learning on unlabelled images. A wealth of effective new methods based on instance matching rely on data-augmentation to drive learning, and these have reached a rough…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Linus Ericsson , Henry Gouk , Timothy M. Hospedales

Learning robust representations that allow to reliably establish relations between images is of paramount importance for virtually all of computer vision. Annotating the quadratic number of pairwise relations between training images is…

Computer Vision and Pattern Recognition · Computer Science 2019-11-19 Timo Milbich , Omair Ghori , Ferran Diego , Björn Ommer

We study the problem of meta-learning through the lens of online convex optimization, developing a meta-algorithm bridging the gap between popular gradient-based meta-learning and classical regularization-based multi-task transfer methods.…

Machine Learning · Computer Science 2019-05-17 Mikhail Khodak , Maria-Florina Balcan , Ameet Talwalkar

We propose contextual convolution (CoConv) for visual recognition. CoConv is a direct replacement of the standard convolution, which is the core component of convolutional neural networks. CoConv is implicitly equipped with the capability…

Computer Vision and Pattern Recognition · Computer Science 2021-08-18 Ionut Cosmin Duta , Mariana Iuliana Georgescu , Radu Tudor Ionescu

Graph neural networks (GNNs) build on the success of deep learning models by extending them for use in graph spaces. Transfer learning has proven extremely successful for traditional deep learning problems: resulting in faster training and…

Machine Learning · Computer Science 2022-02-03 Nishai Kooverjee , Steven James , Terence van Zyl

As people's aesthetic preferences for images are far from understood, image aesthetic assessment is a challenging artificial intelligence task. The range of factors underlying this task is almost unlimited, but we know that some aesthetic…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Derya Soydaner , Johan Wagemans

We introduce a framework for learning robust visual representations that generalize to new viewpoints, backgrounds, and scene contexts. Discriminative models often learn naturally occurring spurious correlations, which cause them to fail on…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Chengzhi Mao , Augustine Cha , Amogh Gupta , Hao Wang , Junfeng Yang , Carl Vondrick

We present four different robust transfer learning and data augmentation strategies for robust mobile scene recognition. By training three mobile-ready (EfficientNetB0, MobileNetV2, MobileNetV3) and two large-scale baseline (VGG16,…

Computer Vision and Pattern Recognition · Computer Science 2021-07-26 Hermann Baumgartl , Ricardo Buettner

Recent studies have shown that video-level representation learning is crucial to the capture and understanding of the long-range temporal structure for video action recognition. Most existing 3D convolutional neural network (CNN)-based…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Mohammad Al-Saad , Lakshmish Ramaswamy , Suchendra Bhandarkar

Convolutional neural networks (CNNs) are able to attain better visual recognition performance than fully connected neural networks despite having much fewer parameters due to their parameter sharing principle. Modern architectures usually…

Computer Vision and Pattern Recognition · Computer Science 2022-10-20 Ilke Cugu , Emre Akbas

Visual attention modeling has recently gained momentum in developing visual hierarchies provided by Convolutional Neural Networks. Despite recent successes of feedforward processing on the abstraction of concepts form raw images, the…

Computer Vision and Pattern Recognition · Computer Science 2017-08-23 Mahdi Biparva , John Tsotsos

Place recognition is one of the most challenging problems in computer vision, and has become a key part in mobile robotics and autonomous driving applications for performing loop closure in visual SLAM systems. Moreover, the difficulty of…

Computer Vision and Pattern Recognition · Computer Science 2015-05-28 Ruben Gomez-Ojeda , Manuel Lopez-Antequera , Nicolai Petkov , Javier Gonzalez-Jimenez