English
Related papers

Related papers: Factors of Transferability for a Generic ConvNet R…

200 papers

Models based on deep convolutional networks have dominated recent image interpretation tasks; we investigate whether models which are also recurrent, or "temporally deep", are effective for tasks involving sequences, visual and otherwise.…

Computer Vision and Pattern Recognition · Computer Science 2016-06-02 Jeff Donahue , Lisa Anne Hendricks , Marcus Rohrbach , Subhashini Venugopalan , Sergio Guadarrama , Kate Saenko , Trevor Darrell

Transfer learning is a cornerstone of computer vision, yet little work has been done to evaluate the relationship between architecture and transfer. An implicit hypothesis in modern computer vision research is that models that perform…

Computer Vision and Pattern Recognition · Computer Science 2019-06-18 Simon Kornblith , Jonathon Shlens , Quoc V. Le

Unconstrained video recognition and Deep Convolution Network (DCN) are two active topics in computer vision recently. In this work, we apply DCNs as frame-based recognizers for video recognition. Our preliminary studies, however, show that…

Computer Vision and Pattern Recognition · Computer Science 2015-06-16 Yu-Chuan Su , Tzu-Hsuan Chiu , Chun-Yen Yeh , Hsin-Fu Huang , Winston H. Hsu

Convolutional networks trained on large supervised dataset produce visual features which form the basis for the state-of-the-art in many computer-vision problems. Further improvements of these visual features will likely require even larger…

Computer Vision and Pattern Recognition · Computer Science 2015-11-10 Armand Joulin , Laurens van der Maaten , Allan Jabri , Nicolas Vasilache

Transfer learning from huge natural image datasets, fine-tuning of deep neural networks and the use of the corresponding pre-trained networks have become de facto the core of art analysis applications. Nevertheless, the effects of transfer…

Computer Vision and Pattern Recognition · Computer Science 2020-11-25 Nicolas Gonthier , Yann Gousseau , Saïd Ladjal

Convolutional Neural Networks (CNNs) have recently been shown to excel at performing visual place recognition under changing appearance and viewpoint. Previously, place recognition has been improved by intelligently selecting relevant…

Robotics · Computer Science 2018-10-31 Stephen Hausler , Adam Jacobson , Michael Milford

In human learning, it is common to use multiple sources of information jointly. However, most existing feature learning approaches learn from only a single task. In this paper, we propose a novel multi-task deep network to learn…

Computer Vision and Pattern Recognition · Computer Science 2017-11-27 Zhongzheng Ren , Yong Jae Lee

Knowledge transfer between heterogeneous source and target networks and tasks has received a lot of attention in recent times as large amounts of quality labeled data can be difficult to obtain in many applications. Existing approaches…

Machine Learning · Computer Science 2022-03-17 Keerthiram Murugesan , Vijay Sadashivaiah , Ronny Luss , Karthikeyan Shanmugam , Pin-Yu Chen , Amit Dhurandhar

Convolutional Neural Networks (Convnets) have achieved good results in a range of computer vision tasks the recent years. Though given a lot of attention, visualizing the learned representations to interpret Convnets, still remains a…

Computer Vision and Pattern Recognition · Computer Science 2017-02-24 David Malmgren-Hansen , Allan Aasbjerg Nielsen , Rasmus Engholm

The employment of convolutional neural networks has achieved unprecedented performance in the task of image restoration for a variety of degradation factors. However, high-performance networks have been specifically designed for a single…

Computer Vision and Pattern Recognition · Computer Science 2020-01-22 Xing Liu , Masanori Suganuma , Xiyang Luo , Takayuki Okatani

Face attribute evaluation plays an important role in video surveillance and face analysis. Although methods based on convolution neural networks have made great progress, they inevitably only deal with one local neighborhood with…

Computer Vision and Pattern Recognition · Computer Science 2022-07-13 Decheng Liu , Weijie He , Chunlei Peng , Nannan Wang , Jie Li , Xinbo Gao

After the incredible success of deep learning in the computer vision domain, there has been much interest in applying Convolutional Network (ConvNet) features in robotic fields such as visual navigation and SLAM. Unfortunately, there are…

Robotics · Computer Science 2015-07-30 Niko Sünderhauf , Feras Dayoub , Sareh Shirazi , Ben Upcroft , Michael Milford

This paper does not attempt to design a state-of-the-art method for visual recognition but investigates a more efficient way to make use of convolutions to encode spatial features. By comparing the design principles of the recent…

Computer Vision and Pattern Recognition · Computer Science 2022-11-23 Qibin Hou , Cheng-Ze Lu , Ming-Ming Cheng , Jiashi Feng

This work extends the theory of identifiability in supervised learning by considering the consequences of having access to a distribution of tasks. In such cases, we show that linear identifiability is achievable in the general multi-task…

Machine Learning · Statistics 2024-08-26 Wenlin Chen , Julien Horwood , Juyeon Heo , José Miguel Hernández-Lobato

Representation learning is a widely adopted framework for learning in data-scarce environments, aiming to extract common features from related tasks. While centralized approaches have been extensively studied, decentralized methods remain…

Machine Learning · Computer Science 2025-12-30 Donghwa Kang , Shana Moothedath

An important goal in visual recognition is to devise image representations that are invariant to particular transformations. In this paper, we address this goal with a new type of convolutional neural network (CNN) whose invariance is…

Computer Vision and Pattern Recognition · Computer Science 2015-01-08 Julien Mairal , Piotr Koniusz , Zaid Harchaoui , Cordelia Schmid

Transfer learning is a widely used method to build high performing computer vision models. In this paper, we study the efficacy of transfer learning by examining how the choice of data impacts performance. We find that more pre-training…

Computer Vision and Pattern Recognition · Computer Science 2018-12-13 Jiquan Ngiam , Daiyi Peng , Vijay Vasudevan , Simon Kornblith , Quoc V. Le , Ruoming Pang

Convolution is a central operation in Convolutional Neural Networks (CNNs), which applies a kernel to overlapping regions shifted across the image. However, because of the strong correlations in real-world image data, convolutional kernels…

Transfer learning can significantly improve the sample efficiency of neural networks, by exploiting the relatedness between a data-scarce target task and a data-abundant source task. Despite years of successful applications, transfer…

Machine Learning · Computer Science 2023-06-06 Federica Gerace , Luca Saglietti , Stefano Sarao Mannelli , Andrew Saxe , Lenka Zdeborová

Convolutional Neural Networks (CNNs) have revolutionized performances in several machine learning tasks such as image classification, object tracking, and keyword spotting. However, given that they contain a large number of parameters,…

Image and Video Processing · Electrical Eng. & Systems 2019-03-28 Taruna Agrawal , Rahul Gupta , Shrikanth Narayanan