English
Related papers

Related papers: Deep Fishing: Gradient Features from Deep Nets

200 papers

Convolutional neural networks (CNN) exhibit unmatched performance in a multitude of computer vision tasks. However, the advantage of using convolutional networks over fully-connected networks is not understood from a theoretical…

Machine Learning · Computer Science 2020-10-06 Eran Malach , Shai Shalev-Shwartz

Understanding the mechanism of how convolutional neural networks learn features from image data is a fundamental problem in machine learning and computer vision. In this work, we identify such a mechanism. We posit the Convolutional Neural…

Machine Learning · Statistics 2023-09-04 Daniel Beaglehole , Adityanarayanan Radhakrishnan , Parthe Pandit , Mikhail Belkin

Deep learning based on deep neural networks has been very successful in many practical applications, but it lacks enough theoretical understanding due to the network architectures and structures. In this paper we establish some analysis for…

Machine Learning · Computer Science 2024-01-03 Jianfei Li , Han Feng , Ding-Xuan Zhou

We study the natural gradient method for learning in deep Bayesian networks, including neural networks. There are two natural geometries associated with such learning systems consisting of visible and hidden units. One geometry is related…

Machine Learning · Computer Science 2020-05-22 Nihat Ay

In the deep metric learning approach to image segmentation, a convolutional net densely generates feature vectors at the pixels of an image. Pairs of feature vectors are trained to be similar or different, depending on whether the…

Computer Vision and Pattern Recognition · Computer Science 2019-02-04 Kyle Luther , H. Sebastian Seung

Weakly supervised learning of object detection is an important problem in image understanding that still does not have a satisfactory solution. In this paper, we address this problem by exploiting the power of deep convolutional neural…

Computer Vision and Pattern Recognition · Computer Science 2016-12-20 Hakan Bilen , Andrea Vedaldi

The superior performance of Deformable Convolutional Networks arises from its ability to adapt to the geometric variations of objects. Through an examination of its adaptive behavior, we observe that while the spatial support for its neural…

Computer Vision and Pattern Recognition · Computer Science 2018-11-29 Xizhou Zhu , Han Hu , Stephen Lin , Jifeng Dai

We present an analysis of three possible strategies for exploiting the power of existing convolutional neural networks (ConvNets) in different scenarios from the ones they were trained: full training, fine tuning, and using ConvNets as…

Computer Vision and Pattern Recognition · Computer Science 2016-11-08 Keiller Nogueira , Otávio A. B. Penatti , Jefersson A. dos Santos

Deeper neural networks are more difficult to train. We present a residual learning framework to ease the training of networks that are substantially deeper than those used previously. We explicitly reformulate the layers as learning…

Computer Vision and Pattern Recognition · Computer Science 2015-12-11 Kaiming He , Xiangyu Zhang , Shaoqing Ren , Jian Sun

At present, the great achievements of convolutional neural network(CNN) in feature and metric learning have attracted many researchers. However, the vast majority of deep network architectures have been used to represent based on real…

Computer Vision and Pattern Recognition · Computer Science 2019-03-26 Siwen Jiang , Wenxuan Wei , Shihao Guo , Hongguang Fu , Lei Huang

Convolutional Neural Networks (CNNs) have recently been shown to excel at performing visual place recognition under changing appearance and viewpoint. Previously, place recognition has been improved by intelligently selecting relevant…

Robotics · Computer Science 2018-10-31 Stephen Hausler , Adam Jacobson , Michael Milford

Deep learning has established many new state of the art solutions in the last decade in areas such as object, scene and speech recognition. In particular Convolutional Neural Network (CNN) is a category of deep learning which obtains…

Computer Vision and Pattern Recognition · Computer Science 2016-09-26 Vincent Andrearczyk , Paul F. Whelan

Deep convolutional neural networks (DCNNs) have attracted much attention recently, and have shown to be able to recognize thousands of object categories in natural image databases. Their architecture is somewhat similar to that of the human…

Computer Vision and Pattern Recognition · Computer Science 2016-09-13 Saeed Reza Kheradpisheh , Masoud Ghodrati , Mohammad Ganjtabesh , Timothée Masquelier

Convolutional Neural Networks (CNNs) have achieved comparable error rates to well-trained human on ILSVRC2014 image classification task. To achieve better performance, the complexity of CNNs is continually increasing with deeper and bigger…

Computer Vision and Pattern Recognition · Computer Science 2014-12-30 Wei Yu , Kuiyuan Yang , Yalong Bai , Hongxun Yao , Yong Rui

Deep learning has gained great success in various classification tasks. Typically, deep learning models learn underlying features directly from data, and no underlying relationship between classes are included. Similarity between classes…

Computer Vision and Pattern Recognition · Computer Science 2020-09-28 Xueli Xiao , Chunyan Ji , Thosini Bamunu Mudiyanselage , Yi Pan

We cast shape matching as metric learning with convolutional networks. We break the end-to-end process of image representation into two parts. Firstly, well established efficient methods are chosen to turn the images into edge maps.…

Computer Vision and Pattern Recognition · Computer Science 2018-07-27 Filip Radenović , Giorgos Tolias , Ondřej Chum

CoVariance Neural Networks (VNNs) perform convolutions on the graph determined by the covariance matrix of the data, which enables expressive and stable covariance-based learning. However, covariance matrices are typically dense, fail to…

Machine Learning · Computer Science 2026-01-21 Andrea Cavallo , Samuel Rey , Antonio G. Marques , Elvin Isufi

CoVariance Neural Networks (VNNs) perform graph convolutions on the empirical covariance matrix of signals defined over finite-dimensional Hilbert spaces, motivated by robustness and transferability properties. Yet, little is known about…

Machine Learning · Computer Science 2025-09-18 Claudio Battiloro , Andrea Cavallo , Elvin Isufi

Convolutional neural networks (CNN) have recently achieved remarkable successes in various image classification and understanding tasks. The deep features obtained at the top fully-connected layer of the CNN (FC-features) exhibit rich…

Computer Vision and Pattern Recognition · Computer Science 2017-04-05 Sheng Guo , Weilin Huang , Limin Wang , Yu Qiao

Despite recent advances in multi-scale deep representations, their limitations are attributed to expensive parameters and weak fusion modules. Hence, we propose an efficient approach to fuse multi-scale deep representations, called…

Computer Vision and Pattern Recognition · Computer Science 2016-11-18 Yu Liu , Yanming Guo , Michael S. Lew