English
Related papers

Related papers: Scale equivariance in CNNs with vector fields

200 papers

Building on our prior explorations of convolutional neural networks (CNNs) for financial data processing, this paper introduces two significant enhancements to refine our CNN model's predictive performance and robustness for financial…

Computational Finance · Quantitative Finance 2024-08-23 Sina Montazeri , Haseebullah Jumakhan , Sonia Abrasiabian , Amir Mirzaeinia

We address the problem of improving the performance and in particular the sample complexity of deep neural networks by enforcing and guaranteeing invariances to symmetry transformations rather than learning them from data. Group-equivariant…

Machine Learning · Computer Science 2023-03-06 Matthias Rath , Alexandru Paul Condurache

Automated design methods for convolutional neural networks (CNNs) have recently been developed in order to increase the design productivity. We propose a neuroevolution method capable of evolving and optimizing CNNs with respect to the…

Neural and Evolutionary Computing · Computer Science 2019-10-16 Filip Badan , Lukas Sekanina

Convolutional Networks (ConvNets) have recently improved image recognition performance thanks to end-to-end learning of deep feed-forward models from raw pixels. Deep learning is a marked departure from the previous state of the art, the…

Computer Vision and Pattern Recognition · Computer Science 2015-07-24 Albert Gordo , Adrien Gaidon , Florent Perronnin

Convolutional Neural Networks (ConvNets) are commonly developed at a fixed resource budget, and then scaled up for better accuracy if more resources are available. In this paper, we systematically study model scaling and identify that…

Machine Learning · Computer Science 2020-09-14 Mingxing Tan , Quoc V. Le

Most of the recent successful methods in accurate object detection build on the convolutional neural networks (CNN). However, due to the lack of scale normalization in CNN-based detection methods, the activated channels in the feature space…

Computer Vision and Pattern Recognition · Computer Science 2018-08-16 Yonghyun Kim , Bong-Nam Kang , Daijin Kim

Deep convolutional neural networks (CNN) have shown their promise as a universal representation for recognition. However, global CNN activations lack geometric invariance, which limits their robustness for classification and matching of…

Computer Vision and Pattern Recognition · Computer Science 2014-09-10 Yunchao Gong , Liwei Wang , Ruiqi Guo , Svetlana Lazebnik

Recently, convolutional neural networks (CNN) have demonstrated impressive performance in various computer vision tasks. However, high performance hardware is typically indispensable for the application of CNN models due to the high…

Computer Vision and Pattern Recognition · Computer Science 2016-05-17 Jiaxiang Wu , Cong Leng , Yuhang Wang , Qinghao Hu , Jian Cheng

We address the challenge of applying existing convolutional neural network (CNN) architectures to compressed images. Existing CNN architectures represent images as a matrix of pixel intensities with a specified dimension; this desired…

Computer Vision and Pattern Recognition · Computer Science 2019-11-22 Christopher A. George , Bradley M. West

We study the feature-scaled version of the Monte Carlo algorithm with linear function approximation. This algorithm converges to a scale-invariant solution, which is not unduly affected by states having feature vectors with large norms. The…

Machine Learning · Computer Science 2022-05-31 Rahul Madhavan , Hemanta Makwana

We introduce a simple permutation equivariant layer for deep learning with set structure.This type of layer, obtained by parameter-sharing, has a simple implementation and linear-time complexity in the size of each set. We use deep…

Machine Learning · Statistics 2017-02-27 Siamak Ravanbakhsh , Jeff Schneider , Barnabas Poczos

We present a scalable approach for semi-supervised learning on graph-structured data that is based on an efficient variant of convolutional neural networks which operate directly on graphs. We motivate the choice of our convolutional…

Machine Learning · Computer Science 2017-02-23 Thomas N. Kipf , Max Welling

Despite the importance of image representations such as histograms of oriented gradients and deep Convolutional Neural Networks (CNN), our theoretical understanding of them remains limited. Aiming at filling this gap, we investigate three…

Computer Vision and Pattern Recognition · Computer Science 2015-06-23 Karel Lenc , Andrea Vedaldi

Scale variation is a fundamental challenge in computer vision. Objects of the same class can have different sizes, and their perceived size is further affected by the distance from the camera. These variations are local to the objects,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-21 Md Ashiqur Rahman , Chiao-An Yang , Michael N. Cheng , Lim Jun Hao , Jeremiah Jiang , Teck-Yian Lim , Raymond A. Yeh

Convolutional neural networks have many hyperparameters such as the filter size, number of filters, and pooling size, which require manual tuning. Though deep stacked structures are able to create multi-scale and hierarchical…

Computer Vision and Pattern Recognition · Computer Science 2018-03-02 Ilker Cam , F. Boray Tek

Deep convolutional neural networks (CNN) has become the most promising method for object recognition, repeatedly demonstrating record breaking results for image classification and object detection in recent years. However, a very deep CNN…

Computer Vision and Pattern Recognition · Computer Science 2014-12-22 Yunchao Gong , Liu Liu , Ming Yang , Lubomir Bourdev

CNN is very popular neural network architecture in modern days. It is primarily most used tool for vision related task to extract the important features from the given image. Moreover, CNN works as a filter to extract the important features…

Computer Vision and Pattern Recognition · Computer Science 2020-06-09 Vijay Pandey , Shashi Bhushan Jha

Recent advances in hardware and big data acquisition have accelerated the development of deep learning techniques. For an extended period of time, increasing the model complexity has led to performance improvements for various tasks.…

Machine Learning · Computer Science 2023-07-24 Damian Owerko , Charilaos I. Kanatsoulis , Jennifer Bondarchuk , Donald J. Bucci , Alejandro Ribeiro

Convolutional Neural Networks (CNNs) are a class of artificial neural networks whose computational blocks use convolution, together with other linear and non-linear operations, to perform classification or regression. This paper explores…

Computer Vision and Pattern Recognition · Computer Science 2018-10-09 Victor Stamatescu , Mark D. McDonnell

The Coordinate Ascent Variational Inference scheme is a popular algorithm used to compute the mean-field approximation of a probability distribution of interest. We analyze its random scan version, under log-concavity assumptions on the…

Machine Learning · Statistics 2024-09-24 Hugo Lavenant , Giacomo Zanella