English
Related papers

Related papers: Scaling-Translation-Equivariant Networks with Deco…

200 papers

Convolutional neural networks (CNNs) learn filters in order to capture local correlation patterns in feature space. We propose to learn these filters as combinations of preset spectral filters defined by the Discrete Cosine Transform (DCT).…

Computer Vision and Pattern Recognition · Computer Science 2022-04-12 Matej Ulicny , Vladimir A. Krylov , Rozenn Dahyot

Convolutional Neural Networks (CNNs) are powerful models that achieve impressive results for image classification. In addition, pre-trained CNNs are also useful for other computer vision tasks as generic feature extractors. This paper aims…

Computer Vision and Pattern Recognition · Computer Science 2015-07-10 Ben Athiwaratkun , Keegan Kang

Convolutional Neural Networks (CNN) have been successful in processing data signals that are uniformly sampled in the spatial domain (e.g., images). However, most data signals do not natively exist on a grid, and in the process of being…

Computer Vision and Pattern Recognition · Computer Science 2019-01-09 Chiyu "Max" Jiang , Dequan Wang , Jingwei Huang , Philip Marcus , Matthias Nießner

Standard convolutional neural networks(CNNs) require consistent image resolutions in both training and testing phase. However, in practice, testing with smaller image sizes is necessary for fast inference. We show that trivially evaluating…

Computer Vision and Pattern Recognition · Computer Science 2020-09-08 Zhuoran Yu , Aojun Zhou , Yukun Ma , Yudian Li , Xiaohan Zhang , Ping Luo

Very deep convolutional neural networks (CNNs) have been firmly established as the primary methods for many computer vision tasks. However, most state-of-the-art CNNs are large, which results in high inference latency. Recently, depth-wise…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Yihui He , Jianing Qian , Jianren Wang , Cindy X. Le , Congrui Hetang , Qi Lyu , Wenping Wang , Tianwei Yue

As the key advancement of the convolutional neural networks (CNNs), depthwise separable convolutions (DSCs) are becoming one of the most popular techniques to reduce the computations and parameters size of CNNs meanwhile maintaining the…

Machine Learning · Computer Science 2021-01-05 Yuke Wang , Boyuan Feng , Yufei Ding

Subsampling is used in convolutional neural networks (CNNs) in the form of pooling or strided convolutions, to reduce the spatial dimensions of feature maps and to allow the receptive fields to grow exponentially with depth. However, it is…

Machine Learning · Computer Science 2021-06-11 Jin Xu , Hyunjik Kim , Tom Rainforth , Yee Whye Teh

Convolution is the main building block of convolutional neural networks (CNN). We observe that an optimized CNN often has highly correlated filters as the number of channels increases with depth, reducing the expressive power of feature…

Computer Vision and Pattern Recognition · Computer Science 2020-09-28 Xudong Wang , Stella X. Yu

In modern computer vision tasks, convolutional neural networks (CNNs) are indispensable for image classification tasks due to their efficiency and effectiveness. Part of their superiority compared to other architectures, comes from the fact…

Machine Learning · Computer Science 2019-06-11 Vighnesh Birodkar , Hossein Mobahi , Dilip Krishnan , Samy Bengio

Convolutional Neural Networks (CNNs) were the driving force behind many advancements in Computer Vision research in recent years. This progress has spawned many practical applications and we see an increased need to efficiently move CNNs to…

Computer Vision and Pattern Recognition · Computer Science 2020-05-13 Thomas Kurbiel , Shahrzad Khaleghian

Building large models with parameter sharing accounts for most of the success of deep convolutional neural networks (CNNs). In this paper, we propose doubly convolutional neural networks (DCNNs), which significantly improve the performance…

Machine Learning · Computer Science 2016-11-01 Shuangfei Zhai , Yu Cheng , Weining Lu , Zhongfei Zhang

Filter-decomposition-based group equivariant convolutional neural networks (CNNs) have shown promising stability and data efficiency for 3D image feature extraction. However, these networks, which rely on parameter sharing and discrete…

Computer Vision and Pattern Recognition · Computer Science 2026-01-08 Wenzhao Zhao , Steffen Albert , Barbara D. Wichtmann , Angelika Maurer , Ulrike Attenberger , Frank G. Zöllner , Jürgen Hesser

Convolutional neural networks (CNNs) have demonstrated remarkable results in image classification for benchmark tasks and practical applications. The CNNs with deeper architectures have achieved even higher performance recently thanks to…

Computer Vision and Pattern Recognition · Computer Science 2019-04-15 Ryo Takahashi , Takashi Matsubara , Kuniaki Uehara

Convolutional Neural Networks (CNN) offer state of the art performance in various computer vision tasks. Many of those tasks require different subtypes of affine invariances (scale, rotational, translational) to image transformations.…

Computer Vision and Pattern Recognition · Computer Science 2023-10-13 Facundo Manuel Quiroga , Franco Ronchetti , Laura Lanzarini , Aurelio Fernandez-Bariviera

Although group convolution operators are increasingly used in deep convolutional neural networks to improve the computational efficiency and to reduce the number of parameters, most existing methods construct their group convolution…

Machine Learning · Computer Science 2020-09-30 Qingbei Guo , Xiao-Jun Wu , Josef Kittler , Zhiquan Feng

In this paper, we introduce group convolutional neural networks (GCNNs) equivariant to color variation. GCNNs have been designed for a variety of geometric transformations from 2D and 3D rotation groups, to semi-groups such as scale.…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Yulong Yang , Felix O'Mahony , Christine Allen-Blanchette

Convolutional Neural Networks (CNNs) traditionally encode translation equivariance via the convolution operation. Generalization to other transformations has recently received attraction to encode the knowledge of the data geometry in group…

Computer Vision and Pattern Recognition · Computer Science 2018-10-17 Vincent Andrearczyk , Adrien Depeursinge

This paper proposes a generic method to learn interpretable convolutional filters in a deep convolutional neural network (CNN) for object classification, where each interpretable filter encodes features of a specific object part. Our method…

Machine Learning · Computer Science 2020-03-13 Quanshi Zhang , Xin Wang , Ying Nian Wu , Huilin Zhou , Song-Chun Zhu

In convolutional neural networks (CNNs), the filter grouping in convolution layers is known to be useful to reduce the network parameter size. In this paper, we propose a new logarithmic filter grouping which can capture the nonlinearity of…

Computer Vision and Pattern Recognition · Computer Science 2017-09-15 Tae Kwan Lee , Wissam J. Baddar , Seong Tae Kim , Yong Man Ro

This work proposes an unsupervised fusion framework based on deep convolutional transform learning. The great learning ability of convolutional filters for data analysis is well acknowledged. The success of convolutive features owes to…

Machine Learning · Computer Science 2020-11-10 Pooja Gupta , Jyoti Maggu , Angshul Majumdar , Emilie Chouzenoux , Giovanni Chierchia