English
Related papers

Related papers: Convolution with Logarithmic Filter Groups for Eff…

200 papers

Convolutional neural networks (CNNs) are commonplace in high-performing solutions to many real-world problems, such as audio classification. CNNs have many parameters and filters, with some having a larger impact on the performance than…

Sound · Computer Science 2023-05-08 James A King , Arshdeep Singh , Mark D. Plumbley

Convolutional Neural Networks (CNNs) have exhibited great performance in discriminative feature learning for complex visual tasks. Besides discrimination power, interpretability is another important yet under-explored property for CNNs. One…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Wengang Guo , Jiayi Yang , Huilin Yin , Qijun Chen , Wei Ye

The success of convolution neural networks (CNN) has been revolutionising the way we approach and use intelligent machines in the Big Data era. Despite success, CNNs have been consistently put under scrutiny owing to their…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Shengxi Li , Xinyi Zhao , Ljubisa Stankovic , Danilo Mandic

The performance of neural networks has been significantly improved by increasing the number of channels in convolutional layers. However, this increase in performance comes with a higher computational cost, resulting in numerous studies…

Machine Learning · Computer Science 2025-09-01 Youngkyu Lee , Jongho Park , Chang-Ock Lee

Many convolutional neural networks (CNNs) rely on progressive downsampling of their feature maps to increase the network's receptive field and decrease computational cost. However, this comes at the price of losing granularity in the…

Computer Vision and Pattern Recognition · Computer Science 2023-05-17 Robin Hesse , Simone Schaub-Meyer , Stefan Roth

While Convolutional Neural Networks (CNNs) excel at learning complex latent-space representations, their over-parameterization can lead to overfitting and reduced performance, particularly with limited data. This, alongside their high…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Manish Sharma , Jamison Heard , Eli Saber , Panos P. Markopoulos

Convolutional layers in CNNs implement linear filters which decompose the input into different frequency bands. However, most modern architectures neglect standard principles of filter design when optimizing their model choices regarding…

Computer Vision and Pattern Recognition · Computer Science 2021-07-30 Nergis Tomen , Jan van Gemert

Building compact convolutional neural networks (CNNs) with reliable performance is a critical but challenging task, especially when deploying them in real-world applications. As a common approach to reduce the size of CNNs, pruning methods…

Machine Learning · Computer Science 2020-05-26 Hang Li , Chen Ma , Wei Xu , Xue Liu

Although Convolutional Neural Networks (CNNs) achieve effectiveness in various computer vision tasks, the significant requirement of storage of such networks hinders the deployment on computationally limited devices. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2019-02-28 Jinpeng Xia , Jiasong Wu , Youyong Kong , Pinzheng Zhang , Lotfi Senhadji , Huazhong Shu

Retinal vessel information is helpful in retinal disease screening and diagnosis. Retinal vessel segmentation provides useful information about vessels and can be used by physicians during intraocular surgery and retinal diagnostic…

Computer Vision and Pattern Recognition · Computer Science 2018-02-23 M. Hajabdollahi , R. Esfandiarpoor , S. M. R. Soroushmehr , N. Karimi , S. Samavi , K. Najarian

Although Deep Convolutional Neural Networks (CNNs) have liberated their power in various computer vision tasks, the most important components of CNN, convolutional layers and fully connected layers, are still limited to linear…

Computer Vision and Pattern Recognition · Computer Science 2017-09-05 Yanghao Li , Naiyan Wang , Jiaying Liu , Xiaodi Hou

Convolutional neural networks (CNNs) have rapidly risen in popularity for many machine learning applications, particularly in the field of image recognition. Much of the benefit generated from these networks comes from their ability to…

Quantum Physics · Physics 2019-04-10 Maxwell Henderson , Samriddhi Shakya , Shashindra Pradhan , Tristan Cook

It is well known that Convolutional Neural Networks (CNNs) have significant redundancy in their filter weights. Various methods have been proposed in the literature to compress trained CNNs. These include techniques like pruning weights,…

Machine Learning · Computer Science 2019-06-12 Muhammad Tayyab , Abhijit Mahalanobis

This paper proposes a Sub-band Convolutional Neural Network for spoken term classification. Convolutional neural networks (CNNs) have proven to be very effective in acoustic applications such as spoken term classification, keyword spotting,…

Audio and Speech Processing · Electrical Eng. & Systems 2019-07-03 Chieh-Chi Kao , Ming Sun , Yixin Gao , Shiv Vitaladevuni , Chao Wang

We propose methods to train convolutional neural networks (CNNs) with both binarized weights and activations, leading to quantized models that are specifically friendly to mobile devices with limited power capacity and computation…

Computer Vision and Pattern Recognition · Computer Science 2022-06-07 Bohan Zhuang , Chunhua Shen , Mingkui Tan , Peng Chen , Lingqiao Liu , Ian Reid

As the basic building block of Convolutional Neural Networks (CNNs), the convolutional layer is designed to extract local patterns and lacks the ability to model global context in its nature. Many efforts have been recently devoted to…

Computer Vision and Pattern Recognition · Computer Science 2020-07-20 Xudong Lin , Lin Ma , Wei Liu , Shih-Fu Chang

Over the last few years, we have witnessed the availability of an increasing data generated from non-Euclidean domains, which are usually represented as graphs with complex relationships, and Graph Neural Networks (GNN) have gained a high…

Machine Learning · Computer Science 2023-08-15 Andrea Apicella , Francesco Isgrò , Andrea Pollastro , Roberto Prevete

Convolutional neural networks (CNNs) allow for parameter sharing and translational equivariance by using convolutional kernels in their linear layers. By restricting these kernels to be SO(3)-steerable, CNNs can further improve parameter…

Image and Video Processing · Electrical Eng. & Systems 2024-05-20 Ivan Diaz , Mario Geiger , Richard Iain McKinley

In a recent work on direction-of-arrival (DOA) estimation of multiple speakers with convolutional neural networks (CNNs), the phase component of short-time Fourier transform (STFT) coefficients of the microphone signal is given as input and…

Audio and Speech Processing · Electrical Eng. & Systems 2019-12-18 Soumitro Chakrabarty , Emanuël A. P. Habets

This work introduces the Topological CNN (TCNN), which encompasses several topologically defined convolutional methods. Manifolds with important relationships to the natural image space are used to parameterize image filters which are used…

Machine Learning · Computer Science 2021-03-05 Ephy R. Love , Benjamin Filippenko , Vasileios Maroulas , Gunnar Carlsson