English
Related papers

Related papers: Channel Equilibrium Networks for Learning Deep Rep…

200 papers

We propose a convolutional neural network (CNN) architecture for image classification based on subband decomposition of the image using wavelets. The proposed architecture decomposes the input image spectra into multiple critically sampled…

Computer Vision and Pattern Recognition · Computer Science 2021-03-03 Pavel Sinha , Ioannis Psaromiligkos , Zeljko Zilic

Reliable communication over bandlimited and non-linear channels usually requires equalization to simplify receiver processing. Equalizers that perform joint detection and decoding (JDD) achieve the highest information rates but are often…

Information Theory · Computer Science 2024-08-28 Daniel Plabst , Tobias Prinz , Francesca Diedolo , Thomas Wiegart , Georg Böcherer , Norbert Hanik , Gerhard Kramer

The layers of convolutional neural networks (CNNs) can be used to alter the resolution of their inputs, but the scaling factors are limited to integer values. However, in many image and video processing applications, the ability to resize…

Image and Video Processing · Electrical Eng. & Systems 2021-05-24 Li-Heng Chen , Christos G. Bampis , Zhi Li , Chao Chen , Alan C. Bovik

Recent work suggests that changing Convolutional Neural Network (CNN) architecture by introducing a bottleneck in the second layer can yield changes in learned function. To understand this relationship fully requires a way of quantitatively…

Computer Vision and Pattern Recognition · Computer Science 2020-10-07 Ethan Harris , Daniela Mihai , Jonathon Hare

Existing convolutional neural network architectures frequently rely upon batch normalization (BatchNorm) to effectively train the model. BatchNorm, however, performs poorly with small batch sizes, and is inapplicable to differential…

Machine Learning · Computer Science 2024-03-06 Reza Nasirigerdeh , Reihaneh Torkzadehmahani , Daniel Rueckert , Georgios Kaissis

Neural networks have been widely used, and most networks achieve excellent performance by stacking certain types of basic units. Compared to increasing the depth and width of the network, designing more effective basic units has become an…

Machine Learning · Computer Science 2020-06-05 Junyi An , Fengshan Liu , Jian Zhao , Furao Shen

In the present work, 3D convolutional neural networks (CNNs) are trained to link random heterogeneous, two-phase materials of arbitrary phase fractions to their elastic macroscale stiffness thus replacing explicit homogenization…

Materials Science · Physics 2021-09-08 Bernhard Eidel

Convolutional neural networks (CNNs), one of the key architectures of deep learning models, have achieved superior performance on many machine learning tasks such as image classification, video recognition, and power systems. Despite their…

Machine Learning · Computer Science 2024-07-17 Hanxiao Lu , Zeyu Huang , Ren Wang

Convolutional Neural Networks (CNNs) are the state of the art solution for many computer vision problems, and many researchers have explored optimized implementations. Most implementations heuristically block the computation to deal with…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-06-15 Xuan Yang , Jing Pu , Blaine Burton Rister , Nikhil Bhagdikar , Stephen Richardson , Shahar Kvatinsky , Jonathan Ragan-Kelley , Ardavan Pedram , Mark Horowitz

Deep convolutional neural networks (CNN) have recently been shown in many computer vision and pattern recog- nition applications to outperform by a significant margin state- of-the-art solutions that use traditional hand-crafted features.…

Robotics · Computer Science 2015-04-22 Yi Hou , Hong Zhang , Shilin Zhou

State-of-the-art deep learning systems often require large amounts of data and computation. For this reason, leveraging known or unknown structure of the data is paramount. Convolutional neural networks (CNNs) are successful examples of…

Computer Vision and Pattern Recognition · Computer Science 2020-12-07 Carlos Esteves

Convolutional Neural Networks (CNNs) do not have a predictable recognition behavior with respect to the input resolution change. This prevents the feasibility of deployment on different input image resolutions for a specific model. To…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Duo Li , Anbang Yao , Qifeng Chen

Generalization is essential for deep learning. In contrast to previous works claiming that Deep Neural Networks (DNNs) have an implicit regularization implemented by the stochastic gradient descent, we demonstrate explicitly Bayesian…

Machine Learning · Computer Science 2019-10-23 Xinjie Lan , Kenneth E. Barner

Large capacity deep learning models are often prone to a high generalization gap when trained with a limited amount of labeled training data. A recent class of methods to address this problem uses various ways to construct a new training…

Machine Learning · Computer Science 2023-01-10 Mojtaba Faramarzi , Mohammad Amini , Akilesh Badrinaaraayanan , Vikas Verma , Sarath Chandar

Convolutional neural networks (CNNs) are very popular nowadays for image processing. CNNs allow one to learn optimal filters in a (mostly) supervised machine learning context. However this typically requires abundant labelled training data…

Computer Vision and Pattern Recognition · Computer Science 2019-07-04 Matej Ulicny , Vladimir A. Krylov , Rozenn Dahyot

We propose a generalized convolutional neural network (CNN) architecture that first decomposes the input signal into subbands by an adaptive filter bank structure, and then uses convolutional layers to extract features from each subband…

Image and Video Processing · Electrical Eng. & Systems 2023-06-30 Pavel Sinha , Ioannis Psaromiligkos , Zeljko Zilic

Recurrent neural networks (RNNs) trained using Equilibrium Propagation (EP), a biologically plausible training algorithm, have demonstrated strong performance in various tasks such as image classification and reinforcement learning.…

Machine Learning · Computer Science 2025-08-21 Yoshimasa Kubo , Jean Erik Delanois , Maxim Bazhenov

Neural networks (NNs) inspired by the forward-backward algorithm (FBA) are used as equalizers for bandlimited channels with a memoryless nonlinearity. The NN-equalizers are combined with successive interference cancellation (SIC) to…

Information Theory · Computer Science 2024-08-29 Daniel Plabst , Tobias Prinz , Francesca Diedolo , Thomas Wiegart , Georg Böcherer , Norbert Hanik , Gerhard Kramer

Currently, increasingly deeper neural networks have been applied to improve their accuracy. In contrast, We propose a novel wider Convolutional Neural Networks (CNN) architecture, motivated by the Multi-column Deep Neural Networks and the…

Computer Vision and Pattern Recognition · Computer Science 2018-10-10 Xiaobo Huang

In this era of artificial intelligence, deep neural networks like Convolutional Neural Networks (CNNs) have emerged as front-runners, often surpassing human capabilities. These deep networks are often perceived as the panacea for all…

Computer Vision and Pattern Recognition · Computer Science 2023-11-15 Neeraj Kumar Singh , Nikhil R. Pal