English
Related papers

Related papers: Block Walsh-Hadamard Transform Based Binary Layers…

200 papers

Convolutional neural networks (CNNs) are currently state-of-the-art for various classification tasks, but are computationally expensive. Propagating through the convolutional layers is very slow, as each kernel in each layer must…

Neural and Evolutionary Computing · Computer Science 2016-01-27 Tyler Highlander , Andres Rodriguez

The edge processing of deep neural networks (DNNs) is becoming increasingly important due to its ability to extract valuable information directly at the data source to minimize latency and energy consumption. Frequency-domain model…

Hardware Architecture · Computer Science 2023-09-06 Nastaran Darabi , Maeesha Binte Hashem , Hongyi Pan , Ahmet Cetin , Wilfred Gomes , Amit Ranjan Trivedi

In the proposed SEHybridSN model, a dense block was used to reuse shallow feature and aimed at better exploiting hierarchical spatial spectral feature. Subsequent depth separable convolutional layers were used to discriminate the spatial…

Computer Vision and Pattern Recognition · Computer Science 2021-11-22 Jiaxin Cao , Xiaoyan Li

In this paper, we propose a novel Discrete Cosine Transform (DCT)-based neural network layer which we call DCT-perceptron to replace the $3\times3$ Conv2D layers in the Residual neural Network (ResNet). Convolutional filtering operations…

Computer Vision and Pattern Recognition · Computer Science 2022-11-17 Hongyi Pan , Xin Zhu , Salih Atici , Ahmet Enis Cetin

We propose a novel formulation of deep networks that do not use dot-product neurons and rely on a hierarchy of voting tables instead, denoted as Convolutional Tables (CT), to enable accelerated CPU-based inference. Convolutional layers are…

Computer Vision and Pattern Recognition · Computer Science 2023-04-25 Shay Dekel , Yosi Keller , Aharon Bar-Hillel

Dense pixelwise prediction such as semantic segmentation is an up-to-date challenge for deep convolutional neural networks (CNNs). Many state-of-the-art approaches either tackle the loss of high-resolution information due to pooling in the…

Computer Vision and Pattern Recognition · Computer Science 2018-08-07 Lingni Ma , Jörg Stückler , Tao Wu , Daniel Cremers

The Deep Convolutional Neural Networks (CNNs) have obtained a great success for pattern recognition, such as recognizing the texts in images. But existing CNNs based frameworks still have several drawbacks: 1) the traditaional pooling…

Computer Vision and Pattern Recognition · Computer Science 2020-01-20 Zhao Zhang , Zemin Tang , Zheng Zhang , Yang Wang , Jie Qin , Meng Wang

Deep convolutional neural networks have achieved remarkable progress in recent years. However, the large volume of intermediate results generated during inference poses a significant challenge to the accelerator design for…

Hardware Architecture · Computer Science 2021-05-20 Gang Li , Zejian Liu , Fanrong Li , Jian Cheng

Binary Neural Networks (BNNs) use 1-bit weights and activations to efficiently execute deep convolutional neural networks on edge devices. Nevertheless, the binarization of the first layer is conventionally excluded, as it leads to a large…

Machine Learning · Computer Science 2023-05-05 Lorenzo Vorabbi , Davide Maltoni , Stefano Santi

The GHM multi-level discrete wavelet transform is proposed as preprocessing for image super resolution with convolutional neural networks. Previous works perform analysis with the Haar wavelet only. In this work, 37 single-level wavelets…

Image and Video Processing · Electrical Eng. & Systems 2022-04-19 Ben Lowe , Hadi Salman , Justin Zhan

The feature learning methods based on convolutional neural network (CNN) have successfully produced tremendous achievements in image classification tasks. However, the inherent noise and some other factors may weaken the effectiveness of…

Computer Vision and Pattern Recognition · Computer Science 2022-01-25 Zhao Xiangyu

We introduce a novel weighted convolution operator that enhances traditional convolutional neural networks (CNNs) by integrating a spatial density function into the convolution operator. This extension enables the network to differentially…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Simone Cammarasana , Giuseppe Patanè

Convolutional neural networks are state-of-the-art for various segmentation tasks. While for 2D images these networks are also computationally efficient, 3D convolutions have huge storage requirements and therefore, end-to-end training is…

Computer Vision and Pattern Recognition · Computer Science 2022-02-01 Christoph Angermann , Markus Haltmeier

Low-light image enhancement is a classical computer vision problem aiming to recover normal-exposure images from low-light images. However, convolutional neural networks commonly used in this field are good at sampling low-frequency local…

Computer Vision and Pattern Recognition · Computer Science 2022-09-19 Yunliang Zhuang , Zhuoran Zheng , Chen Lyu

In recent years, algorithm unrolling has emerged as a powerful technique for designing interpretable neural networks based on iterative algorithms. Imaging inverse problems have particularly benefited from unrolling-based deep network…

Image and Video Processing · Electrical Eng. & Systems 2024-02-27 Yanan Zhao , Yuelong Li , Haichuan Zhang , Vishal Monga , Yonina C. Eldar

This article presents a convolutional neural network for the automatic segmentation of brain tumors in multimodal 3D MR images based on a U-net architecture.We evaluate the use of a densely connected convolutional network encoder (DenseNet)…

Computer Vision and Pattern Recognition · Computer Science 2018-11-20 Jean Stawiaski

We propose a novel algorithm for computing the Walsh-Hadamard Transform (WHT) which consists entirely of Haar wavelet transforms. We prove that the algorithm, which we call the Cascading Haar Wavelet (CHW) algorithm, shares precisely the…

Data Structures and Algorithms · Computer Science 2017-06-28 Andrew Thompson

We introduce DRHDR, a Dual branch Residual Convolutional Neural Network for Multi-Bracket HDR Imaging. To address the challenges of fusing multiple brackets from dynamic scenes, we propose an efficient dual branch network that operates on…

Computer Vision and Pattern Recognition · Computer Science 2022-06-10 Juan Marín-Vega , Michael Sloth , Peter Schneider-Kamp , Richard Röttger

Unsupervised image registration commonly adopts U-Net style networks to predict dense displacement fields in the full-resolution spatial domain. For high-resolution volumetric image data, this process is however resource-intensive and…

Computer Vision and Pattern Recognition · Computer Science 2023-07-07 Xi Jia , Joseph Bartlett , Wei Chen , Siyang Song , Tianyang Zhang , Xinxing Cheng , Wenqi Lu , Zhaowen Qiu , Jinming Duan

This paper focuses on Winograd transformation in 3D convolutional neural networks (CNNs) that are more over-parameterized compared with the 2D version. The over-increasing Winograd parameters not only exacerbate training complexity but also…

Computer Vision and Pattern Recognition · Computer Science 2023-01-27 Ziran Qin , Mingbao Lin , Weiyao Lin