English
Related papers

Related papers: Wavelet Feature Maps Compression for Image-to-Imag…

200 papers

Convolutional Neural Networks (CNNs) usually use the same activation function, such as RELU, for all convolutional layers. There are performance limitations of just using RELU. In order to achieve better classification performance, reduce…

Computer Vision and Pattern Recognition · Computer Science 2018-11-30 Luna M. Zhang

In recent years, there have been attempts to increase the kernel size of Convolutional Neural Nets (CNNs) to mimic the global receptive field of Vision Transformers' (ViTs) self-attention blocks. That approach, however, quickly hit an upper…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Shahaf E. Finder , Roy Amoyal , Eran Treister , Oren Freifeld

In deep networks, the lost data details significantly degrade the performances of image segmentation. In this paper, we propose to apply Discrete Wavelet Transform (DWT) to extract the data details during feature map down-sampling, and…

Computer Vision and Pattern Recognition · Computer Science 2020-06-01 Qiufu Li , Linlin Shen

The current trend of pushing CNNs deeper with convolutions has created a pressing demand to achieve higher compression gains on CNNs where convolutions dominate the computation and parameter amount (e.g., GoogLeNet, ResNet and Wide ResNet).…

Machine Learning · Computer Science 2018-06-26 Junru Wu , Yue Wang , Zhenyu Wu , Zhangyang Wang , Ashok Veeraraghavan , Yingyan Lin

A novel energy-efficient edge computing paradigm is proposed for real-time deep learning-based image upsampling applications. State-of-the-art deep learning solutions for image upsampling are currently trained using either resize or…

Computer Vision and Pattern Recognition · Computer Science 2021-07-27 Ian Colbert , Ken Kreutz-Delgado , Srinjoy Das

Deep neural networks (DNNs) can be made hardware-efficient by reducing the numerical precision of the weights and activations of the network and by improving the network's resilience to noise. However, this gain in efficiency often comes at…

Convolutional Neural Networks have dramatically improved in recent years, surpassing human accuracy on certain problems and performance exceeding that of traditional computer vision algorithms. While the compute pattern in itself is…

Computer Vision and Pattern Recognition · Computer Science 2018-07-10 Michaela Blott , Thomas B. Preusser , Nicholas Fraser , Giulio Gambardella , Kenneth OBrien , Yaman Umuroglu , Miriam Leeser

We present an approach to learn a dense pixel-wise labeling from image-level tags. Each image-level tag imposes constraints on the output labeling of a Convolutional Neural Network (CNN) classifier. We propose Constrained CNN (CCNN), a…

Computer Vision and Pattern Recognition · Computer Science 2015-10-20 Deepak Pathak , Philipp Krähenbühl , Trevor Darrell

Deep convolutional neural networks (CNNs) are used for image denoising via automatically mining accurate structure information. However, most of existing CNNs depend on enlarging depth of designed networks to obtain better denoising…

Image and Video Processing · Electrical Eng. & Systems 2022-10-04 Chunwei Tian , Menghua Zheng , Wangmeng Zuo , Bob Zhang , Yanning Zhang , David Zhang

In order to enhance the real-time performance of convolutional neural networks(CNNs), more and more researchers are focusing on improving the efficiency of CNN. Based on the analysis of some CNN architectures, such as ResNet, DenseNet,…

Computer Vision and Pattern Recognition · Computer Science 2018-03-16 Qiuyu Zhu , Ruixin Zhang

Recent years have witnessed the success of deep networks in compressed sensing (CS), which allows for a significant reduction in sampling cost and has gained growing attention since its inception. In this paper, we propose a new practical…

Computer Vision and Pattern Recognition · Computer Science 2024-11-21 Bin Chen , Jian Zhang

We present a novel method of compression of deep Convolutional Neural Networks (CNNs) by weight sharing through a new representation of convolutional filters. The proposed method reduces the number of parameters of each convolutional layer…

Machine Learning · Computer Science 2020-04-13 Yingzhen Yang , Jiahui Yu , Nebojsa Jojic , Jun Huan , Thomas S. Huang

Neural image compression methods have seen increasingly strong performance in recent years. However, they suffer orders of magnitude higher computational complexity compared to traditional codecs, which hinders their real-world deployment.…

Image and Video Processing · Electrical Eng. & Systems 2023-11-13 Yibo Yang , Stephan Mandt

Despite the effectiveness of Convolutional Neural Networks (CNNs) for image classification, our understanding of the relationship between shape of convolution kernels and learned representations is limited. In this work, we explore and…

Computer Vision and Pattern Recognition · Computer Science 2016-11-30 Zhun Sun , Mete Ozay , Takayuki Okatani

Convolutional neural networks are modern models that are very efficient in many classification tasks. They were originally created for image processing purposes. Then some trials were performed to use them in different domains like natural…

Computation and Language · Computer Science 2018-05-29 Krzysztof Wróbel , Marcin Pietroń , Maciej Wielgosz , Michał Karwatowski , Kazimierz Wiatr

In this paper, we present a novel transformer-based architecture for end-to-end image compression. Our architecture incorporates blocks that effectively capture local dependencies between tokens, eliminating the need for positional encoding…

Image and Video Processing · Electrical Eng. & Systems 2024-09-09 Bouzid Arezki , Fangchen Feng , Anissa Mokraoui

As edge applications using convolutional neural networks (CNN) models grow, it is becoming necessary to introduce dedicated hardware accelerators in which network parameters and feature-map data are represented with limited precision. In…

Neural and Evolutionary Computing · Computer Science 2018-11-01 Doyun Kim , Han Young Yim , Sanghyuck Ha , Changgwun Lee , Inyup Kang

Convolutional Neural Networks (CNNs) have achieved state-of-the-art performance in many different 2D medical image analysis tasks. In clinical practice, however, a large part of the medical imaging data available is in 3D. This has…

Computer Vision and Pattern Recognition · Computer Science 2018-12-27 Guodong Zeng , Guoyan Zheng

Image denoising is of vital importance in many imaging or computer vision related areas. With the convolutional neural networks showing strong capability in computer vision tasks, the performance of image denoising has also been brought up…

Computer Vision and Pattern Recognition · Computer Science 2021-12-23 Zhuang Jia

Learned image compression research has achieved state-of-the-art compression performance with auto-encoder based neural network architectures, where the image is mapped via convolutional neural networks (CNN) into a latent representation…

Image and Video Processing · Electrical Eng. & Systems 2022-03-23 Fatih Kamisli