English
Related papers

Related papers: PBGen: Partial Binarization of Deconvolution-Based…

200 papers

When trained as generative models, Deep Learning algorithms have shown exceptional performance on tasks involving high dimensional data such as image denoising and super-resolution. In an increasingly connected world dominated by mobile and…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-03-10 Ian Colbert , Jake Daly , Ken Kreutz-Delgado , Srinjoy Das

Deep convolutional neural networks (DCNN for short) are vulnerable to examples with small perturbations. Improving DCNN's robustness is of great significance to the safety-critical applications, such as autonomous driving and industry…

Computer Vision and Pattern Recognition · Computer Science 2024-07-25 Jin Ding , Jie-Chao Zhao , Yong-Zhi Sun , Ping Tan , Jia-Wei Wang , Ji-En Ma , You-Tong Fang

In this work, we propose extreme compression techniques like binarization, ternarization for Neural Decoders such as TurboAE. These methods reduce memory and computation by a factor of 64 with a performance better than the quantized (with…

Information Theory · Computer Science 2021-06-21 Devannagari Vikas , Nancy Nayak , Sheetal Kalyani

Lack of ground-truth MR images impedes the common supervised training of neural networks for image reconstruction. To cope with this challenge, this paper leverages unpaired adversarial training for reconstruction networks, where the inputs…

Image and Video Processing · Electrical Eng. & Systems 2021-05-14 Ke Lei , Morteza Mardani , John M. Pauly , Shreyas S. Vasanawala

A deep generative model is developed for representation and analysis of images, based on a hierarchical convolutional dictionary-learning framework. Stochastic {\em unpooling} is employed to link consecutive layers in the model, yielding…

Computer Vision and Pattern Recognition · Computer Science 2015-12-25 Yunchen Pu , Xin Yuan , Andrew Stevens , Chunyuan Li , Lawrence Carin

We describe a new training methodology for generative adversarial networks. The key idea is to grow both the generator and discriminator progressively: starting from a low resolution, we add new layers that model increasingly fine details…

Neural and Evolutionary Computing · Computer Science 2018-02-28 Tero Karras , Timo Aila , Samuli Laine , Jaakko Lehtinen

To evaluate their performance, existing dehazing approaches generally rely on distance measures between the generated image and its corresponding ground truth. Despite its ability to produce visually good images, using pixel-based or even…

Computer Vision and Pattern Recognition · Computer Science 2020-02-10 Sébastien de Blois , Ihsen Hedhli , Christian Gagné

Generative adversarial networks (GANs) have shown excellent performance in image and speech applications. GANs create impressive data primarily through a new type of operator called deconvolution (DeConv) or transposed convolution (Conv).…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-11-19 Jung-Woo Chang , Saehyun Ahn , Keon-Woo Kang , Suk-Ju Kang

Binary Neural Network (BNN) represents convolution weights with 1-bit values, which enhances the efficiency of storage and computation. This paper is motivated by a previously revealed phenomenon that the binary kernels in successful BNNs…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Yikai Wang , Wenbing Huang , Yinpeng Dong , Fuchun Sun , Anbang Yao

StyleGANs have shown impressive results on data generation and manipulation in recent years, thanks to its disentangled style latent space. A lot of efforts have been made in inverting a pretrained generator, where an encoder is trained ad…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Ligong Han , Sri Harsha Musunuri , Martin Renqiang Min , Ruijiang Gao , Yu Tian , Dimitris Metaxas

The intensive computation and memory requirements of generative adversarial neural networks (GANs) hinder its real-world deployment on edge devices such as smartphones. Despite the success in model reduction of CNNs, neural network…

Neural and Evolutionary Computing · Computer Science 2019-01-25 Peiqi Wang , Dongsheng Wang , Yu Ji , Xinfeng Xie , Haoxuan Song , XuXin Liu , Yongqiang Lyu , Yuan Xie

Unpaired image-to-image translation using Generative Adversarial Networks (GAN) is successful in converting images among multiple domains. Moreover, recent studies have shown a way to diversify the outputs of the generator. However, since…

Computer Vision and Pattern Recognition · Computer Science 2021-07-15 Sho Inoue , Tad Gonsalves

This paper addresses two crucial problems of learning disentangled image representations, namely controlling the degree of disentanglement during image editing, and balancing the disentanglement strength and the reconstruction quality. To…

Machine Learning · Computer Science 2020-06-23 Zengjie Song , Oluwasanmi Koyejo , Jiangshe Zhang

In response to the development of recent efficient dense layers, this paper shows that something as simple as replacing linear components in pointwise convolutions with structured linear decompositions also produces substantial gains in the…

Machine Learning · Statistics 2019-06-04 Gavin Gray , Elliot J. Crowley , Amos Storkey

It has been shown recently that deep convolutional generative adversarial networks (GANs) can learn to generate music in the form of piano-rolls, which represent music by binary-valued time-pitch matrices. However, existing models can only…

Machine Learning · Computer Science 2018-10-09 Hao-Wen Dong , Yi-Hsuan Yang

We present a learned image compression system based on GANs, operating at extremely low bitrates. Our proposed framework combines an encoder, decoder/generator and a multi-scale discriminator, which we train jointly for a generative learned…

Computer Vision and Pattern Recognition · Computer Science 2019-08-20 Eirikur Agustsson , Michael Tschannen , Fabian Mentzer , Radu Timofte , Luc Van Gool

Recent methods for conditional image generation benefit from dense supervision such as segmentation label maps to achieve high-fidelity. However, it is rarely explored to employ dense supervision for unconditional image generation. Here we…

Computer Vision and Pattern Recognition · Computer Science 2022-07-28 Gayoung Lee , Hyunsu Kim , Junho Kim , Seonghyeon Kim , Jung-Woo Ha , Yunjey Choi

Network binarization emerges as one of the most promising compression approaches offering extraordinary computation and memory savings by minimizing the bit-width. However, recent research has shown that applying existing binarization…

Computer Vision and Pattern Recognition · Computer Science 2023-05-23 Haotong Qin , Mingyuan Zhang , Yifu Ding , Aoyu Li , Zhongang Cai , Ziwei Liu , Fisher Yu , Xianglong Liu

Binarization is an attractive strategy for implementing lightweight Deep Convolutional Neural Networks (CNNs). Despite the unquestionable savings offered, memory footprint above all, it may induce an excessive accuracy loss that prevents a…

Machine Learning · Computer Science 2019-12-30 Luca Mocerino , Andrea Calimera

The outcome of text recognition for degraded color documents is often unsatisfactory due to interference from various contaminants. To extract information more efficiently for text recognition, document image enhancement and binarization…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Rui-Yang Ju , KokSheik Wong , Jen-Shiun Chiang