English
Related papers

Related papers: Evaluating Post-Training Compression in GANs using…

200 papers

Generative adversarial networks (GANs) have promoted remarkable advances in single-image super-resolution (SR) by recovering photo-realistic images. However, high memory consumption of GAN-based SR (usually generators) causes performance…

Hardware Architecture · Computer Science 2021-07-28 Wenlong Cheng , Mingbo Zhao , Zhiling Ye , Shuhang Gu

Pre-trained convolutional neural networks (CNNs) are powerful off-the-shelf feature generators and have been shown to perform very well on a variety of tasks. Unfortunately, the generated features are high dimensional and expensive to…

Computer Vision and Pattern Recognition · Computer Science 2020-07-24 Saurabh Singh , Sami Abu-El-Haija , Nick Johnston , Johannes Ballé , Abhinav Shrivastava , George Toderici

Generative adversarial networks (GANs) have achieved remarkable progress in the natural image field. However, when applying GANs in the remote sensing (RS) image generation task, an extraordinary phenomenon is observed: the GAN model is…

Computer Vision and Pattern Recognition · Computer Science 2024-05-15 Xingzhe Su , Wenwen Qiang , Jie Hu , Fengge Wu , Changwen Zheng , Fuchun Sun

Deep learning has revolutionized various fields, yet its efficacy is hindered by overfitting and the requirement of extensive annotated data, particularly in few-shot learning scenarios where limited samples are available. This paper…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Jiacheng Hu , Zhen Qi , Jianjun Wei , Jiajing Chen , Runyuan Bao , Xinyu Qiu

Compressing neural network architectures is important to allow the deployment of models to embedded or mobile devices, and pruning and quantization are the major approaches to compress neural networks nowadays. Both methods benefit when…

Machine Learning · Computer Science 2022-12-16 Torben Krieger , Bernhard Klein , Holger Fröning

Kernel methods have produced state-of-the-art results for a number of NLP tasks such as relation extraction, but suffer from poor scalability due to the high cost of computing kernel similarities between natural language structures. A…

Computation and Language · Computer Science 2019-05-22 Sahil Garg , Aram Galstyan , Greg Ver Steeg , Irina Rish , Guillermo Cecchi , Shuyang Gao

We propose two new techniques for training Generative Adversarial Networks (GANs). Our objectives are to alleviate mode collapse in GAN and improve the quality of the generated samples. First, we propose neighbor embedding, a manifold…

Computer Vision and Pattern Recognition · Computer Science 2018-11-06 Ngoc-Trung Tran , Tuan-Anh Bui , Ngai-Man Cheung

Image compression is a fundamental research field and many well-known compression standards have been developed for many decades. Recently, learned compression methods exhibit a fast development trend with promising results. However, there…

Image and Video Processing · Electrical Eng. & Systems 2020-03-31 Zhengxue Cheng , Heming Sun , Masaru Takeuchi , Jiro Katto

Recent studies have shown that modern deep neural network classifiers are easy to fool, assuming that an adversary is able to slightly modify their inputs. Many papers have proposed adversarial attacks, defenses and methods to measure…

Machine Learning · Computer Science 2020-03-17 Igor Buzhinsky , Arseny Nerinovsky , Stavros Tripakis

Compressing neural networks is a key step when deploying models for real-time or embedded applications. Factorizing the model's matrices using low-rank approximations is a promising method for achieving compression. While it is possible to…

Machine Learning · Computer Science 2023-10-20 Lucas Maison , Hélion du Mas des Bourboux , Thomas Courtat

Deep hashing methods have been proved to be effective and efficient for large-scale Web media search. The success of these data-driven methods largely depends on collecting sufficient labeled data, which is usually a crucial limitation in…

Computer Vision and Pattern Recognition · Computer Science 2019-11-21 Sheng Jin , Shangchen Zhou , Yao Liu , Chao Chen , Xiaoshuai Sun , Hongxun Yao , Xiansheng Hua

The success of deep learning in numerous application domains created the de- sire to run and train them on mobile devices. This however, conflicts with their computationally, memory and energy intense nature, leading to a growing interest…

Machine Learning · Statistics 2017-05-10 Karen Ullrich , Edward Meeds , Max Welling

Recent breakthroughs in computer vision make use of large deep neural networks, utilizing the substantial speedup offered by GPUs. For applications running on limited hardware, however, high precision real-time processing can still be a…

Machine Learning · Computer Science 2018-02-05 Oran Shayer , Dan Levi , Ethan Fetaya

Generative adversarial networks (GAN) have shown remarkable results in image generation tasks. High fidelity class-conditional GAN methods often rely on stabilization techniques by constraining the global Lipschitz continuity. Such…

Machine Learning · Computer Science 2020-08-11 Jiachen Zhong , Xuanqing Liu , Cho-Jui Hsieh

Generative Adversarial Networks (GANs), as a framework for estimating generative models via an adversarial process, have attracted huge attention and have proven to be powerful in a variety of tasks. However, training GANs is well known for…

Machine Learning · Computer Science 2017-11-09 Zi-Yi Dou

In this paper, we investigate the impact of compression on stochastic gradient algorithms for machine learning, a technique widely used in distributed and federated learning. We underline differences in terms of convergence rates between…

Machine Learning · Computer Science 2025-07-25 Constantin Philippenko , Aymeric Dieuleveut

Generative adversarial networks (GANs) has gained tremendous popularity lately due to an ability to reinforce quality of its predictive model with generated objects and the quality of the generative model with and supervised feedback. GANs…

Computer Vision and Pattern Recognition · Computer Science 2017-05-31 Evgeny Zamyatin , Andrey Filchenkov

Deep neural networks have achieved great success in many data processing applications. However, the high computational complexity and storage cost makes deep learning hard to be used on resource-constrained devices, and it is not…

Machine Learning · Computer Science 2023-03-27 Xinwei Ou , Zhangxin Chen , Ce Zhu , Yipeng Liu

Despite the successes in capturing continuous distributions, the application of generative adversarial networks (GANs) to discrete settings, like natural language tasks, is rather restricted. The fundamental reason is the difficulty of…

Artificial Intelligence · Computer Science 2017-02-28 Tong Che , Yanran Li , Ruixiang Zhang , R Devon Hjelm , Wenjie Li , Yangqiu Song , Yoshua Bengio

Similarity joins are important operations with a broad range of applications. In this paper, we study the problem of vector similarity join size estimation (VSJ). It is a generalization of the previously studied set similarity join size…

Databases · Computer Science 2011-04-19 Hongrae Lee , Raymond T. Ng , Kyuseok Shim