English
Related papers

Related papers: Diversity-aware Channel Pruning for StyleGAN Compr…

200 papers

The style-based GAN architecture (StyleGAN) yields state-of-the-art results in data-driven unconditional generative image modeling. We expose and analyze several of its characteristic artifacts, and propose changes in both model…

Computer Vision and Pattern Recognition · Computer Science 2020-03-25 Tero Karras , Samuli Laine , Miika Aittala , Janne Hellsten , Jaakko Lehtinen , Timo Aila

This paper describes a channel-selection approach for simplifying deep neural networks. Specifically, we propose a new type of generic network layer, called pruning layer, to seamlessly augment a given pre-trained model for compression.…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Chih-Yao Chiu , Hwann-Tzong Chen , Tyng-Luh Liu

Generative Adversarial Networks (GANs) have shown remarkable success in modeling complex data distributions for image-to-image translation. Still, their high computational demands prohibit their deployment in practical scenarios like edge…

Computer Vision and Pattern Recognition · Computer Science 2023-12-25 Alireza Ganjdanesh , Shangqian Gao , Hirad Alipanah , Heng Huang

The discovery of interpretable directions in the latent spaces of pre-trained GAN models has recently become a popular topic. In particular, StyleGAN2 has enabled various image generation and manipulation tasks due to its rich and…

Computer Vision and Pattern Recognition · Computer Science 2022-04-01 Enis Simsar , Umut Kocasari , Ezgi Gülperi Er , Pinar Yanardag

Model pruning has become a useful technique that improves the computational efficiency of deep learning, making it possible to deploy solutions in resource-limited scenarios. A widely-used practice in relevant work assumes that a…

Machine Learning · Computer Science 2018-02-06 Jianbo Ye , Xin Lu , Zhe Lin , James Z. Wang

Generative adversarial models (GANs) continue to produce advances in terms of the visual quality of still images, as well as the learning of temporal correlations. However, few works manage to combine these two interesting capabilities for…

Computer Vision and Pattern Recognition · Computer Science 2021-12-01 Gereon Fox , Ayush Tewari , Mohamed Elgharib , Christian Theobalt

Numerous studies have revealed that deep learning-based medical image classification models may exhibit bias towards specific demographic attributes, such as race, gender, and age. Existing bias mitigation methods often achieve high level…

Computer Vision and Pattern Recognition · Computer Science 2024-05-15 Qingpeng Kong , Ching-Hao Chiu , Dewen Zeng , Yu-Jen Chen , Tsung-Yi Ho , Jingtong hu , Yiyu Shi

We propose in this paper a new paradigm for facial video compression. We leverage the generative capacity of GANs such as StyleGAN to represent and compress a video, including intra and inter compression. Each frame is inverted in the…

Image and Video Processing · Electrical Eng. & Systems 2022-07-14 Mustafa Shukor , Bharath Bhushan Damodaran , Xu Yao , Pierre Hellier

Channel pruning has been broadly recognized as an effective technique to reduce the computation and memory cost of deep convolutional neural networks. However, conventional pruning methods have limitations in that: they are restricted to…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Zejiang Hou , Minghai Qin , Fei Sun , Xiaolong Ma , Kun Yuan , Yi Xu , Yen-Kuang Chen , Rong Jin , Yuan Xie , Sun-Yuan Kung

We propose a discrete latent distribution for Generative Adversarial Networks (GANs). Instead of drawing latent vectors from a continuous prior, we sample from a finite set of learnable latents. However, a direct parametrization of such a…

Computer Vision and Pattern Recognition · Computer Science 2023-05-02 Evangelos Ntavelis , Mohamad Shahbazi , Iason Kastanis , Radu Timofte , Martin Danelljan , Luc Van Gool

Channel pruning is one of the major compression approaches for deep neural networks. While previous pruning methods have mostly focused on identifying unimportant channels, channel pruning is considered as a special case of neural…

Computer Vision and Pattern Recognition · Computer Science 2021-09-15 Xiangcheng Liu , Jian Cao , Hongyi Yao , Wenyu Sun , Yuan Zhang

We push forward neural network compression research by exploiting a novel challenging task of large-scale conditional generative adversarial networks (GANs) compression. To this end, we propose a gradually shrinking GAN (PPCD-GAN) by…

Computer Vision and Pattern Recognition · Computer Science 2022-03-17 Duc Minh Vo , Akihiro Sugimoto , Hideki Nakayama

Under limited data setting, GANs often struggle to navigate and effectively exploit the input latent space. Consequently, images generated from adjacent variables in a sparse input latent space may exhibit significant discrepancies in…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Jian Wang , Xin Lan , Jizhe Zhou , Yuxin Tian , Jiancheng Lv

Convolutional Neural Networks (CNNs) compression is crucial to deploying these models in edge devices with limited resources. Existing channel pruning algorithms for CNNs have achieved plenty of success on complex models. They approach the…

Computer Vision and Pattern Recognition · Computer Science 2022-09-08 Alireza Ganjdanesh , Shangqian Gao , Heng Huang

Recent studies on StyleGAN variants show promising performances for various generation tasks. In these models, latent codes have traditionally been manipulated and searched for the desired images. However, this approach sometimes suffers…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Takumi Harada , Kazuyuki Aihara , Hiroyuki Sakai

Deep generative models are proficient in generating realistic data but struggle with producing rare samples in low density regions due to their scarcity of training datasets and the mode collapse problem. While recent methods aim to improve…

Computer Vision and Pattern Recognition · Computer Science 2025-01-08 Subeen Lee , Jiyeon Han , Soyeon Kim , Jaesik Choi

We present a provable, sampling-based approach for generating compact Convolutional Neural Networks (CNNs) by identifying and removing redundant filters from an over-parameterized network. Our algorithm uses a small batch of input data…

Machine Learning · Computer Science 2020-03-24 Lucas Liebenwein , Cenk Baykal , Harry Lang , Dan Feldman , Daniela Rus

This paper addresses the challenges of storage and communication costs for large-scale datasets in resource-constrained edge devices by proposing a novel dataset quantization approach to reduce intra-sample redundancy. Unlike traditional…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Chenyue Yu , Jianyu Yu

The task of accelerating large neural networks on general purpose hardware has, in recent years, prompted the use of channel pruning to reduce network size. However, the efficacy of pruning based approaches has since been called into…

Machine Learning · Statistics 2019-03-08 Jack Turner , Elliot J. Crowley , Valentin Radu , José Cano , Amos Storkey , Michael O'Boyle

Generative Adversarial Networks (GANs) have proven to exhibit remarkable performance and are widely used across many generative computer vision applications. However, the unprecedented demand for the deployment of GANs on…

Computer Vision and Pattern Recognition · Computer Science 2024-03-14 Aman Kumar , Khushboo Anand , Shubham Mandloi , Ashutosh Mishra , Avinash Thakur , Neeraj Kasera , Prathosh A P