English
Related papers

Related papers: Diversity-aware Channel Pruning for StyleGAN Compr…

200 papers

Network pruning is one of the most dominant methods for reducing the heavy inference cost of deep neural networks. Existing methods often iteratively prune networks to attain high compression ratio without incurring significant loss in…

Computer Vision and Pattern Recognition · Computer Science 2020-08-17 Duong H. Le , Trung-Nhan Vo , Nam Thoai

We present the first neural video compression method based on generative adversarial networks (GANs). Our approach significantly outperforms previous neural and non-neural video compression methods in a user study, setting a new…

Image and Video Processing · Electrical Eng. & Systems 2022-07-13 Fabian Mentzer , Eirikur Agustsson , Johannes Ballé , David Minnen , Nick Johnston , George Toderici

We propose a framework for the automatic one-shot segmentation of synthetic images generated by a StyleGAN. Our framework is based on the observation that the multi-scale hidden features in the GAN generator hold useful semantic information…

Computer Vision and Pattern Recognition · Computer Science 2023-10-24 Ankit Manerikar , Avinash C. Kak

In this work, we propose a new layer-by-layer channel pruning method called Channel Pruning guided by classification Loss and feature Importance (CPLI). In contrast to the existing layer-by-layer channel pruning approaches that only…

Computer Vision and Pattern Recognition · Computer Science 2020-03-17 Jinyang Guo , Wanli Ouyang , Dong Xu

Pixel-level fine-grained image editing remains an open challenge. Previous works fail to achieve an ideal trade-off between control granularity and inference speed. They either fail to achieve pixel-level fine-grained control, or their…

Computer Vision and Pattern Recognition · Computer Science 2024-07-29 Pengxiang Cai , Zhiwei Liu , Guibo Zhu , Yunfang Niu , Jinqiao Wang

Despite the strong performance of Transformers, their quadratic computation complexity presents challenges in applying them to vision tasks. Automatic pruning is one of effective methods for reducing computation complexity without heuristic…

Computer Vision and Pattern Recognition · Computer Science 2024-06-03 Eunho Lee , Youngbae Hwang

Current approaches for compressing the Segment Anything Model (SAM) yield commendable results, yet necessitate extensive data to train a new network from scratch. Employing conventional pruning techniques can remarkably reduce data…

Computer Vision and Pattern Recognition · Computer Science 2024-09-27 Zigeng Chen , Gongfan Fang , Xinyin Ma , Xinchao Wang

Self-supervised speech representation learning (SSL) has shown to be effective in various downstream tasks, but SSL models are usually large and slow. Model compression techniques such as pruning aim to reduce the model size and computation…

Computation and Language · Computer Science 2023-03-01 Yifan Peng , Kwangyoun Kim , Felix Wu , Prashant Sridhar , Shinji Watanabe

Recently, many neural network-based image compression methods have shown promising results superior to the existing tool-based conventional codecs. However, most of them are often trained as separate models for different target bit rates,…

Image and Video Processing · Electrical Eng. & Systems 2022-11-09 Jooyoung Lee , Seyoon Jeong , Munchurl Kim

The semantic controllability of StyleGAN is enhanced by unremitting research. Although the existing weak supervision methods work well in manipulating the style codes along one attribute, the accuracy of manipulating multiple attributes is…

Computer Vision and Pattern Recognition · Computer Science 2022-09-29 Bingchuan Li , Shaofei Cai , Wei Liu , Peng Zhang , Qian He , Miao Hua , Zili Yi

Channel, as the medium for the propagation of electromagnetic waves, is one of the most important parts of a communication system. Being aware of how the channel affects the propagation waves is essential for designing, optimization and…

Signal Processing · Electrical Eng. & Systems 2019-08-20 Shirin Seyedsalehi , Vahid Pourahmadi , Hamid Sheikhzadeh , Ali Hossein Gharari Foumani

We introduce PRANCE, a Vision Transformer compression framework that jointly optimizes the activated channels and reduces tokens, based on the characteristics of inputs. Specifically, PRANCE~ leverages adaptive token optimization strategies…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Ye Li , Chen Tang , Yuan Meng , Jiajun Fan , Zenghao Chai , Xinzhu Ma , Zhi Wang , Wenwu Zhu

The success of convolutional neural networks (CNNs) in various applications is accompanied by a significant increase in computation and parameter storage costs. Recent efforts to reduce these overheads involve pruning and compressing the…

Latent Diffusion Models (LDMs) have emerged as powerful generative models, known for delivering remarkable results under constrained computational resources. However, deploying LDMs on resource-limited devices remains a complex issue,…

Machine Learning · Computer Science 2024-04-19 Thibault Castells , Hyoung-Kyu Song , Bo-Kyeong Kim , Shinkook Choi

This work integrates StyleGAN, DragGAN and Principal Component Analysis (PCA) to enhance the latent space efficiency and controllability of GAN-generated images. Style-GAN provides a structured latent space, DragGAN enables intuitive image…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Kirsten Odendaal , Neela Kaushik , Spencer Halverson

To address the limitations of existing magnitude-based pruning algorithms in cases where model weights or activations are of large and similar magnitude, we propose a novel perspective to discover parameter redundancy among channels and…

Machine Learning · Computer Science 2019-08-08 Yunxiang Zhang , Chenglong Zhao , Bingbing Ni , Jian Zhang , Haoran Deng

Potential radioactive hazards in full-dose positron emission tomography (PET) imaging remain a concern, whereas the quality of low-dose images is never desirable for clinical use. So it is of great interest to translate low-dose PET images…

Image and Video Processing · Electrical Eng. & Systems 2023-06-06 Yang Zhou , Zhiwen Yang , Hui Zhang , Eric I-Chao Chang , Yubo Fan , Yan Xu

Recent works have indicated redundancy across transformer blocks, prompting the research of depth compression to prune less crucial blocks. However, current ways of entire-block pruning suffer from risks of discarding meaningful cues…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Ruihan Xu , Qingpei Guo , Yao Zhu , Xiangyang Ji , Ming Yang , Shiliang Zhang

Channel-based pruning has achieved significant successes in accelerating deep convolutional neural network, whose pipeline is an iterative three-step procedure: ranking, pruning and fine-tuning. However, this iterative procedure is…

Computer Vision and Pattern Recognition · Computer Science 2019-02-19 Zi Wang , Chengcheng Li , Dali Wang , Xiangyang Wang , Hairong Qi

Text-driven image manipulation is developed since the vision-language model (CLIP) has been proposed. Previous work has adopted CLIP to design a text-image consistency-based objective to address this issue. However, these methods require…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Wanfeng Zheng , Qiang Li , Xiaoyan Guo , Pengfei Wan , Zhongyuan Wang