English
Related papers

Related papers: Stabilizing GANs with Soft Octave Convolutions

200 papers

Very deep convolutional neural networks (CNNs) have been firmly established as the primary methods for many computer vision tasks. However, most state-of-the-art CNNs are large, which results in high inference latency. Recently, depth-wise…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Yihui He , Jianing Qian , Jianren Wang , Cindy X. Le , Congrui Hetang , Qi Lyu , Wenping Wang , Tianwei Yue

This paper presents a novel convolutional layer, called perturbed convolution (PConv), which focuses on achieving two goals simultaneously: improving the generative adversarial network (GAN) performance and alleviating the memorization…

Computer Vision and Pattern Recognition · Computer Science 2021-12-23 Seung Park , Yoon-Jae Yeo , Yong-Goo Shin

In this paper we propose a novel approach for stabilizing the training process of Generative Adversarial Networks as well as alleviating the mode collapse problem. The main idea is to introduce a regularization term that we call…

Machine Learning · Statistics 2020-08-11 Jiadong Liang , Liangyu Zhang , Cheng Zhang , Zhihua Zhang

Generative Adversarial Networks (GANs) have proved as a powerful framework for denoising applications in medical imaging. However, GAN-based denoising algorithms still suffer from limitations in capturing complex relationships within the…

Image and Video Processing · Electrical Eng. & Systems 2026-02-16 Francesco Di Feola , Lorenzo Tronchin , Valerio Guarrasi , Paolo Soda

Supervised learning-based methods yield robust denoising results, yet they are inherently limited by the need for large-scale clean/noisy paired datasets. The use of unsupervised denoisers, on the other hand, necessitates a more detailed…

Image and Video Processing · Electrical Eng. & Systems 2021-11-30 Nahyun Kim , Donggon Jang , Sunhyeok Lee , Bomi Kim , Dae-Shik Kim

In machine learning approach to image denoising a network is trained to recover a clean image from a noisy one. In this paper a novel structure is proposed based on training multiple specialized networks as opposed to existing structures…

Image and Video Processing · Electrical Eng. & Systems 2020-12-01 Seyed Mohsen Hosseini

The recent explosive interest on transformers has suggested their potential to become powerful "universal" models for computer vision tasks, such as classification, detection, and segmentation. While those attempts mainly study the…

Computer Vision and Pattern Recognition · Computer Science 2021-12-10 Yifan Jiang , Shiyu Chang , Zhangyang Wang

The rapid progression of generative AI (GenAI) technologies has heightened concerns regarding the misuse of AI-generated imagery. To address this issue, robust detection methods have emerged as particularly compelling, especially in…

Graphics · Computer Science 2025-04-07 Hongfei Cai , Chi Liu , Sheng Shen , Youyang Qu , Peng Gui

Tensor decomposition is one of the fundamental technique for model compression of deep convolution neural networks owing to its ability to reveal the latent relations among complex structures. However, most existing methods compress the…

Computer Vision and Pattern Recognition · Computer Science 2021-12-08 Bo-Shiuan Chu , Che-Rung Lee

Generative Adversarial Networks (GANs) have been shown to be powerful and flexible priors when solving inverse problems. One challenge of using them is overcoming representation error, the fundamental limitation of the network in…

Machine Learning · Computer Science 2022-04-12 Sean Gunn , Jorio Cocola , Paul Hand

Generative Adversarial Networks (GANs) are powerful models able to synthesize data samples closely resembling the distribution of real data, yet the diversity of those generated samples is limited due to the so-called mode collapse…

Computer Vision and Pattern Recognition · Computer Science 2023-06-26 Jan Dubiński , Kamil Deja , Sandro Wenzel , Przemysław Rokita , Tomasz Trzciński

Recent work has increased the performance of Generative Adversarial Networks (GANs) by enforcing a consistency cost on the discriminator. We improve on this technique in several ways. We first show that consistency regularization can…

Machine Learning · Statistics 2020-12-16 Zhengli Zhao , Sameer Singh , Honglak Lee , Zizhao Zhang , Augustus Odena , Han Zhang

Despite the significant advances in recent years, Generative Adversarial Networks (GANs) are still notoriously hard to train. In this paper, we propose three novel curriculum learning strategies for training GANs. All strategies are first…

Machine Learning · Computer Science 2019-10-24 Petru Soviany , Claudiu Ardei , Radu Tudor Ionescu , Marius Leordeanu

Pose-conditioned convolutional generative models struggle with high-quality 3D-consistent image generation from single-view datasets, due to their lack of sufficient 3D priors. Recently, the integration of Neural Radiance Fields (NeRFs) and…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Mohamad Shahbazi , Evangelos Ntavelis , Alessio Tonioni , Edo Collins , Danda Pani Paudel , Martin Danelljan , Luc Van Gool

Deep convolutional neural networks are known to be unstable during training at high learning rate unless normalization techniques are employed. Normalizing weights or activations allows the use of higher learning rates, resulting in faster…

Machine Learning · Computer Science 2019-12-02 Brendan Ruff , Taylor Beck , Joscha Bach

Image compression is a method to remove spatial redundancy between adjacent pixels and reconstruct a high-quality image. In the past few years, deep learning has gained huge attention from the research community and produced promising image…

Image and Video Processing · Electrical Eng. & Systems 2021-09-07 Khawar Islam , L. Minh Dang , Sujin Lee , Hyeonjoon Moon

Since the advent of generative adversarial networks (GANs), various loss functions have been developed and combined to constitute the overall training objective function, in order to improve model performance or for specific learning tasks.…

Image and Video Processing · Electrical Eng. & Systems 2020-06-30 Jingwen Su , Hujun Yin

Model compression and acceleration are attracting increasing attentions due to the demand for embedded devices and mobile applications. Research on efficient convolutional neural networks (CNNs) aims at removing feature redundancy by…

Machine Learning · Computer Science 2020-08-21 Jinhua Liang , Tao Zhang , Guoqing Feng

3D-aware GANs offer new capabilities for view synthesis while preserving the editing functionalities of their 2D counterparts. GAN inversion is a crucial step that seeks the latent code to reconstruct input images or videos, subsequently…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Yiran Xu , Zhixin Shu , Cameron Smith , Seoung Wug Oh , Jia-Bin Huang

This paper presents a new conditional GAN (named convex relaxing CGAN or crCGAN) to replicate the conventional constrained topology optimization algorithms in an extremely effective and efficient process. The proposed crCGAN consists of a…

Machine Learning · Computer Science 2019-04-02 M. -H. Herman Shen , Liang Chen