English
Related papers

Related papers: Towards Device Efficient Conditional Image Generat…

200 papers

Machine learning at the edge offers great benefits such as increased privacy and security, low latency, and more autonomy. However, a major challenge is that many devices, in particular edge devices, have very limited memory, weak…

Machine Learning · Computer Science 2019-09-05 Yang Li , Thomas Strohmer

We introduce a simple but effective unsupervised method for generating realistic and diverse images. We train a class-conditional GAN model without using manually annotated class labels. Instead, our model is conditional on labels…

Computer Vision and Pattern Recognition · Computer Science 2022-02-11 Steven Liu , Tongzhou Wang , David Bau , Jun-Yan Zhu , Antonio Torralba

We present a novel generative approach based on Denoising Diffusion Models (DDMs), which produces high-quality image samples along with their losslessly compressed bit-stream representations. This is obtained by replacing the standard…

Image and Video Processing · Electrical Eng. & Systems 2025-07-29 Guy Ohayon , Hila Manor , Tomer Michaeli , Michael Elad

Segmenting an image into its parts is a frequent preprocess for high-level vision tasks such as image editing. However, annotating masks for supervised training is expensive. Weakly-supervised and unsupervised methods exist, but they depend…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Xingzhe He , Bastian Wandt , Helge Rhodin

Conditioning image generation on specific features of the desired output is a key ingredient of modern generative models. However, existing approaches lack a general and unified way of representing structural and semantic conditioning at…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Luca Butera , Andrea Cini , Alberto Ferrante , Cesare Alippi

Researchers have applied deep neural networks to image restoration tasks, in which they proposed various network architectures, loss functions, and training methods. In particular, adversarial training, which is employed in recent studies,…

Neural and Evolutionary Computing · Computer Science 2018-03-02 Masanori Suganuma , Mete Ozay , Takayuki Okatani

This paper proposes a series of new approaches to improve Generative Adversarial Network (GAN) for conditional image synthesis and we name the proposed model as ArtGAN. One of the key innovation of ArtGAN is that, the gradient of the loss…

Computer Vision and Pattern Recognition · Computer Science 2018-08-27 Wei Ren Tan , Chee Seng Chan , Hernan Aguirre , Kiyoshi Tanaka

Advancements in text-to-image generative AI with large multimodal models are spreading into the field of image compression, creating high-quality representation of images at extremely low bit rates. This work introduces novel components to…

Image and Video Processing · Electrical Eng. & Systems 2025-06-02 Cheng-Lin Wu , Hyomin Choi , Ivan V. Bajić

We provide a two-way integration for the widely adopted ControlNet by integrating external condition generation algorithms into a single dense prediction method and incorporating its individually trained image generation processes into a…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Yilin Wang , Haiyang Xu , Xiang Zhang , Zeyuan Chen , Zhizhou Sha , Zirui Wang , Zhuowen Tu

Semantic image synthesis, i.e., generating images from user-provided semantic label maps, is an important conditional image generation task as it allows to control both the content as well as the spatial layout of generated images. Although…

Computer Vision and Pattern Recognition · Computer Science 2024-01-09 Tariq Berrada , Jakob Verbeek , Camille Couprie , Karteek Alahari

While large-scale pre-trained text-to-image models can synthesize diverse and high-quality human-centric images, an intractable problem is how to preserve the face identity for conditioned face images. Existing methods either require…

Computer Vision and Pattern Recognition · Computer Science 2023-07-04 Zhuowei Chen , Shancheng Fang , Wei Liu , Qian He , Mengqi Huang , Yongdong Zhang , Zhendong Mao

Generative adversarial networks (GANs) have enabled photorealistic image synthesis and editing. However, due to the high computational cost of large-scale generators (e.g., StyleGAN2), it usually takes seconds to see the results of a single…

Computer Vision and Pattern Recognition · Computer Science 2021-03-05 Ji Lin , Richard Zhang , Frieder Ganz , Song Han , Jun-Yan Zhu

Autoregressive conditional image generation algorithms are capable of generating photorealistic images that are consistent with given textual or image conditions, and have great potential for a wide range of applications. Nevertheless, the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-19 Qiaoying Qu , Shiyu Shen

In this work we address the problem of real-time dynamic medical MRI and X Ray CT image reconstruction from parsimonious samples Fourier frequency space for MRI and sinogram tomographic projections for CT. Today the de facto standard for…

Image and Video Processing · Electrical Eng. & Systems 2019-12-17 Janki Mehta , Angshul Majumdar

Image compression is a widely used technique to reduce the spatial redundancy in images. Recently, learning based image compression has achieved significant progress by using the powerful representation ability from neural networks.…

Image and Video Processing · Electrical Eng. & Systems 2020-05-26 Jiaheng Liu , Guo Lu , Zhihao Hu , Dong Xu

Perceptual studies demonstrate that conditional diffusion models excel at reconstructing video content aligned with human visual perception. Building on this insight, we propose a video compression framework that leverages conditional…

Computer Vision and Pattern Recognition · Computer Science 2025-09-26 Fangqiu Yi , Jingyu Xu , Jiawei Shao , Chi Zhang , Xuelong Li

Despite that deep learning has achieved state-of-the-art performance for medical image segmentation, its success relies on a large set of manually annotated images for training that are expensive to acquire. In this paper, we propose an…

Image and Video Processing · Electrical Eng. & Systems 2021-01-01 Lu Wang , Dong Guo , Guotai Wang , Shaoting Zhang

Autoencoders are composed of coding and decoding units, hence they hold the inherent potential of high-performance data compression and signal compressed sensing. The main disadvantages of current autoencoders comprise the following several…

Machine Learning · Computer Science 2022-07-28 Honggui Li , Dimitri Galayko , Maria Trocan , Mohamad Sawan

Current state-of-the-art photorealistic generators are computationally expensive, involve unstable training processes, and have real and synthetic distributions that are dissimilar in higher-dimensional spaces. To solve these issues, we…

Computer Vision and Pattern Recognition · Computer Science 2021-08-31 Badr Belhiti , Justin Milushev , Avinash Gupta , John Breedis , Johnson Dinh , Jesse Pisel , Michael Pyrcz

With the inexorable digitalisation of the modern world, every subset in the field of technology goes through major advancements constantly. One such subset is digital images which are ever so popular. Images can not always be as visually…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Prashanth Venkataraman