English
Related papers

Related papers: Robust Latent Matters: Boosting Image Generation w…

200 papers

Recent implicit neural representation (INR)-based image compression methods have shown competitive performance by overfitting image-specific latent codes. However, they remain inferior to end-to-end (E2E) compression approaches due to the…

Image and Video Processing · Electrical Eng. & Systems 2025-11-12 Chaoyi Lin , Yaojun Wu , Yue Li , Junru Li , Kai Zhang , Li Zhang

Autoregressive visual generation models typically rely on tokenizers to compress images into tokens that can be predicted sequentially. A fundamental dilemma exists in token representation: discrete tokens enable straightforward modeling…

Computer Vision and Pattern Recognition · Computer Science 2025-09-01 Yuqing Wang , Zhijie Lin , Yao Teng , Yuanzhi Zhu , Shuhuai Ren , Jiashi Feng , Xihui Liu

In the majority of GAN architectures, the latent space is defined as a set of vectors of given dimensionality. Such representations are not easily interpretable and do not capture spatial information of image content directly. In this work,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Maciej Sypetkowski

Enabling image generation models to be spatially controlled is an important area of research, empowering users to better generate images according to their own fine-grained specifications via e.g. edge maps, poses. Although this task has…

Computer Vision and Pattern Recognition · Computer Science 2025-11-05 Guoxuan Xia , Harleen Hanspal , Petru-Daniel Tudosiu , Shifeng Zhang , Sarah Parisot

Flow matching and diffusion models have shown impressive results in text-to-image generation, producing photorealistic images through an iterative denoising process. A common strategy to speed up synthesis is to perform early denoising at…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Jyun-Ze Tang , Chih-Fan Hsu , Jeng-Lin Li , Ming-Ching Chang , Wei-Chao Chen

This study investigates the impact of regularization of latent spaces through truncation on the quality of generated test inputs for deep learning classifiers. We evaluate this effect using style-based GANs, a state-of-the-art generative…

Software Engineering · Computer Science 2026-02-18 Giorgi Merabishvili , Oliver Weißl , Andrea Stocco

We tackle a challenging blind image denoising problem, in which only single distinct noisy images are available for training a denoiser, and no information about noise is known, except for it being zero-mean, additive, and independent of…

Image and Video Processing · Electrical Eng. & Systems 2021-07-06 Sungmin Cha , Taeeon Park , Byeongjoon Kim , Jongduk Baek , Taesup Moon

The rapid advancement of generative models has introduced serious risks, including deepfake techniques for facial synthesis and editing. Traditional approaches rely on training classifiers and enhancing generalizability through various…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Chung-Ting Tsai , Ching-Yun Ko , I-Hsin Chung , Yu-Chiang Frank Wang , Pin-Yu Chen

Latent diffusion models have emerged as the leading approach for generating high-quality images and videos, utilizing compressed latent representations to reduce the computational burden of the diffusion process. While recent advancements…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Ivan Skorokhodov , Sharath Girish , Benran Hu , Willi Menapace , Yanyu Li , Rameen Abdal , Sergey Tulyakov , Aliaksandr Siarohin

In generative modeling, numerous successful approaches leverage a low-dimensional latent space, e.g., Stable Diffusion models the latent space induced by an encoder and generates images through a paired decoder. Although the selection of…

Machine Learning · Computer Science 2023-10-31 Tianyang Hu , Fei Chen , Haonan Wang , Jiawei Li , Wenjia Wang , Jiacheng Sun , Zhenguo Li

In recent years, Generative Adversarial Networks have become ubiquitous in both research and public perception, but how GANs convert an unstructured latent code to a high quality output is still an open question. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2021-06-07 Lucy Chai , Jonas Wulff , Phillip Isola

The remarkable realism of images generated by diffusion models poses critical detection challenges. Current methods utilize reconstruction error as a discriminative feature, exploiting the observation that real images exhibit higher…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Jie Li , Yingying Feng , Chi Xie , Jie Hu , Lei Tan , Jiayi Ji

Text-to-image synthesis models require the ability to generate diverse images while maintaining stability. To overcome this challenge, a number of methods have been proposed, including the collection of prompt-image datasets and the…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Keunwoo Park , Jihye Chae , Joong Ho Ahn , Jihoon Kweon

We present TokenFlow, a novel unified image tokenizer that bridges the long-standing gap between multimodal understanding and generation. Prior research attempt to employ a single reconstruction-targeted Vector Quantization (VQ) encoder for…

Computer Vision and Pattern Recognition · Computer Science 2025-08-08 Liao Qu , Huichao Zhang , Yiheng Liu , Xu Wang , Yi Jiang , Yiming Gao , Hu Ye , Daniel K. Du , Zehuan Yuan , Xinglong Wu

While diffusion-based generative models have made significant strides in visual content creation, conventional approaches face computational challenges, especially for high-resolution images, as they denoise the entire image from noisy…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Haohang Xu , Longyu Chen , Yichen Zhang , Shuangrui Ding , Zhipeng Zhang

In this paper, we focus on motion discrete tokenization, which converts raw motion into compact discrete tokens--a process proven crucial for efficient motion generation. In this paradigm, increasing the number of tokens is a common…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Sheng Yan , Yong Wang , Xin Du , Junsong Yuan , Mengyuan Liu

Modern cameras' performance in low-light conditions remains suboptimal due to fundamental limitations in photon shot noise and sensor read noise. Generative image restoration methods have shown promising results compared to traditional…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Xijun Wang , Prateek Chennuri , Dilshan Godaliyadda , Yu Yuan , Bole Ma , Xingguang Zhang , Hamid R. Sheikh , Stanley Chan

Advances in generative models increase the need for sample quality assessment. To do so, previous methods rely on a pre-trained feature extractor to embed the generated samples and real samples into a common space for comparison. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Jingyi Xu , Hieu Le , Dimitris Samaras

Visual generative models based on latent space have achieved great success, underscoring the significance of visual tokenization. Mapping images to latents boosts efficiency and enables multimodal alignment for scaling up in downstream…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Yunpeng Qu , Kaidong Zhang , Yukang Ding , Ying Chen , Jian Wang

Text-to-image generation is a significant domain in modern computer vision and has achieved substantial improvements through the evolution of generative architectures. Among these, there are diffusion-based models that have demonstrated…