中文
相关论文

相关论文: MoVQ: Modulating Quantized Vectors for High-Fideli…

200 篇论文

Generation of photo-realistic images, semantic editing and representation learning are a few of many potential applications of high resolution generative models. Recent progress in GANs have established them as an excellent choice for such…

计算机视觉与模式识别 · 计算机科学 2021-12-13 Partha Ghosh , Dominik Zietlow , Michael J. Black , Larry S. Davis , Xiaochen Hu

We introduce a new category of generative autoencoders called automodulators. These networks can faithfully reproduce individual real-world input images like regular autoencoders, but also generate a fused sample from an arbitrary…

机器学习 · 计算机科学 2020-10-30 Ari Heljakka , Yuxin Hou , Juho Kannala , Arno Solin

The instability in GAN training has been a long-standing problem despite remarkable research efforts. We identify that instability issues stem from difficulties of performing feature matching with mini-batch statistics, due to a fragile…

机器学习 · 计算机科学 2020-07-16 Yang Zhao , Chunyuan Li , Ping Yu , Jianfeng Gao , Changyou Chen

In quantised autoencoders, images are usually split into local patches, each encoded by one token. This representation is redundant in the sense that the same number of tokens is spend per region, regardless of the visual information…

计算机视觉与模式识别 · 计算机科学 2024-08-06 Tim Elsner , Paula Usinger , Victor Czech , Gregor Kobsik , Yanjiang He , Isaak Lim , Leif Kobbelt

Autoregressive conditional image generation algorithms are capable of generating photorealistic images that are consistent with given textual or image conditions, and have great potential for a wide range of applications. Nevertheless, the…

计算机视觉与模式识别 · 计算机科学 2024-12-19 Qiaoying Qu , Shiyu Shen

Vector quantization (VQ) is a key component in discrete tokenizers for image generation, but its training is often unstable due to straight-through estimation bias, one-step-behind updates, and sparse codebook gradients, which lead to…

计算机视觉与模式识别 · 计算机科学 2025-09-15 Yifan Chang , Jie Qin , Limeng Qiao , Xiaofeng Wang , Zheng Zhu , Lin Ma , Xingang Wang

We present FusedGAN, a deep network for conditional image synthesis with controllable sampling of diverse images. Fidelity, diversity and controllable sampling are the main quality measures of a good image generation model. Most existing…

计算机视觉与模式识别 · 计算机科学 2018-01-18 Navaneeth Bodla , Gang Hua , Rama Chellappa

Deep generative models have achieved conspicuous progress in realistic image synthesis with multifarious conditional inputs, while generating diverse yet high-fidelity images remains a grand challenge in conditional image generation. This…

计算机视觉与模式识别 · 计算机科学 2022-07-25 Fangneng Zhan , Yingchen Yu , Rongliang Wu , Jiahui Zhang , Kaiwen Cui , Changgong Zhang , Shijian Lu

Quantum generative models offer a promising new direction in machine learning by leveraging quantum circuits to enhance data generation capabilities. In this study, we propose a hybrid quantum-classical image generation framework that…

量子物理 · 物理学 2025-04-04 Chi-Sheng Chen , Wei An Hou , Hsiang-Wei Hu , Zhen-Sheng Cai

Diffusion models have emerged as powerful generative models, but their high computation cost in iterative sampling remains a significant bottleneck. In this work, we present an in-depth and insightful study of state-of-the-art acceleration…

计算机视觉与模式识别 · 计算机科学 2025-11-19 Weizhi Gao , Zhichao Hou , Junqi Yin , Feiyi Wang , Linyu Peng , Xiaorui Liu

The high dimensionality of images presents architecture and sampling-efficiency challenges for likelihood-based generative models. Previous approaches such as VQ-VAE use deep autoencoders to obtain compact representations, which are more…

计算机视觉与模式识别 · 计算机科学 2021-03-08 Charlie Nash , Jacob Menick , Sander Dieleman , Peter W. Battaglia

Recent advancements in generative models have highlighted the crucial role of image tokenization in the efficient synthesis of high-resolution images. Tokenization, which transforms images into latent representations, reduces computational…

计算机视觉与模式识别 · 计算机科学 2024-06-12 Qihang Yu , Mark Weber , Xueqing Deng , Xiaohui Shen , Daniel Cremers , Liang-Chieh Chen

Recent advancements in implicit neural representations have contributed to high-fidelity surface reconstruction and photorealistic novel view synthesis. However, the computational complexity inherent in these methodologies presents a…

计算机视觉与模式识别 · 计算机科学 2023-10-24 Yiying Yang , Wen Liu , Fukun Yin , Xin Chen , Gang Yu , Jiayuan Fan , Tao Chen

In the domain of image generation, latent-based generative models occupy a dominant status; however, these models rely heavily on image tokenizer. To meet modeling requirements, autoregressive models possessing the characteristics of…

计算机视觉与模式识别 · 计算机科学 2025-03-24 Panpan Wang , Liqiang Niu , Fandong Meng , Jinan Xu , Yufeng Chen , Jie Zhou

Recent work has shown the possibility of training generative models of 3D content from 2D image collections on small datasets corresponding to a single object class, such as human faces, animal faces, or cars. However, these models struggle…

计算机视觉与模式识别 · 计算机科学 2023-02-15 Kyle Sargent , Jing Yu Koh , Han Zhang , Huiwen Chang , Charles Herrmann , Pratul Srinivasan , Jiajun Wu , Deqing Sun

Colour controlled image generation and manipulation are of interest to artists and graphic designers. Vector Quantised Variational AutoEncoders (VQ-VAEs) with autoregressive (AR) prior are able to produce high quality images, but lack an…

计算机视觉与模式识别 · 计算机科学 2023-05-31 Keerth Rathakumar , David Liebowitz , Christian Walder , Kristen Moore , Salil S. Kanhere

Despite recent successes in synthesizing faces and bedrooms, existing generative models struggle to capture more complex image types, potentially due to the oversimplification of their latent space constructions. To tackle this issue,…

机器学习 · 计算机科学 2018-03-13 Wenling Shang , Kihyuk Sohn , Yuandong Tian

Deep networks are now ubiquitous in large-scale multi-center imaging studies. However, the direct aggregation of images across sites is contraindicated for downstream statistical and deep learning-based image analysis due to inconsistent…

图像与视频处理 · 电气工程与系统科学 2021-04-16 Mengwei Ren , Neel Dey , James Fishbaugh , Guido Gerig

Discrete image tokenization is a key bottleneck for scalable visual generation: a tokenizer must remain compact for efficient latent-space priors while preserving semantic structure and using discrete capacity effectively. Existing…

计算机视觉与模式识别 · 计算机科学 2026-02-23 Idil Bilge Altun , Mert Onur Cakiroglu , Elham Buxton , Mehmet Dalkilic , Hasan Kurban

Detecting manipulated images has become a significant emerging challenge. The advent of image sharing platforms and the easy availability of advanced photo editing software have resulted in a large quantities of manipulated images being…

计算机视觉与模式识别 · 计算机科学 2019-11-26 Peng Zhou , Bor-Chun Chen , Xintong Han , Mahyar Najibi , Abhinav Shrivastava , Ser Nam Lim , Larry S. Davis