中文
相关论文

相关论文: Gradient-free Decoder Inversion in Latent Diffusio…

200 篇论文

Diffusion models are a state-of-the-art generative modeling framework that transform noise to images via Langevin sampling, guided by the score, which is the gradient of the logarithm of the data distribution. Recent works have shown…

机器学习 · 计算机科学 2025-08-01 Aadithya Srikanth , Siddarth Asokan , Nishanth Shetty , Chandra Sekhar Seelamantula

Current video diffusion models achieve impressive generation quality but struggle in interactive applications due to bidirectional attention dependencies. The generation of a single frame requires the model to process the entire sequence,…

计算机视觉与模式识别 · 计算机科学 2025-09-25 Tianwei Yin , Qiang Zhang , Richard Zhang , William T. Freeman , Fredo Durand , Eli Shechtman , Xun Huang

We investigate the utility of diffusion generative models to efficiently synthesise datasets that effectively train deep learning models for image analysis. Specifically, we propose novel $\Gamma$-distribution Latent Denoising Diffusion…

图像与视频处理 · 电气工程与系统科学 2024-10-01 David Stojanovski , Mariana da Silva , Pablo Lamata , Arian Beqiri , Alberto Gomez

Neural channel decoder, as a data-driven channel decoding strategy, has shown very promising improvement on error-correcting capability over the classical methods. However, the success of those deep learning-based decoder comes at the cost…

信息论 · 计算机科学 2026-05-20 Chengwei Zhang , Yifan Du , Siyu Liao

Denoising diffusion models (DDMs) have recently attracted increasing attention by showing impressive synthesis quality. DDMs are built on a diffusion process that pushes data to the noise distribution and the models learn to denoise. In…

机器学习 · 计算机科学 2023-05-16 Jaemoo Choi , Yesom Park , Myungjoo Kang

In the realm of image synthesis, achieving fidelity to a reference image while adhering to conditional prompts remains a significant challenge. This paper proposes a novel approach that integrates a diffusion model with latent space…

计算机视觉与模式识别 · 计算机科学 2024-08-30 Kshitij Pathania

Latent diffusion models (LDMs) have made significant advancements in the field of image generation in recent years. One major advantage of LDMs is their ability to operate in a compressed latent space, allowing for more efficient training…

计算机视觉与模式识别 · 计算机科学 2024-09-27 Christina Zhang , Simran Motwani , Matthew Yu , Ji Hou , Felix Juefei-Xu , Sam Tsai , Peter Vajda , Zijian He , Jialiang Wang

Latent Consistency Models (LCMs) have achieved impressive performance in accelerating text-to-image generative tasks, producing high-quality images with minimal inference steps. LCMs are distilled from pre-trained latent diffusion models…

计算机视觉与模式识别 · 计算机科学 2023-11-10 Simian Luo , Yiqin Tan , Suraj Patil , Daniel Gu , Patrick von Platen , Apolinário Passos , Longbo Huang , Jian Li , Hang Zhao

Diffusion models (DMs) have been adopted across diverse fields with its remarkable abilities in capturing intricate data distributions. In this paper, we propose a Fast Diffusion Model (FDM) to significantly speed up DMs from a stochastic…

计算机视觉与模式识别 · 计算机科学 2023-10-05 Zike Wu , Pan Zhou , Kenji Kawaguchi , Hanwang Zhang

As the boosting development of large vision-language models like Contrastive Language-Image Pre-training (CLIP), many CLIP-like methods have shown impressive abilities on visual recognition, especially in low-data regimes scenes. However,…

计算机视觉与模式识别 · 计算机科学 2024-10-11 Zhinuo Zhou , Peng Zhou , Xiaoyong Pan

This paper introduces a novel watermarking method for diffusion models. It is based on guiding the diffusion process using the gradient computed from any off-the-shelf watermark decoder. The gradient computation encompasses different image…

密码学与安全 · 计算机科学 2026-05-08 Enoal Gesny , Eva Giboulot , Teddy Furon , Vivien Chappelier

The most advanced diffusion models have recently adopted increasingly deep stacked networks (e.g., U-Net or Transformer) to promote the generative emergence capabilities of vision generation models similar to large language models (LLMs).…

计算机视觉与模式识别 · 计算机科学 2024-07-23 Zhiyuan Ma , Liangliang Zhao , Biqing Qi , Bowen Zhou

Training-free acceleration has emerged as an advanced research area in video generation based on diffusion models. The redundancy of latents in diffusion model inference provides a natural entry point for acceleration. In this paper, we…

计算机视觉与模式识别 · 计算机科学 2025-10-08 Yang Xiao , Gen Li , Kaiyuan Deng , Yushu Wu , Zheng Zhan , Yanzhi Wang , Xiaolong Ma , Bo Hui

Recent years have witnessed the dramatic growth of Internet video traffic, where the video bitstreams are often compressed and delivered in low quality to fit the streamer's uplink bandwidth. To alleviate the quality degradation, it comes…

图像与视频处理 · 电气工程与系统科学 2023-03-09 Qihua Zhou , Ruibin Li , Song Guo , Peiran Dong , Yi Liu , Jingcai Guo , Zhenda Xu

Diffusion models have achieved great success in modeling continuous data modalities such as images, audio, and video, but have seen limited use in discrete domains such as language. Recent attempts to adapt diffusion to language have…

计算与语言 · 计算机科学 2023-11-08 Justin Lovelace , Varsha Kishore , Chao Wan , Eliot Shekhtman , Kilian Q. Weinberger

The video generation field has witnessed rapid improvements with the introduction of recent diffusion models. While these models have successfully enhanced appearance quality, they still face challenges in generating coherent and natural…

计算机视觉与模式识别 · 计算机科学 2025-04-21 Yaosi Hu , Zhenzhong Chen , Chong Luo

We present LatentCSI, a novel method for generating images of the physical environment from WiFi CSI measurements that leverages a pretrained latent diffusion model (LDM). Unlike prior approaches that rely on complex and computationally…

计算机视觉与模式识别 · 计算机科学 2025-09-08 Eshan Ramesh , Takayuki Nishio

Generative models have made significant impacts across various domains, largely due to their ability to scale during training by increasing data, computational resources, and model size, a phenomenon characterized by the scaling laws.…

计算机视觉与模式识别 · 计算机科学 2025-01-17 Nanye Ma , Shangyuan Tong , Haolin Jia , Hexiang Hu , Yu-Chuan Su , Mingda Zhang , Xuan Yang , Yandong Li , Tommi Jaakkola , Xuhui Jia , Saining Xie

Diffusion-based large language models (Diffusion LLMs) have shown promise for non-autoregressive text generation with parallel decoding capabilities. However, the practical inference speed of open-sourced Diffusion LLMs often lags behind…

计算与语言 · 计算机科学 2025-07-04 Chengyue Wu , Hao Zhang , Shuchen Xue , Zhijian Liu , Shizhe Diao , Ligeng Zhu , Ping Luo , Song Han , Enze Xie

Diffusion-based methods represented as stochastic differential equations on a continuous-time domain have recently proven successful as a non-adversarial generative model. Training such models relies on denoising score matching, which can…

机器学习 · 计算机科学 2024-11-05 Sarthak Mittal , Korbinian Abstreiter , Stefan Bauer , Bernhard Schölkopf , Arash Mehrjou