中文
相关论文

相关论文: JLT: Clean-Latent Prediction in Latent Diffusion T…

200 篇论文

Diffusion transformers (DiTs) achieve high generative quality but lock FLOPs to image resolution, limiting principled latency-quality trade-offs, and allocate computation uniformly across input spatial tokens, wasting resource allocation to…

Diffusion Transformers (DiT) have emerged as a widely adopted backbone for high-fidelity image and video generation, yet their iterative denoising process incurs high computational costs. Existing training-free acceleration methods rely on…

计算机视觉与模式识别 · 计算机科学 2026-02-23 Hanshuai Cui , Zhiqing Tang , Qianli Ma , Zhi Yao , Weijia Jia

Deep learning-based image enhancement methods face a fundamental trade-off between computational efficiency and representational capacity. For example, although a conventional three-dimensional Look-Up Table (3D LUT) can process a degraded…

计算机视觉与模式识别 · 计算机科学 2025-09-30 Liubing Hu , Chen Wu , Anrui Wang , Dianjie Lu , Guijuan Zhang , Zhuoran Zheng

Flow matching with $x$-prediction -- regressing the clean data point rather than the ambient velocity -- is known to exploit low-dimensional manifold structure effectively in pixel space \cite{li2025back}. We ask whether a pretrained…

计算机视觉与模式识别 · 计算机科学 2026-05-22 Le Zhang , Ning Mang , Aishwarya Agrawal

Diffusion Transformers (DiT) trained with flow matching in a VAE latent space have unified visual generation across images and videos. A natural next step toward a single architecture for both generation (visual synthesis) and understanding…

Due to strict rate and reliability demands, wireless image transmission remains difficult for both classical layered designs and joint source-channel coding (JSCC), especially under low latency. Diffusion-based generative decoders can…

机器学习 · 计算机科学 2026-01-13 Jingwen Fu , Ming Xiao , Mikael Skoglund , Dong In Kim

Continuous diffusion and flow models are attractive for non-autoregressive text generation because they can update all positions in parallel. A major difficulty is the interface between continuous latent states and discrete tokens. This…

计算与语言 · 计算机科学 2026-05-18 De Shuai Zhang

In this paper, we investigate how to convert a pre-trained Diffusion Transformer (DiT) into a linear DiT, as its simplicity, parallelism, and efficiency for image generation. Through detailed exploration, we offer a suite of ready-to-use…

Today's denoising diffusion models do not "denoise" in the classical sense, i.e., they do not directly predict clean images. Rather, the neural networks predict noise or a noised quantity. In this paper, we suggest that predicting clean…

计算机视觉与模式识别 · 计算机科学 2026-01-08 Tianhong Li , Kaiming He

Diffusion Transformers (DiT) have become a leading architecture in image generation. However, the quadratic complexity of attention mechanisms, which are responsible for modeling token-wise relationships, results in significant latency when…

计算机视觉与模式识别 · 计算机科学 2024-12-23 Songhua Liu , Zhenxiong Tan , Xinchao Wang

Video prediction is a fundamental task for various downstream applications, including robotics and world modeling. Although general video prediction models have achieved remarkable performance in standard scenarios, occlusion is still an…

计算机视觉与模式识别 · 计算机科学 2025-11-21 Eliyas Suleyman , Paul Henderson , Eksan Firkat , Nicolas Pugeault

Recent advances in inverse problem solving have increasingly adopted flow priors over diffusion models due to their ability to construct straight probability paths from noise to data, thereby enhancing efficiency in both training and…

计算机视觉与模式识别 · 计算机科学 2025-11-11 Hossein Askari , Yadan Luo , Hongfu Sun , Fred Roosta

We explore a new class of diffusion models based on the transformer architecture. We train latent diffusion models of images, replacing the commonly-used U-Net backbone with a transformer that operates on latent patches. We analyze the…

计算机视觉与模式识别 · 计算机科学 2023-03-03 William Peebles , Saining Xie

We investigate the statistical and computational limits of latent Diffusion Transformers (DiTs) under the low-dimensional linear latent space assumption. Statistically, we study the universal approximation and sample complexity of the DiTs…

机器学习 · 统计学 2024-11-01 Jerry Yao-Chieh Hu , Weimin Wu , Zhao Song , Han Liu

Leveraging the visual priors of pre-trained text-to-image diffusion models offers a promising solution to enhance zero-shot generalization in dense prediction tasks. However, existing methods often uncritically use the original diffusion…

计算机视觉与模式识别 · 计算机科学 2025-01-22 Jing He , Haodong Li , Wei Yin , Yixun Liang , Leheng Li , Kaiqiang Zhou , Hongbo Zhang , Bingbing Liu , Ying-Cong Chen

Diffusion Transformers have established a new state-of-the-art in image synthesis, but the high computational cost of iterative sampling severely hampers their practical deployment. While existing acceleration methods often focus on the…

计算机视觉与模式识别 · 计算机科学 2026-03-19 Wenhao Sun , Ji Li , Zhaoqiang Liu

Visual synthesis has recently seen significant leaps in performance, largely due to breakthroughs in generative models. Diffusion models have been a key enabler, as they excel in image diversity. However, this comes at the cost of slow…

计算机视觉与模式识别 · 计算机科学 2024-12-05 Johannes Schusterbauer , Ming Gui , Pingchuan Ma , Nick Stracke , Stefan A. Baumann , Vincent Tao Hu , Björn Ommer

Inverse problems arise in a multitude of applications, where the goal is to recover a clean signal from noisy and possibly (non)linear observations. The difficulty of a reconstruction problem depends on multiple factors, such as the ground…

图像与视频处理 · 电气工程与系统科学 2024-08-21 Zalan Fabian , Berk Tinaz , Mahdi Soltanolkotabi

Diffusion-based image compression has recently shown outstanding perceptual fidelity, yet its practicality is hindered by prohibitive sampling overhead and high memory usage. Most existing diffusion codecs employ U-Net architectures, where…

图像与视频处理 · 电气工程与系统科学 2026-03-16 Junqi Shi , Ming Lu , Xingchen Li , Anle Ke , Ruiqi Zhang , Zhan Ma

Diffusion-based Image Editing has achieved significant success in recent years. However, it remains challenging to achieve high-quality image editing while maintaining the background similarity without sacrificing speed or memory…

图形学 · 计算机科学 2025-09-03 Siyi Liu , Weiming Chen , Yushun Tang , Zhihai He
‹ 上一页 1 2 3 10 下一页 ›