English
Related papers

Related papers: Why Do DiT Editors Drift? Plug-and-Play Low Freque…

200 papers

Image compression at extremely low bitrates (below 0.1 bits per pixel (bpp)) is a significant challenge due to substantial information loss. In this work, we propose a novel two-stage extreme image compression framework that exploits the…

Image and Video Processing · Electrical Eng. & Systems 2024-09-05 Zhiyuan Li , Yanhui Zhou , Hao Wei , Chenyang Ge , Jingwen Jiang

End-to-end autonomous driving via Vision-Language-Action (VLA) models demands a precarious balance between high-fidelity trajectory planning and efficient inference. Existing paradigms typically fall short: autoregressive (AR) VLAs are…

Computation and Language · Computer Science 2026-05-26 Kewei Zhang , Jin Wang , Sensen Gao , Chengyue Wu , Yulong Cao , Songyang Han , Boris Ivanovic , Langechuan Liu , Marco Pavone , Song Han , Daquan Zhou , Enze Xie

We present a novel, training-free approach for textual editing of real images using diffusion models. Unlike prior methods that rely on computationally expensive finetuning, our approach leverages LAtent SPatial Alignment (LASPA) to…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Yazeed Alharbi , Peter Wonka

Diffusion models are widely used for generative tasks across domains. Given a pre-trained diffusion model, it is often desirable to fine-tune it further either to correct for errors in learning or to align with downstream applications.…

Recent inversion-free, flow-based image editing methods such as FlowEdit leverages a pre-trained noise-to-image flow model such as Stable Diffusion 3, enabling text-driven manipulation by solving an ordinary differential equation (ODE).…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Jeongsol Kim , Yeobin Hong , Jonghyun Park , Jong Chul Ye

Variational autoencoders (VAEs), as an important aspect of generative models, have received a lot of research interests and reached many successful applications. However, it is always a challenge to achieve the consistency between the…

Machine Learning · Computer Science 2022-05-10 Xiaoyu Chen , Chen Gong , Qiang He , Xinwen Hou , Yu Liu

While the diffusion transformer (DiT) has become a focal point of interest in recent years, its application in low-light image enhancement remains a blank area for exploration. Current methods recover the details from low-light images while…

Computer Vision and Pattern Recognition · Computer Science 2026-01-14 Xiangchen Yin , Zhenda Yu , Longtao Jiang , Xin Gao , Xiao Sun , Zhi Liu , Xun Yang

In this work, we empirically study Diffusion Transformers (DiTs) for text-to-image generation, focusing on architectural choices, text-conditioning strategies, and training protocols. We evaluate a range of DiT-based…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Chen Chen , Rui Qian , Wenze Hu , Tsu-Jui Fu , Jialing Tong , Xinze Wang , Lezhi Li , Bowen Zhang , Alex Schwing , Wei Liu , Yinfei Yang

Latent diffusion models have emerged as the dominant paradigm for many generation tasks including audio generation such as text-to-audio, text-to-music and text-to-speech. A key component of latent diffusion is an autoencoder (VAE) that…

Sound · Computer Science 2026-05-19 Prem Seetharaman , Rithesh Kumar

Pixel diffusion aims to generate images directly in pixel space in an end-to-end fashion. This approach avoids the limitations of VAE in the two-stage latent diffusion, offering higher model capacity. Existing pixel diffusion models suffer…

Computer Vision and Pattern Recognition · Computer Science 2026-04-09 Zehong Ma , Longhui Wei , Shuai Wang , Shiliang Zhang , Qi Tian

Leveraging pre-trained Diffusion Transformers (DiTs) for high-resolution (HR) image synthesis often leads to spatial layout collapse and degraded texture fidelity. Prior work mitigates these issues with complex pipelines that first perform…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Yiyang Ma , Feng Zhou , Xuedan Yin , Pu Cao , Yonghao Dang , Jianqin Yin

The reliance on implicit point matching via attention has become a core bottleneck in drag-based editing, resulting in a fundamental compromise on weakened inversion strength and costly test-time optimization (TTO). This compromise severely…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Zixin Yin , Xili Dai , Duomin Wang , Xianfang Zeng , Lionel M. Ni , Gang Yu , Heung-Yeung Shum

Text-Aware Image Restoration (TAIR) aims to recover high-quality images from low-quality inputs containing degraded textual content. While diffusion models provide strong generative priors for general image restoration, they often produce…

Computer Vision and Pattern Recognition · Computer Science 2025-12-10 Jin Hyeon Kim , Paul Hyunbin Cho , Claire Kim , Jaewon Min , Jaeeun Lee , Jihye Park , Yeji Choi , Seungryong Kim

Current image editing methods primarily utilize DDIM Inversion, employing a two-branch diffusion approach to preserve the attributes and layout of the original image. However, these methods encounter challenges with non-rigid edits, which…

Computer Vision and Pattern Recognition · Computer Science 2024-07-26 Gwanhyeong Koo , Sunjae Yoon , Ji Woo Hong , Chang D. Yoo

With diffusion transformer (DiT) excelling in video generation, its use in specific tasks has drawn increasing attention. However, adapting DiT for pose-guided human image animation faces two core challenges: (a) existing U-Net-based pose…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Haoyu Zhao , Zhongang Qi , Cong Wang , Qingping Zheng , Guansong Lu , Fei Chen , Hang Xu , Zuxuan Wu

Vision-Language-Action (VLA) models offer a unified framework for robotic manipulation by integrating visual perception, language understanding, and control generation. However, existing VLA systems still struggle to generalize across…

Recent advances in Latent Video Diffusion Models (LVDMs) have revolutionized video generation by leveraging Video Variational Autoencoders (Video VAEs) to compress intricate video data into a compact latent space. However, as LVDM training…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Yu Cheng , Fajie Yuan

Diffusion Transformers (DiTs) are a dominant backbone for high-fidelity text-to-image generation due to strong scalability and alignment at high resolutions. However, quadratic self-attention over dense spatial tokens leads to high…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Xuanhua Yin , Chuanzhi Xu , Haoxian Zhou , Boyu Wei , Weidong Cai

Low-light video enhancement (LLVE) is challenging due to noise, low contrast, and color degradation. While learning-based methods enable fast inference, they often fail under heavy real-world noise because they do not sufficiently exploit…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Ruirui Lin , Guoxi Huang , Nantheera Anantrasirichai

When deep learning models are sequentially trained on new data, they tend to abruptly lose performance on previously learned tasks, a critical failure known as catastrophic forgetting. This challenge severely limits the deployment of AI in…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Paraskevi-Antonia Theofilou , Anuhya Thota , Stefanos Kollias , Mamatha Thota