English
Related papers

Related papers: JLT: Clean-Latent Prediction in Latent Diffusion T…

200 papers

Machine learning is becoming increasingly important for nonlinear system identification, including dynamical systems with spatially distributed outputs. However, classical identification and forecasting approaches become markedly less…

Systems and Control · Electrical Eng. & Systems 2026-04-21 Achraf El Messaoudi , Noureddine Khaous , Karim Cherifi

Current top-notch deep learning (DL) based vision models are primarily based on exploring and exploiting the inherent correlations between training data samples and their associated labels. However, a known practical challenge is their…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Chao-Han Huck Yang , I-Te Danny Hung , Yi-Chieh Liu , Pin-Yu Chen

Diffusion models are often trained in low-dimensional latent spaces, which are then reused for related but shifted datasets. In this work, we study when such latent reuse remains reliable under distribution shift. We consider a…

Machine Learning · Statistics 2026-05-14 Yifeng Yu , Lu Yu

To address the high sampling cost of Diffusion Transformers (DiTs), feature caching offers a training-free acceleration method. However, existing methods rely on hand-crafted forecasting formulas that fail under aggressive skipping. We…

Computer Vision and Pattern Recognition · Computer Science 2026-04-30 Zhirong Shen , Rui Huang , Jiacheng Liu , Chang Zou , Peiliang Cai , Shikang Zheng , Zhengyi Shi , Liang Feng , Linfeng Zhang

Generating visual layouts is an essential ingredient of graphic design. The ability to condition layout generation on a partial subset of component attributes is critical to real-world applications that involve user interaction. Recently,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-08 Elad Levi , Eli Brosh , Mykola Mykhailych , Meir Perez

Instead of performing text-conditioned denoising in the image domain, latent diffusion models (LDMs) operate in latent space of a variational autoencoder (VAE), enabling more efficient processing at reduced computational costs. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Jason Becker , Chris Wendler , Peter Baylies , Robert West , Christian Wressnegger

Recent byte-level language models (LMs) match the performance of token-level models without relying on subword vocabularies, yet their utility is limited by slow, byte-by-byte autoregressive generation. We address this bottleneck in the…

Diffusion model-based channel estimators have shown impressive performance but suffer from high computational complexity because they rely on iterative reverse sampling. This paper proposes a sampling-free diffusion transformer (DiT) for…

Signal Processing · Electrical Eng. & Systems 2026-04-28 Zhixiong Chen , Hyundong Shin , Arumugam Nallanathan

The rapid advancement of diffusion-based image generators has made it increasingly difficult to distinguish generated from real images. This erodes trust in digital media, making it critical to develop generated image detectors that remain…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Ana Vasilcoiu , Ivona Najdenkoska , Zeno Geradts , Marcel Worring

Limited-angle computed tomography (LACT) reconstruction is an inverse problem with severe ill-posedness arising from missing projection angles, and it is difficult to restore high-precision images without sufficient prior knowledge. In…

Image and Video Processing · Electrical Eng. & Systems 2026-03-06 Hinako Isogai , Naruki Murahashi , Mitsuhiro Nakamura , Megumi Nakao

Discrete diffusion models have emerged as a powerful class of models and a promising route to fast language generation, but practical implementations typically rely on factored reverse transitions ignoring cross-token dependencies and…

Machine Learning · Computer Science 2026-05-14 Dario Shariatian , Alain Durmus , Umut Simsekli , Stefano Peluchetti

Generative models have demonstrated strong performance in conditional settings and can be viewed as a form of data compression, where the condition serves as a compact representation. However, their limited controllability and…

Machine Learning · Computer Science 2025-07-04 Xiao Li , Liangji Zhu , Anand Rangarajan , Sanjay Ranka

We introduce FLEX (FLow EXpert), a backbone architecture for generative modeling of spatio-temporal physical systems using diffusion models. FLEX operates in the residual space rather than on raw data, a modeling choice that we motivate…

Machine Learning · Computer Science 2025-05-26 N. Benjamin Erichson , Vinicius Mikuni , Dongwei Lyu , Yang Gao , Omri Azencot , Soon Hoe Lim , Michael W. Mahoney

Transformers replace recurrence with a memory that grows with sequence length and self-attention that enables ad-hoc lookups over past tokens. Consequently, they lack an inherent incentive to compress history into compact latent states with…

Recent DiT-based text-to-image models increasingly adopt LLMs as text encoders, yet text conditioning remains largely static and often utilizes only a single LLM layer, despite pronounced semantic hierarchy across LLM layers and…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Bozhou Li , Yushuo Guan , Haolin Li , Bohan Zeng , Yiyan Ji , Yue Ding , Pengfei Wan , Kun Gai , Yuanxing Zhang , Wentao Zhang

Diffusion Transformers (DiT) have demonstrated remarkable generative capabilities but remain highly computationally expensive. Previous acceleration methods, such as pruning and distillation, typically rely on a fixed computational…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Jiangshan Wang , Zeqiang Lai , Jiarui Chen , Jiayi Guo , Hang Guo , Xiu Li , Xiangyu Yue , Chunchao Guo

JPEG images can be further compressed to enhance the storage and transmission of large-scale image datasets. Existing learned lossless compressors for RGB images cannot be well transferred to JPEG images due to the distinguishing…

Image and Video Processing · Electrical Eng. & Systems 2023-03-09 Jixiang Luo , Shaohui Li , Wenrui Dai , Chenglin Li , Junni Zou , Hongkai Xiong

Diffusion Transformers (DiTs) have recently achieved remarkable success in text-guided image generation. In image editing, DiTs project text and image inputs to a joint latent space, from which they decode and synthesize new images.…

Computer Vision and Pattern Recognition · Computer Science 2024-11-14 Zitao Shuai , Chenwei Wu , Zhengxu Tang , Bowen Song , Liyue Shen

Diffusion Transformers (DiTs) have demonstrated remarkable performance in visual generation tasks. However, their low inference speed limits their deployment in low-resource applications. Recent training-free approaches exploit the…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Xiaoliu Guan , Lielin Jiang , Hanqi Chen , Xu Zhang , Jiaxing Yan , Guanzhong Wang , Yi Liu , Zetao Zhang , Yu Wu

We empirically study the scaling properties of various Diffusion Transformers (DiTs) for text-to-image generation by performing extensive and rigorous ablations, including training scaled DiTs ranging from 0.3B upto 8B parameters on…

Computer Vision and Pattern Recognition · Computer Science 2024-12-18 Hao Li , Shamit Lal , Zhiheng Li , Yusheng Xie , Ying Wang , Yang Zou , Orchid Majumder , R. Manmatha , Zhuowen Tu , Stefano Ermon , Stefano Soatto , Ashwin Swaminathan