English
Related papers

Related papers: Training-free Mixed-Resolution Latent Upsampling f…

200 papers

Training diffusion models for audiovisual sequences allows for a range of generation tasks by learning conditional distributions of various input-output combinations of the two modalities. Nevertheless, this strategy often requires training…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Gwanghyun Kim , Alonso Martinez , Yu-Chuan Su , Brendan Jou , José Lezama , Agrim Gupta , Lijun Yu , Lu Jiang , Aren Jansen , Jacob Walker , Krishna Somandepalli

Inverse problems arise in a multitude of applications, where the goal is to recover a clean signal from noisy and possibly (non)linear observations. The difficulty of a reconstruction problem depends on multiple factors, such as the ground…

Image and Video Processing · Electrical Eng. & Systems 2024-08-21 Zalan Fabian , Berk Tinaz , Mahdi Soltanolkotabi

Diffusion-based methods demonstrate significant potential for remote sensing image super-resolution at large scaling factors, particularly in reference-based super-resolution (RefSR) where high-resolution reference images provide critical…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Bin Luo , Runmin Dong , Zhaoyang Luo , Jinxiao Zhang , Jiyao Zhao , Fan Wei , Haohuan Fu

Diffusion Large Language Models (dLLMs) offer a compelling paradigm for natural language generation, leveraging parallel decoding and bidirectional attention to achieve superior global coherence compared to autoregressive models. While…

Machine Learning · Computer Science 2026-01-28 Zhongyu Xiao , Zhiwei Hao , Jianyuan Guo , Yong Luo , Jia Liu , Jie Xu , Han Hu

Transformer-based diffusion models offer superior scalability and performance but suffer from high computational overhead due to the iterative nature and quadratic complexity of self-attention at high resolutions. In this paper, we propose…

Hardware Architecture · Computer Science 2026-05-26 Jieon Yoon , Hangyeol Lee , Jaehoon Heo , Joo-Young Kim

Latent Diffusion Models (LDMs) are generally trained at fixed resolutions, limiting their capability when scaling up to high-resolution images. While training-based approaches address this limitation by training on high-resolution datasets,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-30 Sangmin Han , Jinho Jeong , Jinwoo Kim , Seon Joo Kim

High-fidelity video generation remains challenging for diffusion models due to the difficulty of modeling complex spatio-temporal dynamics efficiently. Recent video diffusion methods typically represent a video as a sequence of…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Minh Khoa Le , Kien Do , Duc Thanh Nguyen , Truyen Tran

Diffusion Transformers (DiT) trained with flow matching in a VAE latent space have unified visual generation across images and videos. A natural next step toward a single architecture for both generation (visual synthesis) and understanding…

Computation and Language · Computer Science 2026-05-11 Jiaxiu Jiang , Jingjing Ren , Wenbo Li , Bo Wang , Haoze Sun , Yijun Yang , Jianhui Liu , Yanbing Zhang , Shenghe Zheng , Yuan Zhang , Haoyang Huang , Nan Duan , Wangmeng Zuo

Latent diffusion models (LDMs) dominate high-quality image generation, yet integrating representation learning with generative modeling remains a challenge. We introduce a novel generative image modeling framework that seamlessly bridges…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Theodoros Kouzelis , Efstathios Karypidis , Ioannis Kakogeorgiou , Spyros Gidaris , Nikos Komodakis

Diffusion-based Transformers have demonstrated impressive generative capabilities, but their high computational costs hinder practical deployment, for example, generating an $8192\times 8192$ image can take over an hour on an A100 GPU. In…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Sucheng Ren , Qihang Yu , Ju He , Alan Yuille , Liang-Chieh Chen

Recent studies have demonstrated that learning a meaningful internal representation can accelerate generative training. However, existing approaches necessitate to either introduce an off-the-shelf external representation task or rely on a…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Dengyang Jiang , Mengmeng Wang , Liuzhuozheng Li , Lei Zhang , Haoyu Wang , Wei Wei , Guang Dai , Yanning Zhang , Jingdong Wang

High-resolution spatiotemporal simulations effectively capture the complexities of atmospheric plume dispersion in complex terrain. However, their high computational cost makes them impractical for applications requiring rapid responses or…

Text-to-image diffusion models are increasingly vulnerable to backdoor attacks, where malicious modifications to the training data cause the model to generate unintended outputs when specific triggers are present. While classification…

Cryptography and Security · Computer Science 2025-04-29 Abha Jha , Ashwath Vaithinathan Aravindan , Matthew Salaway , Atharva Sandeep Bhide , Duygu Nur Yaldiz

Image tokenization plays a central role in modern generative modeling by mapping visual inputs into compact representations that serve as an intermediate signal between pixels and generative models. Diffusion-based decoders have recently…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Chuhan Wang , Hao Chen

Latent diffusion models (LDMs) achieve state-of-the-art image synthesis, yet their reconstruction-style denoising objective provides only indirect semantic supervision: high-level semantics emerge slowly, requiring longer training and…

Computer Vision and Pattern Recognition · Computer Science 2025-12-19 Giorgos Petsangourakis , Christos Sgouropoulos , Bill Psomas , Theodoros Giannakopoulos , Giorgos Sfikas , Ioannis Kakogeorgiou

MR data are acquired in the frequency domain, known as k-space. Acquiring high-quality and high-resolution MR images can be time-consuming, posing a significant challenge when multiple sequences providing complementary contrast information…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Georgia Kanli , Daniele Perlo , Selma Boudissa , Radovan Jirik , Olivier Keunen

Diffusion-based image compression has recently shown outstanding perceptual fidelity, yet its practicality is hindered by prohibitive sampling overhead and high memory usage. Most existing diffusion codecs employ U-Net architectures, where…

Image and Video Processing · Electrical Eng. & Systems 2026-03-16 Junqi Shi , Ming Lu , Xingchen Li , Anle Ke , Ruiqi Zhang , Zhan Ma

Diffusion-based zero-shot image restoration and enhancement models have achieved great success in various tasks of image restoration and enhancement. However, directly applying them to video restoration and enhancement results in severe…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Cong Cao , Huanjing Yue , Xin Liu , Jingyu Yang

Despite recent advances in dexterous manipulations, the manipulation of articulated objects and generalization across different categories remain significant challenges. To address these issues, we introduce DART, a novel framework that…

Robotics · Computer Science 2025-09-19 Hao Zhang , Zhen Kan , Weiwei Shang , Yongduan Song

The growing demand for text-to-image generation has led to rapid advances in generative modeling. Recently, text-to-image diffusion models trained with flow matching algorithms, such as FLUX, have achieved remarkable progress and emerged as…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Zikai Zhou , Muyao Wang , Shitong Shao , Lichen Bai , Haoyi Xiong , Bo Han , Zeke Xie