English
Related papers

Related papers: AHPA: Adaptive Hierarchical Prior Alignment for Di…

200 papers

Recent advances in Diffusion Transformers (DiTs) demonstrate that aligning noisy latent states with well-trained semantic features-as pioneered by Representation Alignment (REPA)-can substantially accelerate training and improve generation…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Shaodong Xu , Zhendong Wang , Litong Gong , Zexian Li , Wengang Zhou , Tiezheng Ge , Houqiang Li

Modern diffusion models encounter a fundamental trade-off between training efficiency and generation quality. While existing representation alignment methods, such as REPA, accelerate convergence through patch-wise alignment, they often…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Hesen Chen , Junyan Wang , Zhiyu Tan , Hao Li

Denoising-based diffusion transformers, despite their strong generation performance, suffer from inefficient training convergence. Existing methods addressing this issue, such as REPA (relying on external representation encoders) or SRA…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Mengmeng Wang , Dengyang Jiang , Liuzhuozheng Li , Yucheng Lin , Guojiang Shen , Xiangjie Kong , Yong Liu , Guang Dai , Jingdong Wang

Recent studies have shown that the denoising process in (generative) diffusion models can induce meaningful (discriminative) representations inside the model, though the quality of these representations still lags behind those learned…

Computer Vision and Pattern Recognition · Computer Science 2025-06-19 Sihyun Yu , Sangkyung Kwak , Huiwon Jang , Jongheon Jeong , Jonathan Huang , Jinwoo Shin , Saining Xie

Diffusion models have revolutionized text-to-image generation, but their real-world applications are hampered by the extensive time needed for hundreds of diffusion steps. Although progressive distillation has been proposed to speed up…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Yifan Zhang , Bryan Hooi

Efficiently aligning large-scale video diffusion models with human intent requires a scalable and trajectory-aware pathway that bridges the inherent discrepancy between training noise distributions and practical inference trajectories.…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Jingyuan Zhu , Biaolong Chen , Le Zhang , Aixi Zhang , Hao Jiang , Pipei Huang

Preference alignment in diffusion models has primarily focused on benign human preferences (e.g., aesthetic). In this paper, we propose a novel perspective: framing unrestricted adversarial example generation as a problem of aligning with…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Kaixun Jiang , Zhaoyu Chen , Haijing Guo , Jinglun Li , Jiyuan Fu , Pinxue Guo , Hao Tang , Bo Li , Wenqiang Zhang

Enforcing alignment between the internal representations of diffusion or flow-based generative models and those of pretrained self-supervised encoders has recently been shown to provide a powerful inductive bias, improving both convergence…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Loukas Sfountouris , Giannis Daras , Paris Giampouras

Diffusion Transformers (DiTs) deliver state-of-the-art image quality, yet their training remains notoriously slow. A recent remedy -- representation alignment (REPA) that matches DiT hidden features to those of a non-generative teacher…

Computer Vision and Pattern Recognition · Computer Science 2025-05-23 Ziqiao Wang , Wangbo Zhao , Yuhao Zhou , Zekai Li , Zhiyuan Liang , Mingjia Shi , Xuanlei Zhao , Pengfei Zhou , Kaipeng Zhang , Zhangyang Wang , Kai Wang , Yang You

Diffusion model alignment aims to bridge the gap between generated outputs and human preferences by enhancing both semantic consistency with textual prompts and overall visual quality. Existing alignment methods face a challenging…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Xin Xie , Jiaxian Guo , Dong Gong

Representation Alignment (REPA) that aligns Diffusion Transformer (DiT) hidden-states with ViT visual encoders has proven highly effective in DiT training, demonstrating superior convergence properties, but it has not been validated on the…

Computer Vision and Pattern Recognition · Computer Science 2026-01-08 Yuchuan Tian , Hanting Chen , Mengyu Zheng , Yuchen Liang , Chao Xu , Yunhe Wang

Deep hierarchical variational autoencoders (VAEs) are powerful latent variable generative models. In this paper, we introduce Hierarchical VAE with Diffusion-based Variational Mixture of the Posterior Prior (VampPrior). We apply…

Machine Learning · Computer Science 2024-12-03 Anna Kuzina , Jakub M. Tomczak

The goal of this paper is to optimize the training process of diffusion-based text-to-speech models. While recent studies have achieved remarkable advancements, their training demands substantial time and computational costs, largely due to…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-02 Jeongsoo Choi , Zhikang Niu , Ji-Hoon Kim , Chunhui Wang , Joon Son Chung , Xie Chen

Diffusion policies have recently emerged as a powerful class of visuomotor controllers for robot manipulation, offering stable training and expressive multi-modal action modeling. However, existing approaches typically treat action…

Robotics · Computer Science 2025-10-01 Zezeng Li , Rui Yang , Ruochen Chen , ZhongXuan Luo , Liming Chen

Representation Alignment (REPA) has emerged as a simple way to accelerate Diffusion Transformers training in latent space. At the same time, pixel-space diffusion transformers such as Just image Transformers (JiT) have attracted growing…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Jaeyo Shin , Jiwook Kim , Hyunjung Shim

While recent advancements in generative modeling have significantly improved text-image alignment, some residual misalignment between text and image representations still remains. Some approaches address this issue by fine-tuning models in…

Computer Vision and Pattern Recognition · Computer Science 2025-12-11 Jaa-Yeon Lee , Byunghee Cha , Jeongsol Kim , Jong Chul Ye

In recent years, the development of diffusion models has led to significant progress in image and video generation tasks, with pre-trained models like the Stable Diffusion series playing a crucial role. Inspired by model pruning which…

Computer Vision and Pattern Recognition · Computer Science 2025-04-03 Teng Hu , Jiangning Zhang , Ran Yi , Hongrui Huang , Yabiao Wang , Lizhuang Ma

Recent progress in generative modeling has enabled high-quality visual synthesis with diffusion-based frameworks, supporting controllable sampling and large-scale training. Inference-time guidance methods such as classifier-free and…

Computer Vision and Pattern Recognition · Computer Science 2026-02-02 Wenqiang Zu , Shenghao Xie , Bo Lei , Lei Ma

We propose a novel hierarchical diffusion planner that embeds task and motion structure directly into the noise model. Unlike standard diffusion-based planners that rely on zero-mean, isotropic Gaussian corruption, we introduce…

Robotics · Computer Science 2026-03-17 Amelie Minji Kim , Anqi Wu , Ye Zhao

Fine-tuning Video Diffusion Models (VDMs) at the user level to generate videos that reflect specific attributes of training data presents notable challenges, yet remains underexplored despite its practical importance. Meanwhile, recent work…

Computer Vision and Pattern Recognition · Computer Science 2025-06-26 Sungwon Hwang , Hyojin Jang , Kinam Kim , Minho Park , Jaegul Choo
‹ Prev 1 2 3 10 Next ›