中文
相关论文

相关论文: Exploring Multimodal Diffusion Transformers for En…

200 篇论文

Representing the cutting-edge technique of text-to-image models, the latest Multimodal Diffusion Transformer (MMDiT) largely mitigates many generation issues existing in previous models. However, we discover that it still suffers from…

计算机视觉与模式识别 · 计算机科学 2024-11-28 Tianyi Wei , Dongdong Chen , Yifan Zhou , Xingang Pan

Diffusion-based text-to-image models have rapidly gained popularity for their ability to generate detailed and realistic images from textual descriptions. However, these models often reflect the biases present in their training data,…

计算机视觉与模式识别 · 计算机科学 2024-04-01 Hidir Yesiltepe , Kiymet Akdemir , Pinar Yanardag

Transformer architectures, particularly Diffusion Transformers (DiTs), have become widely used in diffusion and flow-matching models due to their strong performance compared to convolutional UNets. However, the isotropic design of DiTs…

计算机视觉与模式识别 · 计算机科学 2026-04-07 Quan Dao , Dimitris Metaxas

Image generation and editing have seen a great deal of advancements with the rise of large-scale diffusion models that allow user control of different modalities such as text, mask, depth maps, etc. However, controlled editing of videos…

计算机视觉与模式识别 · 计算机科学 2024-06-04 AmirHossein Zamani , Amir G. Aghdam , Tiberiu Popa , Eugene Belilovsky

Fashion illustration is a crucial medium for designers to convey their creative vision and transform design concepts into tangible representations that showcase the interplay between clothing and the human body. In the context of fashion…

计算机视觉与模式识别 · 计算机科学 2024-03-26 Alberto Baldrati , Davide Morelli , Marcella Cornia , Marco Bertini , Rita Cucchiara

Recent advances in diffusion transformers (DiTs) have set new standards in image generation, yet remain impractical for on-device deployment due to their high computational and memory costs. In this work, we present an efficient DiT…

Recent advances in tuning-free personalized image generation based on diffusion models are impressive. However, to improve subject fidelity, existing methods either retrain the diffusion model or infuse it with dense visual embeddings, both…

计算机视觉与模式识别 · 计算机科学 2024-03-25 Zhichao Wei , Qingkun Su , Long Qin , Weizhi Wang

Diffusion models have opened the path to a wide range of text-based image editing frameworks. However, these typically build on the multi-step nature of the diffusion backwards process, and adapting them to distilled, fast-sampling methods…

计算机视觉与模式识别 · 计算机科学 2024-08-02 Gilad Deutch , Rinon Gal , Daniel Garibi , Or Patashnik , Daniel Cohen-Or

Unified generation models aim to handle diverse tasks across modalities -- such as text generation, image generation, and vision-language reasoning -- within a single architecture and decoding paradigm. Autoregressive unified models suffer…

Rectified flow (RF) models have recently demonstrated superior generative performance compared to DDIM-based diffusion models. However, in real-world applications, they suffer from two major challenges: (1) low inversion accuracy that…

计算机视觉与模式识别 · 计算机科学 2025-09-17 Weiming Chen , Zhihan Zhu , Yijia Wang , Zhihai He

Diffusion models (DMs) have gained prominence due to their ability to generate high-quality varied images with recent advancements in text-to-image generation. The research focus is now shifting towards the controllability of DMs. A…

计算机视觉与模式识别 · 计算机科学 2024-12-06 Enis Simsar , Alessio Tonioni , Yongqin Xian , Thomas Hofmann , Federico Tombari

Diffusion Transformers (DiT) excel at image and video generation but face computational challenges due to the quadratic complexity of self-attention operators. We propose DiTFastAttn, a post-training compression method to alleviate the…

计算机视觉与模式识别 · 计算机科学 2024-10-21 Zhihang Yuan , Hanling Zhang , Pu Lu , Xuefei Ning , Linfeng Zhang , Tianchen Zhao , Shengen Yan , Guohao Dai , Yu Wang

Despite the rapid advancement of Virtual Try-On (VTON) and Try-Off (VTOFF) technologies, existing VTON methods face challenges with fine-grained detail preservation, generalization to complex scenes, complicated pipeline, and efficient…

计算机视觉与模式识别 · 计算机科学 2026-03-25 Weixuan Zeng , Pengcheng Wei , Huaiqing Wang , Boheng Zhang , Jia Sun , Dewen Fan , Lin HE , Long Chen , Qianqian Gan , Fan Yang , Tingting Gao

Transformer-based video diffusion models (VDMs) deliver state-of-the-art video generation quality but are constrained by the quadratic cost of self-attention, making long sequences and high resolutions computationally expensive. While…

计算机视觉与模式识别 · 计算机科学 2025-11-18 Mohsen Ghafoorian , Denis Korzhenkov , Amirhossein Habibian

Utilizing pre-trained Text-to-Image (T2I) diffusion models to guide Blind Super-Resolution (BSR) has become a predominant approach in the field. While T2I models have traditionally relied on U-Net architectures, recent advancements have…

计算机视觉与模式识别 · 计算机科学 2026-05-12 Haizhen Xie , Kunpeng Du , Qiangyu Yan , Sen Lu , Jianhong Han , Hanting Chen , Hailin Hu , Jie Hu

Recent advances in image editing have shifted from manual pixel manipulation to employing deep learning methods like stable diffusion models, which now leverage cross-attention mechanisms for text-driven control. This transition has…

计算机视觉与模式识别 · 计算机科学 2025-10-07 Linn Bieske , Carla Lorente

Diffusion transformer-based video generation models (DiTs) have recently attracted widespread attention for their excellent generation quality. However, their computational cost remains a major bottleneck-attention alone accounts for over…

计算机视觉与模式识别 · 计算机科学 2025-05-22 Xuan Shen , Chenxia Han , Yufa Zhou , Yanyue Xie , Yifan Gong , Quanyi Wang , Yiwei Wang , Yanzhi Wang , Pu Zhao , Jiuxiang Gu

The reliance on implicit point matching via attention has become a core bottleneck in drag-based editing, resulting in a fundamental compromise on weakened inversion strength and costly test-time optimization (TTO). This compromise severely…

计算机视觉与模式识别 · 计算机科学 2026-02-04 Zixin Yin , Xili Dai , Duomin Wang , Xianfang Zeng , Lionel M. Ni , Gang Yu , Heung-Yeung Shum

While generative modeling on time series facilitates more capable and flexible probabilistic forecasting, existing generative time series models do not address the multi-dimensional properties of time series data well. The prevalent…

机器学习 · 计算机科学 2026-02-09 Haoran Zhang , Haixuan Liu , Yong Liu , Yunzhong Qiu , Yuxuan Wang , Jianmin Wang , Mingsheng Long

This paper presents innovative enhancements to diffusion models by integrating a novel multi-resolution network and time-dependent layer normalization. Diffusion models have gained prominence for their effectiveness in high-fidelity image…

计算机视觉与模式识别 · 计算机科学 2024-12-02 Qihao Liu , Zhanpeng Zeng , Ju He , Qihang Yu , Xiaohui Shen , Liang-Chieh Chen