English
Related papers

Related papers: Exploring Multimodal Diffusion Transformers for En…

200 papers

While the diffusion transformer (DiT) has become a focal point of interest in recent years, its application in low-light image enhancement remains a blank area for exploration. Current methods recover the details from low-light images while…

Computer Vision and Pattern Recognition · Computer Science 2026-01-14 Xiangchen Yin , Zhenda Yu , Longtao Jiang , Xin Gao , Xiao Sun , Zhi Liu , Xun Yang

Diffusion Transformers (DiTs) have recently achieved remarkable success in text-guided image generation. In image editing, DiTs project text and image inputs to a joint latent space, from which they decode and synthesize new images.…

Computer Vision and Pattern Recognition · Computer Science 2024-11-14 Zitao Shuai , Chenwei Wu , Zhengxu Tang , Bowen Song , Liyue Shen

We present a novel method for 3D scene editing using diffusion models, designed to ensure view consistency and realism across perspectives. Our approach leverages attention features extracted from a single reference image to define the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 Eyal Gomel , Lior Wolf

Despite its success in image synthesis, we observe that diffusion probabilistic models (DPMs) often lack contextual reasoning ability to learn the relations among object parts in an image, leading to a slow learning process. To solve this…

Computer Vision and Pattern Recognition · Computer Science 2024-02-22 Shanghua Gao , Pan Zhou , Ming-Ming Cheng , Shuicheng Yan

Diffusion models, such as Stable Diffusion, have shown incredible performance on text-to-image generation. Since text-to-image generation often requires models to generate visual concepts with fine-grained details and attributes specified…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Xuehai He , Weixi Feng , Tsu-Jui Fu , Varun Jampani , Arjun Akula , Pradyumna Narayana , Sugato Basu , William Yang Wang , Xin Eric Wang

Diffusion Transformers (DiTs) have significantly enhanced text-to-image (T2I) generation quality, enabling high-quality personalized content creation. However, fine-tuning these models requires substantial computational complexity and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Sunghyun Park , Jeongho Kim , Hyoungwoo Park , Debasmit Das , Sungrack Yun , Munawar Hayat , Jaegul Choo , Fatih Porikli , Seokeon Choi

Recent interactive matting methods have shown satisfactory performance in capturing the primary regions of objects, but they fall short in extracting fine-grained details in edge regions. Diffusion models trained on billions of image-text…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Longfei Huang , Yu Liang , Hao Zhang , Jinwei Chen , Wei Dong , Lunde Chen , Wanyu Liu , Bo Li , Peng-Tao Jiang

Diffusion models have been widely deployed in various image generation tasks, demonstrating an extraordinary connection between image and text modalities. Although prior studies have explored the vulnerability of diffusion models from the…

Machine Learning · Computer Science 2025-01-06 Dingcheng Yang , Yang Bai , Xiaojun Jia , Yang Liu , Xiaochun Cao , Wenjian Yu

Diffusion Transformers (DiT) have emerged as a powerful architecture for image and video generation, offering superior quality and scalability. However, their practical application suffers from inherent dynamic feature instability, leading…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Guanjie Chen , Xinyu Zhao , Yucheng Zhou , Xiaoye Qu , Tianlong Chen , Yu Cheng

Diffusion models have become a leading approach for high-fidelity medical image synthesis. However, most existing methods for 3D medical image generation rely on convolutional U-Net backbones within latent diffusion frameworks. While…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Marvin Seyfarth , Salman Ul Hassan Dar , Yannik Frisch , Philipp Wild , Norbert Frey , Florian André , Sandy Engelhardt

While recent Multimodal Large Language Models (MLLMs) have attained significant strides in multimodal reasoning, their reasoning processes remain predominantly text-centric, leading to suboptimal performance in complex long-horizon,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-01 Zefeng He , Xiaoye Qu , Yafu Li , Tong Zhu , Siyuan Huang , Yu Cheng

Virtual try-on methods based on diffusion models achieve realistic try-on effects. They use an extra reference network or an additional image encoder to process multiple conditional image inputs, which adds complexity pre-processing and…

Computer Vision and Pattern Recognition · Computer Science 2025-01-13 Junsheng Luan , Guangyuan Li , Lei Zhao , Wei Xing

Recent advancements in diffusion models have showcased their impressive capacity to generate visually striking images. Nevertheless, ensuring a close match between the generated image and the given prompt remains a persistent challenge. In…

Computer Vision and Pattern Recognition · Computer Science 2023-09-11 Yupeng Zhou , Daquan Zhou , Zuo-Liang Zhu , Yaxing Wang , Qibin Hou , Jiashi Feng

Visual prompt, a pair of before-and-after edited images, can convey indescribable imagery transformations and prosper in image editing. However, current visual prompt methods rely on a pretrained text-guided image-to-image generative model…

Computer Vision and Pattern Recognition · Computer Science 2025-01-28 Pengcheng Xu , Qingnan Fan , Fei Kou , Shuai Qin , Hong Gu , Ruoyu Zhao , Charles Ling , Boyu Wang

Large-scale Text-to-Image (T2I) diffusion models demonstrate significant generation capabilities based on textual prompts. Based on the T2I diffusion models, text-guided image editing research aims to empower users to manipulate generated…

Computer Vision and Pattern Recognition · Computer Science 2024-05-03 Chuanming Tang , Kai Wang , Fei Yang , Joost van de Weijer

Large text-to-image diffusion models have achieved remarkable success in generating diverse, high-quality images. Additionally, these models have been successfully leveraged to edit input images by just changing the text prompt. But when…

Computer Vision and Pattern Recognition · Computer Science 2023-08-11 Anant Khandelwal

Diffusion-based methods demonstrate significant potential for remote sensing image super-resolution at large scaling factors, particularly in reference-based super-resolution (RefSR) where high-resolution reference images provide critical…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Bin Luo , Runmin Dong , Zhaoyang Luo , Jinxiao Zhang , Jiyao Zhao , Fan Wei , Haohuan Fu

The diffusion transformer (DiT) architecture has attracted significant attention in image generation, achieving better fidelity, performance, and diversity. However, most existing DiT - based image generation methods focus on global - aware…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Zhen Xiong , Yuqi Li , Chuanguang Yang , Tiao Tan , Zhihong Zhu , Siyuan Li , Yue Ma

Diffusion Transformers (DiTs) introduce the transformer architecture to diffusion tasks for latent-space image generation. With an isotropic architecture that chains a series of transformer blocks, DiTs demonstrate competitive performance…

Computer Vision and Pattern Recognition · Computer Science 2024-10-31 Yuchuan Tian , Zhijun Tu , Hanting Chen , Jie Hu , Chao Xu , Yunhe Wang

Since their introduction the Trasformer architectures emerged as the dominating architectures for both natural language processing and, more recently, computer vision applications. An intrinsic limitation of this family of "fully-attentive"…

Machine Learning · Computer Science 2023-03-16 Carmelo Scribano , Giorgia Franchini , Marco Prato , Marko Bertogna