中文
相关论文

相关论文: MaterialPicker: Multi-Modal DiT-Based Material Gen…

200 篇论文

In this work, we rethink the approach to video super-resolution by introducing a method based on the Diffusion Posterior Sampling framework, combined with an unconditional video diffusion transformer operating in latent space. The video…

计算机视觉与模式识别 · 计算机科学 2025-11-05 Zhihao Zhan , Wang Pang , Xiang Zhu , Yechao Bai

Previously, non-autoregressive models were widely perceived as being superior in generation efficiency but inferior in generation quality due to the difficulties of modeling multiple target modalities. To enhance the multi-modality modeling…

计算与语言 · 计算机科学 2023-11-30 Lihua Qian , Mingxuan Wang , Yang Liu , Hao Zhou

Recent developments in large-scale pre-trained text-to-image diffusion models have significantly improved the generation of high-fidelity images, particularly with the emergence of diffusion transformer models (DiTs). Among diffusion…

计算机视觉与模式识别 · 计算机科学 2025-04-08 Xudong Lu , Aojun Zhou , Ziyi Lin , Qi Liu , Yuhui Xu , Renrui Zhang , Xue Yang , Junchi Yan , Peng Gao , Hongsheng Li

Complex vector modes have become topical of late due to their fascinating properties and the many applications they have found across a broad variety of research fields. Even though such modes can be generated in a wide variety of ways,…

光学 · 物理学 2021-05-26 Xiao-Bo Hu , Si-Yuan Ma , Carmelo Rosales-Guzmán

Recently, diffusion-based image generation methods are credited for their remarkable text-to-image generation capabilities, while still facing challenges in accurately generating multilingual scene text images. To tackle this problem, we…

计算机视觉与模式识别 · 计算机科学 2023-12-20 Lingjun Zhang , Xinyuan Chen , Yaohui Wang , Yue Lu , Yu Qiao

Diffusion models have emerged as a dominant paradigm for generative modeling across a wide range of domains, including prompt-conditional generation. The vast majority of samplers, however, rely on forward discretization of the reverse…

计算机视觉与模式识别 · 计算机科学 2025-12-01 Zhenghan Fang , Jian Zheng , Qiaozi Gao , Xiaofeng Gao , Jeremias Sulam

Generating cognitive-aligned layered SVGs remains challenging due to existing methods' tendencies toward either oversimplified single-layer outputs or optimization-induced shape redundancies. We propose LayerTracer, a diffusion transformer…

计算机视觉与模式识别 · 计算机科学 2025-08-14 Yiren Song , Danze Chen , Mike Zheng Shou

Diffusion models enable high-quality and diverse visual content synthesis. However, they struggle to generate rare or unseen concepts. To address this challenge, we explore the usage of Retrieval-Augmented Generation (RAG) with image…

计算机视觉与模式识别 · 计算机科学 2026-02-10 Rotem Shalev-Arkushin , Rinon Gal , Amit H. Bermano , Ohad Fried

Text-to-image models give rise to workflows which often begin with an exploration step, where users sift through a large collection of generated images. The global nature of the text-to-image generation process prevents users from narrowing…

计算机视觉与模式识别 · 计算机科学 2023-08-15 Or Patashnik , Daniel Garibi , Idan Azuri , Hadar Averbuch-Elor , Daniel Cohen-Or

Text-to-image (T2I) generative models such as Stable Diffusion and FLUX can synthesize realistic, high-quality images directly from textual prompts. The resulting image quality depends critically on well-crafted prompts that specify both…

计算机视觉与模式识别 · 计算机科学 2025-12-01 Mingzhe Li , Renhao Zhang , Zhiyang Wen , Siqi Pan , Bruno Castro da Silva , Juan Zhai , Shiqing Ma

We present DiffCollage, a compositional diffusion model that can generate large content by leveraging diffusion models trained on generating pieces of the large content. Our approach is based on a factor graph representation where each…

计算机视觉与模式识别 · 计算机科学 2023-03-31 Qinsheng Zhang , Jiaming Song , Xun Huang , Yongxin Chen , Ming-Yu Liu

Diffusion Transformers (DiTs) have emerged as a leading architecture for text-to-image synthesis, producing high-quality and photorealistic images. However, the quadratic scaling properties of the attention in DiTs hinder image generation…

计算机视觉与模式识别 · 计算机科学 2025-08-12 Philipp Becker , Abhinav Mehrotra , Ruchika Chavhan , Malcolm Chadwick , Luca Morreale , Mehdi Noroozi , Alberto Gil Ramos , Sourav Bhattacharya

High-fidelity video generation remains challenging for diffusion models due to the difficulty of modeling complex spatio-temporal dynamics efficiently. Recent video diffusion methods typically represent a video as a sequence of…

计算机视觉与模式识别 · 计算机科学 2026-04-21 Minh Khoa Le , Kien Do , Duc Thanh Nguyen , Truyen Tran

Generating photos satisfying multiple constraints find broad utility in the content creation industry. A key hurdle to accomplishing this task is the need for paired data consisting of all modalities (i.e., constraints) and their…

计算机视觉与模式识别 · 计算机科学 2023-04-21 Nithin Gopalakrishnan Nair , Wele Gedara Chaminda Bandara , Vishal M. Patel

Recent progresses in large-scale text-to-image models have yielded remarkable accomplishments, finding various applications in art domain. However, expressing unique characteristics of an artwork (e.g. brushwork, colortone, or composition)…

计算机视觉与模式识别 · 计算机科学 2023-12-19 Namhyuk Ahn , Junsoo Lee , Chunggi Lee , Kunhee Kim , Daesik Kim , Seung-Hun Nam , Kibeom Hong

We propose an approach to 3D reconstruction via inverse procedural modeling and investigate two variants of this approach. The first option consists in the fitting set of input parameters using a genetic algorithm. We demonstrate the…

图形学 · 计算机科学 2023-10-23 Albert Garifullin , Nikolay Maiorov , Vladimir Frolov

Have you ever thought that you can be an intelligent painter? This means that you can paint a picture with a few expected objects in mind, or with a desirable scene. This is different from normal inpainting approaches for which the location…

计算机视觉与模式识别 · 计算机科学 2023-07-06 Wing-Fung Ku , Wan-Chi Siu , Xi Cheng , H. Anthony Chan

The recent advancements in Generative AI have significantly advanced the field of text-to-image generation. The state-of-the-art text-to-image model, Stable Diffusion, is now capable of synthesizing high-quality images with a strong sense…

人机交互 · 计算机科学 2024-03-08 Zhijie Wang , Yuheng Huang , Da Song , Lei Ma , Tianyi Zhang

The inverse design of metasurfaces faces inherent challenges due to the nonlinear and highly complex relationship between geometric configurations and their electromagnetic behavior. Traditional optimization approaches often suffer from…

Text-to-image diffusion models have recently attracted the interest of many researchers, and inverting the diffusion process can play an important role in better understanding the generative process and how to engineer prompts in order to…

计算机视觉与模式识别 · 计算机科学 2024-10-22 Florinel-Alin Croitoru , Vlad Hondru , Radu Tudor Ionescu , Mubarak Shah