中文
相关论文

相关论文: Typographic Text Generation with Off-the-Shelf Dif…

200 篇论文

Diffusion models have emerged as powerful tools for high-quality image generation and editing, but guiding these models to produce specific outputs remains a challenge. Conventional approaches rely on conditioning mechanisms, such as text…

计算机视觉与模式识别 · 计算机科学 2026-05-27 Nithesh Chandher Karthikeyan , Jonas Unger , Gabriel Eilertsen

This survey reviews the progress of diffusion models in generating images from text, ~\textit{i.e.} text-to-image diffusion models. As a self-contained work, this survey starts with a brief introduction of how diffusion models work for…

计算机视觉与模式识别 · 计算机科学 2024-11-11 Chenshuang Zhang , Chaoning Zhang , Mengchun Zhang , In So Kweon , Junmo Kim

Fonts are integral to creative endeavors, design processes, and artistic productions. The appropriate selection of a font can significantly enhance artwork and endow advertisements with a higher level of expressivity. Despite the…

计算机视觉与模式识别 · 计算机科学 2024-08-15 Lei Kang , Fei Yang , Kai Wang , Mohamed Ali Souibgui , Lluis Gomez , Alicia Fornés , Ernest Valveny , Dimosthenis Karatzas

With the rising industrial attention to 3D virtual modeling technology, generating novel 3D content based on specified conditions (e.g. text) has become a hot issue. In this paper, we propose a new generative 3D modeling framework called…

计算机视觉与模式识别 · 计算机科学 2023-05-09 Muheng Li , Yueqi Duan , Jie Zhou , Jiwen Lu

Diffusion models, such as Stable Diffusion, have shown incredible performance on text-to-image generation. Since text-to-image generation often requires models to generate visual concepts with fine-grained details and attributes specified…

计算机视觉与模式识别 · 计算机科学 2024-04-26 Xuehai He , Weixi Feng , Tsu-Jui Fu , Varun Jampani , Arjun Akula , Pradyumna Narayana , Sugato Basu , William Yang Wang , Xin Eric Wang

Image composition targets at synthesizing a realistic composite image from a pair of foreground and background images. Recently, generative composition methods are built on large pretrained diffusion models to generate composite images,…

计算机视觉与模式识别 · 计算机科学 2023-08-22 Bo Zhang , Yuxuan Duan , Jun Lan , Yan Hong , Huijia Zhu , Weiqiang Wang , Li Niu

Recent text-to-image diffusion models are able to generate convincing results of unprecedented quality. However, it is nearly impossible to control the shapes of different regions/objects or their layout in a fine-grained fashion. Previous…

计算机视觉与模式识别 · 计算机科学 2023-09-06 Omri Avrahami , Thomas Hayes , Oran Gafni , Sonal Gupta , Yaniv Taigman , Devi Parikh , Dani Lischinski , Ohad Fried , Xi Yin

Automated creation of synthetic traffic scenarios is a key part of validating the safety of autonomous vehicles (AVs). In this paper, we propose Scenario Diffusion, a novel diffusion-based architecture for generating traffic scenarios that…

Generating sewing patterns in garment design is receiving increasing attention due to its CG-friendly and flexible-editing nature. Previous sewing pattern generation methods have been able to produce exquisite clothing, but struggle to…

计算机视觉与模式识别 · 计算机科学 2025-07-08 Shengqi Liu , Yuhao Cheng , Zhuo Chen , Xingyu Ren , Wenhan Zhu , Lincheng Li , Mengxiao Bi , Xiaokang Yang , Yichao Yan

Graph generation has emerged as a crucial task in machine learning, with significant challenges in generating graphs that accurately reflect specific properties. Existing methods often fall short in efficiently addressing this need as they…

Text-conditioned image generation models are a prevalent use of AI image synthesis, yet intuitively controlling output guided by an artist remains challenging. Current methods require multiple images and textual prompts for each object to…

计算机视觉与模式识别 · 计算机科学 2024-01-02 Shounak Chatterjee

Text-to-Image diffusion models have made tremendous progress over the past two years, enabling the generation of highly realistic images based on open-domain text descriptions. However, despite their success, text descriptions often…

计算机视觉与模式识别 · 计算机科学 2023-10-31 Shihao Zhao , Dongdong Chen , Yen-Chun Chen , Jianmin Bao , Shaozhe Hao , Lu Yuan , Kwan-Yee K. Wong

Recently, there has been an increasing interest in developing diffusion-based text-to-image generative models capable of generating coherent and well-formed visual text. In this paper, we propose a novel and efficient approach called…

计算机视觉与模式识别 · 计算机科学 2023-11-14 Yukang Yang , Dongnan Gui , Yuhui Yuan , Weicong Liang , Haisong Ding , Han Hu , Kai Chen

Controlled generation refers to the problem of creating text that contains stylistic or semantic attributes of interest. Many approaches reduce this problem to training a predictor of the desired attribute. For example, researchers hoping…

计算与语言 · 计算机科学 2023-06-02 Carolina Zheng , Claudia Shi , Keyon Vafa , Amir Feder , David M. Blei

Currently, personalized image generation methods mostly require considerable time to finetune and often overfit the concept resulting in generated images that are similar to custom concepts but difficult to edit by prompts. We propose an…

计算机视觉与模式识别 · 计算机科学 2024-03-19 Yuxuan Zhang , Yiren Song , Jinpeng Yu , Han Pan , Zhongliang Jing

Recent advancements in layout pattern generation have been dominated by deep generative models. However, relying solely on neural networks for legality guarantees raises concerns in many practical applications. In this paper, we present…

机器学习 · 计算机科学 2025-05-09 Zixiao Wang , Wenqian Zhao , Yunheng Shen , Yang Bai , Guojin Chen , Farzan Farnia , Bei Yu

The problem of text-guided image generation is a complex task in Computer Vision, with various applications, including creating visually appealing artwork and realistic product images. One popular solution widely used for this task is the…

计算机视觉与模式识别 · 计算机科学 2023-04-04 Halil Faruk Karagoz , Gulcin Baykal , Irem Arikan Eksi , Gozde Unal

Existing text-to-image diffusion models struggle to synthesize realistic images given dense captions, where each text prompt provides a detailed description for a specific image region. To address this, we propose DenseDiffusion, a…

计算机视觉与模式识别 · 计算机科学 2023-08-25 Yunji Kim , Jiyoung Lee , Jin-Hwa Kim , Jung-Woo Ha , Jun-Yan Zhu

Paraphrase generation strives to generate high-quality and diverse expressions of a given text, a domain where diffusion models excel. Though SOTA diffusion generation reconciles generation quality and diversity, textual diffusion suffers…

计算与语言 · 计算机科学 2025-01-20 Wei Zou , Ziyuan Zhuang , Xiang Geng , Shujian Huang , Jia Liu , Jiajun Chen

Diffusion models trained on large-scale text-image datasets have demonstrated a strong capability of controllable high-quality image generation from arbitrary text prompts. However, the generation quality and generalization ability of 3D…

计算机视觉与模式识别 · 计算机科学 2024-04-23 Ying-Tian Liu , Yuan-Chen Guo , Guan Luo , Heyi Sun , Wei Yin , Song-Hai Zhang