中文
相关论文

相关论文: Zero-Shot Subject-Centric Generation for Creative …

200 篇论文

The rapid development of the Internet has profoundly changed human life. Humans are increasingly expressing themselves and interacting with others on social media platforms. However, although artificial intelligence technology has been…

计算与语言 · 计算机科学 2024-07-11 Haochen Xue , Chong Zhang , Chengzhi Liu , Fangyu Wu , Xiaobo Jin

Visual question answering requires a deep understanding of both images and natural language. However, most methods mainly focus on visual concept; such as the relationships between various objects. The limited use of object categories…

计算机视觉与模式识别 · 计算机科学 2021-01-25 Jung-Jun Kim , Dong-Gyu Lee , Jialin Wu , Hong-Gyu Jung , Seong-Whan Lee

This paper examines the limitations of advanced text-to-image models in accurately rendering unconventional concepts which are scarcely represented or absent in their training datasets. We identify how these limitations not only confine the…

计算机视觉与模式识别 · 计算机科学 2024-05-31 Jiyoon Myung , Jihyeon Park

We introduce a method for composing object-level visual prompts within a text-to-image diffusion model. Our approach addresses the task of generating semantically coherent compositions across diverse scenes and styles, similar to the…

计算机视觉与模式识别 · 计算机科学 2025-01-03 Gaurav Parmar , Or Patashnik , Kuan-Chieh Wang , Daniil Ostashev , Srinivasa Narasimhan , Jun-Yan Zhu , Daniel Cohen-Or , Kfir Aberman

Recent remarkable improvements in large-scale text-to-image generative models have shown promising results in generating high-fidelity images. To further enhance editability and enable fine-grained generation, we introduce a…

计算机视觉与模式识别 · 计算机科学 2023-04-20 Kangyeol Kim , Sunghyun Park , Junsoo Lee , Jaegul Choo

Text-driven video generation witnesses rapid progress. However, merely using text prompts is not enough to depict the desired subject appearance that accurately aligns with users' intents, especially for customized content creation. In this…

计算机视觉与模式识别 · 计算机科学 2023-12-04 Yuming Jiang , Tianxing Wu , Shuai Yang , Chenyang Si , Dahua Lin , Yu Qiao , Chen Change Loy , Ziwei Liu

We present evaluation results for FLUX.1 Kontext, a generative flow matching model that unifies image generation and editing. The model generates novel output views by incorporating semantic context from text and image inputs. Using a…

Diffusion and flow matching models have unlocked unprecedented capabilities for creative content creation, such as interactive image and streaming video generation. The growing demand for higher resolutions, frame rates, and context…

计算机视觉与模式识别 · 计算机科学 2026-03-25 Brian Chao , Lior Yariv , Howard Xiao , Gordon Wetzstein

Recent text-to-image models have achieved impressive results in generating high-quality images. However, when tasked with multi-concept generation creating images that contain multiple characters or objects, existing methods often suffer…

计算机视觉与模式识别 · 计算机科学 2025-03-04 Yang Zhang , Rui Zhang , Xuecheng Nie , Haochen Li , Jikun Chen , Yifan Hao , Xin Zhang , Luoqi Liu , Ling Li

A picture is worth a thousand words, thus, it is crucial for conversational agents to understand, perceive, and effectively respond with pictures. However, we find that directly employing conventional image generation techniques is…

计算与语言 · 计算机科学 2024-02-09 Xiaowen Sun , Jiazhan Feng , Yuxuan Wang , Yuxuan Lai , Xingyu Shen , Dongyan Zhao

Recent approaches have achieved great success in image generation from structured inputs, e.g., semantic segmentation, scene graph or layout. Although these methods allow specification of objects and their locations at image-level, they…

计算机视觉与模式识别 · 计算机科学 2020-08-28 Ke Ma , Bo Zhao , Leonid Sigal

Despite the unprecedented success of text-to-image diffusion models, controlling the number of depicted objects using text is surprisingly hard. This is important for various applications from technical documents, to children's books to…

计算机视觉与模式识别 · 计算机科学 2024-06-17 Lital Binyamin , Yoad Tewel , Hilit Segev , Eran Hirsch , Royi Rassin , Gal Chechik

We present a novel approach to data-to-text generation based on iterative text editing. Our approach maximizes the completeness and semantic accuracy of the output text while leveraging the abilities of recent pre-trained models for text…

计算与语言 · 计算机科学 2021-01-29 Zdeněk Kasner , Ondřej Dušek

Recent deep image-to-image translation techniques allow fast generation of face images from freehand sketches. However, existing solutions tend to overfit to sketches, thus requiring professional sketches or even edge maps as input. To…

图形学 · 计算机科学 2020-06-09 Shu-Yu Chen , Wanchao Su , Lin Gao , Shihong Xia , Hongbo Fu

Current text-to-image diffusion models excel at generating diverse, high-quality images, yet they struggle to incorporate fine-grained camera metadata such as precise aperture settings. In this work, we introduce a novel text-to-image…

计算机视觉与模式识别 · 计算机科学 2025-12-15 Ayush Shrivastava , Connelly Barnes , Xuaner Zhang , Lingzhi Zhang , Andrew Owens , Sohrab Amirghodsi , Eli Shechtman

This paper proposes a method for generating images of customized objects specified by users. The method is based on a general framework that bypasses the lengthy optimization required by previous approaches, which often employ a per-object…

计算机视觉与模式识别 · 计算机科学 2023-04-06 Xuhui Jia , Yang Zhao , Kelvin C. K. Chan , Yandong Li , Han Zhang , Boqing Gong , Tingbo Hou , Huisheng Wang , Yu-Chuan Su

Recent text-to-image diffusion models can generate striking visuals from text prompts, but they often fail to maintain subject consistency across generations and contexts. One major limitation of current fine-tuning approaches is the…

计算机视觉与模式识别 · 计算机科学 2025-09-23 Gordon Chen , Ziqi Huang , Cheston Tan , Ziwei Liu

Generative depth estimation methods leverage the rich visual priors stored in pre-trained text-to-image diffusion models, demonstrating astonishing zero-shot capability. However, parameter updates during training lead to catastrophic…

计算机视觉与模式识别 · 计算机科学 2025-10-28 Hongkai Lin , Dingkang Liang , Mingyang Du , Xin Zhou , Xiang Bai

Recent advancements in diffusion models have notably improved the perceptual quality of generated images in text-to-image synthesis tasks. However, diffusion models often struggle to produce images that accurately reflect the intended…

计算机视觉与模式识别 · 计算机科学 2024-03-12 Yang Zhang , Teoh Tze Tzun , Lim Wei Hern , Tiviatis Sim , Kenji Kawaguchi

The growing demand for text-to-image generation has led to rapid advances in generative modeling. Recently, text-to-image diffusion models trained with flow matching algorithms, such as FLUX, have achieved remarkable progress and emerged as…

计算机视觉与模式识别 · 计算机科学 2026-04-28 Zikai Zhou , Muyao Wang , Shitong Shao , Lichen Bai , Haoyi Xiong , Bo Han , Zeke Xie