English
Related papers

Related papers: Cones 2: Customizable Image Synthesis with Multipl…

200 papers

In subject-driven text-to-image synthesis, the synthesis process tends to be heavily influenced by the reference images provided by users, often overlooking crucial attributes detailed in the text prompt. In this work, we propose…

Computer Vision and Pattern Recognition · Computer Science 2024-05-03 Kelvin C. K. Chan , Yang Zhao , Xuhui Jia , Ming-Hsuan Yang , Huisheng Wang

Recent advances in text-to-image (T2I) generation have enabled visually coherent image synthesis from descriptions, but generating images containing multiple given subjects remains challenging. As the number of reference identities…

Machine Learning · Computer Science 2026-04-10 Yucheng Zhou , Dubing Chen , Huan Zheng , Jianbing Shen

Subject-driven image generation aims at generating images containing customized subjects, which has recently drawn enormous attention from the research community. However, the previous works cannot precisely control the background and…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Tianle Li , Max Ku , Cong Wei , Wenhu Chen

Given a text and an image of a specific subject, text-to-image customization aims to generate new images that align with both the text and the subject's appearance. Existing works follow the pseudo-word paradigm, which represents the…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Zhendong Mao , Mengqi Huang , Fei Ding , Mingcong Liu , Qian He , Yongdong Zhang

Personalized text-to-image generation has attracted unprecedented attention in the recent few years due to its unique capability of generating highly-personalized images via using the input concept dataset and novel textual prompt. However,…

Artificial Intelligence · Computer Science 2024-07-02 Shian Du , Xiaotian Cheng , Qi Qian , Henglu Wei , Yi Xu , Xiangyang Ji

Generating customized content in videos has received increasing attention recently. However, existing works primarily focus on customized text-to-video generation for single subject, suffering from subject-missing and attribute-binding…

Computer Vision and Pattern Recognition · Computer Science 2024-05-22 Hong Chen , Xin Wang , Yipeng Zhang , Yuwei Zhou , Zeyang Zhang , Siao Tang , Wenwu Zhu

Diffusion-based text-to-image generation has advanced significantly, yet customizing scenes with multiple distinct subjects while maintaining fine-grained control over their interactions remains challenging. Existing methods often struggle…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Pengxiang Cai , Mengyang Li

Generating high-fidelity images of humans with fine-grained control over attributes such as hairstyle and clothing remains a core challenge in personalized text-to-image synthesis. While prior methods emphasize identity preservation from a…

Computer Vision and Pattern Recognition · Computer Science 2025-10-17 Guocheng Gordon Qian , Daniil Ostashev , Egor Nemchinov , Avihay Assouline , Sergey Tulyakov , Kuan-Chieh Jackson Wang , Kfir Aberman

Conditional image synthesis from layout has recently attracted much interest. Previous approaches condition the generator on object locations as well as class labels but lack fine-grained control over the diverse appearance aspects of…

Computer Vision and Pattern Recognition · Computer Science 2021-08-27 Stanislav Frolov , Avneesh Sharma , Jörn Hees , Tushar Karayil , Federico Raue , Andreas Dengel

Large-scale text-to-image diffusion models have achieved great success in synthesizing high-quality and diverse images given target text prompts. Despite the revolutionary image generation ability, current state-of-the-art models still…

Computer Vision and Pattern Recognition · Computer Science 2025-01-20 Jingyuan Zhu , Huimin Ma , Jiansheng Chen , Jian Yuan

Text-to-image diffusion models have shown remarkable success in generating personalized subjects based on a few reference images. However, current methods often fail when generating multiple subjects simultaneously, resulting in mixed…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Sangwon Jang , Jaehyeong Jo , Kimin Lee , Sung Ju Hwang

Despite recent advancements, the field of text-to-image synthesis still suffers from lack of fine-grained control. Using only text, it remains challenging to deal with issues such as concept coherence and concept contamination. We propose a…

Computer Vision and Pattern Recognition · Computer Science 2023-03-10 Rodrigo Mello , Filipe Calegario , Geber Ramalho

Subject-driven text-to-image diffusion models empower users to tailor the model to new concepts absent in the pre-training dataset using a few sample images. However, prevalent subject-driven models primarily rely on single-concept input…

Computer Vision and Pattern Recognition · Computer Science 2024-02-16 Junjie Shentu , Matthew Watson , Noura Al Moubayed

Despite significant progress, controlled generation of complex images with interacting people remains difficult. Existing layout generation methods fall short of synthesizing realistic person instances; while pose-guided generation…

Computer Vision and Pattern Recognition · Computer Science 2020-08-31 Weidong Yin , Ziwei Liu , Leonid Sigal

Existing generative approaches for guided image synthesis of multi-object scenes typically rely on 2D controls in the image or text space. As a result, these methods struggle to maintain and respect consistent three-dimensional geometric…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Léopold Maillard , Tom Durand , Adrien Ramanana Rahary , Maks Ovsjanikov

Recent large-scale text-driven synthesis models have attracted much attention thanks to their remarkable capabilities of generating highly diverse images that follow given text prompts. Such text-based synthesis methods are particularly…

Computer Vision and Pattern Recognition · Computer Science 2022-08-03 Amir Hertz , Ron Mokady , Jay Tenenbaum , Kfir Aberman , Yael Pritch , Daniel Cohen-Or

Recent conditional image synthesis approaches provide high-quality synthesized images. However, it is still challenging to accurately adjust image contents such as the positions and orientations of objects, and synthesized images often have…

Computer Vision and Pattern Recognition · Computer Science 2021-08-25 Jaebong Jeong , Janghun Jo , Jingdong Wang , Sunghyun Cho , Jaesik Park

In this paper, we propose a way of synthesizing realistic images directly with natural language description, which has many useful applications, e.g. intelligent image manipulation. We attempt to accomplish such synthesis: given a source…

Computer Vision and Pattern Recognition · Computer Science 2017-07-24 Hao Dong , Simiao Yu , Chao Wu , Yike Guo

Text-to-image generative models have attracted rising attention for flexible image editing via user-specified descriptions. However, text descriptions alone are not enough to elaborate the details of subjects, often compromising the…

Computer Vision and Pattern Recognition · Computer Science 2023-06-14 Xin Zhang , Jiaxian Guo , Paul Yoo , Yutaka Matsuo , Yusuke Iwasawa

We present an approach to synthesizing photographic images conditioned on semantic layouts. Given a semantic label map, our approach produces an image with photographic appearance that conforms to the input layout. The approach thus…

Computer Vision and Pattern Recognition · Computer Science 2017-08-01 Qifeng Chen , Vladlen Koltun