English
Related papers

Related papers: AutoStudio: Crafting Consistent Subjects in Multi-…

200 papers

While large language models (LLMs) have revolutionized natural language processing with their task-agnostic capabilities, visual generation tasks such as image translation, style transfer, and character customization still rely heavily on…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Lianghua Huang , Wei Wang , Zhi-Fan Wu , Huanzhang Dou , Yupeng Shi , Yutong Feng , Chen Liang , Yu Liu , Jingren Zhou

Environment designers in the entertainment industry create imaginative 2D and 3D scenes for games, films, and television, requiring both fine-grained control of specific details and consistent global coherence. Designers have increasingly…

Human-Computer Interaction · Computer Science 2025-09-03 Wen-Fan Wang , Ting-Ying Lee , Chien-Ting Lu , Che-Wei Hsu , Nil Ponsa Campanyà , Yu Chen , Mike Y. Chen , Bing-Yu Chen

We propose a simple yet effective zero-shot framework for subject-driven image generation using a vanilla Flux model. By framing the task as grid-based image completion and simply replicating the subject image(s) in a mosaic layout, we…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Hao Kang , Stathi Fotiadis , Liming Jiang , Qing Yan , Yumin Jia , Zichuan Liu , Min Jin Chong , Xin Lu

Information-seeking conversation, which aims to help users gather information through conversation, has achieved great progress in recent years. However, the research is still stymied by the scarcity of training data. To alleviate this…

Computation and Language · Computer Science 2023-08-15 Siheng Li , Cheng Yang , Yichun Yin , Xinyu Zhu , Zesen Cheng , Lifeng Shang , Xin Jiang , Qun Liu , Yujiu Yang

Modern text-to-image generation systems have enabled the creation of remarkably realistic and high-quality visuals, yet they often falter when handling the inherent ambiguities in user prompts. In this work, we present Twin-Co, a framework…

Computer Vision and Pattern Recognition · Computer Science 2026-02-26 Jianhui Wang , Yangfan He , Yan Zhong , Xinyuan Song , Jiayi Su , Yuheng Feng , Ruoyu Wang , Hongyang He , Wenyu Zhu , Xinhang Yuan , Miao Zhang , Keqin Li , Jiaqi Chen , Tianyu Shi , Xueqian Wang

Recent advances in personalized image generation allow a pre-trained text-to-image model to learn a new concept from a set of images. However, existing personalization approaches usually require heavy test-time finetuning for each concept,…

Computer Vision and Pattern Recognition · Computer Science 2023-04-10 Jing Shi , Wei Xiong , Zhe Lin , Hyun Joon Jung

Maintaining consistent characters, props, and environments across multiple shots is a central challenge in narrative video generation. Existing models can produce high-quality short clips but often fail to preserve entity identity and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-08 Jinsong Zhou , Yihua Du , Xinli Xu , Luozhou Wang , Zijie Zhuang , Yehang Zhang , Shuaibo Li , Xiaojun Hu , Bolan Su , Ying-cong Chen

Recent advances in text-to-image generation with diffusion models present transformative capabilities in image quality. However, user controllability of the generated image, and fast adaptation to new tasks still remains an open challenge,…

Computer Vision and Pattern Recognition · Computer Science 2023-02-17 Omer Bar-Tal , Lior Yariv , Yaron Lipman , Tali Dekel

Subject-driven text-to-image generation still struggles to preserve high-frequency identity details such as logos, patterns, and text. Existing methods typically operate directly in RGB space, which often leads to detail degradation under…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Hanzhong Guo , Yizhou Yu

Users interact with text, image, code, or other editors on a daily basis. However, machine learning models are rarely trained in the settings that reflect the interactivity between users and their editor. This is understandable as training…

Computation and Language · Computer Science 2023-11-14 Felix Faltings , Michel Galley , Baolin Peng , Kianté Brantley , Weixin Cai , Yizhe Zhang , Jianfeng Gao , Bill Dolan

Recent text-to-image diffusion models can generate striking visuals from text prompts, but they often fail to maintain subject consistency across generations and contexts. One major limitation of current fine-tuning approaches is the…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Gordon Chen , Ziqi Huang , Cheston Tan , Ziwei Liu

Sketching serves as a versatile tool for externalizing ideas, enabling rapid exploration and visual communication that spans various disciplines. While artificial systems have driven substantial advances in content creation and…

Computer Vision and Pattern Recognition · Computer Science 2024-11-27 Yael Vinker , Tamar Rott Shaham , Kristine Zheng , Alex Zhao , Judith E Fan , Antonio Torralba

Recent advancements in text-to-image diffusion models have shown remarkable creative capabilities with textual prompts, but generating personalized instances based on specific subjects, known as subject-driven generation, remains…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Shanyan Guan , Yanhao Ge , Ying Tai , Jian Yang , Wei Li , Mingyu You

Text-to-image generation models have made significant progress in producing high-quality images from textual descriptions, yet they continue to struggle with maintaining subject consistency across multiple images, a fundamental requirement…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Mingxiao Li , Mang Ning , Marie-Francine Moens

Text-to-image (T2I) diffusion models, when fine-tuned on a few personal images, can generate visuals with a high degree of consistency. However, such fine-tuned models are not robust; they often fail to compose with concepts of pretrained…

Computer Vision and Pattern Recognition · Computer Science 2024-12-13 Kyungmin Lee , Sangkyung Kwak , Kihyuk Sohn , Jinwoo Shin

Maintaining narrative coherence and visual consistency remains a central challenge in open-domain video generation. Existing text-to-video models often treat each shot independently, resulting in identity drift, scene inconsistency, and…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Qinglin Zeng , Kaitong Cai , Ruiqi Chen , Qinhan Lv , Keze Wang

Subject-Driven Text-to-Image (T2I) Generation aims to preserve a subject's identity while editing its context based on a text prompt. A core challenge in this task is the "similarity-controllability paradox", where enhancing textual control…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Shuang Li , Chao Deng , Hang Chen , Liqun Liu , Zhenyu Hu , Te Cao , Mengge Xue , Yuan Chen , Peng Shu , Huan Yu , Jie Jiang

Large-scale text-to-image models have demonstrated amazing ability to synthesize diverse and high-fidelity images. However, these models are often violated by several limitations. Firstly, they require the user to provide precise and…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 Yupei Lin , Sen Zhang , Xiaojun Yang , Xiao Wang , Yukai Shi

Existing subject-driven text-to-image generation models suffer from tedious fine-tuning steps and struggle to maintain both text-image alignment and subject fidelity. For generating compositional subjects, it often encounters problems such…

Computer Vision and Pattern Recognition · Computer Science 2025-09-10 Shengyuan Liu , Bo Wang , Ye Ma , Te Yang , Xipeng Cao , Quan Chen , Han Li , Di Dong , Peng Jiang

Generating long-form storytelling videos with consistent visual narratives remains a significant challenge in video synthesis. We present a novel framework, dataset, and a model that address three critical limitations: background…