中文
相关论文

相关论文: Personalized Text-to-Image Generation with Auto-Re…

200 篇论文

Recent advances in text-to-image models have enabled high-quality personalized image synthesis of user-provided concepts with flexible textual control. In this work, we analyze the limitations of two primary techniques in text-to-image…

计算机视觉与模式识别 · 计算机科学 2024-06-10 Lianyu Pang , Jian Yin , Baoquan Zhao , Feize Wu , Fu Lee Wang , Qing Li , Xudong Mao

Recent progress in controllable image generation and editing is largely driven by diffusion-based methods. Although diffusion models perform exceptionally well in specific tasks with tailored designs, establishing a unified model is still…

计算机视觉与模式识别 · 计算机科学 2025-01-09 Jiteng Mu , Nuno Vasconcelos , Xiaolong Wang

Personalizing text-to-image diffusion models is crucial for adapting the pre-trained models to specific target concepts, enabling diverse image generation. However, fine-tuning with few images introduces an inherent trade-off between…

计算机视觉与模式识别 · 计算机科学 2025-08-04 Sunghyun Park , Seokeon Choi , Hyoungwoo Park , Sungrack Yun

Current language models demonstrate remarkable proficiency in text generation. However, for many applications it is desirable to control attributes, such as sentiment, or toxicity, of the generated language -- ideally tailored towards each…

计算与语言 · 计算机科学 2024-08-09 Justin Lovelace , Varsha Kishore , Yiwei Chen , Kilian Q. Weinberger

Recursive Self-Improvement (RSI) enables intelligence systems to autonomously refine their capabilities. This paper explores the application of RSI in text-to-image diffusion models, addressing the challenge of training collapse caused by…

计算机视觉与模式识别 · 计算机科学 2025-02-17 Xulu Zhang , Xiaoyong Wei , Jinlin Wu , Jiaxin Wu , Zhaoxiang Zhang , Zhen Lei , Qing Li

Attribute guided face image synthesis aims to manipulate attributes on a face image. Most existing methods for image-to-image translation can either perform a fixed translation between any two image domains using a single attribute or…

计算机视觉与模式识别 · 计算机科学 2019-05-02 Behzad Bozorgtabar , Mohammad Saeed Rad , Hazım Kemal Ekenel , Jean-Philippe Thiran

Recent advancements in diffusion models have significantly impacted content creation, leading to the emergence of Personalized Content Synthesis (PCS). By utilizing a small set of user-provided examples featuring the same subject, PCS aims…

计算机视觉与模式识别 · 计算机科学 2025-12-01 Xulu Zhang , Xiaoyong Wei , Wentao Hu , Jinlin Wu , Jiaxin Wu , Wengyu Zhang , Zhaoxiang Zhang , Zhen Lei , Qing Li

Building generic robotic manipulation systems often requires large amounts of real-world data, which can be dificult to collect. Synthetic data generation offers a promising alternative, but limiting the sim-to-real gap requires significant…

机器人学 · 计算机科学 2024-11-18 Thomas Lips , Francis wyffels

Text-guided 3D face synthesis has achieved remarkable results by leveraging text-to-image (T2I) diffusion models. However, most existing works focus solely on the direct generation, ignoring the editing, restricting them from synthesizing…

计算机视觉与模式识别 · 计算机科学 2023-12-04 Yunjie Wu , Yapeng Meng , Zhipeng Hu , Lincheng Li , Haoqian Wu , Kun Zhou , Weiwei Xu , Xin Yu

Recent advancements in image generation have made significant progress, yet existing models present limitations in perceiving and generating an arbitrary number of interrelated images within a broad context. This limitation becomes…

计算机视觉与模式识别 · 计算机科学 2024-04-05 Ying Shen , Yizhe Zhang , Shuangfei Zhai , Lifu Huang , Joshua M. Susskind , Jiatao Gu

Recent text-to-image diffusion models are able to learn and synthesize images containing novel, personalized concepts (e.g., their own pets or specific items) with just a few examples for training. This paper tackles two interconnected…

计算机视觉与模式识别 · 计算机科学 2024-02-26 Chun-Hsiao Yeh , Ta-Ying Cheng , He-Yen Hsieh , Chuan-En Lin , Yi Ma , Andrew Markham , Niki Trigoni , H. T. Kung , Yubei Chen

We propose CatVersion, an inversion-based method that learns the personalized concept through a handful of examples. Subsequently, users can utilize text prompts to generate images that embody the personalized concept, thereby achieving…

计算机视觉与模式识别 · 计算机科学 2023-12-01 Ruoyu Zhao , Mingrui Zhu , Shiyin Dong , Nannan Wang , Xinbo Gao

Although diffusion models exhibit impressive generative capabilities, existing methods for stylized image generation based on these models often require textual inversion or fine-tuning with style images, which is time-consuming and limits…

计算机视觉与模式识别 · 计算机科学 2025-05-28 Xin Ma , Yaohui Wang , Xinyuan Chen , Tien-Tsin Wong , Cunjian Chen

Text-to-image diffusion models have been shown to suffer from sample-level memorization, possibly reproducing near-perfect replica of images that they are trained on, which may be undesirable. To remedy this issue, we develop the first…

Diffusion models have shown superior performance in image generation and manipulation, but the inherent stochasticity presents challenges in preserving and manipulating image content and identity. While previous approaches like DreamBooth…

计算机视觉与模式识别 · 计算机科学 2023-04-20 Inhwa Han , Serin Yang , Taesung Kwon , Jong Chul Ye

While modern diffusion models excel at generating high-quality and diverse images, they still struggle with high-fidelity compositional and multimodal control, particularly when users simultaneously specify text prompts, subject references,…

计算机视觉与模式识别 · 计算机科学 2025-11-27 Yusuf Dalva , Guocheng Gordon Qian , Maya Goldenberg , Tsai-Shien Chen , Kfir Aberman , Sergey Tulyakov , Pinar Yanardag , Kuan-Chieh Jackson Wang

Text-to-image diffusion models have remarkably excelled in producing diverse, high-quality, and photo-realistic images. This advancement has spurred a growing interest in incorporating specific identities into generated content. Most…

计算机视觉与模式识别 · 计算机科学 2023-11-30 Xiaoming Li , Xinyu Hou , Chen Change Loy

Multimodal autoregressive (AR) models, based on next-token prediction and transformer architecture, have demonstrated remarkable capabilities in various multimodal tasks including text-to-image (T2I) generation. Despite their strong…

计算机视觉与模式识别 · 计算机科学 2025-12-02 Yi Wu , Shengju Qian , Lingting Zhu , Lei Liu , Wandi Qiao , Ziqiang Li , Lequan Yu , Bin Li

Can continuous diffusion models bring the same performance breakthrough on natural language they did for image generation? To circumvent the discrete nature of text data, we can simply project tokens in a continuous space of embeddings, as…

Diffusion models have revolted the field of text-to-image generation recently. The unique way of fusing text and image information contributes to their remarkable capability of generating highly text-related images. From another…

计算机视觉与模式识别 · 计算机科学 2024-10-02 Changming Xiao , Qi Yang , Feng Zhou , Changshui Zhang