中文
相关论文

相关论文: Personalized Image Generation with Large Multimoda…

200 篇论文

Professional-grade software applications are powerful but complicated$-$expert users can achieve impressive results, but novices often struggle to complete even basic tasks. Photo editing is a prime example: after loading a photo, the user…

Text-to-image generation has advanced rapidly, yet it still struggles to capture the nuanced user preferences. Existing approaches typically rely on multimodal large language models to infer user preferences, but the derived prompts or…

计算机视觉与模式识别 · 计算机科学 2026-04-14 Zihao Wang , Yuxiang Wei , Xinpeng Zhou , Tianyu Zhang , Tao Liang , Yalong Bai , Hongzhi Zhang , Wangmeng Zuo

Text-to-image diffusion models have attracted considerable interest due to their wide applicability across diverse fields. However, challenges persist in creating controllable models for personalized object generation. In this paper, we…

计算机视觉与模式识别 · 计算机科学 2023-06-30 Yuheng Li , Haotian Liu , Yangming Wen , Yong Jae Lee

Generative models are increasingly powerful, yet users struggle to guide them through prompts. The generative process is difficult to control and unpredictable, and user instructions may be ambiguous or under-specified. Prior prompt…

人机交互 · 计算机科学 2026-02-16 Zhipeng Li , Yi-Chi Liao , Christian Holz

Facial images have extensive practical applications. Although the current large-scale text-image diffusion models exhibit strong generation capabilities, it is challenging to generate the desired facial images using only text prompt. Image…

计算机视觉与模式识别 · 计算机科学 2025-01-07 Dawei Dai , Mingming Jia , Yinxiu Zhou , Hang Xing , Chenghang Li

Recently, large multimodal models, such as CLIP and Stable Diffusion have experimented tremendous successes in both foundations and applications. However, as these models increase in parameter size and computational requirements, it becomes…

计算机视觉与模式识别 · 计算机科学 2023-09-22 Victor Gallego

Recent advances in large language models (LLMs) have enabled multimodal foundation models to tackle both image understanding and generation within a unified framework. Despite these gains, unified models often underperform compared to…

计算机视觉与模式识别 · 计算机科学 2025-07-15 Zhiyang Xu , Jiuhai Chen , Zhaojiang Lin , Xichen Pan , Lifu Huang , Tianyi Zhou , Madian Khabsa , Qifan Wang , Di Jin , Michihiro Yasunaga , Lili Yu , Xi Victoria Lin , Shaoliang Nie

We address personalized image enhancement in this study, where we enhance input images for each user based on the user's preferred images. Previous methods apply the same preferred style to all input images (i.e., only one style for each…

计算机视觉与模式识别 · 计算机科学 2023-06-16 Satoshi Kosugi , Toshihiko Yamasaki

Customized image generation is essential for creating personalized content based on user prompts, allowing large-scale text-to-image diffusion models to more effectively meet individual needs. However, existing models often neglect the…

计算机视觉与模式识别 · 计算机科学 2025-04-08 Qingyu Shi , Lu Qi , Jianzong Wu , Jinbin Bai , Jingbo Wang , Yunhai Tong , Xiangtai Li

Deep generative models have the capacity to render high fidelity images of content like human faces. Recently, there has been substantial progress in conditionally generating images with specific quantitative attributes, like the emotion…

计算机视觉与模式识别 · 计算机科学 2023-04-04 Alec Helbling , Christopher J. Rozell , Matthew O'Shaughnessy , Kion Fallah

Personalized image generation aims to integrate user-provided concepts into text-to-image models, enabling the generation of customized content based on a given prompt. Recent zero-shot approaches, particularly those leveraging diffusion…

计算机视觉与模式识别 · 计算机科学 2025-05-29 Yiheng Lin , Shifang Zhao , Ting Liu , Xiaochao Qu , Luoqi Liu , Yao Zhao , Yunchao Wei

Personalized text-to-image generation has attracted unprecedented attention in the recent few years due to its unique capability of generating highly-personalized images via using the input concept dataset and novel textual prompt. However,…

人工智能 · 计算机科学 2024-07-02 Shian Du , Xiaotian Cheng , Qi Qian , Henglu Wei , Yi Xu , Xiangyang Ji

The ability to collect a large dataset of human preferences from text-to-image users is usually limited to companies, making such datasets inaccessible to the public. To address this issue, we create a web app that enables text-to-image…

计算机视觉与模式识别 · 计算机科学 2023-11-27 Yuval Kirstain , Adam Polyak , Uriel Singer , Shahbuland Matiana , Joe Penna , Omer Levy

User preference prediction requires a comprehensive and accurate understanding of individual tastes. This includes both surface-level attributes, such as color and style, and deeper content-related aspects, such as themes and composition.…

计算机视觉与模式识别 · 计算机科学 2025-08-12 Wenyi Mo , Ying Ba , Tianyu Zhang , Yalong Bai , Biye Li

Customizing pre-trained text-to-image generation model has attracted massive research interest recently, due to its huge potential in real-world applications. Although existing methods are able to generate creative content for a novel…

计算机视觉与模式识别 · 计算机科学 2024-05-10 Yufan Zhou , Ruiyi Zhang , Jiuxiang Gu , Tong Sun

Recent text-to-image generation models have demonstrated impressive capability of generating text-aligned images with high fidelity. However, generating images of novel concept provided by the user input image is still a challenging task.…

计算机视觉与模式识别 · 计算机科学 2023-05-24 Yufan Zhou , Ruiyi Zhang , Tong Sun , Jinhui Xu

For visual content generation, discrepancies between user intentions and the generated content have been a longstanding problem. This discrepancy arises from two main factors. First, user intentions are inherently complex, with subtle…

计算机视觉与模式识别 · 计算机科学 2024-05-22 Yi Cheng , Ziwei Xu , Dongyun Lin , Harry Cheng , Yongkang Wong , Ying Sun , Joo Hwee Lim , Mohan Kankanhalli

Many applications can benefit from personalized image generation models, including image enhancement, video conferences, just to name a few. Existing works achieved personalization by fine-tuning one model for each person. While being…

计算机视觉与模式识别 · 计算机科学 2023-04-18 Yu-Chuan Su , Kelvin C. K. Chan , Yandong Li , Yang Zhao , Han Zhang , Boqing Gong , Huisheng Wang , Xuhui Jia

With the dynamic evolution of user interests and the increasing multimodal demands in internet applications, personalized content generation strategies based on static interest preferences struggle to meet practical application…

信息检索 · 计算机科学 2025-09-05 Tian Miao

Imagine Alice has a specific image $x^\ast$ in her mind, say, the view of the street in which she grew up during her childhood. To generate that exact image, she guides a generative model with multiple rounds of prompting and arrives at an…

计算机视觉与模式识别 · 计算机科学 2026-02-05 Rajalaxmi Rajagopalan , Debottam Dutta , Yu-Lin Wei , Romit Roy Choudhury