English
Related papers

Related papers: Premier: Personalized Preference Modulation with L…

200 papers

Diffusion models have achieved remarkable results in generating high-quality, diverse, and creative images. However, when it comes to text-based image generation, they often fail to capture the intended meaning presented in the text. For…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Kota Sueyoshi , Takashi Matsubara

Large Language Models (LLMs) have quickly become an invaluable assistant for a variety of tasks. However, their effectiveness is constrained by their ability to tailor responses to human preferences and behaviors via personalization. Prior…

Computation and Language · Computer Science 2024-11-21 Lucie Charlotte Magister , Katherine Metcalf , Yizhe Zhang , Maartje ter Hoeve

Incorporating personal preference is crucial in advanced machine translation tasks. Despite the recent advancement of machine translation, it remains a demanding task to properly reflect personal style. In this paper, we introduce a…

Computation and Language · Computer Science 2023-04-14 Jihyeon Lee , Taehee Kim , Yunwon Tae , Cheonbok Park , Jaegul Choo

Text-to-image generative models have attracted rising attention for flexible image editing via user-specified descriptions. However, text descriptions alone are not enough to elaborate the details of subjects, often compromising the…

Computer Vision and Pattern Recognition · Computer Science 2023-06-14 Xin Zhang , Jiaxian Guo , Paul Yoo , Yutaka Matsuo , Yusuke Iwasawa

Current image generation systems produce high-quality images but struggle with ambiguous user prompts, making interpretation of actual user intentions difficult. Many users must modify their prompts several times to ensure the generated…

Collaborative filtering is a very useful general technique for exploiting the preference patterns of a group of users to predict the utility of items to a particular user. Previous research has studied several probabilistic graphic models…

Information Retrieval · Computer Science 2012-12-12 Rong Jin , Luo Si , ChengXiang Zhai

Achieving precise alignment between user intent and generated visuals remains a central challenge in text-to-visual generation, as a single attempt often fails to produce the desired output. To handle this, prior approaches mainly scale the…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Subin Kim , Sangwoo Mo , Mamshad Nayeem Rizve , Yiran Xu , Difan Liu , Jinwoo Shin , Tobias Hinz

Personalized image generation, where reference images of one or more subjects are used to generate their image according to a scene description, has gathered significant interest in the community. However, such generated images suffer from…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Parul Gupta , Abhinav Dhall , Thanh-Toan Do

Federated learning (FL) emerges as a decentralized learning framework which trains models from multiple distributed clients without sharing their data to preserve privacy. Recently, large-scale pre-trained models (e.g., Vision Transformer)…

Computer Vision and Pattern Recognition · Computer Science 2023-08-30 Fu-En Yang , Chien-Yi Wang , Yu-Chiang Frank Wang

The text-to-image synthesis by diffusion models has recently shown remarkable performance in generating high-quality images. Although performs well for simple texts, the models may get confused when faced with complex texts that contain…

Computer Vision and Pattern Recognition · Computer Science 2024-01-15 Chang Yu , Junran Peng , Xiangyu Zhu , Zhaoxiang Zhang , Qi Tian , Zhen Lei

This paper introduces the first gradient-based framework for prompt optimization in text-to-image diffusion models. We formulate prompt engineering as a discrete optimization problem over the language space. Two major challenges arise in…

Machine Learning · Computer Science 2024-07-03 Ruochen Wang , Ting Liu , Cho-Jui Hsieh , Boqing Gong

Content creators often aim to create personalized images using personal subjects that go beyond the capabilities of conventional text-to-image models. Additionally, they may want the resulting image to encompass a specific location, style,…

Computer Vision and Pattern Recognition · Computer Science 2024-01-12 Moab Arar , Andrey Voynov , Amir Hertz , Omri Avrahami , Shlomi Fruchter , Yael Pritch , Daniel Cohen-Or , Ariel Shamir

Sequential recommendation (SR) systems excel at capturing users' dynamic preferences by leveraging their interaction histories. Most existing SR systems assign a single embedding vector to each item to represent its features, adopting…

Information Retrieval · Computer Science 2026-01-21 Mingrui Liu , Sixiao Zhang , Cheng Long

Currently, personalized image generation methods mostly require considerable time to finetune and often overfit the concept resulting in generated images that are similar to custom concepts but difficult to edit by prompts. We propose an…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Yuxuan Zhang , Yiren Song , Jinpeng Yu , Han Pan , Zhongliang Jing

Federated recommendation systems employ federated learning techniques to safeguard user privacy by transmitting model parameters instead of raw user data between user devices and the central server. Nevertheless, the current federated…

Information Retrieval · Computer Science 2023-05-12 Sichun Luo , Yuanzhang Xiao , Xinyi Zhang , Yang Liu , Wenbo Ding , Linqi Song

Recent advances in text-to-image generation have made remarkable progress in synthesizing realistic human photos conditioned on given text prompts. However, existing personalized generation methods cannot simultaneously satisfy the…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Zhen Li , Mingdeng Cao , Xintao Wang , Zhongang Qi , Ming-Ming Cheng , Ying Shan

With the rapid expansion of user bases on short video platforms, personalized recommendation systems are playing an increasingly critical role in enhancing user experience and optimizing content distribution. Traditional interest modeling…

Information Retrieval · Computer Science 2025-09-08 Yushang Zhao , Yike Peng , Li Zhang , Qianyi Sun , Zhihui Zhang , Yingying Zhuang

Text-to-image diffusion models can generate diverse content with flexible prompts, which makes them well-suited for customization through fine-tuning with a small amount of user-provided data. However, controllable fine-tuning that prevents…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Ziyao Zeng , Jingcheng Ni , Ruyi Liu , Alex Wong

This work presents a generative modeling approach based on successive subspace learning (SSL). Unlike most generative models in the literature, our method does not utilize neural networks to analyze the underlying source distribution and…

Computer Vision and Pattern Recognition · Computer Science 2022-08-24 Zohreh Azizi , C. -C. Jay Kuo

Recent text-to-image diffusion models have significantly improved visual quality and text alignment. However, generating a sequence of images while preserving consistent character identity across diverse scene descriptions remains a…

Computer Vision and Pattern Recognition · Computer Science 2026-01-05 Shin Seong Kim , Minjung Shin , Hyunin Cho , Youngjung Uh