English
Related papers

Related papers: Identity Encoder for Personalized Diffusion

200 papers

Recent advancements in generative models have significantly facilitated the development of personalized content creation. Given a small set of images with user-specific concept, personalized image generation allows to create images that…

Computer Vision and Pattern Recognition · Computer Science 2025-02-19 Yuxiang Wei , Yiheng Zheng , Yabo Zhang , Ming Liu , Zhilong Ji , Lei Zhang , Wangmeng Zuo

Encoding models that predict brain response patterns to stimuli are one way to capture this relationship between variability in bottom-up neural systems and individual's behavior or pathological state. However, they generally need a large…

Quantitative Methods · Quantitative Biology 2022-05-17 Zijin Gu , Keith Jamison , Mert Sabuncu , Amy Kuceyeski

We present the self-encoder, a neural network trained to guess the identity of each data sample. Despite its simplicity, it learns a very useful representation of data, in a self-supervised way. Specifically, the self-encoder learns to…

Machine Learning · Computer Science 2023-06-27 Armand Boschin , Thomas Bonald , Marc Jeanmougin

Recent advances in generative modeling have enabled the generation of high-quality synthetic data that is applicable in a variety of domains, including face recognition. Here, state-of-the-art generative models typically rely on…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Darian Tomašević , Fadi Boutros , Chenhao Lin , Naser Damer , Vitomir Štruc , Peter Peer

Despite recent progress in diffusion models, generating realistic head portraits from novel viewpoints remains a significant challenge. Most current approaches are constrained to limited angular ranges, predominantly focusing on frontal or…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Stathis Galanakis , Alexandros Lattas , Stylianos Moschoglou , Bernhard Kainz , Stefanos Zafeiriou

We address personalized image enhancement in this study, where we enhance input images for each user based on the user's preferred images. Previous methods apply the same preferred style to all input images (i.e., only one style for each…

Computer Vision and Pattern Recognition · Computer Science 2023-06-16 Satoshi Kosugi , Toshihiko Yamasaki

Large-scale generative models are capable of producing high-quality images from detailed text descriptions. However, many aspects of an image are difficult or impossible to convey through text. We introduce self-guidance, a method that…

Computer Vision and Pattern Recognition · Computer Science 2023-06-13 Dave Epstein , Allan Jabri , Ben Poole , Alexei A. Efros , Aleksander Holynski

Recent advances in large pretrained text-to-image models have shown unprecedented capabilities for high-quality human-centric generation, however, customizing face identity is still an intractable problem. Existing methods cannot ensure…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 Qinghe Wang , Xu Jia , Xiaomin Li , Taiqing Li , Liqian Ma , Yunzhi Zhuge , Huchuan Lu

Popularized by their strong image generation performance, diffusion and related methods for generative modeling have found widespread success in visual media applications. In particular, diffusion methods have enabled new approaches to data…

Image and Video Processing · Electrical Eng. & Systems 2026-01-28 Yibo Yang , Stephan Mandt

Computer graphics seeks to deliver compelling images, generated within a computing budget, targeted at a specific display device, and ultimately viewed by an individual user. The foveated nature of human vision offers an opportunity to…

Graphics · Computer Science 2021-07-27 Rachel Brown , Vasha DuTell , Bruce Walter , Ruth Rosenholtz , Peter Shirley , Morgan McGuire , David Luebke

Portrait customization (PC) has recently garnered significant attention due to its potential applications. However, existing PC methods lack precise identity (ID) preservation and face control. To address these tissues, we propose Diff-PC,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Yifang Xu , Benxiang Zhai , Chenyu Zhang , Ming Li , Yang Li , Sidan Du

Intrinsic image decomposition is an important and long-standing computer vision problem. Given an input image, recovering the physical scene properties is ill-posed. Several physically motivated priors have been used to restrict the…

Computer Vision and Pattern Recognition · Computer Science 2022-09-27 Zongji Wang , Yunfei Liu , Feng Lu

In recent years, diffusion models have gained popularity for their ability to generate higher-quality images in comparison to GAN models. However, like any other large generative models, these models require a huge amount of data,…

Computer Vision and Pattern Recognition · Computer Science 2023-12-21 Rajesh Shrestha , Bowen Xie

Recent text-to-image diffusion models have demonstrated remarkable generation of realistic facial images conditioned on textual prompts and human identities, enabling creating personalized facial imagery. However, existing prompt-based…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Han-Wei Kung , Tuomas Varanka , Nicu Sebe

Diffusion-based models have demonstrated impressive capabilities for text-to-image generation and are expected for personalized applications of subject-driven generation, which require the generation of customized concepts with one or a few…

Computer Vision and Pattern Recognition · Computer Science 2023-12-22 Miao Hua , Jiawei Liu , Fei Ding , Wei Liu , Jie Wu , Qian He

The rapid evolution of deepfake technologies demands robust and reliable face forgery detection algorithms. While determining whether an image has been manipulated remains essential, the ability to precisely localize forgery clues is also…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Siran Peng , Haoyuan Zhang , Li Gao , Tianshuo Zhang , Xiangyu Zhu , Bao Li , Weisong Zhao , Zhen Lei

People can view the same image differently: they focus on different regions, objects, and details in varying orders and describe them in distinct linguistic styles. This leads to substantial variability in image descriptions. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Ruoyu Xue , Hieu Le , Jingyi Xu , Sounak Mondal , Abe Leite , Gregory Zelinsky , Minh Hoai , Dimitris Samaras

Denoising diffusion models have gained popularity as a generative modeling technique for producing high-quality and diverse images. Applying these models to downstream tasks requires conditioning, which can take the form of text, class…

Computer Vision and Pattern Recognition · Computer Science 2023-06-06 Alexandros Graikos , Srikar Yellapragada , Dimitris Samaras

One of the key issues in Deep Neural Networks (DNNs) is the black-box nature of their internal feature extraction process. Targeting vision-related domains, this paper focuses on analysing the feature space of a DNN by proposing a decoder…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Kimiaki Shirahama , Miki Yanobu , Kaduki Yamashita , Miho Ohsaki

Text-to-image diffusion models produce impressive results but are frustrating tools for artists who desire fine-grained control. For example, a common use case is to create images of a specific instance in novel contexts, i.e.,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-28 Shengqu Cai , Eric Chan , Yunzhi Zhang , Leonidas Guibas , Jiajun Wu , Gordon Wetzstein