English
Related papers

Related papers: Resolving the Identity Crisis in Text-to-Image Gen…

200 papers

Large text-to-image models have revolutionized the ability to generate imagery using natural language. However, particularly unique or personal visual concepts, such as pets and furniture, will not be captured by the original model. This…

Computer Vision and Pattern Recognition · Computer Science 2024-11-07 Xingzhe He , Zhiwen Cao , Nicholas Kolkin , Lantao Yu , Kun Wan , Helge Rhodin , Ratheesh Kalarot

Recently, large-scale text-to-image (T2I) models have shown impressive performance in generating high-fidelity images, but with limited controllability, e.g., precisely specifying the content in a specific region with a free-form text…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Zhengyuan Yang , Jianfeng Wang , Zhe Gan , Linjie Li , Kevin Lin , Chenfei Wu , Nan Duan , Zicheng Liu , Ce Liu , Michael Zeng , Lijuan Wang

Multi-modal generation struggles to ensure thematic coherence and style consistency. Semantically, existing methods suffer from cross-modal mismatch and lack explicit modeling of commonality and discrepancy. Methods that rely on…

Multimedia · Computer Science 2025-12-01 Zhiyong Ma , Jiahao Chen , Qingyuan Chuai , Zhengping Li

Text-to-image diffusion models are typically trained to optimize the log-likelihood objective, which presents challenges in meeting specific requirements for downstream tasks, such as image aesthetics and image-text alignment. Recent…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Chaofeng Chen , Annan Wang , Haoning Wu , Liang Liao , Wenxiu Sun , Qiong Yan , Weisi Lin

Face personalization aims to insert specific faces, taken from images, into pretrained text-to-image diffusion models. However, it is still challenging for previous methods to preserve both the identity similarity and editability due to…

Computer Vision and Pattern Recognition · Computer Science 2024-03-11 Kaede Shiohara , Toshihiko Yamasaki

Optimizing communication topology is fundamental to the efficiency and effectiveness of Large Language Model (LLM)-based Multi-Agent Systems (MAS). While recent approaches utilize reinforcement learning to dynamically construct…

Computation and Language · Computer Science 2026-03-04 Yueyang Cang , Xiaoteng Zhang , Erlu Zhao , Zehua Ji , Yuhang Liu , Yuchen He , Zhiyuan Ning , Chen Yijun , Wenge Que , Li Shi

Diffusion models usher a new era of video editing, flexibly manipulating the video contents with text prompts. Despite the widespread application demand in editing human-centered videos, these models face significant challenges in handling…

Computer Vision and Pattern Recognition · Computer Science 2024-08-15 Xiaojing Zhong , Xinyi Huang , Xiaofeng Yang , Guosheng Lin , Qingyao Wu

The goal of text-to-image synthesis is to generate a visually realistic image that matches a given text description. In practice, the captions annotated by humans for the same image have large variance in terms of contents and the choice of…

Machine Learning · Computer Science 2021-11-30 Hui Ye , Xiulong Yang , Martin Takac , Rajshekhar Sunderraman , Shihao Ji

Text-to-image diffusion models produce impressive results but are frustrating tools for artists who desire fine-grained control. For example, a common use case is to create images of a specific instance in novel contexts, i.e.,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-28 Shengqu Cai , Eric Chan , Yunzhi Zhang , Leonidas Guibas , Jiajun Wu , Gordon Wetzstein

Text-conditioned image editing has greatly benefitted from the advancements in Image Diffusion Models. However, extending these techniques to facial video editing introduces challenges in preserving facial identity throughout the source…

Computer Vision and Pattern Recognition · Computer Science 2026-04-16 Huanghao Yin , Shenkun Xu , Kanle Shi , Junhai Yong , Bin Wang

We present TokenCompose, a Latent Diffusion Model for text-to-image generation that achieves enhanced consistency between user-specified text prompts and model-generated images. Despite its tremendous success, the standard denoising process…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Zirui Wang , Zhizhou Sha , Zheng Ding , Yilin Wang , Zhuowen Tu

Recent deep learning based approaches have outperformed classical stereo matching methods. However, current deep learning based end-to-end stereo matching methods adopt a generic encoder-decoder style network with skip connections. To limit…

Computer Vision and Pattern Recognition · Computer Science 2019-06-04 Kunal Swami , Kaushik Raghavan , Nikhilanj Pelluri , Rituparna Sarkar , Pankaj Bajpai

Inspired by the success of reinforcement learning (RL) in refining large language models (LLMs), we propose AR-GRPO, an approach to integrate online RL training into autoregressive (AR) image generation models. We adapt the Group Relative…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Shihao Yuan , Yahui Liu , Yang Yue , Jingyuan Zhang , Wangmeng Zuo , Qi Wang , Fuzheng Zhang , Guorui Zhou

Text-to-Image (T2I) models have made significant strides in visual realism and semantic consistency, yet they often perpetuate and amplify societal biases. Existing evaluation methods typically address only single-dimensional biases,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Ruyi Chen , Lu Zhou , Xiaogang Xu , Chiyu Zhang , Jiafei Wu , Liming Fang

Latent diffusion models (LDMs) dominate high-quality image generation, yet integrating representation learning with generative modeling remains a challenge. We introduce a novel generative image modeling framework that seamlessly bridges…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Theodoros Kouzelis , Efstathios Karypidis , Ioannis Kakogeorgiou , Spyros Gidaris , Nikos Komodakis

Large Language Models (LLMs) are increasingly deployed in business-critical domains such as finance, education, healthcare, and customer support, where users expect consistent and reliable recommendations. Yet LLMs often exhibit variability…

Machine Learning · Computer Science 2026-04-20 Sonal Prabhune , Balaji Padmanabhan , Kaushik Dutta

Recent advances in diffusion models have led to impressive image generation capabilities, but aligning these models with human preferences remains challenging. Reward-based fine-tuning using models trained on human feedback improves…

Computer Vision and Pattern Recognition · Computer Science 2025-05-29 Dmitrii Sorokin , Maksim Nakhodnov , Andrey Kuznetsov , Aibek Alanov

Multimodal models are becoming increasingly effective, in part due to unified components, such as the Transformer architecture. However, multimodal models still often consist of many task- and modality-specific pieces and training…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Michael Tschannen , Basil Mustafa , Neil Houlsby

Conditional image generation enhances text-to-image synthesis with structural, spatial, or stylistic priors, but current methods face challenges in handling conflicts between sources. These include 1) input-level conflicts, where the…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Dewei Zhou , Mingwei Li , Zongxin Yang , Yu Lu , Yunqiu Xu , Zhizhong Wang , Zeyi Huang , Yi Yang

Learning identity-discriminative representations with multi-scene generality has become a critical objective in person re-identification (ReID). However, mainstream perception-driven paradigms tend to identify fitting from massive annotated…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Quan Zhang , Jingze Wu , Jialong Wang , Xiaohua Xie , Jianhuang Lai , Hongbo Chen