中文
相关论文

相关论文: Resolving the Identity Crisis in Text-to-Image Gen…

200 篇论文

Large text-to-image models have revolutionized the ability to generate imagery using natural language. However, particularly unique or personal visual concepts, such as pets and furniture, will not be captured by the original model. This…

计算机视觉与模式识别 · 计算机科学 2024-11-07 Xingzhe He , Zhiwen Cao , Nicholas Kolkin , Lantao Yu , Kun Wan , Helge Rhodin , Ratheesh Kalarot

Recently, large-scale text-to-image (T2I) models have shown impressive performance in generating high-fidelity images, but with limited controllability, e.g., precisely specifying the content in a specific region with a free-form text…

计算机视觉与模式识别 · 计算机科学 2022-11-29 Zhengyuan Yang , Jianfeng Wang , Zhe Gan , Linjie Li , Kevin Lin , Chenfei Wu , Nan Duan , Zicheng Liu , Ce Liu , Michael Zeng , Lijuan Wang

Multi-modal generation struggles to ensure thematic coherence and style consistency. Semantically, existing methods suffer from cross-modal mismatch and lack explicit modeling of commonality and discrepancy. Methods that rely on…

多媒体 · 计算机科学 2025-12-01 Zhiyong Ma , Jiahao Chen , Qingyuan Chuai , Zhengping Li

Text-to-image diffusion models are typically trained to optimize the log-likelihood objective, which presents challenges in meeting specific requirements for downstream tasks, such as image aesthetics and image-text alignment. Recent…

计算机视觉与模式识别 · 计算机科学 2024-07-18 Chaofeng Chen , Annan Wang , Haoning Wu , Liang Liao , Wenxiu Sun , Qiong Yan , Weisi Lin

Face personalization aims to insert specific faces, taken from images, into pretrained text-to-image diffusion models. However, it is still challenging for previous methods to preserve both the identity similarity and editability due to…

计算机视觉与模式识别 · 计算机科学 2024-03-11 Kaede Shiohara , Toshihiko Yamasaki

Optimizing communication topology is fundamental to the efficiency and effectiveness of Large Language Model (LLM)-based Multi-Agent Systems (MAS). While recent approaches utilize reinforcement learning to dynamically construct…

计算与语言 · 计算机科学 2026-03-04 Yueyang Cang , Xiaoteng Zhang , Erlu Zhao , Zehua Ji , Yuhang Liu , Yuchen He , Zhiyuan Ning , Chen Yijun , Wenge Que , Li Shi

Diffusion models usher a new era of video editing, flexibly manipulating the video contents with text prompts. Despite the widespread application demand in editing human-centered videos, these models face significant challenges in handling…

计算机视觉与模式识别 · 计算机科学 2024-08-15 Xiaojing Zhong , Xinyi Huang , Xiaofeng Yang , Guosheng Lin , Qingyao Wu

The goal of text-to-image synthesis is to generate a visually realistic image that matches a given text description. In practice, the captions annotated by humans for the same image have large variance in terms of contents and the choice of…

机器学习 · 计算机科学 2021-11-30 Hui Ye , Xiulong Yang , Martin Takac , Rajshekhar Sunderraman , Shihao Ji

Text-to-image diffusion models produce impressive results but are frustrating tools for artists who desire fine-grained control. For example, a common use case is to create images of a specific instance in novel contexts, i.e.,…

计算机视觉与模式识别 · 计算机科学 2024-11-28 Shengqu Cai , Eric Chan , Yunzhi Zhang , Leonidas Guibas , Jiajun Wu , Gordon Wetzstein

Text-conditioned image editing has greatly benefitted from the advancements in Image Diffusion Models. However, extending these techniques to facial video editing introduces challenges in preserving facial identity throughout the source…

计算机视觉与模式识别 · 计算机科学 2026-04-16 Huanghao Yin , Shenkun Xu , Kanle Shi , Junhai Yong , Bin Wang

We present TokenCompose, a Latent Diffusion Model for text-to-image generation that achieves enhanced consistency between user-specified text prompts and model-generated images. Despite its tremendous success, the standard denoising process…

计算机视觉与模式识别 · 计算机科学 2024-06-25 Zirui Wang , Zhizhou Sha , Zheng Ding , Yilin Wang , Zhuowen Tu

Recent deep learning based approaches have outperformed classical stereo matching methods. However, current deep learning based end-to-end stereo matching methods adopt a generic encoder-decoder style network with skip connections. To limit…

计算机视觉与模式识别 · 计算机科学 2019-06-04 Kunal Swami , Kaushik Raghavan , Nikhilanj Pelluri , Rituparna Sarkar , Pankaj Bajpai

Inspired by the success of reinforcement learning (RL) in refining large language models (LLMs), we propose AR-GRPO, an approach to integrate online RL training into autoregressive (AR) image generation models. We adapt the Group Relative…

计算机视觉与模式识别 · 计算机科学 2025-08-12 Shihao Yuan , Yahui Liu , Yang Yue , Jingyuan Zhang , Wangmeng Zuo , Qi Wang , Fuzheng Zhang , Guorui Zhou

Text-to-Image (T2I) models have made significant strides in visual realism and semantic consistency, yet they often perpetuate and amplify societal biases. Existing evaluation methods typically address only single-dimensional biases,…

计算机视觉与模式识别 · 计算机科学 2026-05-26 Ruyi Chen , Lu Zhou , Xiaogang Xu , Chiyu Zhang , Jiafei Wu , Liming Fang

Latent diffusion models (LDMs) dominate high-quality image generation, yet integrating representation learning with generative modeling remains a challenge. We introduce a novel generative image modeling framework that seamlessly bridges…

计算机视觉与模式识别 · 计算机科学 2026-01-23 Theodoros Kouzelis , Efstathios Karypidis , Ioannis Kakogeorgiou , Spyros Gidaris , Nikos Komodakis

Large Language Models (LLMs) are increasingly deployed in business-critical domains such as finance, education, healthcare, and customer support, where users expect consistent and reliable recommendations. Yet LLMs often exhibit variability…

机器学习 · 计算机科学 2026-04-20 Sonal Prabhune , Balaji Padmanabhan , Kaushik Dutta

Recent advances in diffusion models have led to impressive image generation capabilities, but aligning these models with human preferences remains challenging. Reward-based fine-tuning using models trained on human feedback improves…

计算机视觉与模式识别 · 计算机科学 2025-05-29 Dmitrii Sorokin , Maksim Nakhodnov , Andrey Kuznetsov , Aibek Alanov

Multimodal models are becoming increasingly effective, in part due to unified components, such as the Transformer architecture. However, multimodal models still often consist of many task- and modality-specific pieces and training…

计算机视觉与模式识别 · 计算机科学 2023-04-04 Michael Tschannen , Basil Mustafa , Neil Houlsby

Conditional image generation enhances text-to-image synthesis with structural, spatial, or stylistic priors, but current methods face challenges in handling conflicts between sources. These include 1) input-level conflicts, where the…

计算机视觉与模式识别 · 计算机科学 2025-11-25 Dewei Zhou , Mingwei Li , Zongxin Yang , Yu Lu , Yunqiu Xu , Zhizhong Wang , Zeyi Huang , Yi Yang

Learning identity-discriminative representations with multi-scene generality has become a critical objective in person re-identification (ReID). However, mainstream perception-driven paradigms tend to identify fitting from massive annotated…

计算机视觉与模式识别 · 计算机科学 2026-04-22 Quan Zhang , Jingze Wu , Jialong Wang , Xiaohua Xie , Jianhuang Lai , Hongbo Chen