English
Related papers

Related papers: GEA: Generation-Enhanced Alignment for Text-to-Ima…

200 papers

Composed Image Retrieval (CIR) is an important image retrieval paradigm that enables users to retrieve a target image using a multimodal query that consists of a reference image and modification text. Although research on CIR has made…

Computer Vision and Pattern Recognition · Computer Science 2026-04-27 Zixu Li , Yupeng Hu , Zhiheng Fu , Zhiwei Chen , Yongqi Li , Liqiang Nie

We develop an approach for text-to-image generation that embraces additional retrieval images, driven by a combination of implicit visual guidance loss and generative objectives. Unlike most existing text-to-image generation methods which…

Computer Vision and Pattern Recognition · Computer Science 2022-08-19 Xin Yuan , Zhe Lin , Jason Kuen , Jianming Zhang , John Collomosse

Many real-world applications in digital forensics, urban monitoring, and environmental analysis require jointly reasoning about visual appearance, location, and time. Beyond standard geo-localization and time-of-capture prediction, these…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 David G. Shatwell , Sirnam Swetha , Mubarak Shah

Text-to-image person re-identification (ReID) aims to search for pedestrian images of an interested identity via textual descriptions. It is challenging due to both rich intra-modal variations and significant inter-modal gaps. Existing…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Zhiyin Shao , Xinyu Zhang , Meng Fang , Zhifeng Lin , Jian Wang , Changxing Ding

Image-text matching aims to find matched cross-modal pairs accurately. While current methods often rely on projecting cross-modal features into a common embedding space, they frequently suffer from imbalanced feature representations across…

Information Retrieval · Computer Science 2024-01-19 Zuhui Wang , Yunting Yin , I. V. Ramakrishnan

Graph retrieval-augmented generation (GRAG) places high demands on graph-specific retrievers. However, existing retrievers often rely on language models pretrained on plain text, limiting their effectiveness due to domain misalignment and…

Information Retrieval · Computer Science 2025-06-04 Xiaochen Wang , Zongyu Wu , Yuan Zhong , Xiang Zhang , Suhang Wang , Fenglong Ma

Recent advances in large-scale text-to-image generation models have led to a surge in subject-driven text-to-image generation, which aims to produce customized images that align with textual descriptions while preserving the identity of…

Computer Vision and Pattern Recognition · Computer Science 2025-05-29 Kewen Chen , Xiaobin Hu , Wenqi Ren

Retrieval-Augmented Generation (RAG) has become a pivotal paradigm for Large Language Models (LLMs), yet current approaches struggle with visually rich documents by treating text and images as isolated retrieval targets. Existing methods…

Computation and Language · Computer Science 2026-01-13 Xuan Li , Yining Wang , Haocai Luo , Shengping Liu , Jerry Liang , Ying Fu , Weihuang , Jun Yu , Junnan Zhu

Deep neural networks have greatly promoted the performance of single image super-resolution (SISR). Conventional methods still resort to restoring the single high-resolution (HR) solution only based on the input of image modality. However,…

Computer Vision and Pattern Recognition · Computer Science 2022-07-15 Chenxi Ma , Bo Yan , Qing Lin , Weimin Tan , Siming Chen

The performance of traditional text-image person retrieval task is easily affected by lighting variations due to imaging limitations of visible spectrum sensors. In recent years, cross-modal information fusion has emerged as an effective…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Yifei Deng , Chenglong Li , Zhenyu Chen , Zihen Xu , Jin Tang

As a challenging task, text-to-image generation aims to generate photo-realistic and semantically consistent images according to the given text descriptions. Existing methods mainly extract the text information from only one sentence to…

Computer Vision and Pattern Recognition · Computer Science 2022-09-29 Xintian Wu , Hanbin Zhao , Liangli Zheng , Shouhong Ding , Xi Li

Learning from feedback has been shown to enhance the alignment between text prompts and images in text-to-image diffusion models. However, due to the lack of focus in feedback content, especially regarding the object type and quantity,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Xuexiang Niu , Jinping Tang , Lei Wang , Ge Zhu

With generative models becoming increasingly sophisticated and diverse, detecting AI-generated images has become increasingly challenging. While existing AI-genereted Image detectors achieve promising performance on in-distribution…

Computer Vision and Pattern Recognition · Computer Science 2026-01-26 Haozhen Yan , Yan Hong , Suning Lang , Jiahui Zhan , Yikun Ji , Yujie Gao , Huijia Zhu , Jun Lan , Jianfu Zhang

Text attribute person search aims to find specific pedestrians through given textual attributes, which is very meaningful in the scene of searching for designated pedestrians through witness descriptions. The key challenge is the…

Computer Vision and Pattern Recognition · Computer Science 2024-06-07 Xin Wang , Fangfang Liu , Zheng Li , Caili Guo

Entity Alignment (EA) aims to match equivalent entities in different Knowledge Graphs (KGs), which is essential for knowledge fusion and integration. Recently, embedding-based EA has attracted significant attention and many approaches have…

Computation and Language · Computer Science 2024-08-05 Zhichun Wang , Xuan Chen

While representation alignment with self-supervised models has been shown to improve diffusion model training, its potential for enhancing inference-time conditioning remains largely unexplored. We introduce Representation-Aligned Guidance…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Nicolas Sereyjol-Garros , Ellington Kirby , Victor Letzelter , Victor Besnier , Nermin Samet

News image captioning aims to produce journalistically informative descriptions by combining visual content with contextual cues from associated articles. Despite recent advances, existing methods struggle with three key challenges: (1)…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Xiaoxing You , Qiang Huang , Lingyu Li , Chi Zhang , Xiaopeng Liu , Min Zhang , Jun Yu

Text-to-image (T2I) models have achieved remarkable progress, yet they continue to struggle with complex prompts that require simultaneously handling multiple objects, relations, and attributes. Existing inference-time strategies, such as…

Computer Vision and Pattern Recognition · Computer Science 2026-01-22 Shantanu Jaiswal , Mihir Prabhudesai , Nikash Bhardwaj , Zheyang Qin , Amir Zadeh , Chuan Li , Katerina Fragkiadaki , Deepak Pathak

This paper addresses the performance bottlenecks of existing text-driven image generation methods in terms of semantic alignment accuracy and structural consistency. A high-fidelity image generation method is proposed by integrating…

Computer Vision and Pattern Recognition · Computer Science 2025-08-15 Danyi Gao

Despite advancements in text-to-image generation (T2I), prior methods often face text-image misalignment problems such as relation confusion in generated images. Existing solutions involve cross-attention manipulation for better…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Leigang Qu , Wenjie Wang , Yongqi Li , Hanwang Zhang , Liqiang Nie , Tat-Seng Chua