中文
相关论文

相关论文: Multi-Modal Language Models as Text-to-Image Model…

200 篇论文

Despite their impressive capabilities, diffusion-based text-to-image (T2I) models can lack faithfulness to the text prompt, where generated images may not contain all the mentioned objects, attributes or relations. To alleviate these…

计算机视觉与模式识别 · 计算机科学 2023-05-23 Shyamgopal Karthik , Karsten Roth , Massimiliano Mancini , Zeynep Akata

Subject-driven text-to-image (T2I) generation aims to produce images that align with a given textual description, while preserving the visual identity from a referenced subject image. Despite its broad downstream applicability - ranging…

Text-to-image (T2I) generation has seen significant progress with diffusion models, enabling generation of photo-realistic images from text prompts. Despite this progress, existing methods still face challenges in following complex text…

计算机视觉与模式识别 · 计算机科学 2025-03-12 Ashish Goswami , Satyam Kumar Modi , Santhosh Rishi Deshineni , Harman Singh , Prathosh A. P , Parag Singla

This research investigates prompt designs of evaluating generated texts using large language models (LLMs). While LLMs are increasingly used for scoring various inputs, creating effective prompts for open-ended text evaluation remains…

计算与语言 · 计算机科学 2024-06-28 KuanChao Chu , Yi-Pei Chen , Hideki Nakayama

Recent advancements in generative models have significantly enhanced their capacity for image generation, enabling a wide range of applications such as image editing, completion and video editing. A specialized area within generative…

计算机视觉与模式识别 · 计算机科学 2025-01-14 Jiaxin Cheng , Zixu Zhao , Tong He , Tianjun Xiao , Yicong Zhou , Zheng Zhang

Evaluating text-guided image editing (TIE) methods remains a challenging problem, as reliable assessment should simultaneously consider perceptual quality, alignment with textual instructions, and preservation of original image content.…

计算机视觉与模式识别 · 计算机科学 2026-03-26 Shiqi Gao , Zitong Xu , Kang Fu , Huiyu Duan , Xiongkuo Min , Jia wang

Instruction-based image editing improves the controllability and flexibility of image manipulation via natural commands without elaborate descriptions or regional masks. However, human instructions are sometimes too brief for current…

计算机视觉与模式识别 · 计算机科学 2024-02-06 Tsu-Jui Fu , Wenze Hu , Xianzhi Du , William Yang Wang , Yinfei Yang , Zhe Gan

Well-designed prompts can guide text-to-image models to generate amazing images. However, the performant prompts are often model-specific and misaligned with user input. Instead of laborious human engineering, we propose prompt adaptation,…

计算与语言 · 计算机科学 2024-01-01 Yaru Hao , Zewen Chi , Li Dong , Furu Wei

Text-to-image (T2I) generative models can create vivid, realistic images from textual descriptions. As these models proliferate, they expose new concerns about their ability to represent diverse demographic groups, propagate stereotypes,…

计算机视觉与模式识别 · 计算机科学 2025-06-02 Sangwon Jung , Alex Oesterling , Claudio Mayrink Verdun , Sajani Vithana , Taesup Moon , Flavio P. Calmon

Recently, text-to-image (T2I) synthesis has undergone significant advancements, particularly with the emergence of Large Language Models (LLM) and their enhancement in Large Vision Models (LVM), greatly enhancing the instruction-following…

计算机视觉与模式识别 · 计算机科学 2025-03-27 Weijin Cheng , Jianzhi Liu , Jiawen Deng , Fuji Ren

The recent advancements in text-to-image generative models have been remarkable. Yet, the field suffers from a lack of evaluation metrics that accurately reflect the performance of these models, particularly lacking fine-grained metrics…

计算机视觉与模式识别 · 计算机科学 2024-10-11 Zhiyu Tan , Xiaomeng Yang , Luozheng Qin , Mengping Yang , Cheng Zhang , Hao Li

Text-to-image generative models have demonstrated remarkable capabilities in generating high-quality images based on textual prompts. However, crafting prompts that accurately capture the user's creative intent remains challenging. It often…

人机交互 · 计算机科学 2023-04-20 Stephen Brade , Bryan Wang , Mauricio Sousa , Sageev Oore , Tovi Grossman

The rapid advancement of Text-to-Image(T2I) generative models has enabled the synthesis of high-quality images guided by textual descriptions. Despite this significant progress, these models are often susceptible in generating contents that…

计算机视觉与模式识别 · 计算机科学 2024-06-25 Yichen Sun , Zhixuan Chu , Zhan Qin , Kui Ren

One challenge in text-to-image (T2I) generation is the inadvertent reflection of culture gaps present in the training data, which signifies the disparity in generated image quality when the cultural elements of the input text are rarely…

计算机视觉与模式识别 · 计算机科学 2023-07-07 Bingshuai Liu , Longyue Wang , Chenyang Lyu , Yong Zhang , Jinsong Su , Shuming Shi , Zhaopeng Tu

Recent progress in Text-to-Image (T2I) generative models has enabled high-quality image generation. As performance and accessibility increase, these models are gaining significant attraction and popularity: ensuring their fairness and…

计算机视觉与模式识别 · 计算机科学 2024-08-30 Moreno D'Incà , Elia Peruzzo , Massimiliano Mancini , Xingqian Xu , Humphrey Shi , Nicu Sebe

Large Language Models (LLMs) have demonstrated exceptional proficiency in text understanding and embedding tasks. However, their potential in multimodal representation, particularly for item-to-item (I2I) recommendations, remains…

信息检索 · 计算机科学 2025-01-22 Chao Zhang , Haoxin Zhang , Shiwei Wu , Di Wu , Tong Xu , Xiangyu Zhao , Yan Gao , Yao Hu , Enhong Chen

Existing automatic evaluation on text-to-image synthesis can only provide an image-text matching score, without considering the object-level compositionality, which results in poor correlation with human judgments. In this work, we propose…

计算机视觉与模式识别 · 计算机科学 2023-05-19 Yujie Lu , Xianjun Yang , Xiujun Li , Xin Eric Wang , William Yang Wang

The practical use of text-to-image generation has evolved from simple, monolithic models to complex workflows that combine multiple specialized components. While workflow-based approaches can lead to improved image quality, crafting…

计算机视觉与模式识别 · 计算机科学 2024-10-03 Rinon Gal , Adi Haviv , Yuval Alaluf , Amit H. Bermano , Daniel Cohen-Or , Gal Chechik

Recent advancements in text-to-image (T2I) generation models have transformed the field. However, challenges persist in generating images that reflect demanding textual descriptions, especially for fine-grained details and unusual…

多媒体 · 计算机科学 2025-02-21 Ran Li , Xiaomeng Jin , Heng ji

Despite recent advances in text-to-image (T2I) models, they often fail to faithfully render all elements of complex prompts, frequently omitting or misrepresenting specific objects and attributes. Test-time optimization has emerged as a…