中文
相关论文

相关论文: Structured Information for Improving Spatial Relat…

200 篇论文

In this paper, we present an empirical study introducing a nuanced evaluation framework for text-to-image (T2I) generative models, applied to human image synthesis. Our framework categorizes evaluations into two distinct groups: first,…

计算机视觉与模式识别 · 计算机科学 2024-10-29 Muxi Chen , Yi Liu , Jian Yi , Changran Xu , Qiuxia Lai , Hongliang Wang , Tsung-Yi Ho , Qiang Xu

Modern text-to-image synthesis models have achieved an exceptional level of photorealism, generating high-quality images from arbitrary text descriptions. In light of the impressive synthesis ability, several studies have exhibited…

计算机视觉与模式识别 · 计算机科学 2023-06-13 Joonghyuk Shin , Minguk Kang , Jaesik Park

State-of-the-art T2I models are capable of generating high-resolution images given textual prompts. However, they still struggle with accurately depicting compositional scenes that specify multiple objects, attributes, and spatial…

计算机视觉与模式识别 · 计算机科学 2025-05-19 Yixin Wan , Kai-Wei Chang

In this paper, we propose a novel fully automatic pipeline to generate text images that are legible and strongly aligned to the desired semantic concept taken from the users' inputs. In our method, users are able to put three inputs into…

图形学 · 计算机科学 2025-12-02 Mohammad Javadian Farzaneh , Selim Balcisoy

Neural image classifiers are known to undergo severe performance degradation when exposed to inputs that are sampled from environmental conditions that differ from their training data. Given the recent progress in Text-to-Image (T2I)…

计算机视觉与模式识别 · 计算机科学 2024-06-05 Jianhao Yuan , Francesco Pinto , Adam Davies , Philip Torr

The recent large-scale generative modeling has attained unprecedented performance especially in producing high-fidelity images driven by text prompts. Text inversion (TI), alongside the text-to-image model backbones, is proposed as an…

计算机视觉与模式识别 · 计算机科学 2023-09-26 Jianan Yang , Haobo Wang , Yanming Zhang , Ruixuan Xiao , Sai Wu , Gang Chen , Junbo Zhao

Speech-to-text (S2T) generation systems frequently face challenges in low-resource scenarios, primarily due to the lack of extensive labeled datasets. One emerging solution is constructing virtual training samples by interpolating inputs…

计算与语言 · 计算机科学 2024-06-25 Chen Xu , Jie Wang , Xiaoqian Liu , Qianqian Dong , Chunliang Zhang , Tong Xiao , Jingbo Zhu , Dapeng Man , Wu Yang

Text-to-Image (T2I) diffusion models are widely recognized for their ability to generate high-quality and diverse images based on text prompts. However, despite recent advances, these models are still prone to generating unsafe images…

计算机视觉与模式识别 · 计算机科学 2024-12-06 Jiangweizhi Peng , Zhiwei Tang , Gaowen Liu , Charles Fleming , Mingyi Hong

Despite astonishing progress, generating realistic images of complex scenes remains a challenging problem. Recently, layout-to-image synthesis approaches have attracted much interest by conditioning the generator on a list of bounding boxes…

计算机视觉与模式识别 · 计算机科学 2022-04-06 Stanislav Frolov , Prateek Bansal , Jörn Hees , Andreas Dengel

Text-to-image (T2I) generative models have recently emerged as a powerful tool, enabling the creation of photo-realistic images and giving rise to a multitude of applications. However, the effective integration of T2I models into…

计算机视觉与模式识别 · 计算机科学 2024-03-29 Zhicai Wang , Longhui Wei , Tan Wang , Heyu Chen , Yanbin Hao , Xiang Wang , Xiangnan He , Qi Tian

Text-to-image generation models can create high-quality images from input prompts. However, they struggle to support the consistent generation of identity-preserving requirements for storytelling. Existing approaches to this problem…

计算机视觉与模式识别 · 计算机科学 2025-02-06 Tao Liu , Kai Wang , Senmao Li , Joost van de Weijer , Fahad Shahbaz Khan , Shiqi Yang , Yaxing Wang , Jian Yang , Ming-Ming Cheng

The increasing popularity of long Text-to-Image (T2I) generation has created an urgent need for automatic and interpretable models that can evaluate the image-text alignment in long prompt scenarios. However, the existing T2I alignment…

计算机视觉与模式识别 · 计算机科学 2025-12-11 Zhichao Yang , Tianjiao Gu , Jianjie Wang , Feiyu Lin , Xiangfei Sheng , Pengfei Chen , Leida Li

Recent advances in Machine-Learning have led to the development of models that generate images based on a text description.Such large prompt-based text to image models (TTIs), trained on a considerable amount of data, allow the creation of…

人机交互 · 计算机科学 2023-03-23 Chinmay Kulkarni , Stefania Druga , Minsuk Chang , Alex Fiannaca , Carrie Cai , Michael Terry

Text-to-image generation has advanced rapidly, yet aligning complex textual prompts with generated visuals remains challenging, especially with intricate object relationships and fine-grained details. This paper introduces Fast Prompt…

计算与语言 · 计算机科学 2024-12-12 Khalil Mrini , Hanlin Lu , Linjie Yang , Weilin Huang , Heng Wang

Recent text-to-image (T2I) models generate semantically coherent images from textual prompts, yet evaluating how well they align with individual user preferences remains an open challenge. Conventional evaluation methods, general reward…

计算机视觉与模式识别 · 计算机科学 2025-11-26 Jeongeun Lee , Ryang Heo , Dongha Lee

Recent years have witnessed the substantial progress of large-scale models across various domains, such as natural language processing and computer vision, facilitating the expression of concrete concepts. Unlike concrete concepts that are…

计算机视觉与模式识别 · 计算机科学 2023-09-28 Jiayi Liao , Xu Chen , Qiang Fu , Lun Du , Xiangnan He , Xiang Wang , Shi Han , Dongmei Zhang

Text-to-image (T2I) diffusion models generate high-quality images but often fail to capture the spatial relations specified in text prompts. This limitation can be traced to two factors: lack of fine-grained spatial supervision in training…

计算机视觉与模式识别 · 计算机科学 2025-12-30 Sarah Rastegar , Violeta Chatalbasheva , Sieger Falkena , Anuj Singh , Yanbo Wang , Tejas Gokhale , Hamid Palangi , Hadi Jamali-Rad

Recent work suggests that large language models enhanced with retrieval-augmented generation are easily influenced by the order, in which the retrieved documents are presented to the model when solving tasks such as question answering (QA).…

计算与语言 · 计算机科学 2025-12-12 Tianyu Liu , Jirui Qi , Paul He , Arianna Bisazza , Mrinmaya Sachan , Ryan Cotterell

Recent progress in text-to-image generation has greatly advanced visual fidelity and creativity, but it has also imposed higher demands on prompt complexity-particularly in encoding intricate spatial relationships. In such cases, achieving…

计算机视觉与模式识别 · 计算机科学 2026-03-02 Zhenyu Tang , Chaoran Feng , Yufan Deng , Jie Wu , Xiaojie Li , Rui Wang , Yunpeng Chen , Daquan Zhou

Text-to-Image (T2I) generation has long been an open problem, with compositional synthesis remaining particularly challenging. This task requires accurate rendering of complex scenes containing multiple objects that exhibit diverse…

计算机视觉与模式识别 · 计算机科学 2025-11-25 Shijian Wang , Runhao Fu , Siyi Zhao , Qingqin Zhan , Xingjian Wang , Jiarui Jin , Yuan Lu , Hanqian Wu , Cunjian Chen