中文
相关论文

相关论文: Large-scale Text-to-Image Generation Models for Vi…

200 篇论文

Large language models (LLMs) have demonstrated immense potential across various tasks. However, research for exploring and improving the capabilities of LLMs in interpreting graph structures remains limited. To address this gap, we conduct…

计算与语言 · 计算机科学 2025-02-17 Jie He , Yijun Yang , Wanqiu Long , Deyi Xiong , Victor Gutierrez-Basulto , Jeff Z. Pan

This paper investigates the direct risks and harms associated with modern text-to-image generative models, such as DALL-E and Midjourney, through a comprehensive literature review. While these models offer unprecedented capabilities for…

计算机与社会 · 计算机科学 2023-07-13 Charlotte Bird , Eddie L. Ungless , Atoosa Kasirzadeh

Long-tail recognition is challenging because it requires the model to learn good representations from tail categories and address imbalances across all categories. In this paper, we propose a novel generative and fine-tuning framework,…

计算机视觉与模式识别 · 计算机科学 2024-05-28 Qihao Zhao , Yalun Dai , Hao Li , Wei Hu , Fan Zhang , Jun Liu

Recent advances in text-to-image synthesis make it possible to visualize machine imaginations for a given context. On the other hand, when generating text, human writers are gifted at creative visualization, which enhances their writings by…

计算与语言 · 计算机科学 2023-02-16 Wanrong Zhu , An Yan , Yujie Lu , Wenda Xu , Xin Eric Wang , Miguel Eckstein , William Yang Wang

Connecting text and visual modalities plays an essential role in generative intelligence. For this reason, inspired by the success of large language models, significant research efforts are being devoted to the development of Multimodal…

Diffusion models have exhibited substantial success in text-to-image generation. However, they often encounter challenges when dealing with complex and dense prompts involving multiple objects, attribute binding, and long descriptions. In…

计算机视觉与模式识别 · 计算机科学 2024-08-28 Mushui Liu , Yuhang Ma , Yang Zhen , Jun Dan , Yunlong Yu , Zeng Zhao , Zhipeng Hu , Bai Liu , Changjie Fan

Text-to-image generative models have recently exploded in popularity and accessibility. Yet so far, use of these models in creative tasks that bridge the 2D digital world and the creation of physical artefacts has been understudied. We…

人工智能 · 计算机科学 2023-02-02 Amy Smith , Hope Schroeder , Ziv Epstein , Michael Cook , Simon Colton , Andrew Lippman

Generative AI applications, such as ChatGPT or DALL-E, have shown the world their impressive capabilities in generating human-like text or image. Diving deeper, the science stakeholder for those AI applications are Deep Generative Models,…

人工智能 · 计算机科学 2024-03-05 Yuan Wang , Lokesh Kumar Sambasivan , Mingang Fu , Prakhar Mehrotra

One critical prerequisite for faithful text-to-image generation is the accurate understanding of text inputs. Existing methods leverage the text encoder of the CLIP model to represent input prompts. However, the pre-trained CLIP model can…

计算机视觉与模式识别 · 计算机科学 2024-07-19 Zhiyu Tan , Mengping Yang , Luozheng Qin , Hao Yang , Ye Qian , Qiang Zhou , Cheng Zhang , Hao Li

This work investigates a challenging task named open-domain interleaved image-text generation, which generates interleaved texts and images following an input query. We propose a new interleaved generation framework based on prompting…

计算机视觉与模式识别 · 计算机科学 2023-11-07 Jie An , Zhengyuan Yang , Linjie Li , Jianfeng Wang , Kevin Lin , Zicheng Liu , Lijuan Wang , Jiebo Luo

The field of agricultural communication is evolving rapidly with the advent of generative artificial intelligence (AI), particularly image generation technologies. As these tools begin to influence how agricultural data is visualized and…

计算机视觉与模式识别 · 计算机科学 2025-07-29 Ranjan Sapkota , Manoj Karkee

Text-to-image models are powerful for producing high-quality images based on given text prompts, but crafting these prompts often requires specialized vocabulary. To address this, existing methods train rewriting models with supervision…

计算机视觉与模式识别 · 计算机科学 2025-12-16 Hongji Yang , Yucheng Zhou , Wencheng Han , Jianbing Shen

Diffusion-based generative models have significantly advanced text-to-image generation but encounter challenges when processing lengthy and intricate text prompts describing complex scenes with multiple objects. While excelling in…

计算机视觉与模式识别 · 计算机科学 2024-02-27 Hanan Gani , Shariq Farooq Bhat , Muzammal Naseer , Salman Khan , Peter Wonka

The recent progress of text-to-image generation has been recognized in architectural design. Our study is the first to investigate the potential of text-to-image generators in supporting creativity during the early stages of the…

人机交互 · 计算机科学 2024-01-17 Ville Paananen , Jonas Oppenlaender , Aku Visuri

Large Multimodal Models (LMMs) have demonstrated impressive capabilities in multimodal understanding and generation, pushing forward advancements in text-to-image generation. However, achieving accurate text-image alignment for LMMs,…

计算机视觉与模式识别 · 计算机科学 2025-03-26 Leigang Qu , Haochuan Li , Wenjie Wang , Xiang Liu , Juncheng Li , Liqiang Nie , Tat-Seng Chua

Text-to-image generative models are a new and powerful way to generate visual artwork. However, the open-ended nature of text as interaction is double-edged; while users can input anything and have access to an infinite range of…

人机交互 · 计算机科学 2023-09-29 Vivian Liu , Lydia B. Chilton

Recent advancements in text-to-image models, particularly diffusion models, have shown significant promise. However, compositional text-to-image models frequently encounter difficulties in generating high-quality images that accurately…

计算机视觉与模式识别 · 计算机科学 2023-10-11 Song Wen , Guian Fang , Renrui Zhang , Peng Gao , Hao Dong , Dimitris Metaxas

Text-to-image models such as stable diffusion have opened a plethora of opportunities for generating art. Recent literature has surveyed the use of text-to-image models for enhancing the work of many creative artists. Many e-commerce…

Large language models (LLMs) have garnered significant attention for their superior performance in many knowledge-driven applications on the world wide web.These models are designed to train hundreds of millions or more parameters on large…

计算与语言 · 计算机科学 2025-04-09 Bingchen Liu , Yuanyuan Fang , Naixing Xu , Shihao Hou , Xin Li , Qian Li

Explanatory images play a pivotal role in accessible and easy-to-read (E2R) texts. However, the images available in online databases are not tailored toward the respective texts, and the creation of customized images is expensive. In this…

计算机视觉与模式识别 · 计算机科学 2024-10-07 Miriam Anschütz , Tringa Sylaj , Georg Groh