中文
相关论文

相关论文: UFOGen: You Forward Once Large Scale Text-to-Image…

200 篇论文

Diffusion models enable high-quality and diverse visual content synthesis. However, they struggle to generate rare or unseen concepts. To address this challenge, we explore the usage of Retrieval-Augmented Generation (RAG) with image…

计算机视觉与模式识别 · 计算机科学 2026-02-10 Rotem Shalev-Arkushin , Rinon Gal , Amit H. Bermano , Ohad Fried

Large diffusion-based Text-to-Image (T2I) models have shown impressive generative powers for text-to-image generation as well as spatially conditioned image generation. For most applications, we can train the model end-toend with paired…

计算机视觉与模式识别 · 计算机科学 2024-04-16 Nithin Gopalakrishnan Nair , Jeya Maria Jose Valanarasu , Vishal M Patel

Over the past few years, Text-to-Image (T2I) generation approaches based on diffusion models have gained significant attention. However, vanilla diffusion models often suffer from spelling inaccuracies in the text displayed within the…

计算机视觉与模式识别 · 计算机科学 2024-10-30 Sanyam Lakhanpal , Shivang Chopra , Vinija Jain , Aman Chadha , Man Luo

We present Imagen, a text-to-image diffusion model with an unprecedented degree of photorealism and a deep level of language understanding. Imagen builds on the power of large transformer language models in understanding text and hinges on…

We present EasyGen, an efficient model designed to enhance multimodal understanding and generation by harnessing the capabilities of diffusion models and large language models (LLMs), Unlike existing multimodal models that predominately…

人工智能 · 计算机科学 2024-05-20 Xiangyu Zhao , Bo Liu , Qijiong Liu , Guangyuan Shi , Xiao-Ming Wu

Recent advances in diffusion models enable many powerful instruments for image editing. One of these instruments is text-driven image manipulations: editing semantic attributes of an image according to the provided text description. %…

计算机视觉与模式识别 · 计算机科学 2023-04-11 Nikita Starodubcev , Dmitry Baranchuk , Valentin Khrulkov , Artem Babenko

Text-to-image synthesis has witnessed remarkable advancements in recent years. Many attempts have been made to adopt text-to-image models to support multiple tasks. However, existing approaches typically require resource-intensive…

计算机视觉与模式识别 · 计算机科学 2025-03-18 Ruchika Chavhan , Abhinav Mehrotra , Malcolm Chadwick , Alberto Gil Ramos , Luca Morreale , Mehdi Noroozi , Sourav Bhattacharya

Recent text-to-image diffusion models are able to learn and synthesize images containing novel, personalized concepts (e.g., their own pets or specific items) with just a few examples for training. This paper tackles two interconnected…

计算机视觉与模式识别 · 计算机科学 2024-02-26 Chun-Hsiao Yeh , Ta-Ying Cheng , He-Yen Hsieh , Chuan-En Lin , Yi Ma , Andrew Markham , Niki Trigoni , H. T. Kung , Yubei Chen

While generative models produce high-quality images of concepts learned from a large-scale database, a user often wishes to synthesize instantiations of their own concepts (for example, their family, pets, or items). Can we teach a model to…

计算机视觉与模式识别 · 计算机科学 2023-06-21 Nupur Kumari , Bingliang Zhang , Richard Zhang , Eli Shechtman , Jun-Yan Zhu

Recent progress in generative compression technology has significantly improved the perceptual quality of compressed data. However, these advancements primarily focus on producing high-frequency details, often overlooking the ability of…

计算机视觉与模式识别 · 计算机科学 2024-03-07 Naifu Xue , Qi Mao , Zijian Wang , Yuan Zhang , Siwei Ma

The emergence of diffusion models has significantly advanced image synthesis. The recent studies of model interaction and self-corrective reasoning approach in large language models offer new insights for enhancing text-to-image models.…

计算机视觉与模式识别 · 计算机科学 2024-12-19 Zhongjie Duan , Qianyi Zhao , Cen Chen , Daoyuan Chen , Wenmeng Zhou , Yaliang Li , Yingda Chen

Text-to-image diffusion models have remarkably excelled in producing diverse, high-quality, and photo-realistic images. This advancement has spurred a growing interest in incorporating specific identities into generated content. Most…

计算机视觉与模式识别 · 计算机科学 2023-11-30 Xiaoming Li , Xinyu Hou , Chen Change Loy

Recent breakthroughs in text-to-image synthesis have been driven by diffusion models trained on billions of image-text pairs. Adapting this approach to 3D synthesis would require large-scale datasets of labeled 3D data and efficient…

计算机视觉与模式识别 · 计算机科学 2022-09-30 Ben Poole , Ajay Jain , Jonathan T. Barron , Ben Mildenhall

Recent studies have shown remarkable success in image-to-image translation for two domains. However, existing approaches have limited scalability and robustness in handling more than two domains, since different models should be built…

计算机视觉与模式识别 · 计算机科学 2018-09-24 Yunjey Choi , Minje Choi , Munyoung Kim , Jung-Woo Ha , Sunghun Kim , Jaegul Choo

With the continuous advancement of image generation technology, advanced models such as GPT-Image-1 and Qwen-Image have achieved remarkable text-to-image consistency and world knowledge However, these models still fall short in…

计算机视觉与模式识别 · 计算机科学 2025-12-02 Junyan Ye , Leiqi Zhu , Yuncheng Guo , Dongzhi Jiang , Zilong Huang , Yifan Zhang , Zhiyuan Yan , Haohuan Fu , Conghui He , Weijia Li

The goal of a speech-to-image transform is to produce a photo-realistic picture directly from a speech signal. Recently, various studies have focused on this task and have achieved promising performance. However, current speech-to-image…

计算机视觉与模式识别 · 计算机科学 2023-05-18 Zhenxing Zhang , Lambert Schomaker

Despite the unprecedented success of text-to-image diffusion models, controlling the number of depicted objects using text is surprisingly hard. This is important for various applications from technical documents, to children's books to…

计算机视觉与模式识别 · 计算机科学 2024-06-17 Lital Binyamin , Yoad Tewel , Hilit Segev , Eran Hirsch , Royi Rassin , Gal Chechik

Text-to-image generation has greatly advanced content creation, yet accurately rendering visual text remains a key challenge due to blurred glyphs, semantic drift, and limited style control. Existing methods often rely on pre-rendered glyph…

计算机视觉与模式识别 · 计算机科学 2025-07-03 Yuanrui Wang , Cong Han , Yafei Li , Zhipeng Jin , Xiawei Li , SiNan Du , Wen Tao , Yi Yang , Shuanglong Li , Chun Yuan , Liu Lin

Unified multimodal generative models aim to integrate image understanding and generation abilities, offering significant advantages in harnessing multimodal corpora, particularly interleaved text-image data. However, existing unified models…

计算机视觉与模式识别 · 计算机科学 2025-07-16 Hong Zhang , Zhongjie Duan , Xingjun Wang , Yuze Zhao , Weiyi Lu , Zhipeng Di , Yixuan Xu , Yingda Chen , Yu Zhang

Currently, high-fidelity text-to-image models are developed in an accelerating pace. Among them, Diffusion Models have led to a remarkable improvement in the quality of image generation, making it vary challenging to distinguish between…

计算机视觉与模式识别 · 计算机科学 2024-11-21 Ziyue Zeng , Haoyuan Liu , Dingjie Peng , Luoxu Jing , Hiroshi Watanabe