中文
相关论文

相关论文: ORACLE: Leveraging Mutual Information for Consiste…

200 篇论文

Text-conditioned image generation models are a prevalent use of AI image synthesis, yet intuitively controlling output guided by an artist remains challenging. Current methods require multiple images and textual prompts for each object to…

计算机视觉与模式识别 · 计算机科学 2024-01-02 Shounak Chatterjee

Storyboarding is an established method for designing user experiences. Generative AI can support this process by helping designers quickly create visual narratives. However, existing tools only focus on accurate text-to-image generation.…

人机交互 · 计算机科学 2024-07-11 Zhaohui Liang , Xiaoyu Zhang , Kevin Ma , Zhao Liu , Xipei Ren , Kosa Goucher-Lambert , Can Liu

EasyRead pictograms are simple, visually clear images that represent specific concepts and support comprehension for people with intellectual disabilities, low literacy, or language barriers. The large-scale production of EasyRead content…

Recently, the impressive generative capabilities of diffusion models have been demonstrated, producing images with remarkable fidelity. Particularly, existing methods for the 3D object generation tasks, which is one of the fastest-growing…

计算机视觉与模式识别 · 计算机科学 2025-12-01 Jaeseok Lee , Jaekoo Lee

Text-to-image generation models have grown in popularity due to their ability to produce high-quality images from a text prompt. One use for this technology is to enable the creation of more accessible art creation software. In this paper,…

人机交互 · 计算机科学 2023-09-06 Atieh Taheri , Mohammad Izadi , Gururaj Shriram , Negar Rostamzadeh , Shaun Kane

Recent advances in text-to-image customization have enabled high-fidelity, context-rich generation of personalized images, allowing specific concepts to appear in a variety of scenarios. However, current methods struggle with combining…

计算机视觉与模式识别 · 计算机科学 2025-09-30 Enis Simsar , Thomas Hofmann , Federico Tombari , Pinar Yanardag

The quality of the prompts provided to text-to-image diffusion models determines how faithful the generated content is to the user's intent, often requiring `prompt engineering'. To harness visual concepts from target images without prompt…

计算机视觉与模式识别 · 计算机科学 2023-12-20 Shweta Mahajan , Tanzila Rahman , Kwang Moo Yi , Leonid Sigal

Diffusion models developed on top of powerful text-to-image generation models like Stable Diffusion achieve remarkable success in visual story generation. However, the best-performing approach considers historically generated results as…

计算机视觉与模式识别 · 计算机科学 2023-05-29 Zhangyin Feng , Yuchen Ren , Xinmiao Yu , Xiaocheng Feng , Duyu Tang , Shuming Shi , Bing Qin

In text-to-image generation tasks, the advancements of diffusion models have facilitated the fidelity of generated results. However, these models encounter challenges when processing text prompts containing multiple entities and attributes.…

计算与语言 · 计算机科学 2024-04-23 Yihang Wu , Xiao Cao , Kaixin Li , Zitan Chen , Haonan Wang , Lei Meng , Zhiyong Huang

While recent advancements in Image Super-Resolution (SR) using diffusion models have shown promise in improving overall image quality, their application to scene text images has revealed limitations. These models often struggle with…

计算机视觉与模式识别 · 计算机科学 2025-05-30 Keren Ye , Ignacio Garcia Dorado , Michalis Raptis , Mauricio Delbracio , Irene Zhu , Peyman Milanfar , Hossein Talebi

We present RaCig, a novel system for generating comic-style image sequences with consistent characters and expressive gestures. RaCig addresses two key challenges: (1) maintaining character identity and costume consistency across frames,…

计算机视觉与模式识别 · 计算机科学 2025-06-17 Yunhao Shui , Xuekuan Wang , Feng Qiu , Yuqiu Huang , Jinzhu Li , Haoyu Zheng , Jinru Han , Zhuo Zeng , Pengpeng Zhang , Jiarui Han , Keqiang Sun

Facial images have extensive practical applications. Although the current large-scale text-image diffusion models exhibit strong generation capabilities, it is challenging to generate the desired facial images using only text prompt. Image…

计算机视觉与模式识别 · 计算机科学 2025-01-07 Dawei Dai , Mingming Jia , Yinxiu Zhou , Hang Xing , Chenghang Li

Sketch colorization plays an important role in animation and digital illustration production tasks. However, existing methods still meet problems in that text-guided methods fail to provide accurate color and style reference, hint-guided…

计算机视觉与模式识别 · 计算机科学 2025-02-28 Dingkun Yan , Xinrui Wang , Zhuoru Li , Suguru Saito , Yusuke Iwasawa , Yutaka Matsuo , Jiaxian Guo

Diffusion models have become a new generative paradigm for text generation. Considering the discrete categorical nature of text, in this paper, we propose GlyphDiffusion, a novel diffusion approach for text generation via text-guided image…

计算与语言 · 计算机科学 2023-05-09 Junyi Li , Wayne Xin Zhao , Jian-Yun Nie , Ji-Rong Wen

Artistic typography aims to stylize input characters with visual effects that are both creative and legible. Traditional approaches rely heavily on manual design, while recent generative models, particularly diffusion-based methods, have…

计算机视觉与模式识别 · 计算机科学 2025-07-15 Zhe Wang , Jingbo Zhang , Tianyi Wei , Wanchao Su , Can Wang

Text-to-image diffusion models have demonstrated an unparalleled ability to generate high-quality, diverse images from a textual prompt. However, the internal representations learned by these models remain an enigma. In this work, we…

计算机视觉与模式识别 · 计算机科学 2023-10-06 Hila Chefer , Oran Lang , Mor Geva , Volodymyr Polosukhin , Assaf Shocher , Michal Irani , Inbar Mosseri , Lior Wolf

Text-to-image generation has witnessed great progress, especially with the recent advancements in diffusion models. Since texts cannot provide detailed conditions like object appearance, reference images are usually leveraged for the…

计算机视觉与模式识别 · 计算机科学 2024-04-09 Zhiqi Huang , Huixin Xiong , Haoyu Wang , Longguang Wang , Zhiheng Li

Personalized text-to-image models allow users to generate varied styles of images (specified with a sentence) for an object (specified with a set of reference images). While remarkable results have been achieved using diffusion-based…

计算机视觉与模式识别 · 计算机科学 2024-07-19 Fanyue Wei , Wei Zeng , Zhenyang Li , Dawei Yin , Lixin Duan , Wen Li

Text-to-image models offer a new level of creative flexibility by allowing users to guide the image generation process through natural language. However, using these models to consistently portray the same subject across diverse prompts…

计算机视觉与模式识别 · 计算机科学 2024-05-31 Yoad Tewel , Omri Kaduri , Rinon Gal , Yoni Kasten , Lior Wolf , Gal Chechik , Yuval Atzmon

Tuning-free personalized image generation methods have achieved significant success in maintaining facial consistency, i.e., identities, even with multiple characters. However, the lack of holistic consistency in scenes with multiple…

计算机视觉与模式识别 · 计算机科学 2024-09-20 Zhengguang Zhou , Jing Li , Huaxia Li , Nemo Chen , Xu Tang