中文
相关论文

相关论文: Diff-Aid: Inference-time Adaptive Interaction Deno…

200 篇论文

The text-to-image (T2I) personalization diffusion model can generate images of the novel concept based on the user input text caption. However, existing T2I personalized methods either require test-time fine-tuning or fail to generate…

计算机视觉与模式识别 · 计算机科学 2024-12-25 Xiao Guo , Manh Tran , Jiaxin Cheng , Xiaoming Liu

Text-to-Image (T2I) diffusion models have achieved remarkable success in image generation. Despite their progress, challenges remain in both prompt-following ability, image quality and lack of high-quality datasets, which are essential for…

计算机视觉与模式识别 · 计算机科学 2025-01-03 Jingkun An , Yinghao Zhu , Zongjian Li , Enshen Zhou , Haoran Feng , Xijie Huang , Bohua Chen , Yemin Shi , Chengwei Pan

Scaling up model and data size has been quite successful for the evolution of LLMs. However, the scaling law for the diffusion based text-to-image (T2I) models is not fully explored. It is also unclear how to efficiently scale the model for…

计算机视觉与模式识别 · 计算机科学 2024-04-04 Hao Li , Yang Zou , Ying Wang , Orchid Majumder , Yusheng Xie , R. Manmatha , Ashwin Swaminathan , Zhuowen Tu , Stefano Ermon , Stefano Soatto

Diffusion-based text-to-image (T2I) models have made remarkable progress in generating photorealistic and semantically rich images. However, when the target concepts lie in low-density regions of the training distribution, these models…

计算机视觉与模式识别 · 计算机科学 2026-03-20 Kwanyoung Lee , SeungJu Cha , Yebin Ahn , Hyunwoo Oh , Sungho Koh , Dong-Jin Kim

This research focuses on the development and enhancement of text-to-image denoising diffusion models, addressing key challenges such as limited sample diversity and training instability. By incorporating Classifier-Free Guidance (CFG) and…

计算机视觉与模式识别 · 计算机科学 2025-03-10 Rajdeep Roshan Sahu

Text-to-Image (T2I) diffusion models are widely recognized for their ability to generate high-quality and diverse images based on text prompts. However, despite recent advances, these models are still prone to generating unsafe images…

计算机视觉与模式识别 · 计算机科学 2024-12-06 Jiangweizhi Peng , Zhiwei Tang , Gaowen Liu , Charles Fleming , Mingyi Hong

This paper introduces a novel approach to synthesize texture to dress up a given 3D object, given a text prompt. Based on the pretrained text-to-image (T2I) diffusion model, existing methods usually employ a project-and-inpaint approach, in…

计算机视觉与模式识别 · 计算机科学 2025-03-19 Yuxin Liu , Minshan Xie , Hanyuan Liu , Tien-Tsin Wong

The rapid development of diffusion models has triggered diverse applications. Identity-preserving text-to-image generation (ID-T2I) particularly has received significant attention due to its wide range of application scenarios like AI…

计算机视觉与模式识别 · 计算机科学 2024-04-25 Weifeng Chen , Jiacheng Zhang , Jie Wu , Hefeng Wu , Xuefeng Xiao , Liang Lin

Text-to-image diffusion models have proven effective for solving many image editing tasks. However, the seemingly straightforward task of seamlessly relocating objects within a scene remains surprisingly challenging. Existing methods…

计算机视觉与模式识别 · 计算机科学 2024-12-17 Omri Avrahami , Rinon Gal , Gal Chechik , Ohad Fried , Dani Lischinski , Arash Vahdat , Weili Nie

Diffusion-based text-to-image models have rapidly gained popularity for their ability to generate detailed and realistic images from textual descriptions. However, these models often reflect the biases present in their training data,…

计算机视觉与模式识别 · 计算机科学 2024-04-01 Hidir Yesiltepe , Kiymet Akdemir , Pinar Yanardag

With the development of Artificial Intelligence, numerous real-world tasks have been accomplished using technology integrated with deep learning. To achieve optimal performance, deep neural networks typically require large volumes of data…

机器学习 · 计算机科学 2025-05-09 Yuren Zhang , Zhongnan Pu , Lei Jing

Recently, text-to-image diffusion models have demonstrated impressive ability to generate high-quality images conditioned on the textual input. However, these models struggle to accurately adhere to textual instructions regarding spatial…

计算机视觉与模式识别 · 计算机科学 2024-01-30 Wenqiang Sun , Teng Li , Zehong Lin , Jun Zhang

Text-to-motion generation, which synthesizes 3D human motions from text inputs, holds immense potential for applications in gaming, film, and robotics. Recently, diffusion-based methods have been shown to generate more diversity and…

计算机视觉与模式识别 · 计算机科学 2025-11-25 Wanjiang Weng , Xiaofeng Tan , Junbo Wang , Guo-Sen Xie , Pan Zhou , Hongsong Wang

Recent text-to-image (T2I) diffusion models have achieved remarkable progress in generating high-quality images given text-prompts as input. However, these models fail to convey appropriate spatial composition specified by a layout…

计算机视觉与模式识别 · 计算机科学 2023-11-28 Jiayu Xiao , Henglei Lv , Liang Li , Shuhui Wang , Qingming Huang

Diffusion models have been successfully adapted to text generation tasks by mapping the discrete text into the continuous space. However, there exist nonnegligible gaps between training and inference, owing to the absence of the forward…

计算与语言 · 计算机科学 2023-05-09 Zecheng Tang , Pinzheng Wang , Keyan Zhou , Juntao Li , Ziqiang Cao , Min Zhang

Inference-time alignment provides an efficient alternative for aligning LLMs with humans. However, these approaches still face challenges, such as limited scalability due to policy-specific value functions and latency during the inference…

计算与语言 · 计算机科学 2025-05-27 Ruizhe Chen , Wenhao Chai , Zhifei Yang , Xiaotian Zhang , Joey Tianyi Zhou , Tony Quek , Soujanya Poria , Zuozhu Liu

Recent advances in diffusion models have showcased promising results in the text-to-video (T2V) synthesis task. However, as these T2V models solely employ text as the guidance, they tend to struggle in modeling detailed temporal dynamics.…

计算机视觉与模式识别 · 计算机科学 2023-05-24 Seungwoo Lee , Chaerin Kong , Donghyeon Jeon , Nojun Kwak

Focusing on text-to-image (T2I) generation, we propose Text and Image Mutual-Translation Adversarial Networks (TIME), a lightweight but effective model that jointly learns a T2I generator G and an image captioning discriminator D under the…

计算机视觉与模式识别 · 计算机科学 2020-12-24 Bingchen Liu , Kunpeng Song , Yizhe Zhu , Gerard de Melo , Ahmed Elgammal

The most advanced text-to-image (T2I) models require significant training costs (e.g., millions of GPU hours), seriously hindering the fundamental innovation for the AIGC community while increasing CO2 emissions. This paper introduces…

计算机视觉与模式识别 · 计算机科学 2024-01-01 Junsong Chen , Jincheng Yu , Chongjian Ge , Lewei Yao , Enze Xie , Yue Wu , Zhongdao Wang , James Kwok , Ping Luo , Huchuan Lu , Zhenguo Li

As artificial intelligence-generated content (AIGC) continues to evolve, video-to-audio (V2A) generation has emerged as a key area with promising applications in multimedia editing, augmented reality, and automated content creation. While…

计算机视觉与模式识别 · 计算机科学 2025-03-17 Yuhuan You , Xihong Wu , Tianshu Qu