English
Related papers

Related papers: ReNO: Enhancing One-step Text-to-Image Models thro…

200 papers

Text-to-image models have shown remarkable progress in generating high-quality images from user-provided prompts. Despite this, the quality of these images varies due to the models' sensitivity to human language nuances. With advancements…

Artificial Intelligence · Computer Science 2024-06-14 Xinrui Yang , Zhuohan Wang , Anthony Hu

Deep generative models have shown impressive results in text-to-image synthesis. However, current text-to-image models often generate images that are inadequately aligned with text prompts. We propose a fine-tuning method for aligning such…

Text-to-image (T2I) systems enable rapid generation of high-fidelity imagery but are misaligned with how visual ideas develop. T2I systems generate outputs that make implicit visual decisions on behalf of the user, often introduce…

Human-Computer Interaction · Computer Science 2026-04-16 Zoe De Simone , Angie Boggust , Fredo Durand , Ashia Wilson , Arvind Satyanarayan

Despite recent advancements in text-to-image models, achieving semantically accurate images in text-to-image diffusion models is a persistent challenge. While existing initial latent optimization methods have demonstrated impressive…

Computer Vision and Pattern Recognition · Computer Science 2024-11-27 Aravindan Sundaram , Ujjayan Pal , Abhimanyu Chauhan , Aishwarya Agarwal , Srikrishna Karanam

Text-to-image (T2I) generation models have made significant strides but still struggle with prompt sensitivity: even minor changes in prompt wording can yield inconsistent or inaccurate outputs. To address this challenge, we introduce a…

Machine Learning · Computer Science 2025-07-31 Mohammad Abdul Hafeez Khan , Yash Jain , Siddhartha Bhattacharyya , Vibhav Vineet

Denoising Diffusion Probabilistic Models (DDPMs) are emerging in text-to-speech (TTS) synthesis because of their strong capability of generating high-fidelity samples. However, their iterative refinement process in high-dimensional data…

Audio and Speech Processing · Electrical Eng. & Systems 2023-01-02 Zehua Chen , Yihan Wu , Yichong Leng , Jiawei Chen , Haohe Liu , Xu Tan , Yang Cui , Ke Wang , Lei He , Sheng Zhao , Jiang Bian , Danilo Mandic

The new paradigm of test-time scaling has yielded remarkable breakthroughs in Large Language Models (LLMs) (e.g. reasoning models) and in generative vision models, allowing models to allocate additional computation during inference to…

Machine Learning · Computer Science 2025-08-14 Luca Eyring , Shyamgopal Karthik , Alexey Dosovitskiy , Nataniel Ruiz , Zeynep Akata

High-quality and open datasets remain a major bottleneck for text-to-image (T2I) fine-tuning. Despite rapid progress in model architectures and training pipelines, most publicly available fine-tuning datasets suffer from low resolution,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-11 Xu Ma , Yitian Zhang , Qihua Dong , Yun Fu

Text-to-image diffusion models (T2I DMs) have achieved remarkable success in generating high-quality and diverse images from text prompts, yet recent studies have revealed their vulnerability to backdoor attacks. Existing attack methods…

Cryptography and Security · Computer Science 2025-08-05 Haoran Dai , Jiawen Wang , Ruo Yang , Manali Sharma , Zhonghao Liao , Yuan Hong , Binghui Wang

The rapid advancement of text-to-image (T2I) models has increased the need for reliable human preference modeling, a demand further amplified by recent progress in reinforcement learning for preference alignment. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Yuxiang Guo , Jiang Liu , Ze Wang , Hao Chen , Ximeng Sun , Yang Zhao , Jialian Wu , Xiaodong Yu , Zicheng Liu , Emad Barsoum

With the open-sourcing of text-to-image models (T2I) such as stable diffusion (SD) and stable diffusion XL (SD-XL), there is an influx of models fine-tuned in specific domains based on the open-source SD model, such as in anime, character…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Ruyi Gan , Xiaojun Wu , Junyu Lu , Yuanhe Tian , Dixiang Zhang , Ziwei Wu , Renliang Sun , Chang Liu , Jiaxing Zhang , Pingjian Zhang , Yan Song

Diffusion-based text-to-video (T2V) models have achieved significant success but continue to be hampered by the slow sampling speed of their iterative sampling processes. To address the challenge, consistency models have been proposed to…

Computer Vision and Pattern Recognition · Computer Science 2024-10-14 Jiachen Li , Weixi Feng , Tsu-Jui Fu , Xinyi Wang , Sugato Basu , Wenhu Chen , William Yang Wang

Unified multimodal generation architectures that jointly produce text and images have recently emerged as a promising direction for text-to-image (T2I) synthesis. However, many existing systems rely on explicit modality switching,…

The rapid advancements of Text-to-Image (T2I) models have ushered in a new phase of AI-generated content, marked by their growing ability to interpret and follow user instructions. However, existing T2I model evaluation benchmarks fall…

Computer Vision and Pattern Recognition · Computer Science 2025-06-26 Xinyu Wei , Jinrui Zhang , Zeqing Wang , Hongyang Wei , Zhen Guo , Lei Zhang

Despite the rapid progress of text-to-image (T2I) models, generating images that accurately reflect complex compositional prompts (covering attribute bindings, object relationships, counting) still remains challenging. To address this, we…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Zhuohan Liu , Wujian Peng , Yitong Chen , Zuxuan Wu

Text-to-Image (T2I) diffusion models have made remarkable advancements in generative modeling; however, they face a trade-off between inference speed and image quality, posing challenges for efficient deployment. Existing distilled T2I…

Computer Vision and Pattern Recognition · Computer Science 2025-05-29 Senmao Li , Lei Wang , Kai Wang , Tao Liu , Jiehang Xie , Joost van de Weijer , Fahad Shahbaz Khan , Shiqi Yang , Yaxing Wang , Jian Yang

Text-guided image editing using Text-to-Image (T2I) models often fails to yield satisfactory results, frequently introducing unintended modifications, such as the loss of local detail and color changes. In this paper, we analyze these…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Yufan Ren , Zicong Jiang , Tong Zhang , Søren Forchhammer , Sabine Süsstrunk

Recent text-to-image (T2I) diffusion models achieve remarkable realism, yet faithful prompt-image alignment remains challenging, particularly for complex prompts with multiple objects, relations, and fine-grained attributes. Existing…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Liyao Jiang , Ruichen Chen , Chao Gao , Di Niu

The goal of this paper is to enhance Text-to-Audio generation at inference, focusing on generating realistic audio that precisely aligns with text prompts. Despite the rapid advancements, existing models often fail to achieve a reliable…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-25 Jaemin Jung , Jaehun Kim , Inkyu Shin , Joon Son Chung

Text-to-image diffusion model is a popular paradigm that synthesizes personalized images by providing a text prompt and a random Gaussian noise. While people observe that some noises are ``golden noises'' that can achieve better text-image…

Machine Learning · Computer Science 2025-07-18 Zikai Zhou , Shitong Shao , Lichen Bai , Shufei Zhang , Zhiqiang Xu , Bo Han , Zeke Xie