English
Related papers

Related papers: Highly Efficient Test-Time Scaling for T2I Diffusi…

200 papers

Benefiting from the development of deep learning, text-to-speech (TTS) techniques using clean speech have achieved significant performance improvements. The data collected from real scenes often contains noise and generally needs to be…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-06 Qiushi Zhu , Yu Gu , Rilin Chen , Chao Weng , Yuchen Hu , Lirong Dai , Jie Zhang

Text-to-Image (T2I) Diffusion Models (DMs) have shown impressive abilities in generating high-quality images based on simple text descriptions. However, as is common with many Deep Learning (DL) models, DMs are subject to a lack of…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Yi Zhang , Yun Tang , Wenjie Ruan , Xiaowei Huang , Siddartha Khastgir , Paul Jennings , Xingyu Zhao

Text-to-Image (T2I) diffusion models are widely recognized for their ability to generate high-quality and diverse images based on text prompts. However, despite recent advances, these models are still prone to generating unsafe images…

Computer Vision and Pattern Recognition · Computer Science 2024-12-06 Jiangweizhi Peng , Zhiwei Tang , Gaowen Liu , Charles Fleming , Mingyi Hong

Text-to-Time Series generation holds significant potential to address challenges such as data sparsity, imbalance, and limited availability of multimodal time series datasets across domains. While diffusion models have achieved remarkable…

Machine Learning · Computer Science 2025-05-09 Yunfeng Ge , Jiawei Li , Yiji Zhao , Haomin Wen , Zhao Li , Meikang Qiu , Hongyan Li , Ming Jin , Shirui Pan

Contemporary text-to-image models exhibit a surprising degree of mode collapse, as can be seen when sampling several images given the same text prompt. Previous work has attempted to address this issue by steering the model using guidance…

Computer Vision and Pattern Recognition · Computer Science 2026-05-04 Anne Harrington , A. Sophia Koepke , Shyamgopal Karthik , Trevor Darrell , Alexei A. Efros

Text-to-image (T2I) models offer great potential for creating virtually limitless synthetic data, a valuable resource compared to fixed and finite real datasets. Previous works evaluate the utility of synthetic data from T2I models on three…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Zhang Xiaofeng , Aaron Courville , Michal Drozdzal , Adriana Romero-Soriano

Although neural text-to-speech (TTS) models have attracted a lot of attention and succeeded in generating human-like speech, there is still room for improvements to its naturalness and architectural efficiency. In this work, we propose a…

Audio and Speech Processing · Electrical Eng. & Systems 2021-04-06 Myeonghun Jeong , Hyeongju Kim , Sung Jun Cheon , Byoung Jin Choi , Nam Soo Kim

Text-to-Image (T2I) generation methods based on diffusion model have garnered significant attention in the last few years. Although these image synthesis methods produce visually appealing results, they frequently exhibit spelling errors…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Yiming Zhao , Zhouhui Lian

The iterative and stochastic nature of diffusion models enables test-time scaling, whereby spending additional compute during denoising generates higher-fidelity samples. Increasing the number of denoising steps is the primary scaling axis,…

Machine Learning · Computer Science 2025-09-09 Vignav Ramesh , Morteza Mardani

The Stable Diffusion Model (SDM) is a prevalent and effective model for text-to-image (T2I) and image-to-image (I2I) generation. Despite various attempts at sampler optimization, model distillation, and network quantification, these…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Jinchao Zhu , Yuxuan Wang , Siyuan Pan , Pengfei Wan , Di Zhang , Gao Huang

Scaling text-to-speech (TTS) to large-scale, multi-speaker, and in-the-wild datasets is important to capture the diversity in human speech such as speaker identities, prosodies, and styles (e.g., singing). Current large TTS systems usually…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-31 Kai Shen , Zeqian Ju , Xu Tan , Yanqing Liu , Yichong Leng , Lei He , Tao Qin , Sheng Zhao , Jiang Bian

Large-scale text-guided image diffusion models have shown astonishing results in text-to-image (T2I) generation. However, applying these models to synthesize textures for 3D geometries remains challenging due to the domain gap between 2D…

Computer Vision and Pattern Recognition · Computer Science 2024-09-30 Jiawei Lu , Yingpeng Zhang , Zengjun Zhao , He Wang , Kun Zhou , Tianjia Shao

Diffusion-based Generative AI gains significant attention for its superior performance over other generative techniques like Generative Adversarial Networks and Variational Autoencoders. While it has achieved notable advancements in fields…

Sound · Computer Science 2024-12-12 Haowei Lou , Helen Paik , Pari Delir Haghighi , Wen Hu , Lina Yao

Text-to-speech (TTS) methods have shown promising results in voice cloning, but they require a large number of labeled text-speech pairs. Minimally-supervised speech synthesis decouples TTS by combining two types of discrete speech…

Sound · Computer Science 2023-12-19 Chunyu Qiang , Hao Li , Yixin Tian , Yi Zhao , Ying Zhang , Longbiao Wang , Jianwu Dang

Text-to-image (T2I) generative models have gained increased popularity in the public domain. While boasting impressive user-guided generative abilities, their black-box nature exposes users to intentionally- and intrinsically-biased…

Computer Vision and Pattern Recognition · Computer Science 2024-09-18 Jordan Vice , Naveed Akhtar , Richard Hartley , Ajmal Mian

This paper presents a novel data augmentation technique for text-to-speech (TTS), that allows to generate new (text, audio) training examples without requiring any additional data. Our goal is to increase diversity of text conditionings…

Large-scale diffusion-based generative models have led to breakthroughs in text-conditioned high-resolution image synthesis. Starting from random noise, such text-to-image diffusion models gradually synthesize images in an iterative fashion…

Computer Vision and Pattern Recognition · Computer Science 2023-03-15 Yogesh Balaji , Seungjun Nah , Xun Huang , Arash Vahdat , Jiaming Song , Qinsheng Zhang , Karsten Kreis , Miika Aittala , Timo Aila , Samuli Laine , Bryan Catanzaro , Tero Karras , Ming-Yu Liu

The rapid development of large-scale text-to-speech (TTS) models has led to significant advancements in modeling diverse speaker prosody and voices. However, these models often face issues such as slow inference speeds, reliance on complex…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-17 Yinghao Aaron Li , Xilin Jiang , Cong Han , Nima Mesgarani

Text-guided image editing using Text-to-Image (T2I) models often fails to yield satisfactory results, frequently introducing unintended modifications, such as the loss of local detail and color changes. In this paper, we analyze these…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Yufan Ren , Zicong Jiang , Tong Zhang , Søren Forchhammer , Sabine Süsstrunk

Text-To-Image (TTI) Diffusion Models such as DALL-E and Stable Diffusion are capable of generating images from text prompts. However, they have been shown to perpetuate gender stereotypes. These models process data internally in multiple…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Abhishek Mandal , Susan Leavy , Suzanne Little