English
Related papers

Related papers: Beyond Two-stage Diffusion TTS: Joint Structure an…

200 papers

Test-time Scaling (TTS) has been demonstrated to significantly enhance the reasoning capabilities of Large Language Models (LLMs) during the inference phase without altering model parameters. However, existing TTS methods are largely…

Computation and Language · Computer Science 2025-09-30 Guibin Zhang , Fanci Meng , Guancheng Wan , Zherui Li , Kun Wang , Zhenfei Yin , Lei Bai , Shuicheng Yan

Time series forecasting is vital in diverse sectors such as energy and transportation, where non-stationary dynamics are deeply intertwined with external events in other modalities such as texts. However, incorporating natural…

Machine Learning · Computer Science 2026-05-12 Yunfeng Ge , Ming Jin , Yiji Zhao , Hongyan Li , Bo Du , Chang Xu , Shirui Pan

Diffusion models have shown promising results in speech enhancement, using a task-adapted diffusion process for the conditional generation of clean speech given a noisy mixture. However, at test time, the neural network used for score…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-17 Bunlong Lay , Jean-Marie Lemercier , Julius Richter , Timo Gerkmann

We introduce SupertonicTTS, a novel text-to-speech (TTS) system designed for efficient and streamlined speech synthesis. SupertonicTTS comprises three components: a speech autoencoder for continuous latent representation, a text-to-latent…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-24 Hyeongju Kim , Jinhyeok Yang , Yechan Yu , Seunghun Ji , Jacob Morton , Frederik Bous , Joon Byun , Juheon Lee

The generative priors of pre-trained latent diffusion models (DMs) have demonstrated great potential to enhance the visual quality of image super-resolution (SR) results. However, the noise sampling process in DMs introduces randomness in…

Image and Video Processing · Electrical Eng. & Systems 2024-09-26 Lingchen Sun , Rongyuan Wu , Jie Liang , Zhengqiang Zhang , Hongwei Yong , Lei Zhang

Reasoning with large language models often benefits from generating multiple chains-of-thought, but existing aggregation strategies are typically trajectory-level (e.g., selecting the best trace or voting on the final answer), discarding…

Computation and Language · Computer Science 2026-02-27 Roy Miles , Aysim Toker , Andreea-Maria Oncescu , Songcen Xu , Jiankang Deng , Ismail Elezi

In this technical report, we describe our submission for the WildSpoof Challenge TTS Track: Text-to-Speech with In-the-Wild Data. We introduce F5-TTS-DPS, a model built upon the F5-TTS architecture. Our approach integrates Exponential…

Audio and Speech Processing · Electrical Eng. & Systems 2026-05-25 Renhe Sun , Jiayi Zhou , Haolin He , Yueying Feng , Jian Liu

Test-time adaptation (TTA) addresses the unforeseen distribution shifts occurring during test time. In TTA, performance, memory consumption, and time consumption are crucial considerations. A recent diffusion-based TTA approach for…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Yeongtak Oh , Jonghyun Lee , Jooyoung Choi , Dahuin Jung , Uiwon Hwang , Sungroh Yoon

Zero-shot text-to-speech (TTS) aims to synthesize voices with unseen speech prompts, which significantly reduces the data and computation requirements for voice cloning by skipping the fine-tuning process. However, the prompting mechanisms…

Audio and Speech Processing · Electrical Eng. & Systems 2024-04-11 Ziyue Jiang , Jinglin Liu , Yi Ren , Jinzheng He , Zhenhui Ye , Shengpeng Ji , Qian Yang , Chen Zhang , Pengfei Wei , Chunfeng Wang , Xiang Yin , Zejun Ma , Zhou Zhao

The Stable Diffusion Model (SDM) is a prevalent and effective model for text-to-image (T2I) and image-to-image (I2I) generation. Despite various attempts at sampler optimization, model distillation, and network quantification, these…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Jinchao Zhu , Yuxuan Wang , Siyuan Pan , Pengfei Wan , Di Zhang , Gao Huang

Current text-to-image (T2I) generation models struggle to align spatial composition with the input text, especially in complex scenes. Even layout-based approaches yield suboptimal spatial control, as their generation process is decoupled…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Zheyuan Liu , Munan Ning , Qihui Zhang , Shuo Yang , Zhongrui Wang , Yiwei Yang , Xianzhe Xu , Yibing Song , Weihua Chen , Fan Wang , Li Yuan

Diffusion Transformers (DiTs) are increasingly adopted in scientific computing, yet growing model sizes and resolutions make distributed multi-GPU inference essential. Ulysses sequence parallelism scales DiT inference but introduces…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-04-22 Bin Ma , Xingjian Ding , Tekin Bicer , Pengfei Su , Dong Li

Diffusion models have emerged as powerful generative frameworks by progressively adding noise to data through a forward process and then reversing this process to generate realistic samples. While these models have achieved strong…

Machine Learning · Computer Science 2025-03-04 Xingzhuo Guo , Yu Zhang , Baixu Chen , Haoran Xu , Jianmin Wang , Mingsheng Long

Diffusion Transformers (DiTs) have become a de facto backbone of modern visual generation, and nearly every major axis of their design -- tokenization, attention, conditioning, objectives, and latent autoencoders -- has been extensively…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Chao Xu , Maohua Li , Qirui Li , Yixuan Xu , Yanke Zhou , Yunhe Li , Cuifeng Shen , Hanlin Tang , Kan Liu , Tao Lan , Lin Qu , Shao-Qun Zhang

Tubular structure segmentation (TSS) is important for various applications, such as hemodynamic analysis and route navigation. Despite significant progress in TSS, domain shifts remain a major challenge, leading to performance degradation…

Computer Vision and Pattern Recognition · Computer Science 2025-08-04 Jiale Zhou , Wenhan Wang , Shikun Li , Xiaolei Qu , Xin Guo , Yizhong Liu , Wenzhong Tang , Xun Lin , Yefeng Zheng

Converting input symbols to output audio in TTS requires modelling the durations of speech sounds. Leading non-autoregressive (NAR) TTS models treat duration modelling as a regression problem. The same utterance is then spoken with…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-11 Shivam Mehta , Harm Lameris , Rajiv Punmiya , Jonas Beskow , Éva Székely , Gustav Eje Henter

Deep research agents, powered by Large Language Models (LLMs), are rapidly advancing; yet, their performance often plateaus when generating complex, long-form research reports using generic test-time scaling algorithms. Drawing inspiration…

Diffusion language models (Diffusion-LMs) introduce an explicit temporal dimension into text generation, yet how this structure can be leveraged to control generation diversity for exploring multiple valid semantic or reasoning paths…

Computation and Language · Computer Science 2026-03-18 Jingxuan Wu , Zhenglin Wan , Xingrui Yu , Yuzhe Yang , Yiqiao Huang , Ivor Tsang , Yang You

Parallel text-to-speech (TTS) models have recently enabled fast and highly-natural speech synthesis. However, they typically require external alignment models, which are not necessarily optimized for the decoder as they are not jointly…

Sound · Computer Science 2023-03-08 Bac Nguyen , Fabien Cardinaux , Stefan Uhlich

We investigate the linear stability of a flat interface that separates a liquid layer from a fully-developed turbulent gas flow. In this context, linear-stability analysis involves the study of the dynamics of a small-amplitude wave on the…

Fluid Dynamics · Physics 2009-08-13 L. Ó Náraigh , P. Spelt , O. Matar , T. Zaki