English
Related papers

Related papers: Solving Audio Inverse Problems with a Diffusion Mo…

200 papers

Recent advancements in diffusion models and large language models (LLMs) have significantly propelled the field of AIGC. Text-to-Audio (TTA), a burgeoning AIGC application designed to generate audio from natural language prompts, is…

Sound · Computer Science 2024-01-03 Jinlong Xue , Yayue Deng , Yingming Gao , Ya Li

Diffusion inversion aims to recover the initial noise corresponding to a given image such that this noise can reconstruct the original image through the denoising diffusion process. The key component of diffusion inversion is to minimize…

Computer Vision and Pattern Recognition · Computer Science 2025-12-10 Yifei Chen , Kaiyu Song , Yan Pan , Jianxing Yu , Jian Yin , Hanjiang Lai

The recent surge in popularity of diffusion models for image generation has brought new attention to the potential of these models in other areas of media generation. One area that has yet to be fully explored is the application of…

Sound · Computer Science 2023-02-01 Flavio Schneider

Recent advances in large language models (LLMs) have shown remarkable capabilities across textual and multimodal domains. In parallel, diffusion-based language models have emerged as a promising alternative to the autoregressive paradigm,…

With the development of large-scale diffusion-based and language-modeling-based generative models, impressive progress has been achieved in text-to-audio generation. Despite producing high-quality outputs, existing text-to-audio models…

Sound · Computer Science 2026-04-28 Yi Yuan , Xubo Liu , Haohe Liu , Xiyuan Kang , Zhuo Chen , Yuxuan Wang , Mark D. Plumbley , Wenwu Wang

Deep learning models are widely used for time series classification (TSC) due to their scalability and efficiency. However, their performance degrades under challenging data conditions such as class similarity, multimodal distributions, and…

Machine Learning · Computer Science 2025-07-30 Yaoyu Zhang , Chi-Guhn Lee

Probabilistic regression models the entire predictive distribution of a response variable, offering richer insights than classical point estimates and directly allowing for uncertainty quantification. While diffusion-based generative models…

Machine Learning · Computer Science 2025-10-07 Carlo Kneissl , Christopher Bülte , Philipp Scholl , Gitta Kutyniok

Diffusion Probabilistic Models (DPMs) are powerful generative models that have achieved unparalleled success in a number of generative tasks. In this work, we aim to build inductive biases into the training and sampling of diffusion models…

Machine Learning · Computer Science 2025-03-14 Thomas Jiralerspong , Berton Earnshaw , Jason Hartford , Yoshua Bengio , Luca Scimeca

In this paper, we present a causal speech signal improvement system that is designed to handle different types of distortions. The method is based on a generative diffusion model which has been shown to work well in scenarios with missing…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-16 Julius Richter , Simon Welker , Jean-Marie Lemercier , Bunlong Lay , Tal Peer , Timo Gerkmann

Diffusion Transformer (DiT) has emerged as the new trend of generative diffusion models on image generation. In view of extremely slow convergence in typical DiT, recent breakthroughs have been driven by mask strategy that significantly…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Rui Zhu , Yingwei Pan , Yehao Li , Ting Yao , Zhenglong Sun , Tao Mei , Chang Wen Chen

This paper introduces a discrete diffusion model (DDM) framework for text-aligned speech tokenization and reconstruction. By replacing the auto-regressive speech decoder with a discrete diffusion counterpart, our model achieves…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-25 Pin-Jui Ku , He Huang , Jean-Marie Lemercier , Subham Sekhar Sahoo , Zhehuai Chen , Ante Jukić

Diffusion models (DMs) have rapidly emerged as a powerful framework for image generation and restoration. However, existing DMs are primarily trained in a supervised manner by using a large corpus of clean images. This reliance on clean…

Image and Video Processing · Electrical Eng. & Systems 2025-10-15 Brett Levac , Jon Tamir , Marcelo Pereyra , Julian Tachella

Several recent studies have attempted to autoregressively generate continuous speech representations without discrete speech tokens by combining diffusion and autoregressive models, yet they often face challenges with excessive…

Audio and Speech Processing · Electrical Eng. & Systems 2025-12-09 Dongya Jia , Zhuo Chen , Jiawei Chen , Chenpeng Du , Jian Wu , Jian Cong , Xiaobin Zhuang , Chumin Li , Zhen Wei , Yuping Wang , Yuxuan Wang

Diffusion models have been shown to achieve natural-sounding enhancement of speech degraded by noise or reverberation. However, their simultaneous denoising and dereverberation capability has so far not been studied much, although this is…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-27 Adrian Meise , Tobias Cord-Landwehr , Reinhold Haeb-Umbach

Acquiring high-quality data for training discriminative models is a crucial yet challenging aspect of building effective predictive systems. In this paper, we present Diffusion Inversion, a simple yet effective method that leverages the…

Computer Vision and Pattern Recognition · Computer Science 2023-05-25 Yongchao Zhou , Hshmat Sahak , Jimmy Ba

Visual generation quality has been greatly promoted with the rapid advances in diffusion transformers (DiTs), which is attributed to the scaling of model size and complexity. However, these attributions also hinder the practical deployment…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Kai Liu , Shaoqiu Zhang , Linghe Kong , Yulun Zhang

Diffusion models have emerged as powerful generative priors for solving inverse imaging problems. However, their practical deployment is hindered by the substantial computational cost of slow, multi-step sampling. Although Consistency…

Image and Video Processing · Electrical Eng. & Systems 2025-12-04 Amirreza Tanevardi , Pooria Abbas Rad Moghadam , Seyed Mohammad Eshtehardian , Sajjad Amini , Babak Khalaj

There are many deterministic mathematical operations (e.g. compression, clipping, downsampling) that degrade speech quality considerably. In this paper we introduce a neural network architecture, based on a modification of the DiffWave…

Sound · Computer Science 2021-09-03 Jianwei Zhang , Suren Jayasuriya , Visar Berisha

Text-guided diffusion models have revolutionized image generation and editing, offering exceptional realism and diversity. Specifically, in the context of diffusion-based editing, where a source image is edited according to a target prompt,…

Computer Vision and Pattern Recognition · Computer Science 2023-10-20 Xuan Ju , Ailing Zeng , Yuxuan Bian , Shaoteng Liu , Qiang Xu

Recent years have witnessed the remarkable performance of diffusion models in various vision tasks. However, for image restoration that aims to recover clear images with sharper details from given degraded observations, diffusion-based…

Computer Vision and Pattern Recognition · Computer Science 2023-10-10 Liyan Wang , Qinyu Yang , Cong Wang , Wei Wang , Jinshan Pan , Zhixun Su
‹ Prev 1 8 9 10 Next ›