English
Related papers

Related papers: Thunder : Unified Regression-Diffusion Speech Enha…

200 papers

Existing diffusion-based purification methods aim to disrupt adversarial perturbations by introducing a certain amount of noise through a forward diffusion process, followed by a reverse process to recover clean examples. However, this…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Gaozheng Pei , Shaojie Lyu , Gong Chen , Ke Ma , Qianqian Xu , Yingfei Sun , Qingming Huang

The problem of speech separation, also known as the cocktail party problem, refers to the task of isolating a single speech signal from a mixture of speech signals. Previous work on source separation derived an upper bound for the source…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-27 Shahar Lutati , Eliya Nachmani , Lior Wolf

Bridge models in image restoration construct a diffusion process from degraded to clear images. However, existing methods typically require training a bridge model from scratch for each specific type of degradation, resulting in high…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Hanting Wang , Tao Jin , Wang Lin , Shulei Wang , Hai Huang , Shengpeng Ji , Zhou Zhao

Diffusion probabilistic models have achieved remarkable success in generative tasks across diverse data types. While recent studies have explored alternative degradation processes beyond Gaussian noise, this paper bridges two key diffusion…

Computer Vision and Pattern Recognition · Computer Science 2025-11-24 Hao-Chien Hsueh , Chi-En Yen , Wen-Hsiao Peng , Ching-Chun Huang

This paper proposes a new unsupervised audio-visual speech enhancement (AVSE) approach that combines a diffusion-based audio-visual speech generative model with a non-negative matrix factorization (NMF) noise model. First, the diffusion…

Sound · Computer Science 2025-01-16 Jean-Eudes Ayilo , Mostafa Sadeghi , Romain Serizel , Xavier Alameda-Pineda

Recent deep learning approaches have shown great improvement in audio source separation tasks. However, the vast majority of such work is focused on improving average separation performance, often neglecting to examine or control the…

Sound · Computer Science 2022-02-01 Efthymios Tzinis , Dimitrios Bralios , Paris Smaragdis

We present an novel framework for efficiently and effectively extending the powerful continuous diffusion processes to discrete modeling. Previous approaches have suffered from the discrepancy between discrete data and continuous modeling.…

Machine Learning · Computer Science 2024-10-31 Yuxuan Gu , Xiaocheng Feng , Lei Huang , Yingsheng Wu , Zekun Zhou , Weihong Zhong , Kun Zhu , Bing Qin

Unmanned Aerial Vehicles (UAVs) are increasingly adopted in modern communication networks. However, challenges in decision-making and digital modeling continue to impede their rapid advancement. Reinforcement Learning (RL) algorithms face…

Machine Learning · Computer Science 2025-01-13 Yousef Emami , Hao Zhou , Luis Almeida , Kai Li

The Drift-Diffusion Model (DDM) is widely used in neuropsychological studies to understand the decision process by incorporating both reaction times and subjects' responses. Various models have been developed to estimate DDM parameters,…

Applications · Statistics 2025-07-03 Zekai Jin , Yaakov Stern , Seonjoo Lee

In this paper, we focus on the often-overlooked issue of embedding collapse in existing diffusion-based sequential recommendation models and propose ADRec, an innovative framework designed to mitigate this problem. Diverging from previous…

Information Retrieval · Computer Science 2025-05-27 Jialei Chen , Yuanbo Xu , Yiheng Jiang

Deep generative models have gained recent traction in accelerated MRI reconstruction. Diffusion priors are particularly promising given their representational fidelity. Instead of the target transformation from undersampled to fully-sampled…

Image and Video Processing · Electrical Eng. & Systems 2023-12-19 Muhammad U. Mirza , Onat Dalmaz , Hasan A. Bedel , Gokberk Elmas , Yilmaz Korkmaz , Alper Gungor , Salman UH Dar , Tolga Çukur

Pretrained language models have significantly advanced performance across various natural language processing tasks. However, adversarial attacks continue to pose a critical challenge to systems built using these models, as they can be…

Computation and Language · Computer Science 2025-05-20 Zhenhao Li , Huichi Zhou , Marek Rei , Lucia Specia

Exemplar-guided image translation, synthesizing photo-realistic images that conform to both structural control and style exemplars, is attracting attention due to its ability to enhance user control over style manipulation. Previous…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Eungbean Lee , Somi Jeong , Kwanghoon Sohn

In text-to-speech (TTS) synthesis, diffusion models have achieved promising generation quality. However, because of the pre-defined data-to-noise diffusion process, their prior distribution is restricted to a noisy representation, which…

Machine Learning · Computer Science 2024-02-09 Zehua Chen , Guande He , Kaiwen Zheng , Xu Tan , Jun Zhu

The paper introduces Diff-Filter, a multichannel speech enhancement approach based on the diffusion probabilistic model, for improving speaker verification performance under noisy and reverberant conditions. It also presents a new two-step…

Sound · Computer Science 2023-07-06 Sandipana Dowerah , Ajinkya Kulkarni , Romain Serizel , Denis Jouvet

In text generation, models that generate text from scratch one token at a time are currently the dominant paradigm. Despite being performant, these models lack the ability to revise existing text, which limits their usability in many…

Computation and Language · Computer Science 2022-11-01 Machel Reid , Vincent J. Hellendoorn , Graham Neubig

Diffusion models have significantly improved the quality and diversity of audio generation but are hindered by slow inference speed. Rectified flow enhances inference speed by learning straight-line ordinary differential equation (ODE)…

Sound · Computer Science 2025-05-29 Junqi Zhao , Jinzheng Zhao , Haohe Liu , Yun Chen , Lu Han , Xubo Liu , Mark Plumbley , Wenwu Wang

Although deep neural network (DNN)-based speech enhancement (SE) methods outperform the previous non-DNN-based ones, they often degrade the perceptual quality of generated outputs. To tackle this problem, we introduce a DNN-based generative…

Audio and Speech Processing · Electrical Eng. & Systems 2023-08-31 Ryosuke Sawata , Naoki Murata , Yuhta Takida , Toshimitsu Uesaka , Takashi Shibuya , Shusuke Takahashi , Yuki Mitsufuji

Acquiring high-quality data for training discriminative models is a crucial yet challenging aspect of building effective predictive systems. In this paper, we present Diffusion Inversion, a simple yet effective method that leverages the…

Computer Vision and Pattern Recognition · Computer Science 2023-05-25 Yongchao Zhou , Hshmat Sahak , Jimmy Ba

The diffusion model is capable of generating high-quality data through a probabilistic approach. However, it suffers from the drawback of slow generation speed due to the requirement of a large number of time steps. To address this…

Sound · Computer Science 2024-04-30 Myeongjin Ko , Yong-Hoon Choi