中文
相关论文

相关论文: Predictive-Generative Drift Decomposition for Spee…

200 篇论文

Diffusion models proved to be powerful models for generative speech enhancement. In recent SGMSE+ approaches, training involves a stochastic differential equation for the diffusion process, adding both Gaussian and environmental noise to…

音频与语音处理 · 电气工程与系统科学 2024-06-14 Bunlong Lay , Timo Gerkmann

Incremental text-to-speech (TTS) synthesis generates utterances in small linguistic units for the sake of real-time and low-latency applications. We previously proposed an incremental TTS method that leverages a large pre-trained language…

声音 · 计算机科学 2021-09-23 Takaaki Saeki , Shinnosuke Takamichi , Hiroshi Saruwatari

We propose a multi-stage framework for universal speech enhancement, designed for the Interspeech 2025 URGENT Challenge. Our system first employs a Sparse Compression Network to robustly separate sources and extract an initial clean speech…

声音 · 计算机科学 2025-06-03 Nabarun Goswami , Tatsuya Harada

Personalized speech enhancement (PSE) models achieve promising results compared with unconditional speech enhancement models due to their ability to remove interfering speech in addition to background noise. Unlike unconditional speech…

音频与语音处理 · 电气工程与系统科学 2022-11-08 Hassan Taherian , Sefik Emre Eskimez , Takuya Yoshioka

Pretrained diffusion models have revolutionized real-world image super-resolution (Real-ISR) but suffer from computational bottlenecks due to iterative sampling. Recent single-step distillation accelerates inference but faces a stark…

计算机视觉与模式识别 · 计算机科学 2026-05-11 Shyang-En Weng , Yi-Cheng Liao , Yu-Syuan Xu , Wei-Chen Chiu , Ching-Chun Huang

In this paper, we address the problem of single-microphone speech separation in the presence of ambient noise. We propose a generative unsupervised technique that directly models both clean speech and structured noise components, training…

音频与语音处理 · 电气工程与系统科学 2025-09-19 Yochai Yemini , Rami Ben-Ari , Sharon Gannot , Ethan Fetaya

We present GraPPa, an effective pre-training approach for table semantic parsing that learns a compositional inductive bias in the joint representations of textual and tabular data. We construct synthetic question-SQL pairs over…

Personalized speech intelligibility prediction is challenging. Previous approaches have mainly relied on audiograms, which are inherently limited in accuracy as they only capture a listener's hearing threshold for pure tones. Rather than…

音频与语音处理 · 电气工程与系统科学 2025-06-04 Haoshuai Zhou , Changgeng Mo , Boxuan Cao , Linkai Li , Shan Xiang Wang

Text-conditioned image generation models have recently shown immense qualitative success using denoising diffusion processes. However, unlike discriminative vision-and-language models, it is a non-trivial task to subject these…

计算机视觉与模式识别 · 计算机科学 2023-11-06 Benno Krojer , Elinor Poole-Dayan , Vikram Voleti , Christopher Pal , Siva Reddy

Self-play fine-tuning enables large language models to improve beyond supervised fine-tuning without additional human annotations by contrasting annotated responses with self-generated ones. Many existing methods rely on a fixed divergence…

机器学习 · 计算机科学 2026-04-24 Wenjie Liao , Like Wu , Liangjie Zhao , Shihui Xu , Shigeru Fujimura

Knowledge distillation is the process of transferring knowledge from a more powerful large model (teacher) to a simpler counterpart (student). Numerous current approaches involve the student imitating the knowledge of the teacher directly.…

计算机视觉与模式识别 · 计算机科学 2024-01-18 Zhaoge Liu , Xiaohao Xu , Yunkang Cao , Weiming Shen

This paper introduces a novel speech enhancement (SE) approach based on a denoising diffusion probabilistic model (DDPM), termed Guided diffusion for speech enhancement (GDiffuSE). In contrast to conventional methods that directly map noisy…

声音 · 计算机科学 2026-03-03 Efrayim Yanir , David Burshtein , Sharon Gannot

Some glottal analysis approaches based upon linear prediction or complex cepstrum approaches have been proved to be effective to estimate glottal source from real speech utterances. We propose a new approach employing both an all-pole…

声音 · 计算机科学 2016-12-16 Yiqiao Chen , John N. Gowdy

We introduce Audio-SDS, a generalization of Score Distillation Sampling (SDS) to text-conditioned audio diffusion models. While SDS was initially designed for text-to-3D generation using image diffusion, its core idea of distilling a…

声音 · 计算机科学 2025-05-08 Jessie Richter-Powell , Antonio Torralba , Jonathan Lorraine

Class Incremental Learning (CIL) based on pre-trained models offers a promising direction for open-world continual learning. Existing methods typically rely on correlation-based strategies, where an image's classification feature is used as…

计算机视觉与模式识别 · 计算机科学 2025-05-20 Libo Huang , Zhulin An , Chuanguang Yang , Boyu Diao , Fei Wang , Yan Zeng , Zhifeng Hao , Yongjun Xu

In today's connected world, the generation of massive streaming data across diverse domains has become commonplace. In the presence of concept drift, class imbalance, label scarcity, and new class emergence, they jointly degrade…

机器学习 · 计算机科学 2026-02-11 Jin Li , Kleanthis Malialis , Marios Polycarpou

Generative models have attracted considerable attention for speech separation tasks, and among these, diffusion-based methods are being explored. Despite the notable success of diffusion techniques in generation tasks, their adaptation to…

音频与语音处理 · 电气工程与系统科学 2025-01-28 Jinwei Dong , Xinsheng Wang , Qirong Mao

In this paper, we present a causal speech signal improvement system that is designed to handle different types of distortions. The method is based on a generative diffusion model which has been shown to work well in scenarios with missing…

音频与语音处理 · 电气工程与系统科学 2023-03-16 Julius Richter , Simon Welker , Jean-Marie Lemercier , Bunlong Lay , Tal Peer , Timo Gerkmann

In supervised speech separation, permutation invariant training (PIT) is widely used to handle label ambiguity by selecting the best permutation to update the model. Despite its success, previous studies showed that PIT is plagued by…

声音 · 计算机科学 2023-11-22 Chenyang Gao , Yue Gu , Ivan Marsic

Performative prediction (PP) is an algorithmic framework for optimizing machine learning (ML) models where the model's deployment affects the distribution of the data it is trained on. Compared to traditional ML with fixed data, designing…

机器学习 · 计算机科学 2025-09-24 Tian Xie , Ding Zhu , Jia Liu , Mahdi Khalili , Xueru Zhang