English
Related papers

Related papers: Real-time Speech Restoration using Data Prediction…

200 papers

Current discriminative depth estimation methods often produce blurry artifacts, while generative approaches suffer from slow sampling due to curvatures in the noise-to-depth transport. Our method addresses these challenges by framing depth…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 Ming Gui , Johannes Schusterbauer , Ulrich Prestel , Pingchuan Ma , Dmytro Kotovenko , Olga Grebenkova , Stefan Andreas Baumann , Vincent Tao Hu , Björn Ommer

Diffusion models have recently shown promising results for difficult enhancement tasks such as the conditional and unconditional restoration of natural images and audio signals. In this work, we explore the possibility of leveraging a…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-24 Hao Yen , François G. Germain , Gordon Wichern , Jonathan Le Roux

Flow-based Generative Models (FGMs) effectively transform noise into complex data distributions. Incorporating Optimal Transport (OT) to couple noise and data during FGM training has been shown to improve the straightness of flow…

Machine Learning · Computer Science 2025-10-20 Lingkai Kong , Molei Tao , Yang Liu , Bryan Wang , Jinmiao Fu , Chien-Chih Wang , Huidong Liu

In image restoration, single-step discriminative mappings often lack fine details via expectation learning, whereas generative paradigms suffer from inefficient multi-step sampling and noise-residual coupling. To address this dilemma, we…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Zihao Fan , Xin Lu , Jie Xiao , Dong Li , Jie Huang , Xueyang Fu

This paper presents a novel generative model to synthesize fluid simulations from a set of reduced parameters. A convolutional neural network is trained on a collection of discrete, parameterizable fluid simulation velocity fields. Due to…

Machine Learning · Computer Science 2019-09-05 Byungsoo Kim , Vinicius C. Azevedo , Nils Thuerey , Theodore Kim , Markus Gross , Barbara Solenthaler

Strong semantic representations improve the convergence and generation quality of diffusion and flow models. Existing approaches largely rely on external models, which require separate training, operate on misaligned objectives, and exhibit…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Hila Chefer , Patrick Esser , Dominik Lorenz , Dustin Podell , Vikash Raja , Vinh Tong , Antonio Torralba , Robin Rombach

Deep generative models for Speech Enhancement (SE) received increasing attention in recent years. The most prominent example are Generative Adversarial Networks (GANs), while normalizing flows (NF) received less attention despite their…

Audio and Speech Processing · Electrical Eng. & Systems 2022-10-24 Martin Strauss , Matteo Torcoli , Bernd Edler

Generative models have emerged as a powerful paradigm for solving physics systems and modeling complex spatiotemporal dynamics. However, achieving high physical accuracy without incurring high computational cost remains a fundamental…

Machine Learning · Computer Science 2026-05-27 Jiahe Huang , Sihan Xu , Sharvaree Vadgama , Rose Yu

Two fundamental problems in unsupervised learning are efficient inference for latent-variable models and robust density estimation based on large amounts of unlabeled data. Algorithms for the two tasks, such as normalizing flows and…

Machine Learning · Statistics 2018-08-02 Changyou Chen , Chunyuan Li , Liqun Chen , Wenlin Wang , Yunchen Pu , Lawrence Carin

Modern diffusion/flow-based models for image generation typically exhibit two core characteristics: (i) using multi-step sampling, and (ii) operating in a latent space. Recent advances have made encouraging progress on each aspect…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Yiyang Lu , Susie Lu , Qiao Sun , Hanhong Zhao , Zhicheng Jiang , Xianbang Wang , Tianhong Li , Zhengyang Geng , Kaiming He

Recently, autoregressive neural vocoders have provided remarkable performance in generating high-fidelity speech and have been able to produce synthetic speech in real-time. However, autoregressive neural vocoders such as WaveFlow are…

Sound · Computer Science 2022-03-28 Manh Luong , Viet Anh Tran

This work proposes an efficient method to enhance the quality of corrupted speech signals by leveraging both acoustic and visual cues. While existing diffusion-based approaches have demonstrated remarkable quality, their applicability is…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-14 Chaeyoung Jung , Suyeon Lee , Ji-Hoon Kim , Joon Son Chung

In this work we propose an inference technique, asynchronous revision, to unify streaming and non-streaming speech recognition models. Specifically, we achieve dynamic latency with only one model by using arbitrary right context during…

Audio and Speech Processing · Electrical Eng. & Systems 2020-11-04 Mingkun Huang , Meng Cai , Jun Zhang , Yang Zhang , Yongbin You , Yi He , Zejun Ma

Data heterogeneity hinders clinical deployment of medical image analysis models, and generative data augmentation helps mitigate this issue. However, recent diffusion-based methods that synthesize image-mask pairs often ignore distribution…

Image and Video Processing · Electrical Eng. & Systems 2026-04-06 Jie Yang , Ziqi Ye , Aihua Ke , Jian Luo , Bo Cai , Xiaosong Wang

Generative models have proven effective at modeling 3D shapes and their statistical variations. In this paper we investigate their application to point clouds, a 3D shape representation widely used in computer vision for which, however,…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Roman Klokov , Edmond Boyer , Jakob Verbeek

The multi-step denoising process in diffusion and Flow Matching models causes major efficiency issues, which motivates research on few-step generation. We present Solution Flow Models (SoFlow), a framework for one-step generation from…

Machine Learning · Computer Science 2026-03-03 Tianze Luo , Haotian Yuan , Zhuang Liu

In this article, we propose a methodology to reconstruct, in a single step, the mean- and unsteady properties of a flow from very few time-resolved measurements. The procedure is based on the {\it a priori} alignement of Fourier- and…

Fluid Dynamics · Physics 2021-02-09 Lucas Franceschini , Denis Sipp , Olivier Marquet

The presence of missing values within high-dimensional data is an ubiquitous problem for many applied sciences. A serious limitation of many available data mining and machine learning methods is their inability to handle partially missing…

Machine Learning · Computer Science 2022-08-02 Qi Ma , Sujit K. Ghosh

With latent variables, stochastic recurrent models have achieved state-of-the-art performance in modeling sound-wave sequence. However, opposite results are also observed in other domains, where standard recurrent networks often outperform…

Machine Learning · Computer Science 2019-09-17 Zihang Dai , Guokun Lai , Yiming Yang , Shinjae Yoo

Flow-based generative models are an important class of exact inference models that admit efficient inference and sampling for image synthesis. Owing to the efficiency constraints on the design of the flow layers, e.g. split coupling flow…

Machine Learning · Computer Science 2020-04-09 Shweta Mahajan , Apratim Bhattacharyya , Mario Fritz , Bernt Schiele , Stefan Roth