English
Related papers

Related papers: Generalized Multichannel Variational Autoencoder f…

200 papers

Distributed microphone arrays composed of multiple subarrays enable blind source separation over a wide spatial area. Directly applying fast multichannel nonnegative matrix factorization (FastMNMF) to all subarrays can exploit observations…

Audio and Speech Processing · Electrical Eng. & Systems 2026-05-20 Hirotaka Nishikori , Nobutaka Ito , Kouei Yamaoka , Norihiro Takamune , Hiroshi Saruwatari

Multiple modalities often co-occur when describing natural phenomena. Learning a joint representation of these modalities should yield deeper and more useful representations. Previous generative approaches to multi-modal input either do not…

Machine Learning · Computer Science 2018-11-13 Mike Wu , Noah Goodman

In this paper we propose a method for separation of moving sound sources. The method is based on first tracking the sources and then estimation of source spectrograms using multichannel non-negative matrix factorization (NMF) and extracting…

Sound · Computer Science 2017-10-30 Joonas Nikunen , Aleksandr Diment , Tuomas Virtanen

Multi-View Clustering (MVC) has gained significant attention for its ability to leverage complementary information across diverse views. However, existing deep MVC methods often struggle with view-distribution entanglement during cross-view…

Computer Vision and Pattern Recognition · Computer Science 2026-05-18 Xin Zou , Ruimeng Liu , Chang Tang , Zhenglai Li , Xinwang Liu , Kunlun He , Wanqing Li

This paper proposes a determined blind source separation method using Bayesian non-parametric modelling of sources. Conventionally source signals are separated from a given set of mixture signals by modelling them using non-negative matrix…

Sound · Computer Science 2019-04-09 Chaitanya Narisetty , Tatsuya Komatsu , Reishi Kondo

Independent deeply learned matrix analysis (IDLMA) is one of the state-of-the-art multichannel audio source separation methods using the source power estimation based on deep neural networks (DNNs). The DNN-based power estimation works well…

An effective approach to non-parallel voice conversion (VC) is to utilize deep neural networks (DNNs), specifically variational auto encoders (VAEs), to model the latent structure of speech in an unsupervised manner. A previous study has…

Audio and Speech Processing · Electrical Eng. & Systems 2020-04-09 Wen-Chin Huang , Hsin-Te Hwang , Yu-Huai Peng , Yu Tsao , Hsin-Min Wang

Reducing the interference noise in a monaural noisy speech signal has been a challenging task for many years. Compared to traditional unsupervised speech enhancement methods, e.g., Wiener filtering, supervised approaches, such as algorithms…

Sound · Computer Science 2017-09-19 Nasser Mohammadiha , Paris Smaragdis , Arne Leijon

Recently, variational autoencoder (VAE), a deep representation learning (DRL) model, has been used to perform speech enhancement (SE). However, to the best of our knowledge, current VAE-based SE methods only apply VAE to the model speech…

Audio and Speech Processing · Electrical Eng. & Systems 2022-01-25 Yang Xiang , Jesper Lisby Højvang , Morten Højfeldt Rasmussen , Mads Græsbøll Christensen

Neural network approaches to single-channel speech enhancement have received much recent attention. In particular, mask-based architectures have achieved significant performance improvements over conventional methods. This paper proposes a…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-22 Bengt J. Borgstrom , Michael S. Brandstein

We propose to utilize a variational autoencoder (VAE) for data-driven channel estimation. The underlying true and unknown channel distribution is modeled by the VAE as a conditional Gaussian distribution in a novel way, parameterized by the…

Signal Processing · Electrical Eng. & Systems 2023-04-07 Michael Baur , Benedikt Fesl , Michael Koller , Wolfgang Utschick

Variational autoencoders (VAEs) are among leading approaches to address the problem of learning disentangled representations. Typically a single VAE is used and disentangled representations are sought within its single continuous latent…

Machine Learning · Statistics 2026-04-02 Veranika Boukun , Jörg Lücke

In this paper, we address a convolutive blind source separation (BSS) problem and propose a new extended framework of FastMNMF by introducing prior information for joint diagonalization of the spatial covariance matrix model. Recently,…

This paper presents a novel approach to sound source separation that leverages spatial information obtained during the recording setup. Our method trains a spatial mixing filter using solo passages to capture information about the room…

Extracting the desired speech from a mixture is a meaningful and challenging task. The end-to-end DNN-based methods, though attractive, face the problem of generalization. In this paper, we explore a sequential approach for target speech…

Audio and Speech Processing · Electrical Eng. & Systems 2020-11-02 Zhaoyi Gu , Lele Liao , Kai Chen , Jing Lu

Deep learning techniques have been used recently to tackle the audio source separation problem. In this work, we propose to use deep fully convolutional denoising autoencoders (CDAEs) for monaural audio source separation. We use as many…

Sound · Computer Science 2017-10-16 Emad M. Grais , Mark D. Plumbley

Reliable fault detection is an essential requirement for safe and efficient operation of complex mechanical systems in various industrial applications. Despite the abundance of existing approaches and the maturity of the fault detection…

Signal Processing · Electrical Eng. & Systems 2024-08-19 Tianfu Li , Chuang Sun , Ruqiang Yan , Xuefeng Chen

In this paper, we propose a latent-variable generative model called mixture of dynamical variational autoencoders (MixDVAE) to model the dynamics of a system composed of multiple moving sources. A DVAE model is pre-trained on a…

Machine Learning · Computer Science 2023-12-08 Xiaoyu Lin , Laurent Girin , Xavier Alameda-Pineda

This paper describes multichannel speech enhancement for improving automatic speech recognition (ASR) in noisy environments. Recently, the minimum variance distortionless response (MVDR) beamforming has widely been used because it works…

We propose SAHMM-VAE, a source-wise adaptive Hidden Markov prior variational autoencoder for unsupervised blind source separation. Instead of treating the latent prior as a single generic regularizer, the proposed framework assigns each…

Machine Learning · Statistics 2026-03-30 Yuan-Hao Wei