English
Related papers

Related papers: Block Coordinate Descent Algorithms for Auxiliary-…

200 papers

An important step in a multi-sensor surveillance system is to estimate sensor biases from their noisy asynchronous measurements. This estimation problem is computationally challenging due to the highly nonlinear transformation between the…

Information Theory · Computer Science 2018-05-21 Wenqiang Pu , Ya-Feng Liu , Junkun Yan , Hongwei Liu , Zhi-Quan Luo

In this paper, we provide a unified iteration complexity analysis for a family of general block coordinate descent (BCD) methods, covering popular methods such as the block coordinate gradient descent (BCGD) and the block coordinate…

Optimization and Control · Mathematics 2015-04-29 Mingyi Hong , Xiangfeng Wang , Meisam Razaviyayn , Zhi-Quan Luo

Independent vector analysis (IVA) is an attractive solution to address the problem of joint blind source separation (JBSS), that is, the simultaneous extraction of latent sources from several datasets implicitly sharing some information.…

Optimization and Control · Mathematics 2024-11-20 Clément Cosserat , Ben Gabrielson , Emilie Chouzenoux , Jean-Christophe Pesquet , Tülay Adali

This study introduces a novel unsupervised approach for separating overlapping heart and lung sounds using variational autoencoders (VAEs). In clinical settings, these sounds often interfere with each other, making manual separation…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-24 Yasaman Torabi , Shahram Shirani , James P. Reilly

This manuscript proposes a novel robust procedure for the extraction of a speaker of interest (SOI) from a mixture of audio sources. The estimation of the SOI is performed via independent vector extraction (IVE). Since the blind IVE cannot…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-29 Jiri Malek , Jakub Jansky , Zbynek Koldovsky , Tomas Kounovsky , Jaroslav Cmejla , Jindrich Zdansky

We develop randomized (block) coordinate descent (CD) methods for linearly constrained convex optimization. Unlike most CD methods, we do not assume the constraints to be separable, but let them be coupled linearly. To our knowledge, ours…

Optimization and Control · Mathematics 2015-06-11 Sashank Reddi , Ahmed Hefny , Carlton Downey , Avinava Dubey , Suvrit Sra

The block coordinate descent (BCD) method is widely used for minimizing a continuous function f of several block variables. At each iteration of this method, a single block of variables is optimized, while the remaining variables are held…

Optimization and Control · Mathematics 2012-09-12 Meisam Razaviyayn , Mingyi Hong , Zhi-Quan Luo

Independent component analysis is a core framework within blind source separation for recovering latent source signals from observed mixtures under statistical independence assumptions. In this work, we propose PDGMM-VAE, a source-oriented…

Machine Learning · Statistics 2026-04-24 Yuan-Hao Wei , Yan-Jie Sun

The task of blind source separation (BSS) involves separating sources from a mixture without prior knowledge of the sources or the mixing system. Single-channel mixtures and non-linear mixtures are a particularly challenging problem in BSS.…

Signal Processing · Electrical Eng. & Systems 2025-07-24 Matthew B. Webster , Joonnyong Lee

We introduce a new analysis method to deal with stationary non-Gaussian noises in gravitational wave detectors in terms of the independent component analysis. First, we consider the simplest case where the detector outputs are linear…

General Relativity and Quantum Cosmology · Physics 2016-11-03 Soichiro Morisaki , Jun'ichi Yokoyama , Kazunari Eda , Yousuke Itoh

This work extends the generalized nearest neighbor decoding (GNND), originally developed as a receiver architecture for memoryless channels, to a vectorized GNND (Vec-GNND) suitable for in-block memory (IBM) channels. Leveraging the…

Information Theory · Computer Science 2026-05-18 Yuhao Liu , Xinwei Li , Shuqin Pang , Hao Wu , Wenyi Zhang

Convolutional sparse coding (CSC) can learn representative shift-invariant patterns from multiple kinds of data. However, existing CSC methods can only model noises from Gaussian distribution, which is restrictive and unrealistic. In this…

Machine Learning · Computer Science 2020-04-22 Yaqing Wang , James T. Kwok , Lionel M. Ni

The stochastic gradient (SG) method can minimize an objective function composed of a large number of differentiable functions, or solve a stochastic optimization problem, to a moderate accuracy. The block coordinate descent/update (BCD)…

Optimization and Control · Mathematics 2015-11-23 Yangyang Xu , Wotao Yin

Independent Component Analysis (ICA) was introduced in the 1980's as a model for Blind Source Separation (BSS), which refers to the process of recovering the sources underlying a mixture of signals, with little knowledge about the source…

Statistics Theory · Mathematics 2026-02-09 Syamantak Kumar , Purnamrita Sarkar , Peter Bickel , Derek Bean

This paper addresses the problem of blind separation of convolutive mixtures of BPSK and circular linearly modulated signals with unknown (and possibly different) baud rates and carrier frequencies. In previous works, we established that…

Information Theory · Computer Science 2011-02-15 E. Florian , A. Chevreuil , P. Loubaton

Block coordinate descent (BCD) methods are prevalent in large scale optimization problems due to the low memory and computational costs per iteration, the predisposition to parallelization, and the ability to exploit the structure of the…

Optimization and Control · Mathematics 2025-10-31 Luis Briceño-Arias , Paulo Gonçalves , Guillaume Lauga , Nelly Pustelnik , Elisa Riccietti

This paper proposes a multichannel source separation technique called the multichannel variational autoencoder (MVAE) method, which uses a conditional VAE (CVAE) to model and estimate the power spectrograms of the sources in a mixture. By…

Machine Learning · Statistics 2018-08-28 Hirokazu Kameoka , Li Li , Shota Inoue , Shoji Makino

The mismatch between the numerical and actual nonlinear models is a challenge to nonlinear acoustic echo cancellation (NAEC) when the nonlinear adaptive filter is utilized. To alleviate this problem, we combine a basis-generic expansion of…

Signal Processing · Electrical Eng. & Systems 2021-04-07 Guoliang Cheng , Lele Liao , Hongsheng Chen , Jing Lu

In order to handle large data sets omnipresent in modern science, efficient compression algorithms are necessary. Here, a Bayesian data compression (BDC) algorithm that adapts to the specific measurement situation is derived in the context…

Data Analysis, Statistics and Probability · Physics 2021-03-01 Johannes Harth-Kitzerow , Reimar Leike , Philipp Arras , Torsten A. Enßlin

This paper concerns underdetermined linear instantaneous and convolutive blind source separation (BSS), i.e., the case when the number of observed mixed signals is lower than the number of sources.We propose partial BSS methods, which…

Data Analysis, Statistics and Probability · Physics 2008-12-18 J. Thomas , Y. Deville , Shahram Hosseini