English
Related papers

Related papers: Block Coordinate Descent Algorithms for Auxiliary-…

200 papers

The iteration complexity of the block-coordinate descent (BCD) type algorithm has been under extensive investigation. It was recently shown that for convex problems the classical cyclic BCGD (block coordinate gradient descent) achieves an…

Optimization and Control · Mathematics 2015-12-16 Ruoyu Sun , Mingyi Hong

In the context of Independent Component Analysis (ICA), noisy mixtures pose a dilemma regarding the desired objective. On one hand, a "maximally separating" solution, providing the minimal attainable Interference-to-Source-Ratio (ISR),…

Applications · Statistics 2019-10-02 Amir Weiss , Arie Yeredor

A blind source separation method is described to extract sources from data mixtures where the underlying sources are assumed to be sparse and uncorrelated. The approach used is to detect and analyse segments of time where one source exists…

Signal Processing · Electrical Eng. & Systems 2018-02-06 Malcolm Woolfson

In this paper, we distinguish two guessing algorithms for decoding binary linear codes. One is the guessing noise decoding (GND) algorithm, and the other is the guessing codeword decoding (GCD) algorithm. We prove that the GCD is a maximum…

Information Theory · Computer Science 2024-01-31 Xiao Ma

In this work we propose a technique to remove sparse impulse noise from hyperspectral images. Our algorithm accounts for the spatial redundancy and spectral correlation of such images. The proposed method is based on the recently introduced…

Image and Video Processing · Electrical Eng. & Systems 2019-12-16 Angshul Majumdar , Naushad Ansari , Hemant Aggarwal , Pravesh Biyani

Block-coordinate descent algorithms and alternating minimization methods are fundamental optimization algorithms and an important primitive in large-scale optimization and machine learning. While various block-coordinate-descent-type…

Optimization and Control · Mathematics 2019-07-02 Jelena Diakonikolas , Lorenzo Orecchia

There have been significant advances in recent years in the development of forward error correction decoders that can decode codes of any structure, including practical realizations in synthesized circuits and taped out chips. While…

Signal Processing · Electrical Eng. & Systems 2025-11-11 Jiewei Feng , Ken R. Duffy , Muriel Médard

In independent component analysis it is assumed that the observed random variables are linear combinations of latent, mutually independent random variables called the independent components. Our model further assumes that only the…

Statistics Theory · Mathematics 2016-12-19 Joni Virta , Klaus Nordhausen , Hannu Oja

In this work, we propose efficient algorithms for joint independent subspace analysis (JISA), an extension of independent component analysis that deals with parallel mixtures, where not all the components are independent. We derive an…

Signal Processing · Electrical Eng. & Systems 2020-04-09 Robin Scheibler , Nobutaka Ono

In this paper, we consider a block coordinate descent (BCD) algorithm for training deep neural networks and provide a new global convergence guarantee under strictly monotonically increasing activation functions. While existing works…

Machine Learning · Statistics 2025-10-28 Shunta Akiyama

Blind source separation (BSS) refers to the process of recovering multiple source signals from observations recorded by an array of sensors. Common approaches to BSS, including independent vector analysis (IVA), and independent low-rank…

Sound · Computer Science 2025-11-11 Jianyu Wang , Shanzheng Guan , Nicolas Dobigeon , Jingdong Chen

This paper presents a novel method for fault detection in vibration/acoustic signals contaminated with non-Gaussian noise, specifically addressing the challenge of random impulsive and wideband disturbances in industrial measurements. While…

Signal Processing · Electrical Eng. & Systems 2025-02-18 A Drewnicka , A Michalak , R Zimroz , A Kumar , A Wyłomańska , J Wodecki

Matrix decomposition is a popular and fundamental approach in machine learning and data mining. It has been successfully applied into various fields. Most matrix decomposition methods focus on decomposing a data matrix from one single…

Computer Vision and Pattern Recognition · Computer Science 2017-12-12 Chihao Zhang , Shihua Zhang

This paper considers the problems of unconstrained minimization of large scale smooth convex functions having block-coordinate-wise Lipschitz continuous gradients. The block coordinate descent (BCD) method are among the first optimization…

Optimization and Control · Mathematics 2016-08-18 Ziqiang Shi , Rujie Liu

While the semi-blind source separation-based acoustic echo cancellation (SBSS-AEC) has received much research attention due to its promising performance during double-talk compared to the traditional adaptive algorithms, it suffers from…

Audio and Speech Processing · Electrical Eng. & Systems 2023-12-15 Kunxing Lu , Xianrui Wang , Tetsuya Ueda , Shoji Makino , Jingdong Chen

In this contribution, we consider the problem of the blind separation of noisy instantaneously mixed images. The images are modelized by hidden Markov fields with unknown parameters. Given the observed images, we give a Bayesian formulation…

Data Analysis, Statistics and Probability · Physics 2007-05-23 Hichem Snoussi , Ali Mohammad-Djafari

Independent Component Analysis (ICA) is a popular model for blind signal separation. The ICA model assumes that a number of independent source signals are linearly mixed to form the observed signals. We propose a new algorithm, PEGI (for…

Machine Learning · Computer Science 2015-10-02 James Voss , Mikhail Belkin , Luis Rademacher

Algorithms for Blind Source Separation (BSS) of acoustic signals require efficient and fast converging optimization strategies to adapt to nonstationary signal statistics and time-varying acoustic scenarios. In this paper, we derive fast…

Signal Processing · Electrical Eng. & Systems 2021-07-23 Andreas Brendel , Walter Kellermann

This letter proposes a new blind source separation (BSS) framework termed minimum variance independent component analysis (MVICA), which can potentially achieve the maximum output signal-to-interference ratio (SIR) while also allowing more…

Sound · Computer Science 2022-03-09 Jianju Gu , Longbiao Cheng , Dingding Yao , Junfeng Li , Yonghong Yan

We propose a new blind source separation algorithm based on mixtures of alpha-stable distributions. Complex symmetric alpha-stable distributions have been recently showed to better model audio signals in the time-frequency domain than…

Machine Learning · Statistics 2018-02-13 Nicolas Keriven , Antoine Deleforge , Antoine Liutkus