English
Related papers

Related papers: A Convex Cauchy-Schwarz DivergenceMeasure for Blin…

200 papers

Sparse principal component analysis (sPCA) enhances the interpretability of principal components (PCs) by imposing sparsity constraints on loading vectors (LVs). However, when used as a precursor to independent component analysis (ICA) for…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Muhammad Usman Khalid

The Improved Partial Area-Analytical Calculation (IPA-AC) method represents a leading meshfree discretization strategy for peridynamic models, distinguished by its rigorous geometric treatment of boundary intersections via dual corrections…

Numerical Analysis · Mathematics 2026-03-20 Xiuzhu Yang , Xiaobo Yin

This work is concerned with robust distributed multi-view image transmission over a severe fading channel with imperfect channel state information (CSI), wherein the sources are slightly correlated. Since the signals are further distorted…

Signal Processing · Electrical Eng. & Systems 2026-04-15 Biao Dong , Bin Cao , Guan Gui , Qinyu Zhang

Independent component analysis (ICA) is a widespread data exploration technique, where observed signals are modeled as linear mixtures of independent components. From a machine learning point of view, it amounts to a matrix factorization…

Machine Learning · Statistics 2019-05-28 Pierre Ablin , Alexandre Gramfort , Jean-François Cardoso , Francis Bach

We study the continuous-time structure of the difference-of-convex algorithm (DCA) for smooth DC decompositions with a strongly convex component. In dual coordinates, classical DCA is exactly the full-step explicit Euler discretization of a…

Optimization and Control · Mathematics 2026-04-09 Yi-Shuai Niu

For many years, a combination of principal component analysis (PCA) and independent component analysis (ICA) has been used for blind source separation (BSS). However, it remains unclear why these linear methods work well with real-world…

Machine Learning · Statistics 2020-12-15 Takuya Isomura , Taro Toyoizumi

We investigate a difference-of-convex (DC) formulation where the second term is allowed to be weakly convex. We examine the precise behavior of a single iteration of the difference-of-convex algorithm (DCA), providing a tight…

Optimization and Control · Mathematics 2026-01-23 Teodor Rotaru , Panagiotis Patrinos , François Glineur

Independent component analysis (ICA) is a powerful method for blind source separation based on the assumption that sources are statistically independent. Though ICA has proven useful and has been employed in many applications, complete…

Machine Learning · Statistics 2016-10-21 Zois Boukouvalas , Yuri Levin-Schwartz , Tulay Adali

In this paper, we study the convergence rate of the DCA (Difference-of-Convex Algorithm), also known as the convex-concave procedure, with two different termination criteria that are suitable for smooth and nonsmooth decompositions…

Optimization and Control · Mathematics 2023-02-24 Hadi Abbaszadehpeivasti , Etienne de Klerk , Moslem Zamani

A novel blind estimate of the number of sources from noisy, linear mixtures is proposed. Based on Sz\'ekely et al.'s distance correlation measure, we define the Sources' Dependency Criterion (SDC), from which our estimate arises. Unlike…

Signal Processing · Electrical Eng. & Systems 2020-09-01 Amir Weiss , Arie Yeredor

Latent component identification from unknown nonlinear mixtures is a foundational challenge in machine learning, with applications in tasks such as disentangled representation learning and causal inference. Prior work in nonlinear…

Machine Learning · Computer Science 2025-10-22 Hoang-Son Nguyen , Xiao Fu

Independent component analysis (ICA) is linked up with the problem of estimating a non linear functional of a density, for which optimal estimators are well known. The precision of ICA is analyzed from the viewpoint of functional spaces in…

Statistics Theory · Mathematics 2007-06-13 Pascal Barbedor

Mirror descent (MD) is a powerful first-order optimization technique that subsumes several optimization algorithms including gradient descent (GD). In this work, we develop a semi-definite programming (SDP) framework to analyze the…

Optimization and Control · Mathematics 2022-01-19 Youbang Sun , Mahyar Fazlyab , Shahin Shahrampour

Blind Source Separation (BSS) is a challenging matrix factorization problem that plays a central role in multichannel imaging science. In a large number of applications, such as astrophysics, current unmixing methods are limited since…

Applications · Statistics 2017-11-22 Ming Jiang , Jérôme Bobin , Jean-Luc Starck

In this paper, we propose a proximal splitting methodology with a non-convex penalty function based on the heavy-tailed Cauchy distribution. We first suggest a closed-form expression for calculating the proximal operator of the Cauchy…

Signal Processing · Electrical Eng. & Systems 2020-10-27 Oktay Karakus , Perla Mayo , Alin Achim

Independent component analysis (ICA) is a method for recovering statistically independent signals from observations of unknown linear combinations of the sources. Some of the most accurate ICA decomposition methods require searching for the…

Machine Learning · Statistics 2016-09-23 Matan Sela , Ron Kimmel

Mode separation, namely how sharply a distribution fragments into barrier-separated clusters, is a fundamental geometric property of densities, difficult to quantify in high dimensions. It is structurally distinct from dispersion, yet…

Machine Learning · Statistics 2026-05-12 Shaul Tolkovsky , Ori Meidler , Or Zuk

This paper concerns underdetermined linear instantaneous and convolutive blind source separation (BSS), i.e., the case when the number of observed mixed signals is lower than the number of sources.We propose partial BSS methods, which…

Data Analysis, Statistics and Probability · Physics 2008-12-18 J. Thomas , Y. Deville , Shahram Hosseini

Group fairness in machine learning is often enforced by adding a regularizer that reduces the dependence between model predictions and sensitive attributes. However, existing regularizers are built on heterogeneous distance measures and…

Machine Learning · Computer Science 2025-12-11 Yezi Liu , Hanning Chen , Wenjun Huang , Yang Ni , Mohsen Imani

We consider distributed optimization with smooth convex objective functions defined on an undirected connected graph. Inspired by mirror descent mehod and RLC circuits, we propose a novel distributed mirror descent method. Compared with…

Optimization and Control · Mathematics 2020-02-25 Yue Yu , Behçet Açıkmeşe