English
Related papers

Related papers: Independent Component Analysis and estimation of a…

200 papers

We propose a stable version of Principal Component Analysis (PCA) in the general framework of a separable Hilbert space. It consists in interpreting the projection on the first eigenvectors as a step function applied to the spectrum of the…

Statistics Theory · Mathematics 2017-04-03 Ilaria Giulini

We develop a theory for functional independent component analysis in an infinite-dimensional framework using Sobolev spaces that accommodate smoother functions. The notion of penalized kurtosis is introduced motivated by Silverman's method…

Statistics Theory · Mathematics 2025-08-05 Marc Vidal , Marc Leman , Ana M. Aguilera

Recently, there has been a trend to combine independent component analysis and canonical polyadic decomposition (ICA-CPD) for an enhanced robustness for the computation of CPD, and ICA-CPD could be further converted into CPD of a 5th-order…

Machine Learning · Statistics 2016-12-30 Xiao-Feng Gong , Cheng-Yuan Wang , Ya-Na Hao , Qiu-Hua Lin

Blind source separation, particularly through independent component analysis (ICA), is widely utilized across various signal processing domains for disentangling underlying components from observed mixed signals, owing to its fully…

Methodology · Statistics 2026-01-06 Qiang Li , Shujian Yu , Liang Ma , Chen Ma , Jingyu Liu , Tulay Adali , Vince D. Calhoun

Independent Component Analysis (ICA) is commonly-used in electroencephalogram (EEG) signal processing to remove non-cerebral artifacts from cerebral data. Despite the ubiquity of ICA, the effect of measurement uncertainty on the artifact…

Systems and Control · Electrical Eng. & Systems 2024-10-07 Jennie Couchman , Orestis Kaparounakis , Chatura Samarakoon , Phillip Stanley-Marbell

For statistical analysis of functional Magnetic Resonance Imaging (fMRI) data sets, we propose a data-driven approach based on Independent Component Analysis (ICA) implemented in a new version of the AnalyzeFMRI R package. For fMRI data…

Computation · Statistics 2013-07-22 Cécile Bordier , Michel Dojat , Pierre Lafaye de Micheaux

We consider the identifiability theory of probabilistic models and establish sufficient conditions under which the representations learned by a very broad family of conditional energy-based models are unique in function space, up to a…

Machine Learning · Statistics 2020-10-27 Ilyes Khemakhem , Ricardo Pio Monti , Diederik P. Kingma , Aapo Hyvärinen

We propose a new algorithm for blind source separation (BSS) using independent vector analysis (IVA). This is an improvement over the popular auxiliary function based IVA (AuxIVA) with iterative projection (IP) or iterative source steering…

Signal Processing · Electrical Eng. & Systems 2021-05-20 Robin Scheibler

We propose a new class of divergence measures for Independent Component Analysis (ICA) for the demixing of multiple source mixtures. We call it the Convex Cauchy-Schwarz Divergence (CCS-DIV), and it is formed by integrating convex functions…

Information Theory · Computer Science 2016-04-19 Zaid Albataineh , Fathi M. Salem

Infrared interferometers are optical devices that can measure optical path-length differences by measuring changes in the refractive index. Several arrangements can be deployed, from single channel devices to multichannel double color…

Signal Processing · Electrical Eng. & Systems 2024-02-16 Luis Esteban , Alberto Regadío , Ulises Losada

Non-linear source separation is a challenging open problem with many applications. We extend a recently proposed Adversarial Non-linear ICA (ANICA) model, and introduce Cramer-Wold ICA (CW-ICA). In contrast to ANICA we use a simple,…

Machine Learning · Computer Science 2020-11-24 Przemysław Spurek , Aleksandra Nowak , Jacek Tabor , Łukasz Maziarka , Stanisław Jastrzębski

Correspondence analysis (CA) is a multivariate statistical tool used to visualize and interpret data dependencies by finding maximally correlated embeddings of pairs of random variables. CA has found applications in fields ranging from…

Machine Learning · Computer Science 2020-07-01 Hsiang Hsu , Salman Salamatian , Flavio P. Calmon

We propose the Sobolev Independence Criterion (SIC), an interpretable dependency measure between a high dimensional random variable X and a response variable Y . SIC decomposes to the sum of feature importance scores and hence can be used…

Machine Learning · Computer Science 2019-11-01 Youssef Mroueh , Tom Sercu , Mattia Rigotti , Inkit Padhi , Cicero Dos Santos

This paper introduces a Projected Principal Component Analysis (Projected-PCA), which employs principal component analysis to the projected (smoothed) data matrix onto a given linear space spanned by covariates. When it applies to…

Methodology · Statistics 2016-01-18 Jianqing Fan , Yuan Liao , Weichen Wang

Given an i.i.d. sample $X_1,...,X_n$ with common bounded density $f_0$ belonging to a Sobolev space of order $\alpha$ over the real line, estimation of the quadratic functional $\int_{\mathbb{R}}f_0^2(x) \mathrm{d}x$ is considered. It is…

Statistics Theory · Mathematics 2008-12-18 Evarist Giné , Richard Nickl

We are interested in consistent estimation of the mixing matrix in the ICA model, when the error distribution is close to (but different from) Gaussian. In particular, we consider $n$ independent samples from the ICA model $X = A\epsilon$,…

Statistics Theory · Mathematics 2014-08-26 Alexander Sokol , Marloes H. Maathuis , Benjamin Falkeborg

Recently, nonlinear ICA has surfaced as a popular alternative to the many heuristic models used in deep representation learning and disentanglement. An advantage of nonlinear ICA is that a sophisticated identifiability theory has been…

Machine Learning · Statistics 2023-11-29 Hermanni Hälvä , Jonathan So , Richard E. Turner , Aapo Hyvärinen

We compare convergence of isogeometric analysis (IGA), a spline modification of finite element method (FEM), with FEM in the context of our real space code for ab-initio electronic structure calculations of non-periodic systems. The…

Computational Physics · Physics 2021-01-07 Robert Cimrman , Matyáš Novák , Radek Kolman , Miroslav Tůma , Jiří Vackář

Self-supervised learning aims to learn a embedding space where semantically similar samples are close. Contrastive learning methods pull views of samples together and push different samples away, which utilizes semantic invariance of…

Machine Learning · Computer Science 2023-02-17 Lu Han , Han-Jia Ye , De-Chuan Zhan

Independent Vector Analysis (IVA) is a popular extension of Independent Component Analysis (ICA) for joint separation of a set of instantaneous linear mixtures, with a direct application in frequency-domain speaker separation or extraction.…

Audio and Speech Processing · Electrical Eng. & Systems 2023-04-05 Zbyněk Koldovský , Jaroslav Čmejla , Tülay Adalı , Stephen O'Regan