English
Related papers

Related papers: Independent Component Analysis via Energy-based an…

200 papers

By deriving influence functions related to multiple-set linear canonical analysis (MSLCA) we show that the classical version of this analysis, based on empirical covariance operators, is not robust. Then, we introduce a robust version of…

Statistics Theory · Mathematics 2018-11-08 Ulrich Djemby Bivigou , Guy Martial Nkiet

Mixture proportion estimation (MPE) aims to estimate class priors from unlabeled data. This task is a critical component in weakly supervised learning, such as PU learning, learning with label noise, and domain adaptation. Existing MPE…

Machine Learning · Computer Science 2026-04-09 Yushi Hirose , Akito Narahara , Takafumi Kanamori

We introduce three novel semi-parametric extensions of probabilistic canonical correlation analysis with identifiability guarantees. We consider moment matching techniques for estimation in these models. For that, by drawing explicit links…

Machine Learning · Statistics 2016-06-06 Anastasia Podosinnikova , Francis Bach , Simon Lacoste-Julien

We consider the identifiability theory of probabilistic models and establish sufficient conditions under which the representations learned by a very broad family of conditional energy-based models are unique in function space, up to a…

Machine Learning · Statistics 2020-10-27 Ilyes Khemakhem , Ricardo Pio Monti , Diederik P. Kingma , Aapo Hyvärinen

In recent years, Independent Component Analysis (ICA) has successfully been applied to remove noise and artifacts in images obtained from Three-dimensional Polarized Light Imaging (3D-PLI) at the mesoscale (i.e., 64 $\mu$m). Here, we…

Medical Physics · Physics 2020-12-01 Kai Benning , Miriam Menzel , Jan Reuter , Markus Axer

Independent Component Analysis (ICA) offers interpretable semantic components of embeddings. While ICA theory assumes that embeddings can be linearly decomposed into independent components, real-world data often do not satisfy this…

Computation and Language · Computer Science 2024-10-10 Momose Oyama , Hiroaki Yamagiwa , Hidetoshi Shimodaira

Independent component analysis (ICA) is a cornerstone of modern data analysis. Its goal is to recover a latent random vector S with independent components from samples of X=AS where A is an unknown mixing matrix. Critically, all existing…

Machine Learning · Statistics 2018-04-04 Nilin Abrahamsen , Philippe Rigollet

We consider moment matching techniques for estimation in Latent Dirichlet Allocation (LDA). By drawing explicit links between LDA and discrete versions of independent component analysis (ICA), we first derive a new set of cumulant-based…

Machine Learning · Statistics 2015-11-06 Anastasia Podosinnikova , Francis Bach , Simon Lacoste-Julien

Group studies involving large cohorts of subjects are important to draw general conclusions about brain functional organization. However, the aggregation of data coming from multiple subjects is challenging, since it requires accounting for…

Machine Learning · Statistics 2020-12-25 Hugo Richard , Luigi Gresele , Aapo Hyvärinen , Bertrand Thirion , Alexandre Gramfort , Pierre Ablin

We provide a unified framework for independence and mean independence tests based on the Hilbert-Schmidt independence criterion, extending some previous results in the literature to hold in general topological spaces. We also present a…

Methodology · Statistics 2026-05-01 Daniel Diz-Castro , Manuel Febrero-Bande , Wenceslao González-Manteiga

A statistical test of independence may be constructed using the Hilbert-Schmidt Independence Criterion (HSIC) as a test statistic. The HSIC is defined as the distance between the embedding of the joint distribution, and the embedding of the…

Machine Learning · Statistics 2015-01-27 Arthur Gretton

A new non parametric approach to the problem of testing the independence of two random process is developed. The test statistic is the Hilbert Schmidt Independence Criterion (HSIC), which was used previously in testing independence for…

Machine Learning · Statistics 2014-06-18 Kacper Chwialkowski , Arthur Gretton

We discuss how MultiFIT, the Multiscale Fisher's Independence Test for Multivariate Dependence proposed by Gorsky and Ma (2022), compares to existing linear-time kernel tests based on the Hilbert-Schmidt independence criterion (HSIC). We…

Methodology · Statistics 2022-06-23 Antonin Schrab , Wittawat Jitkrittum , Zoltán Szabó , Dino Sejdinovic , Arthur Gretton

We consider the problem of identifying the signal shared between two one-dimensional target variables, in the presence of additional multivariate observations. Canonical Correlation Analysis (CCA)-based methods have traditionally been used…

Machine Learning · Computer Science 2023-06-28 Alexander Rakowski , Christoph Lippert

This paper studies the decentralized optimization and learning problem where multiple interconnected agents aim to learn an optimal decision function defined over a reproducing kernel Hilbert space by jointly minimizing a global objective…

Machine Learning · Computer Science 2021-07-01 Ping Xu , Yue Wang , Xiang Chen , Zhi Tian

Momentum dependent local-ansatz wavefunction approach (MLA) to the correlated electron systems in solids has been further developed to solve best a self-consistent equation for variational parameters at non half-filling. With use of the…

Strongly Correlated Electrons · Physics 2015-05-30 M. Atiqur R. Patoary , Yoshiro Kakehashi

Independent Component Analysis (ICA) is the problem of learning a square matrix $A$, given samples of $X=AS$, where $S$ is a random vector with independent coordinates. Most existing algorithms are provably efficient only when each $S_i$…

Machine Learning · Computer Science 2017-02-24 Joseph Anderson , Navin Goyal , Anupama Nandi , Luis Rademacher

Independent component analysis (ICA) studies mixtures of independent latent sources. An ICA model is identifiable if the mixing can be recovered uniquely. It is well-known that ICA is identifiable if and only if at most one source is…

Statistics Theory · Mathematics 2024-01-29 Kexin Wang , Anna Seigal

The analysis of the wavelength-dependent albedo of exoplanets represents a direct way to provide insight of their atmospheric composition and to constrain theoretical planetary atmosphere modelling. Wavelength-dependent albedo can be…

Instrumentation and Methods for Astrophysics · Physics 2019-10-09 Paolo Di Marcantonio , Carlo Morossi , Mariagrazia Franchini , Holger Lehmann

The advancement in the field of data science especially in machine learning along with vast databases of variable star projects like the Optical Gravitational Lensing Experiment (OGLE) encourages researchers to analyse as well as classify…

Solar and Stellar Astrophysics · Physics 2022-01-24 Suman Paul , Tanuka Chattopadhyay