English
Related papers

Related papers: Contrastive independent component analysis

200 papers

Independent component analysis provides a principled framework for unsupervised representation learning, with solid theory on the identifiability of the latent code that generated the data, given only observations of mixtures thereof.…

Machine Learning · Statistics 2022-02-10 Luigi Gresele , Julius von Kügelgen , Vincent Stimper , Bernhard Schölkopf , Michel Besserve

The advancement in the field of data science especially in machine learning along with vast databases of variable star projects like the Optical Gravitational Lensing Experiment (OGLE) encourages researchers to analyse as well as classify…

Solar and Stellar Astrophysics · Physics 2022-01-24 Suman Paul , Tanuka Chattopadhyay

This study utilizes Independent Component Analysis (ICA) to unveil a consistent semantic structure within embeddings of words or images. Our approach extracts independent semantic components from the embeddings of a pre-trained model by…

Computation and Language · Computer Science 2023-11-03 Hiroaki Yamagiwa , Momose Oyama , Hidetoshi Shimodaira

We describe a method for unmixing mixtures of freely independent random variables in a manner analogous to the independent component analysis (ICA) based method for unmixing independent random variables from their additive mixtures. Random…

Machine Learning · Computer Science 2022-02-08 Hao Wu , Raj Rao Nadakuditi

We introduce Contrastive Intrinsic Control (CIC), an algorithm for unsupervised skill discovery that maximizes the mutual information between state-transitions and latent skill vectors. CIC utilizes contrastive learning between…

Machine Learning · Computer Science 2022-03-31 Michael Laskin , Hao Liu , Xue Bin Peng , Denis Yarats , Aravind Rajeswaran , Pieter Abbeel

Independent component analysis (ICA), as a data driven method, has shown to be a powerful tool for functional magnetic resonance imaging (fMRI) data analysis. One drawback of this multivariate approach is, that it is not compatible to the…

Neurons and Cognition · Quantitative Biology 2019-03-25 Simon Wein , Ana Maria Tomé , Markus Goldhacker , Mark W. Greenlee , Elmar W. Lang

Canonical Correlation Analysis (CCA) is a multivariate technique that takes two datasets and forms the most highly correlated possible pairs of linear combinations between them. Each subsequent pair of linear combinations is orthogonal to…

Methodology · Statistics 2015-12-22 Jacob Coleman , Joseph Replogle , Gabriel Chandler , Johanna Hardin

Application of independent component analysis (ICA) as an unmixing and image clustering technique for high spatial resolution Raman maps is reported. A hyperspectral map of a fixed human cell was collected by a Raman micro spectrometer in a…

Quantitative Methods · Quantitative Biology 2022-01-02 M. Hamed Mozaffari , Li-Lin Tay

Commercial cellular networks, like the systems based on DS-CDMA, face many types of interferences such as multi-user interference inside each sector in a cell to interoperate interference. Independent Component Analysis (ICA) has been used…

Networking and Internet Architecture · Computer Science 2010-02-18 Sargam Parmar , Bhuvan Unhelkar

There is a gap between the theoretical foundations of disentanglement and the practice of modern representation learning. Existing theoretical frameworks, particularly Independent Component Analysis (ICA) and its nonlinear variants, assume…

Machine Learning · Computer Science 2026-05-22 Edmond Cunningham

We propose an extension of non-parametric multivariate finite mixture models by dropping the standard conditional independence assumption and incorporating the independent component analysis (ICA) structure instead. We formulate an…

Methodology · Statistics 2018-09-11 Xiaotian Zhu , David R. Hunter

Fast Independent Component Analysis (FastICA) is a component separation algorithm based on the levels of non-Gaussianity. Here we apply the FastICA to the component separation problem of the microwave background including carbon monoxide…

Cosmology and Nongalactic Astrophysics · Physics 2015-06-15 Kiyotomo Ichiki , Ryohei Kaji , Hiroaki Yamamoto , Tsutomu T. Takeuchi , Yasuo Fukui

Separating high-dimensional data like images into independent latent factors, i.e independent component analysis (ICA), remains an open research problem. As we show, existing probabilistic deep generative models (DGMs), which are…

Machine Learning · Computer Science 2021-02-01 Alexander Camuto , Matthew Willetts , Brooks Paige , Chris Holmes , Stephen Roberts

A novel extension of Independent Component and Independent Vector Analysis for blind extraction/separation of one or several sources from time-varying mixtures is proposed. The mixtures are assumed to be separable source-by-source in series…

Signal Processing · Electrical Eng. & Systems 2021-05-12 Zbyněk Koldovský , Václav Kautský , Petr Tichavský

Subjective classification of galaxies can mislead us in the quest of the origin regarding formation and evolution of galaxies since this is necessarily limited to a few features. The human mind is not able to apprehend the complex…

Cosmology and Nongalactic Astrophysics · Physics 2019-10-09 Tanuka Chattopadhyay , Didier Fraix-Burnet , Saptarshi Mondal

We consider shared response modeling, a multi-view learning problem where one wants to identify common components from multiple datasets or views. We introduce Shared Independent Component Analysis (ShICA) that models each view as a linear…

Machine Learning · Computer Science 2021-10-27 Hugo Richard , Pierre Ablin , Bertrand Thirion , Alexandre Gramfort , Aapo Hyvärinen

We introduce a new general identifiable framework for principled disentanglement referred to as Structured Nonlinear Independent Component Analysis (SNICA). Our contribution is to extend the identifiability theory of deep generative models…

At the crossway of machine learning and data analysis, anomaly detection aims at identifying observations that exhibit abnormal behaviour. Be it measurement errors, disease development, severe weather, production quality default(s) (items)…

Methodology · Statistics 2025-06-06 Romain Valla , Pavlo Mozharovskyi , Florence d'Alché-Buc

Methods for analysis of principal components in discrete data have existed for some time under various names such as grade of membership modelling, probabilistic latent semantic analysis, and genotype inference with admixture. In this paper…

Machine Learning · Computer Science 2012-07-19 Wray L. Buntine , Aleks Jakulin

Correspondence analysis (CA) is a multivariate statistical tool used to visualize and interpret data dependencies by finding maximally correlated embeddings of pairs of random variables. CA has found applications in fields ranging from…

Machine Learning · Computer Science 2020-07-01 Hsiang Hsu , Salman Salamatian , Flavio P. Calmon