English
Related papers

Related papers: Randomized Independent Component Analysis

200 papers

We present a novel algorithm for overcomplete independent components analysis (ICA), where the number of latent sources k exceeds the dimension p of observed variables. Previous algorithms either suffer from high computational complexity or…

Fast Independent Component Analysis (FastICA) is a component separation algorithm based on the levels of non-Gaussianity. Here we apply the FastICA to the component separation problem of the microwave background including carbon monoxide…

Cosmology and Nongalactic Astrophysics · Physics 2015-06-15 Kiyotomo Ichiki , Ryohei Kaji , Hiroaki Yamamoto , Tsutomu T. Takeuchi , Yasuo Fukui

Over the last couple of decades, several copula based methods have been proposed in the literature to test for the independence among several random variables. But these existing tests are not invariant under monotone transformations of the…

Statistics Theory · Mathematics 2019-11-15 Angshuman Roy , Anil Ghosh , Alok Goswami , C. A. Murthy

Advances in computational cognitive neuroimaging research are related to the availability of large amounts of labeled brain imaging data, but such data are scarce and expensive to generate. While powerful data generation mechanisms, such as…

Image and Video Processing · Electrical Eng. & Systems 2021-07-15 Badr Tajini , Hugo Richard , Bertrand Thirion

In recent years, several methods have been proposed for the discovery of causal structure from non-experimental data (Spirtes et al. 2000; Pearl 2000). Such methods make various assumptions on the data generating process to facilitate its…

Machine Learning · Computer Science 2012-07-09 Shohei Shimizu , Aapo Hyvarinen , Yutaka Kano , Patrik O. Hoyer

The brain effortlessly solves blind source separation (BSS) problems, but the algorithm it uses remains elusive. In signal processing, linear BSS problems are often solved by Independent Component Analysis (ICA). To serve as a model of a…

Neural and Evolutionary Computing · Computer Science 2021-11-18 Yanis Bahroun , Dmitri B Chklovskii , Anirvan M Sengupta

High-dimensional variable selection is an important issue in many scientific fields, such as genomics. In this paper, we develop a sure independence feature screening pro- cedure based on kernel canonical correlation analysis (KCCA-SIS, for…

Methodology · Statistics 2016-10-04 Tianqi Liu , Kuang-Yao Lee , Hongyu Zhao

Independent Component Analysis (ICA) is commonly-used in electroencephalogram (EEG) signal processing to remove non-cerebral artifacts from cerebral data. Despite the ubiquity of ICA, the effect of measurement uncertainty on the artifact…

Systems and Control · Electrical Eng. & Systems 2024-10-07 Jennie Couchman , Orestis Kaparounakis , Chatura Samarakoon , Phillip Stanley-Marbell

Nonlinear component analysis such as kernel Principle Component Analysis (KPCA) and kernel Canonical Correlation Analysis (KCCA) are widely used in machine learning, statistics and data analysis, but they can not scale up to big datasets.…

Machine Learning · Computer Science 2016-01-12 Bo Xie , Yingyu Liang , Le Song

We consider shared response modeling, a multi-view learning problem where one wants to identify common components from multiple datasets or views. We introduce Shared Independent Component Analysis (ShICA) that models each view as a linear…

Machine Learning · Computer Science 2021-10-27 Hugo Richard , Pierre Ablin , Bertrand Thirion , Alexandre Gramfort , Aapo Hyvärinen

A new computationally efficient dependence measure, and an adaptive statistical test of independence, are proposed. The dependence measure is the difference between analytic embeddings of the joint distribution and the product of the…

Machine Learning · Statistics 2016-10-18 Wittawat Jitkrittum , Zoltan Szabo , Arthur Gretton

Nonlinear independent component analysis (ICA) provides an appealing framework for unsupervised feature learning, but the models proposed so far are not identifiable. Here, we first propose a new intuitive principle of unsupervised deep…

Machine Learning · Statistics 2016-05-23 Aapo Hyvarinen , Hiroshi Morioka

The goal of this paper is to extend independent subspace analysis (ISA) to the case of (i) nonparametric, not strictly stationary source dynamics and (ii) unknown source component dimensions. We make use of functional autoregressive (fAR)…

Methodology · Statistics 2012-01-04 Zoltan Szabo

We examine the problem of selecting a small set of linear measurements for reconstructing high-dimensional signals. Well-established methods for optimizing such measurements include principal component analysis (PCA), independent component…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Ling-Qi Zhang , Zahra Kadkhodaie , Eero P. Simoncelli , David H. Brainard

This paper is concerned with the analysis of correlation between two high-dimensional data sets when there are only few correlated signal components but the number of samples is very small, possibly much smaller than the dimensions of the…

Information Theory · Computer Science 2016-04-08 Yang Song , Peter J. Schreier , David Ramirez , Tanuj Hasija

Nonlinear ICA is a fundamental problem for unsupervised representation learning, emphasizing the capacity to recover the underlying latent variables generating the data (i.e., identifiability). Recently, the very first identifiability…

Machine Learning · Statistics 2019-02-05 Aapo Hyvarinen , Hiroaki Sasaki , Richard E. Turner

Noise subtraction is a crucial process in gravitational wave (GW) data analysis to improve the sensitivity of interferometric detectors. While linear noise coupling has been extensively studied and successfully mitigated using methods such…

Instrumentation and Methods for Astrophysics · Physics 2026-04-22 Jun'ya Kume , Koh Ueno , Tatsuki Washimi , Jun'ichi Yokoyama , Takaaki Yokozawa , Yousuke Itoh

There are a multitude of methods to perform multi-set correlated component analysis (MCCA), including some that require iterative solutions. The methods differ on the criterion they optimize and the constraints placed on the solutions. This…

Machine Learning · Statistics 2018-02-13 Lucas C Parra

Drug discovery is the process of identifying compounds which have potentially meaningful biological activity. A major challenge that arises is that the number of compounds to search over can be quite large, sometimes numbering in the…

Applications · Statistics 2012-02-16 Daniel Samarov , J. S. Marron , Yufeng Liu , Christopher Grulke , Alexander Tropsha

Independent component analysis is an unsupervised learning approach for computing the independent components (ICs) from the multivariate signals or data matrix. The ICs are evaluated based on the multiplication of the weight matrix with the…