English
Related papers

Related papers: Learning overcomplete, low coherence dictionaries …

200 papers

Sparse principal component analysis (sparse PCA) is a widely used technique for dimensionality reduction in multivariate analysis, addressing two key limitations of standard PCA. First, sparse PCA can be implemented in high-dimensional low…

Methodology · Statistics 2025-10-07 Jan O. Bauer

Despite a lack of theoretical understanding, deep neural networks have achieved unparalleled performance in a wide range of applications. On the other hand, shallow representation learning with component analysis is associated with rich…

Machine Learning · Computer Science 2018-03-20 Calvin Murdock , Ming-Fang Chang , Simon Lucey

Independent component analysis (ICA) has been used in many applications, including self-interference cancellation for in-band full-duplex wireless systems and anomaly detection in industrial internet of things. This paper presents a…

Signal Processing · Electrical Eng. & Systems 2022-05-03 Hsi-Hung Lu , Chung-An Shen , Mohammed E. Fouda , Ahmed M. Eltawil

We introduce coroICA, confounding-robust independent component analysis, a novel ICA algorithm which decomposes linearly mixed multivariate observations into independent components that are corrupted (and rendered dependent) by hidden…

Machine Learning · Statistics 2019-10-31 Niklas Pfister , Sebastian Weichwald , Peter Bühlmann , Bernhard Schölkopf

We consider the problem of recovering a common latent source with independent components from multiple views. This applies to settings in which a variable is measured with multiple experimental modalities, and where the goal is to…

Machine Learning · Statistics 2019-08-02 Luigi Gresele , Paul K. Rubenstein , Arash Mehrjou , Francesco Locatello , Bernhard Schölkopf

In representation learning, Convolutional Sparse Coding (CSC) enables unsupervised learning of features by jointly optimising both an \(\ell_2\)-norm fidelity term and a sparsity enforcing penalty. This work investigates using a…

Image and Video Processing · Electrical Eng. & Systems 2021-07-15 Perla Mayo , Oktay Karakuş , Robin Holmes , Alin Achim

The brain effortlessly solves blind source separation (BSS) problems, but the algorithm it uses remains elusive. In signal processing, linear BSS problems are often solved by Independent Component Analysis (ICA). To serve as a model of a…

Neural and Evolutionary Computing · Computer Science 2021-11-18 Yanis Bahroun , Dmitri B Chklovskii , Anirvan M Sengupta

In this paper, the problem of training a classifier on a dataset with incomplete features is addressed. We assume that different subsets of features (random or structured) are available at each data instance. This situation typically occurs…

Machine Learning · Computer Science 2021-04-20 Cesar F. Caiafa , Ziyao Wang , Jordi Solé-Casals , Qibin Zhao

In this work, we explore Partitioned Independent Component Analysis (PICA), an extension of the well-established Independent Component Analysis (ICA) framework. Traditionally, ICA focuses on extracting a vector of independent source signals…

Statistics Theory · Mathematics 2024-02-16 Marina Garrote-López , Monroe Stephenson

At the crossway of machine learning and data analysis, anomaly detection aims at identifying observations that exhibit abnormal behaviour. Be it measurement errors, disease development, severe weather, production quality default(s) (items)…

Methodology · Statistics 2025-06-06 Romain Valla , Pavlo Mozharovskyi , Florence d'Alché-Buc

Independent component analysis (ICA), as an approach to the blind source-separation (BSS) problem, has become the de-facto standard in many medical imaging settings. Despite successes and a large ongoing research effort, the limitation of…

Machine Learning · Computer Science 2016-03-23 R. Devon Hjelm , Sergey M. Plis , Vince C. Calhoun

We analyze the dynamics of an online algorithm for independent component analysis in the high-dimensional scaling limit. As the ambient dimension tends to infinity, and with proper time scaling, we show that the time-varying joint empirical…

Machine Learning · Computer Science 2017-11-08 Chuang Wang , Yue M. Lu

Cosine similarity is widely used to measure the similarity between two embeddings, while interpretations based on angle and correlation coefficient are common. In this study, we focus on the interpretable axes of embeddings transformed by…

Computation and Language · Computer Science 2024-12-18 Hiroaki Yamagiwa , Momose Oyama , Hidetoshi Shimodaira

Latent variable discovery is a central problem in data analysis with a broad range of applications in applied science. In this work, we consider data given as an invertible mixture of two statistically independent components and assume that…

Machine Learning · Statistics 2023-03-08 Uri Shaham , Jonathan Svirsky , Ori Katz , Ronen Talmon

Unsupervised learning plays an important role in many fields, such as artificial intelligence, machine learning, and neuroscience. Compared to static data, methods for extracting low-dimensional structure for dynamic data are lagging. We…

Machine Learning · Computer Science 2022-03-07 Rui Meng , Tianyi Luo , Kristofer Bouchard

Principal component analysis (PCA) is a well-known linear dimension-reduction method that has been widely used in data analysis and modeling. It is an unsupervised learning technique that identifies a suitable linear subspace for the input…

Machine Learning · Statistics 2021-09-10 Shaojie Xu , Joel Vaughan , Jie Chen , Agus Sudjianto , Vijayan Nair

Independent component analysis (ICA), as a data driven method, has shown to be a powerful tool for functional magnetic resonance imaging (fMRI) data analysis. One drawback of this multivariate approach is, that it is not compatible to the…

Neurons and Cognition · Quantitative Biology 2019-03-25 Simon Wein , Ana Maria Tomé , Markus Goldhacker , Mark W. Greenlee , Elmar W. Lang

In many settings, we have multiple data sets (also called views) that capture different and overlapping aspects of the same phenomenon. We are often interested in finding patterns that are unique to one or to a subset of the views. For…

Machine Learning · Computer Science 2015-07-15 Rong Ge , James Zou

Independent component analysis (ICA) is a blind source separation method to recover source signals of interest from their mixtures. Most existing ICA procedures assume independent sampling. Second-order-statistics-based source separation…

Machine Learning · Statistics 2022-12-14 Seonjoo Lee , Haipeng Shen , Young K. Truong

In this letter, we propose a modified version of Fast Independent Component Analysis (FICA) algorithm to solve the self-interference cancellation (SIC) problem in In-band Full Duplex (IBFD) communication systems. The complex mixing problem…

Signal Processing · Electrical Eng. & Systems 2020-01-07 Mohammed E. Fouda , Sergey Shaboyan , Ayman Elezabi , Ahmed Eltawil