English
Related papers

Related papers: Combined Independent Component Analysis and Canoni…

200 papers

Motivated by the recently shown connection between self-attention and (kernel) principal component analysis (PCA), we revisit the fundamentals of PCA. Using the difference-of-convex (DC) framework, we present several novel formulations and…

Machine Learning · Computer Science 2025-10-22 Jan Quan , Johan Suykens , Panagiotis Patrinos

Principal Component Analysis (PCA) is a fundamental data preprocessing tool in the world of machine learning. While PCA is often thought of as a dimensionality reduction method, the purpose of PCA is actually two-fold: dimension reduction…

Machine Learning · Computer Science 2023-01-25 Arpita Gang , Waheed U. Bajwa

We give an information-theoretic interpretation of Canonical Correlation Analysis (CCA) via (relaxed) Wyner's common information. CCA permits to extract from two high-dimensional data sets low-dimensional descriptions (features) that…

Information Theory · Computer Science 2020-03-02 Michael Gastpar , Erixhen Sula

Canonical Correlation Analysis (CCA) is a statistical technique used to extract common information from multiple data sources or views. It has been used in various representation learning problems, such as dimensionality reduction, word…

Machine Learning · Computer Science 2020-06-18 Benjamin Dutton

The Canonical Polyadic (CP) tensor decomposition is a well-known method for interpretable analysis of high-dimensional data. Recently, the Generalized CP method (GCP) was introduced by Hong and Kolda to allow for flexible choice of the loss…

Numerical Analysis · Mathematics 2026-05-21 Jeremy M. Myers , Eric T. Phipps

Independent Component Analysis (ICA) was introduced in the 1980's as a model for Blind Source Separation (BSS), which refers to the process of recovering the sources underlying a mixture of signals, with little knowledge about the source…

Statistics Theory · Mathematics 2026-02-09 Syamantak Kumar , Purnamrita Sarkar , Peter Bickel , Derek Bean

We find conditions that guarantee that a decomposition of a generic third-order tensor in a minimal number of rank-$1$ tensors (canonical polyadic decomposition (CPD)) is unique up to permutation of rank-$1$ tensors. Then we consider the…

Algebraic Geometry · Mathematics 2016-07-20 Ignat Domanov , Lieven De Lathauwer

We consider the framework of Independent Component Analysis (ICA) for the case where the independent sources and their linear mixtures all reside in a Galois field of prime order P. Similarities and differences from the classical ICA…

Information Theory · Computer Science 2010-07-14 Arie Yeredor

We present a federated, asynchronous, and $(\varepsilon, \delta)$-differentially private algorithm for PCA in the memory-limited setting. Our algorithm incrementally computes local model updates using a streaming procedure and adaptively…

Machine Learning · Computer Science 2020-10-26 Andreas Grammenos , Rodrigo Mendoza-Smith , Jon Crowcroft , Cecilia Mascolo

We develop an algorithm for the computation of general Fourier integral operators associated with canonical graphs. The algorithm is based on dyadic parabolic decomposition using wave packets and enables the discrete approximate evaluation…

Numerical Analysis · Mathematics 2015-05-27 Maarten V. de Hoop , Gunther Uhlmann , Andras Vasy , Herwig Wendt

Coupled tensor decomposition (CTD) can extract joint features from multimodal data in various applications. It can be employed for federated learning networks with data confidentiality. Federated CTD achieves data privacy protection by…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-03-06 Xiangtao Zhang , Eleftherios Kofidis , Ce Zhu , Le Zhang , Yipeng Liu

We consider the problem of decomposing a multivariate polynomial as the difference of two convex polynomials. We introduce algebraic techniques which reduce this task to linear, second order cone, and semidefinite programming. This allows…

Optimization and Control · Mathematics 2018-09-13 Amir Ali Ahmadi , Georgina Hall

Commercial cellular networks, like the systems based on DS-CDMA, face many types of interferences such as multi-user interference inside each sector in a cell to interoperate interference. Independent Component Analysis (ICA) has been used…

Networking and Internet Architecture · Computer Science 2010-02-18 Sargam Parmar , Bhuvan Unhelkar

For multivariate data, tandem clustering is a well-known technique aiming to improve cluster identification through initial dimension reduction. Nevertheless, the usual approach using principal component analysis (PCA) has been criticized…

Methodology · Statistics 2024-03-26 Andreas Alfons , Aurore Archimbaud , Klaus Nordhausen , Anne Ruiz-Gazen

Blind source separation algorithms such as independent component analysis (ICA) are widely used in the analysis of neuroimaging data. In order to leverage larger sample sizes, different data holders/sites may wish to collaboratively learn…

We consider the problem of identifying the signal shared between two one-dimensional target variables, in the presence of additional multivariate observations. Canonical Correlation Analysis (CCA)-based methods have traditionally been used…

Machine Learning · Computer Science 2023-06-28 Alexander Rakowski , Christoph Lippert

Principal Component Analysis (PCA)-based techniques can separate data into different uncorrelated components and facilitate the statistical analysis as a pre-processing step. Independent Component Analysis (ICA) can separate statistically…

Instrumentation and Methods for Astrophysics · Physics 2023-01-03 Güray Hatipoğlu

Trimming techniques are efficient ways to generate complex geometries in Computer-Aided Design(CAD). In this paper, an improved isogeometric analysis(IGA) method for trimmed geometries is proposed. We will show that the proposed method…

Numerical Analysis · Computer Science 2017-07-04 Jinlan Xu , Ningning Sun , Laixin Shu , Timon Rabczuk , Gang Xu

Given two sets of variables, derived from a common set of samples, sparse Canonical Correlation Analysis (CCA) seeks linear combinations of a small number of variables in each set, such that the induced canonical variables are maximally…

Machine Learning · Statistics 2016-05-31 Megasthenis Asteris , Anastasios Kyrillidis , Oluwasanmi Koyejo , Russell Poldrack

We generalize the low-rank decomposition problem, such as principal and independent component analysis (PCA, ICA) for continuous-time vector-valued signals and provide a model-agnostic implicit neural signal representation framework to…

Machine Learning · Computer Science 2025-07-15 Shayan K. Azmoodeh , Krishna Subramani , Paris Smaragdis