English
Related papers

Related papers: Grouping effects of sparse CCA models in variable …

200 papers

Standard linear modeling approaches make potentially simplistic assumptions regarding the structure of categorical effects that may obfuscate more complex relationships governing data. For example, recent work focused on the two-way…

Methodology · Statistics 2019-03-05 Thomas A. Metzger , Christopher T. Franck

Integration of multi-omics data provides opportunities for revealing biological mechanisms related to certain phenotypes. We propose a novel method of multi-omics integration called supervised deep generalized canonical correlation analysis…

Quantitative Methods · Quantitative Biology 2022-04-21 Jeongyoung Hwang , Sehwan Moon , Hyunju Lee

This article considers the problem of multi-group classification in the setting where the number of variables $p$ is larger than the number of observations $n$. Several methods have been proposed in the literature that address this problem,…

Machine Learning · Statistics 2021-04-01 Irina Gaynanova , Mladen Kolar

We propose novel first-order stochastic approximation algorithms for canonical correlation analysis (CCA). Algorithms presented are instances of inexact matrix stochastic gradient (MSG) and inexact matrix exponentiated gradient (MEG), and…

Machine Learning · Computer Science 2018-02-27 Raman Arora , Teodor V. Marinov , Poorya Mianjy , Nathan Srebro

Correspondence analysis, multiple correspondence analysis and their discriminant counterparts (i.e., discriminant simple correspondence analysis and discriminant multiple correspondence analysis) are methods of choice for analyzing…

In the presence of grouped covariates, we propose a framework for boosting that allows to enforce sparsity within and between groups. By using component-wise and group-wise gradient boosting at the same time with adjusted degrees of…

Methodology · Statistics 2024-04-09 Fabian Obster , Christian Heumann

We propose a new sparse principal component analysis (SPCA) method in which the solutions are obtained by projecting the full cardinality principal components onto subsets of variables. The resulting components are guaranteed to explain a…

Methodology · Statistics 2019-10-09 Giovanni Maria Merola

Scientific and business practices are increasingly resulting in large collections of randomized experiments. Analyzed together, these collections can tell us things that individual experiments in the collection cannot. We study how to learn…

Machine Learning · Statistics 2017-06-02 Alexander Peysakhovich , Dean Eckles

Sparse latent multi-factor models have been used in many exploratory and predictive problems with high-dimensional multivariate observations. Because of concerns with identifiability, the latent factors are almost always assumed to be…

Applications · Statistics 2013-12-09 Vinicius Diniz Mayrink , Joseph Edward Lucas

Principal component analysis (PCA) is a widely used dimension reduction technique in machine learning and multivariate statistics. To improve the interpretability of PCA, various approaches to obtain sparse principal direction loadings have…

Data Structures and Algorithms · Computer Science 2021-06-07 Agniva Chowdhury , Petros Drineas , David P. Woodruff , Samson Zhou

Recent work has sought to understand the behavior of neural networks by comparing representations between layers and between different trained models. We examine methods for comparing neural network representations based on canonical…

Machine Learning · Computer Science 2019-07-22 Simon Kornblith , Mohammad Norouzi , Honglak Lee , Geoffrey Hinton

The topic of this tutorial is Least Squares Sparse Principal Components Analysis (LS SPCA) which is a simple method for computing approximated Principal Components which are combinations of only a few of the observed variables. Analogously…

Methodology · Statistics 2021-05-31 Giovanni Maria Merola

Clustering has long been a popular unsupervised learning approach to identify groups of similar objects and discover patterns from unlabeled data in many applications. Yet, coming up with meaningful interpretations of the estimated clusters…

Methodology · Statistics 2020-05-26 Minjie Wang , Tianyi Yao , Genevera I. Allen

Principal component analysis (PCA) is a statistical technique commonly used in multivariate data analysis. However, PCA can be difficult to interpret and explain since the principal components (PCs) are linear combinations of the original…

Mathematical Software · Computer Science 2013-12-24 W. Liu , H. Zhang , D. Tao , Y. Wang , K. Lu

Multiview canonical correlation analysis (MCCA) seeks latent low-dimensional representations encountered with multiview data of shared entities (a.k.a. common sources). However, existing MCCA approaches do not exploit the geometry of the…

Signal Processing · Electrical Eng. & Systems 2019-05-22 Jia Chen , Gang Wang , Georgios B. Giannakis

Kernel canonical correlation analysis (KCCA) is a nonlinear multi-view representation learning technique with broad applicability in statistics and machine learning. Although there is a closed-form solution for the KCCA objective, it…

Machine Learning · Computer Science 2016-03-01 Weiran Wang , Karen Livescu

Evaluation of clinical prediction models across multiple clusters, whether centers or datasets, is becoming increasingly common. A comprehensive evaluation includes an assessment of the agreement between the estimated risks and the observed…

Methodology · Statistics 2026-04-22 Lasai Barreñada , Bavo D. C. Campo , Laure Wynants , Ben Van Calster

The model interpretation is essential in many application scenarios and to build a classification model with a ease of model interpretation may provide useful information for further studies and improvement. It is common to encounter with a…

Machine Learning · Statistics 2019-01-07 Wan-Ping Nicole Chen , Yuan-chin Ivan Chang

Unsupervised two-view learning, or detection of dependencies between two paired data sets, is typically done by some variant of canonical correlation analysis (CCA). CCA searches for a linear projection for each view, such that the…

Machine Learning · Statistics 2016-11-18 Leo Lahti , Samuel Myllykangas , Sakari Knuutila , Samuel Kaski

Synthetic control (SC) methods are commonly used to estimate the treatment effect on a single treated unit in panel data settings. An SC is a weighted average of control units built to match the treated unit, with weights typically…

Methodology · Statistics 2023-02-21 Xu Shi , Kendrick Li , Wang Miao , Mengtong Hu , Eric Tchetgen Tchetgen