English
Related papers

Related papers: Joint and Individual Component Regression

200 papers

We propose a new method for modelling simple longitudinal data. We aim to do this in a flexible manner (without restrictive assumptions about the shapes of individual trajectories), while exploiting structural similarities between the…

Methodology · Statistics 2024-09-24 Helen Ogden

We propose a principal components regression method based on maximizing a joint pseudo-likelihood for responses and predictors. Our method uses both responses and predictors to select linear combinations of the predictors relevant for the…

Methodology · Statistics 2021-08-10 Karl Oskar Ekvall

High-dimensional multi-source data are encountered in many fields. Despite recent developments on the integrative dimension reduction of such data, most existing methods cannot easily accommodate data of multiple types (e.g., binary or…

Methodology · Statistics 2018-08-08 Huichen Zhu , Gen Li , Eric F. Lock

Internet of Things devices are expanding rapidly and generating huge amount of data. There is an increasing need to explore data collected from these devices. Collaborative learning provides a strategic solution for the Internet of Things…

Cryptography and Security · Computer Science 2022-07-21 Guanhong Miao

We propose a new method for supervised learning, especially suited to wide data where the number of features is much greater than the number of observations. The method combines the lasso ($\ell_1$) sparsity penalty with a quadratic penalty…

Methodology · Statistics 2018-10-25 J. Kenneth Tay , Jerome Friedman , Robert Tibshirani

Clinical and epidemiological studies encode participant information in multivariate vectors with mixed type variables on continuous, truncated, ordinal, and binary scales. Semiparametric Gaussian Copula (SGC) assumes that observed data is…

Methodology · Statistics 2026-03-19 Debangan Dey , Vadim Zipunnikov

In medical and biological research, longitudinal data and survival data types are commonly seen. Traditional statistical models mostly consider to deal with either of the data types, such as linear mixed models for longitudinal data, and…

Methodology · Statistics 2021-07-12 Jizi Shangguan

We introduce coroICA, confounding-robust independent component analysis, a novel ICA algorithm which decomposes linearly mixed multivariate observations into independent components that are corrupted (and rendered dependent) by hidden…

Machine Learning · Statistics 2019-10-31 Niklas Pfister , Sebastian Weichwald , Peter Bühlmann , Bernhard Schölkopf

Principal component analysis (PCA), the most popular dimension-reduction technique, has been used to analyze high-dimensional data in many areas. It discovers the homogeneity within the data and creates a reduced feature space to capture as…

Methodology · Statistics 2026-03-24 Daning Bi , Le Chang , Yanrong Yang

This paper studies high-dimensional regression with two-way structured data. To estimate the high-dimensional coefficient vector, we propose the generalized matrix decomposition regression (GMDR) to efficiently leverage any auxiliary…

Methodology · Statistics 2023-02-17 Yue Wang , Ali Shojaie , Timothy W. Randolph , Parker Knight , Jing Ma

We propose LOCO, an algorithm for large-scale ridge regression which distributes the features across workers on a cluster. Important dependencies between variables are preserved using structured random projections which are cheap to compute…

Machine Learning · Statistics 2015-06-09 Christina Heinze , Brian McWilliams , Nicolai Meinshausen , Gabriel Krummenacher

A data table which is arranged according to two factors can often be considered as a compositional table. An example is the number of unemployed people, split according to gender and age classes. Analyzed as compositions, the relevant…

Methodology · Statistics 2019-04-12 Julie Rendlová , Karel Hron , Kamila Fačevicová , Peter Filzmoser

Very often data we encounter in practice is a collection of matrices rather than a single matrix. These multi-block data are naturally linked and hence often share some common features and at the same time they have their own individual…

Computer Vision and Pattern Recognition · Computer Science 2017-03-14 Guoxu Zhou , Andrzej Cichocki , Yu Zhang , Danilo Mandic

We consider a a collection of categorical random variables. Of special interest is the causal effect on an outcome variable following an intervention on another variable. Conditionally on a Directed Acyclic Graph (DAG), we assume that the…

Methodology · Statistics 2023-06-29 Federico Castelletti , Guido Consonni , Marco Luigi Della Vedova

This paper proposes a robust reduced-rank scheme for adaptive beamforming based on joint iterative optimization (JIO) of adaptive filters. The scheme provides an efficient way to deal with filters with large number of elements. It consists…

Information Theory · Computer Science 2013-03-18 Lei Wang , Rodrigo C. de Lamare

Multimodal representation learning is commonly built on a shared-private decomposition, treating latent information as either common to all modalities or specific to one. This binary view is often inadequate: many factors are shared by only…

Machine Learning · Statistics 2026-04-08 Huichao Li , Junhan Yu , Doudou Zhou

Integrative analysis of disparate data blocks measured on a common set of experimental subjects is one major challenge in modern data analysis. This data structure naturally motivates the simultaneous exploration of the joint and individual…

Methodology · Statistics 2016-04-26 Qing Feng , Jan Hannig , J. S. Marron

Heterogeneity is a hallmark of complex diseases. Regression-based heterogeneity analysis, which is directly concerned with outcome-feature relationships, has led to a deeper understanding of disease biology. Such an analysis identifies the…

Methodology · Statistics 2022-11-29 Ziye Luo , Xinyue Yao , Yifan Sun , Xinyan Fan

Quantitative analysis of large-scale data is often complicated by the presence of diverse subgroups, which reduce the accuracy of inferences they make on held-out data. To address the challenge of heterogeneous data analysis, we introduce…

Machine Learning · Computer Science 2021-09-01 Nazanin Alipourfard , Keith Burghardt , Kristina Lerman

Principal component regression (PCR) is a popular technique for fixed-design error-in-variables regression, a generalization of the linear regression setting in which the observed covariates are corrupted with random noise. We provide the…

Machine Learning · Computer Science 2024-08-06 Anish Agarwal , Keegan Harris , Justin Whitehouse , Zhiwei Steven Wu