English
Related papers

Related papers: Covariance Regression for High Dimensional Neural …

200 papers

We consider the training process of a neural network as a dynamical system acting on the high-dimensional weight space. Each epoch is an application of the map induced by the optimization algorithm and the loss function. Using this induced…

Machine Learning · Computer Science 2020-06-23 Iva Manojlović , Maria Fonoberova , Ryan Mohr , Aleksandr Andrejčuk , Zlatko Drmač , Yannis Kevrekidis , Igor Mezić

Completely randomized experiment is the gold standard for causal inference. When the covariate information for each experimental candidate is available, one typical way is to include them in covariate adjustments for more accurate treatment…

Methodology · Statistics 2025-06-10 Xin Lu , Fan Yang , Yuhao Wang

A powerful approach for understanding neural population dynamics is to extract low-dimensional trajectories from population recordings using dimensionality reduction methods. Current approaches for dimensionality reduction on neural data…

Machine Learning · Statistics 2017-11-07 Marcel Nonnenmacher , Srinivas C. Turaga , Jakob H. Macke

Linear regression on network-linked observations has been an essential tool in modeling the relationship between response and covariates with additional network structures. Previous methods either lack inference tools or rely on restrictive…

Methodology · Statistics 2022-08-22 Can M. Le , Tianxi Li

We apply Gaussian process (GP) regression, which provides a powerful non-parametric probabilistic method of relating inputs to outputs, to survival data consisting of time-to-event and covariate measurements. In this context, the covariates…

Statistics Theory · Mathematics 2014-09-08 James E. Barrett , Anthony C. C. Coolen

In this paper, we propose a non-parametric conditional factor regression (NCFR)model for domains with high-dimensional input and response. NCFR enhances linear regression in two ways: a) introducing low-dimensional latent factors leading to…

Machine Learning · Statistics 2013-07-03 Ava Bargi , Richard Yi Da Xu , Massimo Piccardi

We propose a new neural network framework, termed Neural Network Machine Regression (NNMR), which integrates trainable input gating and adaptive depth regularization to jointly perform feature selection and function estimation in an…

Methodology · Statistics 2026-02-03 Jiuchen Zhang , Ling Zhou , Peter Song

Dimensionality reduction, a form of compression, can simplify representations of information to increase efficiency and reveal general patterns. Yet, this simplification also forfeits information, thereby reducing representational capacity.…

Despite the widespread utilization of Gaussian process models for versatile nonparametric modeling, they exhibit limitations in effectively capturing abrupt changes in function smoothness and accommodating relationships with heteroscedastic…

Machine Learning · Statistics 2023-09-01 Taehee Lee , Jun S. Liu

Statistical inferences for high-dimensional regression models have been extensively studied for their wide applications ranging from genomics, neuroscience, to economics. However, in practice, there are often potential unmeasured…

Methodology · Statistics 2023-09-12 Jing Ouyang , Kean Ming Tan , Gongjun Xu

In mixed longitudinal studies, a group of subjects enter the study at different ages (cross-sectional) and are followed for successive years (longitudinal). In the context of such studies, we consider nonparametric covariance estimation…

Methodology · Statistics 2020-12-02 Anru R. Zhang , Kehui Chen

We propose a robust inferential procedure for assessing uncertainties of parameter estimation in high-dimensional linear models, where the dimension $p$ can grow exponentially fast with the sample size $n$. Our method combines the…

Machine Learning · Statistics 2015-03-19 Tianqi Zhao , Mladen Kolar , Han Liu

A deep latent variable model is a powerful method for capturing complex distributions. These models assume that underlying structures, but unobserved, are present within the data. In this dissertation, we explore high-dimensional problems…

Machine Learning · Computer Science 2024-06-13 Khuong Vo

This paper studies causal inference with observational data from a single large network. We consider a nonparametric model with interference in both potential outcomes and selection into treatment. Specifically, both stages may be the…

Econometrics · Economics 2025-12-30 Michael P. Leung , Pantelis Loupos

Spontaneous brain activity, as observed in functional neuroimaging, has been shown to display reproducible structure that expresses brain architecture and carries markers of brain pathologies. An important view of modern neuroscience is…

Machine Learning · Statistics 2010-11-15 Gaël Varoquaux , Alexandre Gramfort , Jean Baptiste Poline , Bertrand Thirion

Recurrent event time data arise in many studies, including biomedicine, public health, marketing, and social media analysis. High-dimensional recurrent event data involving many event types and observations have become prevalent with…

Methodology · Statistics 2025-04-02 Fangyi Chen , Yunxiao Chen , Zhiliang Ying , Kangjie Zhou

With the rapid growth of neuroimaging technologies, a great effort has been dedicated recently to investigate the dynamic changes in brain activity. Examples include time course calcium imaging and dynamic brain functional connectivity. In…

Methodology · Statistics 2020-08-31 Wei Hu , Tianyu Pan , Dehan Kong , Weining Shen

Classical regression analysis relates the expectation of a response variable to a linear combination of explanatory variables. In this article, we propose a covariance regression model that parameterizes the covariance matrix of a…

Methodology · Statistics 2011-03-01 Peter D. Hoff , Xiaoyue Niu

Multimodal data, where different types of data are collected from the same subjects, are fast emerging in a large variety of scientific applications. Factor analysis is commonly used in integrative analysis of multimodal data, and is…

Statistics Theory · Mathematics 2021-03-31 Quefeng Li , Lexin Li

We propose a novel approach for modeling multivariate longitudinal data in the presence of unobserved heterogeneity for the analysis of the Health and Retirement Study (HRS) data. Our proposal can be cast within the framework of linear…

Methodology · Statistics 2015-09-17 Laura Anderlucci , Cinzia Viroli