English
Related papers

Related papers: High-Dimensional Gaussian Copula Regression: Adapt…

200 papers

Multiple imputation has become one of the standard methods in drawing inferences in many incomplete data applications. Applications of multiple imputation in relatively more complex settings, such as high-dimensional clustered data, require…

Methodology · Statistics 2025-04-08 Qiushuang Li , Recai Yucel

In this work, we give efficient algorithms for privately estimating a Gaussian distribution in both pure and approximate differential privacy (DP) models with optimal dependence on the dimension in the sample complexity. In the pure DP…

Data Structures and Algorithms · Computer Science 2023-06-02 Daniel Alabi , Pravesh K. Kothari , Pranay Tankala , Prayaag Venkat , Fred Zhang

We propose novel randomized optimization methods for high-dimensional convex problems based on restrictions of variables to random subspaces. We consider oblivious and data-adaptive subspaces and study their approximation properties via…

Information Theory · Computer Science 2020-12-15 Jonathan Lacotte , Mert Pilanci

This paper studies the Gaussian and bootstrap approximations for the probabilities of a non-degenerate U-statistic belonging to the hyperrectangles in $\mathbb{R}^d$ when the dimension $d$ is large. A two-step Gaussian approximation…

Statistics Theory · Mathematics 2017-07-11 Xiaohui Chen

We consider drawing statistical inferences based on data subject to non-Gaussian measurement error. Unlike most existing methods developed under the assumption of Gaussian measurement error, the proposed strategy exploits hypercomplex…

Methodology · Statistics 2025-05-06 Nicholas W. Woolsey , Xianzheng Huang

Extrinsic Gaussian process regression methods, such as wrapped Gaussian process, have been developed to analyze manifold data. However, there is a lack of intrinsic Gaussian process methods for studying complex data with manifold-valued…

Machine Learning · Statistics 2025-02-11 Zhanfeng Wang , Xinyu Li , Hao Ding , Jian Qing Shi

Gaussian process regression is widely used because of its ability to provide well-calibrated uncertainty estimates and handle small or sparse datasets. However, it struggles with high-dimensional data. One possible way to scale this…

Machine Learning · Statistics 2024-02-02 Bernardo Fichera , Viacheslav Borovitskiy , Andreas Krause , Aude Billard

Kendall's tau and conditional Kendall's tau matrices are multivariate (conditional) dependence measures between the components of a random vector. For large dimensions, available estimators are computationally expensive and can be improved…

Statistics Theory · Mathematics 2024-12-30 Rutger van der Spek , Alexis Derumigny

Large-scale Gaussian process inference has long faced practical challenges due to time and space complexity that is superlinear in dataset size. While sparse variational Gaussian process models are capable of learning from large-scale data,…

Machine Learning · Statistics 2018-01-23 Ching-An Cheng , Byron Boots

Fitting high-dimensional statistical models often requires the use of non-linear parameter estimation procedures. As a consequence, it is generally impossible to obtain an exact characterization of the probability distribution of the…

Methodology · Statistics 2014-04-03 Adel Javanmard , Andrea Montanari

Capturing complex dependence structures between outcome variables (e.g., study endpoints) is of high relevance in contemporary biomedical data problems and medical research. Distributional copula regression provides a flexible tool to model…

Methodology · Statistics 2022-02-28 Nicolai Hans , Nadja Klein , Florian Faschingbauer , Michael Schneider , Andreas Mayr

Although a majority of the theoretical literature in high-dimensional statistics has focused on settings which involve fully-observed data, settings with missing values and corruptions are common in practice. We consider the problems of…

Machine Learning · Statistics 2017-11-06 Yining Wang , Jialei Wang , Sivaraman Balakrishnan , Aarti Singh

Consider semiparametric estimation where a doubly robust estimating function for a low-dimensional parameter is available, depending on two working models. With high-dimensional data, we develop regularized calibrated estimation as a…

Methodology · Statistics 2020-09-28 Satyajit Ghosh , Zhiqiang Tan

We study the problem of estimating from data, a sparse approximation to the inverse covariance matrix. Estimating a sparsity constrained inverse covariance matrix is a key component in Gaussian graphical model learning, but one that is…

Machine Learning · Statistics 2011-06-28 Suvrit Sra , Dongmin Kim

Instance-wise feature selection and ranking methods can achieve a good selection of task-friendly features for each sample in the context of neural networks. However, existing approaches that assume feature subsets to be independent are…

Machine Learning · Computer Science 2023-08-02 Hanyu Peng , Guanhua Fang , Ping Li

For predictive modeling relying on Bayesian inversion, fully independent, or ``mean-field'', Gaussian distributions are often used as approximate probability density functions in variational inference since the number of variational…

Methodology · Statistics 2023-07-14 Wyatt Bridgman , Reese Jones , Mohammad Khalil

We develop new econometric methods for estimation and inference in high-dimensional panel data models with interactive fixed effects. Our approach can be regarded as a non-trivial extension of the very popular common correlated effects…

Econometrics · Economics 2025-08-11 Maximilian Ruecker , Michael Vogt , Oliver Linton , Christopher Walsh

Existing high-dimensional statistical methods are largely established for analyzing individual-level data. In this work, we study estimation and inference for high-dimensional linear models where we only observe "proxy data", which include…

Methodology · Statistics 2022-01-12 Sai Li , T. Tony Cai , Hongzhe Li

In this work we present a rigorous application of the Expectation Maximization algorithm to determine the marginal distributions and the dependence structure in a Gaussian copula model with missing data. We further show how to circumvent a…

Machine Learning · Statistics 2022-01-17 Maximilian Kertel , Markus Pauly

We propose a new multivariate dependency measure. It is obtained by considering a Gaussian kernel based distance between the copula transform of the given d-dimensional distribution and the uniform copula and then appropriately normalizing…

Statistics Theory · Mathematics 2019-11-12 Angshuman Roy , Alok Goswami , C. A. Murthy