English
Related papers

Related papers: Effective Data-aware Covariance Estimator from Com…

200 papers

We consider the problem of estimating a low-dimensional parameter in high-dimensional linear regression. Constructing an approximately unbiased estimate of the parameter of interest is a crucial step towards performing statistical…

Statistics Theory · Mathematics 2021-07-30 Michael Celentano , Andrea Montanari

Future large scale cosmological surveys will provide huge data sets whose analysis requires efficient data compression. Calculating accurate covariances is extremely challenging with increasing number of statistics used. Here we introduce a…

Cosmology and Nongalactic Astrophysics · Physics 2015-06-03 Marika Asgari , Peter Schneider

Treatment effect estimation, which refers to the estimation of causal effects and aims to measure the strength of the causal relationship, is of great importance in many fields but is a challenging problem in practice. As present,…

Machine Learning · Computer Science 2021-07-20 Zhenyu Guo , Shuai Zheng , Zhizhe Liu , Kun Yan , Zhenfeng Zhu

Causal effect estimation from observational data is a crucial but challenging task. Currently, only a limited number of data-driven causal effect estimation methods are available. These methods either provide only a bound estimation of the…

Methodology · Statistics 2020-11-10 Debo Cheng , Jiuyong Li , Lin Liu , Kui Yu , Thuc Duy Lee , Jixue Liu

Having a large number of covariates can have a negative impact on the quality of causal effect estimation since confounding adjustment becomes unreliable when the number of covariates is large relative to the samples available. Propensity…

Methodology · Statistics 2020-09-15 Debo Cheng , Jiuyong Li , Lin Liu , Jixue Liu

Many parametric statistical models are not properly normalised and only specified up to an intractable partition function, which renders parameter estimation difficult. Examples of unnormalised models are Gibbs distributions, Markov random…

Machine Learning · Statistics 2018-06-12 Ciwan Ceylan , Michael U. Gutmann

Covariance localization is a critical component of ensemble-based data assimilation (DA) and many current localization schemes simply dampen correlations as a function of distance. Increases in computational resources, broadening scope of…

Data Analysis, Statistics and Probability · Physics 2025-08-27 Shay Gilpin , Matthias Morzfeld , Kevin K. Lin

Precision matrix, which is the inverse of covariance matrix, plays an important role in statistics, as it captures the partial correlation between variables. Testing the equality of two precision matrices in high dimensional setting is a…

Methodology · Statistics 2018-10-23 Mingjuan Zhang , Yong He , Cheng Zhou , Xinsheng Zhang

It is desirable to have accurate uncertainty estimation from a single deterministic forward-pass model, as traditional methods for uncertainty quantification are computationally expensive. However, this is difficult because single…

Machine Learning · Computer Science 2023-08-22 Frederik Boe Hüttel , Filipe Rodrigues , Francisco Câmara Pereira

A hierarchical Bayesian approach that permits simultaneous inference for the regression coefficient matrix and the error precision (inverse covariance) matrix in the multivariate linear model is proposed. Assuming a natural ordering of the…

Methodology · Statistics 2024-10-29 Christina Zhao , Ding Xiang , Galin L. Jones , Adam J. Rothman

Causal decomposition analysis (CDA) is an approach for modeling the impact of hypothetical interventions to reduce disparities. It is useful for identifying foci that future interventions, including multilevel and multimodal interventions,…

Methodology · Statistics 2026-04-28 John W. Jackson , Ting-Hsuan Chang , Aster Meche , Trang Q. Nguyen

We introduce a new sparse estimator of the covariance matrix for high-dimensional models in which the variables have a known ordering. Our estimator, which is the solution to a convex optimization problem, is equivalently expressed as an…

Statistics Theory · Mathematics 2014-05-27 Jacob Bien , Florentina Bunea , Luo Xiao

Covariance estimation and selection for high-dimensional multivariate datasets is a fundamental problem in modern statistics. Gaussian directed acyclic graph (DAG) models are a popular class of models used for this purpose. Gaussian DAG…

Methodology · Statistics 2017-10-12 Xuan Cao , Kshitij Khare , Malay Ghosh

There is a great need for robust techniques in data mining and machine learning contexts where many standard techniques such as principal component analysis and linear discriminant analysis are inherently susceptible to outliers.…

Methodology · Statistics 2015-09-28 Garth Tarr , Samuel Müller , Neville C. Weber

We propose a computationally efficient estimator, formulated as a convex program, for a broad class of non-linear regression problems that involve difference of convex (DC) non-linearities. The proposed method can be viewed as a significant…

Machine Learning · Statistics 2019-04-01 Sohail Bahmani

In medical practice, treatments are selected based on the expected causal effects on patient outcomes. Here, the gold standard for estimating causal effects are randomized controlled trials; however, such trials are costly and sometimes…

Machine Learning · Statistics 2023-01-24 Dennis Frauen , Tobias Hatt , Valentyn Melnychuk , Stefan Feuerriegel

Here we propose the Reweighted Autoencoded Variational Bayes for Enhanced Sampling (RAVE) method, a new iterative scheme that uses the deep learning framework of variational autoencoders to enhance sampling in molecular simulations. RAVE…

Chemical Physics · Physics 2018-02-13 Joao Marcelo Lamim Ribeiro , Pablo Bravo Collado , Yihang Wang , Pratyush Tiwary

Modern causal inference methods allow machine learning to be used to weaken parametric modeling assumptions. However, the use of machine learning may result in complications for inference. Doubly-robust cross-fit estimators have been…

Methodology · Statistics 2022-03-11 Paul N Zivich , Alexander Breskin

Several problems in statistics involve the combination of high-variance unbiased estimators with low-variance estimators that are only unbiased under strong assumptions. A notable example is the estimation of causal effects while combining…

Methodology · Statistics 2023-05-25 Michael Oberst , Alexander D'Amour , Minmin Chen , Yuyan Wang , David Sontag , Steve Yadlowsky

We develop new econometric methods for estimation and inference in high-dimensional panel data models with interactive fixed effects. Our approach can be regarded as a non-trivial extension of the very popular common correlated effects…

Econometrics · Economics 2025-08-11 Maximilian Ruecker , Michael Vogt , Oliver Linton , Christopher Walsh
‹ Prev 1 8 9 10 Next ›