中文
相关论文

相关论文: Debiased Lasso After Sample Splitting for Estimati…

200 篇论文

This paper studies schemes to de-bias the Lasso in a linear model $y=X\beta+\epsilon$ where the goal is to construct confidence intervals for $a_0^T\beta$ in a direction $a_0$, where $X$ has iid $N(0,\Sigma)$ rows. We show that previously…

统计理论 · 数学 2021-07-09 Pierre C. Bellec , Cun-Hui Zhang

A great deal of interest has recently focused on conducting inference on the parameters in a high-dimensional linear model. In this paper, we consider a simple and very na\"{i}ve two-step procedure for this task, in which we (i) fit a lasso…

统计方法学 · 统计学 2020-07-02 Sen Zhao , Daniela Witten , Ali Shojaie

The problem of joint estimation of multiple graphical models from high dimensional data has been studied in the statistics and machine learning literature, due to its importance in diverse fields including molecular biology, neuroscience…

统计方法学 · 统计学 2019-07-04 Peyman Jalali , Kshitij Khare , George Michailidis

An important challenge in statistical analysis concerns the control of the finite sample bias of estimators. For example, the maximum likelihood estimator has a bias that can result in a significant inferential loss. This problem is…

统计理论 · 数学 2019-11-04 Stéphane Guerrier , Mucyo Karemera , Samuel Orso , Maria-Pia Victoria-Feser

Detecting influential features in non-linear and/or high-dimensional data is a challenging and increasingly important task in machine learning. Variable selection methods have thus been gaining much attention as well as post-selection…

We consider drawing statistical inferences based on data subject to non-Gaussian measurement error. Unlike most existing methods developed under the assumption of Gaussian measurement error, the proposed strategy exploits hypercomplex…

统计方法学 · 统计学 2025-05-06 Nicholas W. Woolsey , Xianzheng Huang

In distributed second order optimization, a standard strategy is to average many local estimates, each of which is based on a small sketch or batch of the data. However, the local estimates on each machine are typically biased, relative to…

机器学习 · 计算机科学 2020-07-06 Michał Dereziński , Burak Bartan , Mert Pilanci , Michael W. Mahoney

This paper deals with Gibbs samplers that include high dimensional conditional Gaussian distributions. It proposes an efficient algorithm that avoids the high dimensional Gaussian sampling and relies on a random excursion along a small set…

统计计算 · 统计学 2016-04-20 Olivier Féron , François Orieux , Jean-François Giovannelli

We consider the problem of sampling from the posterior distribution of a $d$-dimensional coefficient vector $\boldsymbol{\theta}$, given linear observations $\boldsymbol{y} = \boldsymbol{X}\boldsymbol{\theta}+\boldsymbol{\varepsilon}$. In…

统计方法学 · 统计学 2024-07-01 Andrea Montanari , Yuchen Wu

This study investigates the estimation and the statistical inference about Conditional Average Treatment Effects (CATEs), which have garnered attention as a metric representing individualized causal effects. In our data-generating process,…

统计方法学 · 统计学 2024-03-07 Masahiro Kato

Online statistical inference facilitates real-time analysis of sequentially collected data, making it different from traditional methods that rely on static datasets. This paper introduces a novel approach to online inference in…

机器学习 · 统计学 2025-02-27 Ruijian Han , Lan Luo , Yuanhang Luo , Yuanyuan Lin , Jian Huang

In a polynomial regression model, the divisibility conditions implicit in polynomial hierarchy give way to a natural construction of constraints for the model parameters. We use this principle to derive versions of strong and weak hierarchy…

统计计算 · 统计学 2020-01-23 Hugo Maruri-Aguilar , Simon Lunagomez

We present prompt distribution learning for effectively adapting a pre-trained vision-language model to address downstream recognition tasks. Our method not only learns low-bias prompts from a few samples but also captures the distribution…

计算机视觉与模式识别 · 计算机科学 2022-05-09 Yuning Lu , Jianzhuang Liu , Yonggang Zhang , Yajing Liu , Xinmei Tian

We propose novel methodology for testing equality of model parameters between two high-dimensional populations. The technique is very general and applicable to a wide range of models. The method is based on sample splitting: the data is…

统计方法学 · 统计学 2013-01-17 Nicolas Städler , Sach Mukherjee

This paper is concerned with inference on the regression function of a high-dimensional linear model when outcomes are missing at random. We propose an estimator which combines a Lasso pilot estimate of the regression function with a bias…

统计方法学 · 统计学 2024-12-11 Yikun Zhang , Alexander Giessing , Yen-Chi Chen

This article investigates uncertainty quantification of the generalized linear lasso~(GLL), a popular variable selection method in high-dimensional regression settings. In many fields of study, researchers use data-driven methods to select…

统计理论 · 数学 2023-07-11 Quentin Duchemin , Yohann de Castro

We study the convergence properties of the Gibbs Sampler in the context of posterior distributions arising from Bayesian analysis of conditionally Gaussian hierarchical models. We develop a multigrid approach to derive analytic expressions…

统计计算 · 统计学 2019-06-27 Giacomo Zanella , Gareth Roberts

For some special data in reality, such as the genetic data, adjacent genes may have the similar function. Thus ensuring the smoothness between adjacent genes is highly necessary. But, in this case, the standard lasso penalty just doesn't…

统计方法学 · 统计学 2022-09-29 Xin Xin , Boyi Xie , Yunhai Xiao

This study introduces a debiasing method for regression estimators, including high-dimensional and nonparametric regression estimators. For example, nonparametric regression methods allow for the estimation of regression functions in a…

机器学习 · 统计学 2024-11-27 Masahiro Kato

This paper develops a new statistical inference theory for the precision matrix of high-frequency data in a high-dimensional setting. The focus is not only on point estimation but also on interval estimation and hypothesis testing for…

统计理论 · 数学 2020-05-20 Yuta Koike