中文
相关论文

相关论文: On the sign recovery by LASSO, thresholded LASSO a…

200 篇论文

We consider high-dimensional inference for potentially misspecified Cox proportional hazard models based on low dimensional results by Lin and Wei [1989]. A de-sparsified Lasso estimator is proposed based on the log partial likelihood…

统计理论 · 数学 2018-11-02 Shengchun Kong , Zhuqing Yu , Xianyang Zhang , Guang Cheng

Improperly constructed datasets can result in inaccurate inferences. For instance, models trained on biased datasets perform poorly in terms of generalization (i.e., dataset bias). Recent debiasing techniques have successfully achieved…

机器学习 · 计算机科学 2022-12-05 Sumyeong Ahn , Se-Young Yun

We investigate non-negative least squares (NNLS) for the recovery of sparse non-negative vectors from noisy linear and biased measurements. We build upon recent results from [1] showing that for matrices whose row-span intersects the…

信息论 · 计算机科学 2019-12-30 Yonatan Shadmi , Peter Jung , Giuseppe Caire

Bayesian (deep) neural networks (BNN) are often more attractive than the vanilla point-estimate deep learning in various aspects including uncertainty quantification, robustness to noise, resistance to overfitting, and more. The variational…

机器学习 · 计算机科学 2026-05-22 Minyoung Kim

Variable selection in linear models plays a pivotal role in modern statistics. Hard-thresholding methods such as $l_0$ regularization are theoretically ideal but computationally infeasible. In this paper, we propose a new approach, called…

机器学习 · 统计学 2015-03-20 Kun Yang

Many machine learning applications use latent variable models to explain structure in data, whereby visible variables (= coordinates of the given datapoint) are explained as a probabilistic function of some hidden variables. Finding…

机器学习 · 计算机科学 2016-12-30 Sanjeev Arora , Rong Ge , Tengyu Ma , Andrej Risteski

Data-driven discovery of governing equations from data remains a fundamental challenge in nonlinear dynamics. Although sparse regression techniques have advanced system identification, they struggle with rational functions and noise…

机器学习 · 计算机科学 2025-11-17 Zitong Zhang , Hao Sun

Additive isotonic regression attempts to determine the relationship between a multi-dimensional observation variable and a response, under the constraint that the estimate is the additive sum of univariate component effects that are…

统计方法学 · 统计学 2010-06-16 Zhou Fang , Nicolai Meinshausen

In this paper, we study the issue of estimating a structured signal $x_0 \in \mathbb{R}^n$ from non-linear and noisy Gaussian observations. Supposing that $x_0$ is contained in a certain convex subset $K \subset \mathbb{R}^n$, we prove that…

统计理论 · 数学 2017-02-21 Martin Genzel

In the Multiple Measurements Vector (MMV) model, measurement vectors are connected to unknown, jointly sparse signal vectors through a linear regression model employing a single known measurement matrix (or dictionary). Typically, the…

统计方法学 · 统计学 2024-08-05 Esa Ollila

We prove the support recovery for a general class of linear and nonlinear evolutionary partial differential equation (PDE) identification from a single noisy trajectory using $\ell_1$ regularized Pseudo-Least Squares model~($\ell_1$-PsLS).…

数值分析 · 数学 2021-03-15 Yuchen He , Namjoon Suh , Xiaoming Huo , Sungha Kang , Yajun Mei

We propose robust methods to identify underlying Partial Differential Equation (PDE) from a given set of noisy time dependent data. We assume that the governing equation is a linear combination of a few linear and nonlinear differential…

数值分析 · 数学 2023-03-03 Yuchen He , Sung Ha Kang , Wenjing Liao , Hao Liu , Yingjie Liu

We propose a new method for reconstruction of sparse signals with and without noisy perturbations, termed the subspace pursuit algorithm. The algorithm has two important characteristics: low computational complexity, comparable to that of…

数值分析 · 计算机科学 2009-01-08 Wei Dai , Olgica Milenkovic

Applying standard statistical methods after model selection may yield inefficient estimators and hypothesis tests that fail to achieve nominal type-I error rates. The main issue is the fact that the post-selection distribution of the data…

统计方法学 · 统计学 2019-05-23 Amit Meir , Mathias Drton

Compressed sensing (CS) model of complex-valued data can represent the signal recovery process of a large amount types of radar systems, especially when the measurement matrix is row-orthogonal. Based on debiased least absolute shrinkage…

信号处理 · 电气工程与系统科学 2023-07-28 Siqi Na , Tianyao Huang , Yimin Liu , Takashi Takahashi , Yoshiyuki Kabashima , Xiqin Wang

We propose a new framework -- Square Root Principal Component Pursuit -- for low-rank matrix recovery from observations corrupted with noise and outliers. Inspired by the square root Lasso, this new formulation does not require prior…

机器学习 · 计算机科学 2021-11-01 Junhui Zhang , Jingkai Yan , John Wright

Let $X_0$ be an unknown $M$ by $N$ matrix. In matrix recovery, one takes $n < MN$ linear measurements $y_1,..., y_n$ of $X_0$, where $y_i = \Tr(a_i^T X_0)$ and each $a_i$ is a $M$ by $N$ matrix. For measurement matrices with Gaussian i.i.d…

信息论 · 计算机科学 2015-06-15 David L. Donoho , Matan Gavish , Andrea Montanari

We consider the problem of estimating the support of a vector $\beta^* \in \mathbb{R}^{p}$ based on observations contaminated by noise. A significant body of work has studied behavior of $\ell_1$-relaxations when applied to measurement…

机器学习 · 统计学 2008-05-21 Dapo Omidiran , Martin J. Wainwright

Dantzig selector (DS) and LASSO problems have attracted plenty of attention in statistical learning, sparse data recovery and mathematical optimization. In this paper, we provide a theoretical analysis of the sparse recovery stability of…

统计理论 · 数学 2017-11-13 Yun-Bin Zhao , Duan Li

One of the most prominent methods for uncertainty quantification in high-dimen-sional statistics is the desparsified LASSO that relies on unconstrained $\ell_1$-minimization. The majority of initial works focused on real (sub-)Gaussian…

信息论 · 计算机科学 2023-09-14 Frederik Hoppe , Felix Krahmer , Claudio Mayrink Verdun , Marion I. Menzel , Holger Rauhut