中文
相关论文

相关论文: Sharp thresholds for high-dimensional and noisy re…

200 篇论文

In this work, we study the problem of learning a nonlinear dynamical system by parameterizing its dynamics using basis functions. We assume that disturbances occur at each time step with an arbitrary probability $p$, which models the…

最优化与控制 · 数学 2025-03-24 Haixiang Zhang , Baturalp Yalcin , Javad Lavaei , Eduardo D. Sontag

Meinshausen and Buhlmann [Ann. Statist. 34 (2006) 1436--1462] showed that, for neighborhood selection in Gaussian graphical models, under a neighborhood stability condition, the LASSO is consistent, even when the number of variables is of…

统计理论 · 数学 2008-08-08 Cun-Hui Zhang , Jian Huang

We study the problem of learning general (i.e., not necessarily homogeneous) halfspaces with Random Classification Noise under the Gaussian distribution. We establish nearly-matching algorithmic and Statistical Query (SQ) lower bound…

机器学习 · 计算机科学 2023-07-18 Ilias Diakonikolas , Jelena Diakonikolas , Daniel M. Kane , Puqian Wang , Nikos Zarifis

Sparse regression is frequently employed in diverse scientific settings as a feature selection method. A pervasive aspect of scientific data that hampers both feature selection and estimation is the presence of strong correlations between…

统计方法学 · 统计学 2021-03-25 Ankit Kumar , Sharmodeep Bhattacharyya , Kristofer Bouchard

This paper describes a fast algorithm for recovering low-rank matrices from their linear measurements contaminated with Poisson noise: the Poisson noise Maximum Likelihood Singular Value thresholding (PMLSV) algorithm. We propose a convex…

机器学习 · 统计学 2014-12-22 Yang Cao , Yao Xie

Non-convex constraints have recently proven a valuable tool in many optimisation problems. In particular sparsity constraints have had a significant impact on sampling theory, where they are used in Compressed Sensing and allow structured…

信息论 · 计算机科学 2012-05-09 Thomas Blumensath

We consider the following basic inference problem: there is an unknown high-dimensional vector $w \in \mathbb{R}^n$, and an algorithm is given access to labeled pairs $(x,y)$ where $x \in \mathbb{R}^n$ is a measurement and $y = w \cdot x +…

计算复杂性 · 计算机科学 2019-11-05 Xue Chen , Anindya De , Rocco A. Servedio

It is well known that $\ell_1$ minimization can be used to recover sufficiently sparse unknown signals from compressed linear measurements. In fact, exact thresholds on the sparsity, as a function of the ratio between the system dimensions,…

信息论 · 计算机科学 2010-04-06 M. Amin Khajehnejad , Weiyu Xu , Salman Avestimehr , Babak Hassibi

In compressed sensing, in order to recover a sparse or nearly sparse vector from possibly noisy measurements, the most popular approach is $\ell_1$-norm minimization. Upper bounds for the $\ell_2$- norm of the error between the true and…

机器学习 · 统计学 2015-12-31 M. Eren Ahsen , M. Vidyasagar

We consider the problem of estimating a sparse linear regression vector $\beta^*$ under a gaussian noise model, for the purpose of both prediction and model selection. We assume that prior knowledge is available on the sparsity pattern,…

We consider a high dimensional linear regression problem where the goal is to efficiently recover an unknown vector $\beta^*$ from $n$ noisy linear observations $Y=X\beta^*+W \in \mathbb{R}^n$, for known $X \in \mathbb{R}^{n \times p}$ and…

统计理论 · 数学 2018-11-12 David Gamarnik , Ilias Zadik

We analyze the performance of the least absolute shrinkage and selection operator (Lasso) for the linear model when the number of regressors $N$ grows larger keeping the true support size $d$ finite, i.e., the ultra-sparse case. The result…

无序系统与神经网络 · 物理学 2023-02-28 Koki Okajima , Xiangming Meng , Takashi Takahashi , Yoshiyuki Kabashima

In this paper, we consider the sparse phase retrieval problem, recovering an $s$-sparse signal $\bm{x}^{\natural}\in\mathbb{R}^n$ from $m$ phaseless samples $y_i=|\langle\bm{x}^{\natural},\bm{a}_i\rangle|$ for $i=1,\ldots,m$. Existing…

数值分析 · 数学 2021-10-15 Jian-Feng Cai , Jingzhi Li , Xiliang Lu , Juntao You

We discuss two new methods of recovery of sparse signals from noisy observation based on $\ell_1$- minimization. They are closely related to the well-known techniques such as Lasso and Dantzig Selector. However, these estimators come with…

统计理论 · 数学 2014-04-11 Anatoli Iouditski , Arkadii S. Nemirovski

We consider multichannel sparse recovery problem where the objective is to find good recovery of jointly sparse unknown signal vectors from the given multiple measurement vectors which are different linear combinations of the same known…

信息论 · 计算机科学 2015-06-11 Esa Ollila

Many applications concern sparse signals, for example, detecting anomalies from the differences between consecutive images taken by surveillance cameras. This paper focuses on the problem of recovering a K-sparse signal x in N dimensions.…

机器学习 · 统计学 2013-02-06 Ping Li , Cun-Hui Zhang

In this paper a new result of recovery of sparse vectors from deterministic and noisy measurements by l1 minimization is given. The sparse vector is randomly chosen and follows a generic p-sparse model introduced by Candes and al. The main…

最优化与控制 · 数学 2012-12-04 Charles Dossal , Rémi Tesson

In high-dimensional statistical inference in which the number of parameters to be estimated is larger than that of the holding data, regularized linear estimation techniques are widely used. These techniques have, however, some drawbacks.…

统计方法学 · 统计学 2025-08-06 Takashi Takahashi , Yoshiyuki Kabashima

The population recovery problem is a basic problem in noisy unsupervised learning that has attracted significant research attention in recent years [WY12,DRWY12, MS13, BIMP13, LZ15,DST16]. A number of different variants of this problem have…

数据结构与算法 · 计算机科学 2017-03-07 Anindya De , Ryan O'Donnell , Rocco Servedio

For statistical modeling wherein the data regime is unfavorable in terms of dimensionality relative to the sample size, finding hidden sparsity in the ground truth can be critical in formulating an accurate statistical model. The so-called…

最优化与控制 · 数学 2025-08-04 Matteo Bergamaschi , Andrea Cristofari , Vyacheslav Kungurtsev , Francesco Rinaldi