中文
相关论文

相关论文: Phase transition and higher order analysis of $L_q…

200 篇论文

Quantization can be used to form new vectors/matrices with shared values close to the original. In recent years, the popularity of scalar quantization for value-sharing applications has been soaring as it has been found huge utilities in…

机器学习 · 计算机科学 2019-12-11 Chen Wang , Xiaomei Yang , Shaomin Fei , Kai Zhou , Xiaofeng Gong , Miao Du , Ruisen Luo

In this paper, we study the estimation performance of empirical $\ell_2$ risk minimization (ERM) in noisy (standard) phase retrieval (NPR) given by $y_k = |\alpha_k^*x_0|^2+\eta_k$, or noisy generalized phase retrieval (NGPR) formulated as…

机器学习 · 统计学 2022-06-29 Junren Chen , Michael K. Ng

Many statistical studies are concerned with the analysis of observations organized in a matrix form whose elements are count data. When these observations are assumed to follow a Poisson or a multinomial distribution, it is of interest to…

统计理论 · 数学 2022-01-04 Jérémie Bigot , Charles Deledalle

Recovery of an $N$-dimensional, $K$-sparse solution $\mathbf{x}$ from an $M$-dimensional vector of measurements $\mathbf{y}$ for multivariate linear regression can be accomplished by minimizing a suitably penalized least-mean-square cost…

信息论 · 计算机科学 2019-10-29 Mohammad Ramezanali , Partha P. Mitra , Anirvan M. Sengupta

Variable selection in linear models plays a pivotal role in modern statistics. Hard-thresholding methods such as $l_0$ regularization are theoretically ideal but computationally infeasible. In this paper, we propose a new approach, called…

机器学习 · 统计学 2015-03-20 Kun Yang

We consider the linear regression problem of estimating a $p$-dimensional vector $\beta$ from $n$ observations $Y = X \beta + W$, where $\beta_j \stackrel{\text{i.i.d.}}{\sim} \pi$ for a real-valued distribution $\pi$ with zero mean and…

统计理论 · 数学 2020-01-01 Galen Reeves , Jiaming Xu , Ilias Zadik

Given an unknown signal $\mathbf{x}_0\in\mathbb{R}^n$ and linear noisy measurements $\mathbf{y}=\mathbf{A}\mathbf{x}_0+\sigma\mathbf{v}\in\mathbb{R}^m$, the generalized $\ell_2^2$-LASSO solves…

统计理论 · 数学 2015-02-24 Christos Thrampoulidis , Ashkan Panahi , Babak Hassibi

We consider statistical models of estimation of a rank-one matrix (the spike) corrupted by an additive gaussian noise matrix in the sparse limit. In this limit the underlying hidden vector (that constructs the rank-one matrix) has a number…

信息论 · 计算机科学 2019-11-13 Jean Barbier , Nicolas Macris

In this study, we consider preliminary test and shrinkage estimation strategies for quantile regression models. In classical Least Squares Estimation (LSE) method, the relationship between the explanatory and explained variables in the…

统计理论 · 数学 2017-09-07 Bahadır Yüzbaşı , Yasin Asar , M. Şamil Şık , Ahmet Demiralp

Accurate phase extraction from sinusoidal signals is a crucial task in various signal processing applications. While prior research predominantly addresses the case of asynchronous sampling with unknown signal frequency, this study focuses…

信号处理 · 电气工程与系统科学 2024-11-01 Emmanuel Dervieux , Florian Tilquin , Alexis Bisiaux , Wilfried Uhring

We consider the generic regularized optimization problem $\hat{\mathsf{\beta}}(\lambda)=\arg \min_{\beta}L({\sf{y}},X{\sf{\beta}})+\lambda J({\sf{\beta}})$. Efron, Hastie, Johnstone and Tibshirani [Ann. Statist. 32 (2004) 407--499] have…

统计理论 · 数学 2007-08-22 Saharon Rosset , Ji Zhu

The use of quadratic discriminant analysis (QDA) or its regularized version (R-QDA) for classification is often not recommended, due to its well-acknowledged high sensitivity to the estimation noise of the covariance matrix. This becomes…

机器学习 · 统计学 2020-09-15 Amine Bejaoui , Khalil Elkhalil , Abla Kammoun , Mohamed Slim Alouni , Tarek Al-Naffouri

In this work we study the sequence of variational eigenvalues of a system of resonant type involving $p-$ and $q-$laplacians on $\Omega \subset \R^N$, with a coupling term depending on two parameters $\alpha$ and $\beta$ satisfying…

偏微分方程分析 · 数学 2009-11-26 J. Fernandez Bonder , J. P. Pinasco

We study predictive density estimation under Kullback-Leibler loss in $\ell_0$-sparse Gaussian sequence models. We propose proper Bayes predictive density estimates and establish asymptotic minimaxity in sparse models. A surprise is the…

统计理论 · 数学 2017-08-01 Gourab Mukherjee , Iain M. Johnstone

For normal canonical models with $X \sim N_p(\theta, \sigma^{2} I_{p}), \;\; S^{2} \sim \sigma^{2}\chi^{2}_{k}, \;{independent}$, we consider the problem of estimating $\theta$ under scale invariant squared error loss $\frac{\|d-\theta…

统计理论 · 数学 2012-04-30 Othmane Kortbi , Éric Marchand

Given a weighted graph with $N$ vertices, consider a real-valued regression problem in a semi-supervised setting, where one observes $n$ labeled vertices, and the task is to label the remaining ones. We present a theoretical study of…

机器学习 · 计算机科学 2016-03-03 Ahmed El Alaoui , Xiang Cheng , Aaditya Ramdas , Martin J. Wainwright , Michael I. Jordan

In this article, we focus on two toy models : the Curie-Weiss model and the system of $N$ particles in linear interactions in a double well confining potential. Both models, which have been extensively studied, describe a large system of…

概率论 · 数学 2023-08-04 Arnaud Guillin , Pierre Le Bris , Pierre Monmarché

Many regularization schemes for high-dimensional regression have been put forward. Most require the choice of a tuning parameter, using model selection criteria or cross-validation schemes. We show that a simple non-negative or…

统计方法学 · 统计学 2012-02-07 Nicolai Meinshausen

Regression analysis is an important instrument to determine the effect of the explanatory variables on response variables. When outliers and bias errors are present, the standard weighted least squares estimator may perform poorly. For this…

统计计算 · 统计学 2025-02-11 Justo Puerto , Alberto Torrejon

Compressed sensing posits that, within limits, one can undersample a sparse signal and yet reconstruct it accurately. Knowing the precise limits to such undersampling is important both for theory and practice. We present a formula that…

信息论 · 计算机科学 2013-01-09 David Donoho , Iain Johnstone , Andrea Montanari