中文
相关论文

相关论文: Phase transition and higher order analysis of $L_q…

200 篇论文

Performance of ordinary least squares(OLS) method for the \emph{estimation of high dimensional stable state transition matrix} $A$(i.e., spectral radius $\rho(A)<1$) from a single noisy observed trajectory of the linear time…

统计理论 · 数学 2023-12-12 Muhammad Abdullah Naeem , Miroslav Pajic

Compressed sensing is a signal processing scheme that reconstructs high-dimensional sparse signals from a limited number of observations. In recent years, various problems involving signals with a finite number of discrete values have been…

统计力学 · 物理学 2024-08-20 Mikiya Doi , Masayuki Ohzeki

We propose in this contribution a method for l one regularization in prototype based relevance learning vector quantization (LVQ) for sparse relevance profiles. Sparse relevance profiles in hyperspectral data analysis fade down those…

机器学习 · 统计学 2013-10-21 Martin Riedel , Marika Kästner , Fabrice Rossi , Thomas Villmann

We study the problem of recovering a hidden binary $k$-sparse $p$-dimensional vector $\beta$ from $n$ noisy linear observations $Y=X\beta+W$ where $X_{ij}$ are i.i.d. $\mathcal{N}(0,1)$ and $W_i$ are i.i.d. $\mathcal{N}(0,\sigma^2)$. A…

统计理论 · 数学 2019-03-13 Galen Reeves , Jiaming Xu , Ilias Zadik

Linear regression is a widely used technique to fit linear models and finds widespread applications across different areas such as machine learning and statistics. In most real-world scenarios, however, linear regression problems are often…

量子物理 · 物理学 2023-05-02 Shantanav Chakraborty , Aditya Morolia , Anurudh Peduri

We consider learning methods based on the regularization of a convex empirical risk by a squared Hilbertian norm, a setting that includes linear predictors and non-linear predictors through positive-definite kernels. In order to go beyond…

机器学习 · 计算机科学 2019-06-19 Ulysse Marteau-Ferey , Dmitrii Ostrovskii , Francis Bach , Alessandro Rudi

We study here the so-called spiked Wigner and Wishart models, where one observes a low-rank matrix perturbed by some Gaussian noise. These models encompass many classical statistical tasks such as sparse PCA, submatrix localization,…

概率论 · 数学 2019-06-25 Léo Miolane

We present a Fisher-matrix forecast for the detectability of a stochastic gravitational wave background generated by a first-order phase transition in the early universe. We use the DECIGO and LISA missions as reference cases. The source…

广义相对论与量子宇宙学 · 物理学 2026-05-07 Diego Rios , William H. Kinney

In the Gaussian sequence model $Y= \theta_0 + \varepsilon$ in $\mathbb{R}^n$, we study the fundamental limit of approximating the signal $\theta_0$ by a class $\Theta(d,d_0,k)$ of (generalized) splines with free knots. Here $d$ is the…

统计理论 · 数学 2020-05-08 Yandi Shen , Qiyang Han , Fang Han

We consider the problem of learning a coefficient vector x_0\in R^N from noisy linear observation y=Ax_0+w \in R^n. In many contexts (ranging from model selection to image processing) it is desirable to construct a sparse estimator x'. In…

统计理论 · 数学 2015-12-16 Mohsen Bayati , Andrea Montanari

Over the past few years, trace regression models have received considerable attention in the context of matrix completion, quantum state tomography, and compressed sensing. Estimation of the underlying matrix from regularization-based…

机器学习 · 统计学 2015-04-24 Martin Slawski , Ping Li , Matthias Hein

Performance of regularized least-squares estimation in noisy compressed sensing is analyzed in the limit when the dimensions of the measurement matrix grow large. The sensing matrix is considered to be from a class of random ensembles that…

信息论 · 计算机科学 2016-02-08 Mikko Vehkapera , Yoshiyuki Kabashima , Saikat Chatterjee

In this paper we formulate and solve a robust least squares problem for a system of linear equations subject to quantization error in the data matrix. Ordinary least squares fails to consider uncertainty in the operator, modeling all noise…

最优化与控制 · 数学 2021-04-09 Richard Clancy , Stephen Becker

We obtain bounds on estimation error rates for regularization procedures of the form \begin{equation*} \hat f \in {\rm argmin}_{f\in F}\left(\frac{1}{N}\sum_{i=1}^N\left(Y_i-f(X_i)\right)^2+\lambda \Psi(f)\right) \end{equation*} when $\Psi$…

统计理论 · 数学 2017-01-04 Guillaume Lecué , Shahar Mendelson

Let $A \subseteq \{0,1,\dots,N\}$ be a random set in which each element is included independently with probability $p=p(N)$. Fix an integer $h \geq 2$ and a linear form $$L(x_1,\dots,x_h) := u_1x_1 + \cdots + u_hx_h.$$ We study the random…

组合数学 · 数学 2026-01-30 Ryan Jeong , Steven J. Miller

Suppose that $\mathbf{y}=\lvert A\mathbf{x_0}\rvert+\eta$ where $\mathbf{x_0} \in \mathbb{R}^d$ is the target signal and $\eta\in \mathbb{R}^m$ is a noise vector. The aim of phase retrieval is to estimate $\mathbf{x_0}$ from $\mathbf{y}$. A…

信息论 · 计算机科学 2019-04-23 Meng Huang , Zhiqiang Xu

We study the problem of designing minimax procedures in linear regression under the quantile risk. We start by considering the realizable setting with independent Gaussian noise, where for any given noise level and distribution of inputs,…

统计理论 · 数学 2024-06-19 Ayoub El Hanchi , Chris J. Maddison , Murat A. Erdogdu

Level set estimation (LSE), the problem of identifying the set of input points where a function takes value above (or below) a given threshold, is important in practical applications. When the function is expensive-to-evaluate and…

机器学习 · 统计学 2024-12-02 Yu Inatsu , Shion Takeno , Kentaro Kutsukake , Ichiro Takeuchi

We address the issue of estimating the regression vector $\beta$ in the generic $s$-sparse linear model $y = X\beta+z$, with $\beta\in\R^{p}$, $y\in\R^{n}$, $z\sim\mathcal N(0,\sg^2 I)$ and $p> n$ when the variance $\sg^{2}$ is unknown. We…

统计理论 · 数学 2012-11-06 Stéphane Chrétien , Sébastien Darses

Consider the standard Gaussian linear regression model $Y=X\theta+\epsilon$, where $Y\in R^n$ is a response vector and $ X\in R^{n*p}$ is a design matrix. Numerous work have been devoted to building efficient estimators of $\theta$ when $p$…

统计理论 · 数学 2012-01-26 Nicolas Verzelen