中文
相关论文

相关论文: Error Scaling Laws for Linear Optimal Estimation f…

200 篇论文

In compressed sensing, in order to recover a sparse or nearly sparse vector from possibly noisy measurements, the most popular approach is $\ell_1$-norm minimization. Upper bounds for the $\ell_2$- norm of the error between the true and…

机器学习 · 统计学 2015-12-31 M. Eren Ahsen , M. Vidyasagar

We consider the problem of fitting a relationship (e.g. a potential scientific law) to data involving multiple variables. Ordinary (least squares) regression is not suitable for this because the estimated relationship will differ according…

统计方法学 · 统计学 2024-09-05 Chris Tofallis

This paper addresses a regression problem in which output label values are the results of sensing the magnitude of a phenomenon. A low value of such labels can mean either that the actual magnitude of the phenomenon was low or that the…

机器学习 · 计算机科学 2023-06-01 Takayuki Katsuki , Takayuki Osogami

High-dimensional inference refers to problems of statistical estimation in which the ambient dimension of the data may be comparable to or possibly even larger than the sample size. We study an instance of high-dimensional inference in…

统计理论 · 数学 2009-12-31 Sahand Negahban , Martin J. Wainwright

In linear regression we wish to estimate the optimum linear least squares predictor for a distribution over $d$-dimensional input points and real-valued responses, based on a small sample. Under standard random design analysis, where the…

机器学习 · 统计学 2022-06-08 Michał Dereziński , Manfred K. Warmuth , Daniel Hsu

In this paper we introduce a new notion of convergence of sparse graphs which we call Large Deviations or LD-convergence and which is based on the theory of large deviations. The notion is introduced by "decorating" the nodes of the graph…

概率论 · 数学 2013-02-20 Christian Borgs , Jennifer Chayes , David Gamarnik

We study the problem of distributed coverage control in a network of mobile agents arranged on a line. The goal is to design distributed dynamics for the agents to achieve optimal coverage positions with respect to a scalar density field…

最优化与控制 · 数学 2014-11-25 P. Davison , N. E. Leonard , A. Olshevsky , M. Schwemmer

When is optimal estimation linear? It is well known that, when a Gaussian source is contaminated with Gaussian noise, a linear estimator minimizes the mean square estimation error. This paper analyzes, more generally, the conditions for…

信息论 · 计算机科学 2015-03-19 Emrah Akyol , Kumar Viswanatha , Kenneth Rose

Consider a target moving at a constant velocity on a unit-circumference circle, starting at an arbitrary location. To acquire the target, any region of the circle can be probed to obtain a noisy measurement of the target's presence, where…

信息论 · 计算机科学 2016-11-29 Yonatan Kaspi , Ofer Shayevitz , Tara Javidi

We demonstrate the first algorithms for the problem of regression for generalized linear models (GLMs) in the presence of additive oblivious noise. We assume we have sample access to examples $(x, y)$ where $y$ is a noisy measurement of…

数据结构与算法 · 计算机科学 2023-09-29 Ilias Diakonikolas , Sushrut Karmalkar , Jongho Park , Christos Tzamos

A challenge in developing machine learning regression models is that it is difficult to know whether maximal performance has been reached on a particular dataset, or whether further model improvement is possible. In biology this problem is…

生物大分子 · 定量生物学 2021-07-28 Gang Li , Jan Zrimec , Boyang Ji , Jun Geng , Johan Larsbrink , Aleksej Zelezniak , Jens Nielsen , Martin KM Engqvist

In this paper, we address the problem of simultaneous classification and estimation of hidden parameters in a sensor network with communications constraints. In particular, we consider a network of noisy sensors which measure a common…

多智能体系统 · 计算机科学 2012-06-19 Fabio Fagnani , Sophie M. Fosson , Chiara Ravazzi

The least-squares estimator has achieved considerable success in learning linear dynamical systems from a single trajectory of length $T$. While it attains an optimal error of $\mathcal{O}(1/\sqrt{T})$ under independent zero-mean noise, it…

最优化与控制 · 数学 2026-02-23 Jihun Kim , Javad Lavaei

Mislabeled samples are ubiquitous in real-world datasets as rule-based or expert labeling is usually based on incorrect assumptions or subject to biased opinions. Neural networks can "memorize" these mislabeled samples and, as a result,…

机器学习 · 计算机科学 2021-11-24 Katharina Rombach , Gabriel Michau , Olga Fink

The present work deals with active sampling of graph nodes representing training data for binary classification. The graph may be given or constructed using similarity measures among nodal features. Leveraging the graph for classification…

机器学习 · 统计学 2018-10-17 Dimitris Berberidis , Georgios B. Giannakis

Consider measuring an n-dimensional vector x through the inner product with several measurement vectors, a_1, a_2, ..., a_m. It is common in both signal processing and statistics to assume the linear response model y_i = <a_i, x> + e_i,…

概率论 · 数学 2016-05-20 Yaniv Plan , Roman Vershynin , Elena Yudovina

We consider the problem of sparse signal recovery from noisy measurements. Many of frequently used recovery methods rely on some sort of tuning depending on either noise or signal parameters. If no estimates for either of them are…

信息论 · 计算机科学 2020-10-20 Hendrik Bernd Petersen , Peter Jung

This work is concerned with the estimation of multidimensional regression and the asymptotic behaviour of the test involved in selecting models. The main problem with such models is that we need to know the covariance matrix of the noise to…

统计理论 · 数学 2008-02-20 Joseph Rynkiewicz

This paper is concerned with high-dimensional panel data models where the number of regressors can be much larger than the sample size. Under the assumption that the true parameter vector is sparse we propose a panel-Lasso estimator and…

统计理论 · 数学 2014-02-14 Anders Bredahl Kock

We consider in this paper the problem of estimating a parameter matrix from observations which are affected by two types of noise components: (i) a sparse noise sequence which, whenever nonzero can have arbitrarily large amplitude (ii) and…

系统与控制 · 计算机科学 2017-11-07 Laurent Bako