English
Related papers

Related papers: Error Scaling Laws for Linear Optimal Estimation f…

200 papers

We study sparse linear regression over a network of agents, modeled as an undirected graph and no server node. The estimation of the $s$-sparse parameter is formulated as a constrained LASSO problem wherein each agent owns a subset of the…

Machine Learning · Computer Science 2024-12-30 Marie Maros , Gesualdo Scutari , Ying Sun , Guang Cheng

Consider the communication-constrained problem of nonparametric function estimation, in which each distributed terminal holds multiple i.i.d. samples. Under certain regularity assumptions, we characterize the minimax optimal rates for all…

Machine Learning · Computer Science 2025-01-15 Deheng Yuan , Tao Guo , Zhongyi Huang

Distant and weak supervision allow to obtain large amounts of labeled training data quickly and cheaply, but these automatic annotations tend to contain a high amount of errors. A popular technique to overcome the negative effects of these…

Machine Learning · Computer Science 2021-03-02 Michael A. Hedderich , Dawei Zhu , Dietrich Klakow

The computation of distance measures between nodes in graphs is inefficient and does not scale to large graphs. We explore dense vector representations as an effective way to approximate the same information: we introduce a simple yet…

Computation and Language · Computer Science 2019-06-18 Andrey Kutuzov , Mohammad Dorgham , Oleksiy Oliynyk , Chris Biemann , Alexander Panchenko

In this paper, we investigate the Gaussian graphical model inference problem in a novel setting that we call erose measurements, referring to irregularly measured or observed data. For graphs, this results in different node pairs having…

Methodology · Statistics 2023-05-16 Lili Zheng , Genevera I. Allen

We consider the problem of imaging sparse scenes from a few noisy data using an $l_1$-minimization approach. This problem can be cast as a linear system of the form $A \, \rho =b$, where $A$ is an $N\times K$ measurement matrix. We assume…

Image and Video Processing · Electrical Eng. & Systems 2020-04-22 Miguel Moscoso , Alexei Novikov , George Papanicolaou , Chrysoula Tsogka

This work introduces a highly scalable spectral graph densification framework for learning resistor networks with linear measurements, such as node voltages and currents. We prove that given $O(\log N)$ pairs of voltage and current…

Machine Learning · Computer Science 2021-04-19 Zhuo Feng

We consider the design of a linear sensing system with a fixed energy budget assuming that the sampling noise is the dominant noise source. The energy constraint implies that the signal energy per measurement decreases linearly with the…

Signal Processing · Electrical Eng. & Systems 2019-05-22 Yang Lu , Wei Dai , Yonina C. Eldar

We consider a situation where the distribution of a random variable is being estimated by the empirical distribution of noisy measurements of that variable. This is common practice in, for example, teacher value-added models and other…

Econometrics · Economics 2021-12-08 Koen Jochmans , Martin Weidner

We consider the related problems of estimating the $l_2$-norm and the squared $l_2$-norm in sparse linear regression with unknown variance, as well as the problem of testing the hypothesis that the regression parameter is null under sparse…

Statistics Theory · Mathematics 2020-10-27 Alexandra Carpentier , Olivier Collier , Laetitia Comminges , Alexandre B. Tsybakov , Yuhao Wang

We study the graph matching problem in the presence of vertex feature information using shallow graph neural networks. Specifically, given two graphs that are independent perturbations of a single random geometric graph with sparse binary…

Machine Learning · Computer Science 2025-03-12 Suqi Liu , Morgane Austern

This paper examines the ability of greedy algorithms to estimate a block sparse parameter vector from noisy measurements. In particular, block sparse versions of the orthogonal matching pursuit and thresholding algorithms are analyzed under…

Information Theory · Computer Science 2015-05-19 Zvika Ben-Haim , Yonina C. Eldar

Node regression consists in predicting the value of a graph label at a node, given observations at the other nodes. To gain some insight into the performance of various estimators for this task, we perform a theoretical study in a context…

Machine Learning · Statistics 2024-10-30 Martin Gjorgjevski , Nicolas Keriven , Simon Barthelmé , Yohann De Castro

Learning with noisy labels (LNL) aims at designing strategies to improve model performance and generalization by mitigating the effects of model overfitting to noisy labels. The key success of LNL lies in identifying as many clean samples…

Computer Vision and Pattern Recognition · Computer Science 2022-08-08 Jichang Li , Guanbin Li , Feng Liu , Yizhou Yu

Although the standard formulations of prediction problems involve fully-observed and noiseless data drawn in an i.i.d. manner, many applications involve noisy and/or missing data, possibly involving dependence, as well. We study these…

Statistics Theory · Mathematics 2015-03-19 Po-Ling Loh , Martin J. Wainwright

In this paper, we consider the problem of distributed parameter estimation in sensor networks. Each sensor makes successive observations of an unknown $d$-dimensional parameter, which might be subject to Gaussian random noises. The sensors…

Signal Processing · Electrical Eng. & Systems 2025-01-20 Jiaqi Yan , Hideaki Ishii

This article discusses a generalization of the 1-dimensional multi-reference alignment problem. The goal is to recover a hidden signal from many noisy observations, where each noisy observation includes a random translation and random…

Signal Processing · Electrical Eng. & Systems 2021-07-06 Matthew Hirn , Anna Little

The `Signal plus Noise' model for nonparametric regression can be extended to the case of observations taken at the vertices of a graph. This model includes many familiar regression problems. This article discusses the use of the edges of a…

Methodology · Statistics 2009-11-11 Arne Kovac , Andrew D. A. C. Smith

The paper studies distributed static parameter (vector) estimation in sensor networks with nonlinear observation models and noisy inter-sensor communication. It introduces \emph{separably estimable} observation models that generalize the…

Multiagent Systems · Computer Science 2012-05-21 Soummya Kar , Jose M. F. Moura , Kavita Ramanan

Node classification is an important problem in graph data management. It is commonly solved by various label propagation methods that work iteratively starting from a few labeled seed nodes. For graphs with arbitrary compatibilities between…

Machine Learning · Computer Science 2020-03-06 Krishna Kumar P. , Paul Langton , Wolfgang Gatterbauer