English
Related papers

Related papers: Distributed Nonparametric Function Estimation: Opt…

200 papers

Consider the communication-constrained problem of nonparametric function estimation, in which each distributed terminal holds multiple i.i.d. samples. Under certain regularity assumptions, we characterize the minimax optimal rates for all…

Machine Learning · Computer Science 2025-01-15 Deheng Yuan , Tao Guo , Zhongyi Huang

This technical note studies the distributed optimization problem of a sum of nonsmooth convex cost functions with local constraints. At first, we propose a novel distributed continuous-time projected algorithm, in which each agent knows its…

Optimization and Control · Mathematics 2016-11-29 Xianlin Zeng , Peng Yi , Yiguang Hong

We provide general adaptive upper bounds for estimating nonparametric functionals based on second order U-statistics arising from finite dimensional approximation of the infinite dimensional models. We then provide examples of functionals…

Statistics Theory · Mathematics 2021-06-07 Lin Liu , Rajarshi Mukherjee , James Robins , Eric Tchetgen Tchetgen

We consider the problem of adaptive estimation of the functional component in a multivariate partial linear model where the argument of the function is defined on a $q$-dimensional grid. Obtaining an adaptive estimator of this functional…

Statistics Theory · Mathematics 2017-12-27 Michael Levine

We consider the equivalent problems of estimating the residual variance, the proportion of explained variance $\eta$ and the signal strength in a high-dimensional linear regression model with Gaussian random design. Our aim is to understand…

Methodology · Statistics 2017-03-17 Nicolas Verzelen , Elisabeth Gassiat

Human learners have the natural ability to use knowledge gained in one setting for learning in a different but related setting. This ability to transfer knowledge from one task to another is essential for effective learning. In this paper,…

Statistics Theory · Mathematics 2019-06-10 T. Tony Cai , Hongji Wei

This paper deals with the nonparametric estimation in heteroscedastic regression $ Y_i=f(X_i)+\xi_i, \: i=1,...,n $, with incomplete information, i.e. each real random variable $ \xi_i $ has a density $ g_{i} $ which is unknown to the…

Statistics Theory · Mathematics 2011-05-10 Michaël Chichignoud

In this paper, we consider adaptive estimation of an unknown planar compact, convex set from noisy measurements of its support function on a uniform grid. Both the problem of estimating the support function at a point and that of estimating…

Statistics Theory · Mathematics 2015-08-18 Tony Cai , Adityanand Guntuboyina , Yuting Wei

A distributed consensus algorithm for estimating the maximum value of the initial measurements in a sensor network with communication noise is proposed. In the absence of communication noise, max estimation can be done by updating the state…

Systems and Control · Computer Science 2016-02-04 Sai Zhang , Cihan Tepedelenlioglu , Mahesh K. Banavar , Andreas Spanias

This paper delves into a nonparametric estimation approach for the interaction function within diffusion-type particle system models. We introduce two estimation methods based upon an empirical risk minimization. Our study encompasses an…

Statistics Theory · Mathematics 2024-02-23 Denis Belomestny , Mark Podolskij , Shi-Yuan Zhou

We quantify the minimax rate for a nonparametric regression model over a star-shaped function class $\mathcal{F}$ with bounded diameter. We obtain a minimax rate of ${\varepsilon^{\ast}}^2\wedge\mathrm{diam}(\mathcal{F})^2$ where…

Statistics Theory · Mathematics 2025-08-20 Akshay Prasadan , Matey Neykov

The paper considers so-called adaptive estimations of regression, distribution density and spectral density of a Gaussian stationary sequence, asymptotically optimal in order at a growing number of observation on any regular subspace…

Probability · Mathematics 2007-05-23 Eugene Ostrovsky , Leonid Sirota

The paper studies distributed static parameter (vector) estimation in sensor networks with nonlinear observation models and noisy inter-sensor communication. It introduces \emph{separably estimable} observation models that generalize the…

Multiagent Systems · Computer Science 2012-05-21 Soummya Kar , Jose M. F. Moura , Kavita Ramanan

We establish the O($\frac{1}{k}$) convergence rate for distributed stochastic gradient methods that operate over strongly convex costs and random networks. The considered class of methods is standard each node performs a weighted average of…

Optimization and Control · Mathematics 2018-03-22 Dusan Jakovetic , Dragana Bajovic , Anit Kumar Sahu , Soummya Kar

The problem of accurate nonparametric estimation of distributional functionals (integral functionals of one or more probability distributions) has received recent interest due to their wide applicability in signal processing, information…

Information Theory · Computer Science 2017-07-12 Kevin R. Moon , Kumar Sricharan , Alfred O. Hero

The problem of distributed estimation of a parametric physical field is stated as a maximum likelihood estimation problem. Sensor observations are distorted by additive white Gaussian noise. Prior to data transmission, each sensor quantizes…

Information Theory · Computer Science 2012-09-21 Natalia A. Schmid , Marwan Alkhweldi , Matthew C. Valenti

In this work, we consider the problem of distributed approximation of functions over multiple-access channels with additive noise. In contrast to previous works, we take fast fading into account and give explicit probability bounds for the…

Information Theory · Computer Science 2021-03-01 Igor Bjelakovic , Matthias Frey , Slawomir Stanczak

We consider the problem of sparse normal means estimation in a distributed setting with communication constraints. We assume there are $M$ machines, each holding $d$-dimensional observations of a $K$-sparse vector $\mu$ corrupted by…

Machine Learning · Statistics 2022-02-15 Chen Amiraz , Robert Krauthgamer , Boaz Nadler

In this paper, we study the distributed nonconvex optimization problem, which aims to minimize the average value of the local nonconvex cost functions using local information exchange. To reduce the communication overhead, we introduce…

Optimization and Control · Mathematics 2025-02-12 Lei Xu , Xinlei Yi , Guanghui Wen , Yang Shi , Karl H. Johansson , Tao Yang

The distributed nonconvex optimization problem of minimizing a global cost function formed by a sum of $n$ local cost functions by using local information exchange is considered. This problem is an important component of many machine…

Optimization and Control · Mathematics 2022-01-11 Xinlei Yi , Shengjun Zhang , Tao Yang , Tianyou Chai , Karl H. Johansson