English
Related papers

Related papers: Breaking The Dimension Dependence in Sparse Distri…

200 papers

Deep neural networks have achieved tremendous success due to their representation power and adaptation to low-dimensional structures. Their potential for estimating structured regression functions has been recently established in the…

Statistics Theory · Mathematics 2023-02-14 Sohom Bhattacharya , Jianqing Fan , Debarghya Mukherjee

In this paper, we consider the classic measurement error regression scenario in which our independent, or design, variables are observed with several sources of additive noise. We will show that our motivating example's replicated…

Applications · Statistics 2012-07-10 David J. Biagioni , Ryan Elmore , Wesley Jones

For multiple index models, it has recently been shown that the sliced inverse regression (SIR) is consistent for estimating the sufficient dimension reduction (SDR) space if and only if $\rho=\lim\frac{p}{n}=0$, where $p$ is the dimension…

Statistics Theory · Mathematics 2018-06-19 Qian Lin , Zhigen Zhao , Jun S. Liu

In this work, we propose an algorithm for solving exact sparse linear regression problems over a network in a distributed manner. Particularly, we consider the problem where data is stored among different computers or agents that seek to…

Optimization and Control · Mathematics 2022-04-04 Tu Anh-Nguyen , César A. Uribe

We give lower bounds for the problem of stable sparse recovery from /adaptive/ linear measurements. In this problem, one would like to estimate a vector $x \in \R^n$ from $m$ linear measurements $A_1x,..., A_mx$. One may choose each vector…

Data Structures and Algorithms · Computer Science 2012-10-23 Eric Price , David P. Woodruff

Estimating an unknown distribution from its samples is a fundamental problem in statistics. The common, min-max, formulation of this goal considers the performance of the best estimator over all distributions in a class. It shows that with…

Information Theory · Computer Science 2015-03-30 Alon Orlitsky , Ananda Theertha Suresh

We present an efficient method for computing A-optimal experimental designs for infinite-dimensional Bayesian linear inverse problems governed by partial differential equations (PDEs). Specifically, we address the problem of optimizing the…

Computation · Statistics 2014-05-29 Alen Alexanderian , Noemi Petra , Georg Stadler , Omar Ghattas

In this paper, we study a method to sample from a target distribution $\pi$ over $\mathbb{R}^d$ having a positive density with respect to the Lebesgue measure, known up to a normalisation factor. This method is based on the Euler…

Statistics Theory · Mathematics 2016-12-20 Alain Durmus , Eric Moulines

We study network loss tomography based on observing average loss rates over a set of paths forming a tree -- a severely underdetermined linear problem for the unknown link loss probabilities. We examine in detail the role of sparsity as a…

Networking and Internet Architecture · Computer Science 2015-03-19 Vijay Arya , Darryl Veitch

Polynomial regression is a basic primitive in learning and statistics. In its most basic form the goal is to fit a degree $d$ polynomial to a response variable $y$ in terms of an $n$-dimensional input vector $x$. This is extremely…

Data Structures and Algorithms · Computer Science 2020-04-30 Sitan Chen , Raghu Meka

The phenomenon of data distribution evolving over time has been observed in a range of applications, calling the needs of adaptive learning algorithms. We thus study the problem of supervised gradual domain adaptation, where labeled data…

Machine Learning · Computer Science 2022-11-15 Jing Dong , Shiji Zhou , Baoxiang Wang , Han Zhao

In this paper, we study the problem of distributed mean estimation with 1-bit communication constraints. We propose a mean estimator that is based on (randomized and sequentially-chosen) interval queries, whose 1-bit outcome indicates…

Machine Learning · Statistics 2026-04-07 Ivan Lau , Jonathan Scarlett

In group testing, the goal is to identify a subset of defective items within a larger set of items based on tests whose outcomes indicate whether any defective item is present. This problem is relevant in areas such as medical testing, data…

Information Theory · Computer Science 2020-11-11 Nelvin Tan , Jonathan Scarlett

For data segmentation in high-dimensional linear regression settings, the regression parameters are often assumed to be sparse segment-wise, which enables many existing methods to estimate the parameters locally via $\ell_1$-regularised…

Methodology · Statistics 2026-05-08 Haeran Cho , Tobias Kley , Housen Li

It is well known that estimating the expectation of any given bounded random variable with values in $[-B, B]$ has a sample complexity of $\mathrm{O}(B^2/\epsilon^2)$ that is independent of the underlying probability measure. We show that…

Optimization and Control · Mathematics 2026-04-29 Yan Li

In this paper, we consider a least-squares (LS)-based distributed algorithm build on a sensor network to estimate an unknown parameter vector of a dynamical system, where each sensor in the network has partial information only but is…

Systems and Control · Electrical Eng. & Systems 2022-12-19 Siyu Xie , Yaqi Zhang , Lei Guo

Disentangled representation learning aims to uncover latent variables underlying the observed data, and generally speaking, rather strong assumptions are needed to ensure identifiability. Some approaches rely on sufficient changes on the…

Machine Learning · Computer Science 2025-03-04 Zijian Li , Shunxing Fan , Yujia Zheng , Ignavier Ng , Shaoan Xie , Guangyi Chen , Xinshuai Dong , Ruichu Cai , Kun Zhang

Dimension is an inherent bottleneck to some modern learning tasks, where optimization methods suffer from the size of the data. In this paper, we study non-isotropic distributions of data and develop tools that aim at reducing these…

Machine Learning · Statistics 2025-02-12 Mathieu Even , Laurent Massoulié

Several classification methods assume that the underlying distributions follow tree-structured graphical models. Indeed, trees capture statistical dependencies between pairs of variables, which may be crucial to attain low classification…

Machine Learning · Statistics 2021-05-31 Yaniv Tenzer , Amit Moscovich , Mary Frances Dorn , Boaz Nadler , Clifford Spiegelman

We consider the problem of estimating the support of a vector $\beta^* \in \mathbb{R}^{p}$ based on observations contaminated by noise. A significant body of work has studied behavior of $\ell_1$-relaxations when applied to measurement…

Machine Learning · Statistics 2008-05-21 Dapo Omidiran , Martin J. Wainwright