English
Related papers

Related papers: Active Subsampling for Measurement-Constrained M-E…

200 papers

We develop new stochastic gradient methods for efficiently solving sparse linear regression in a partial attribute observation setting, where learners are only allowed to observe a fixed number of actively chosen attributes per example at…

Optimization and Control · Mathematics 2018-12-04 Tomoya Murata , Taiji Suzuki

We consider a multi-agent setting with agents exchanging information over a possibly time-varying network, aiming at minimising a separable objective function subject to constraints. To achieve this objective we propose a novel subgradient…

Optimization and Control · Mathematics 2020-11-20 Licio Romao , Kostas Margellos , Giuseppe Notarstefano , Antonis Papachristodoulou

This work concerns the minimization of the pseudospectral abscissa of a matrix-valued function dependent on parameters analytically. The problem is motivated by robust stability and transient behavior considerations for a linear control…

Numerical Analysis · Mathematics 2024-06-21 Nicat Aliyev , Emre Mengi

We present the first minimax risk bounds for estimators of the spectral measure in multivariate linear factor models, where observations are linear combinations of regularly varying latent factors. Non-asymptotic convergence rates are…

Statistics Theory · Mathematics 2024-11-12 Xuhui Zhang , Jose Blanchet , Youssef Marzouk , Viet Anh Nguyen , Sven Wang

A common practice in obtaining a semiparametric efficient estimate is through iteratively maximizing the (penalized) log-likelihood w.r.t. its Euclidean parameter and functional nuisance parameter via Newton-Raphson algorithm. The purpose…

Statistics Theory · Mathematics 2010-09-23 Guang Cheng

Estimation of large covariance matrices has drawn considerable recent attention, and the theoretical focus so far has mainly been on developing a minimax theory over a fixed parameter space. In this paper, we consider adaptive covariance…

Statistics Theory · Mathematics 2012-11-05 T. Tony Cai , Ming Yuan

Labelled data often comes at a high cost as it may require recruiting human labelers or running costly experiments. At the same time, in many practical scenarios, one already has access to a partially labelled, potentially biased dataset…

Machine Learning · Computer Science 2021-06-15 Fnu Devvrit , Nived Rajaraman , Pranjal Awasthi

Stochastic processes are often used to model complex scientific problems in fields ranging from biology and finance to engineering and physical science. This paper investigates rate-optimal estimation of the volatility matrix of a…

Statistics Theory · Mathematics 2014-01-30 Minjing Tao , Yazhen Wang , Harrison H. Zhou

Compressed sensing aims to undersample certain high-dimensional signals, yet accurately reconstruct them by exploiting signal characteristics. Accurate reconstruction is possible when the object to be recovered is sufficiently sparse in a…

Information Theory · Computer Science 2015-05-13 David L. Donoho , Arian Maleki , Andrea Montanari

The experimenter must perform a legitimate search in the entire set of feasible censoring schemes to identify the optimal type II progressive censoring scheme, when applied to a life-testing experiment. Current recommendations are limited…

Applications · Statistics 2025-07-29 Ujjwal Roy , Ritwik Bhattacharya

Extensive efforts have been made to boost the performance in the domain of language models by introducing various attention-based transformers. However, the inclusion of linear layers with large dimensions contributes to significant…

Machine Learning · Computer Science 2024-11-19 Priyansh Bhatnagar , Linfeng Wen , Mingu Kang

In this paper we consider estimation of sparse covariance matrices and propose a thresholding procedure which is adaptive to the variability of individual entries. The estimators are fully data driven and enjoy excellent performance both…

Methodology · Statistics 2011-02-14 Tony Cai , Weidong Liu

In two-phase multiwave sampling, inexpensive measurements are collected on a large sample and expensive, more informative measurements are adaptively obtained on subsets of units across multiple waves. Adaptively collecting the expensive…

Methodology · Statistics 2026-03-18 Dan M. Kluger , Stephen Bates

We develop approximation algorithms for set-selection problems with deterministic constraints, but random objective values, i.e., stochastic probing problems. When the goal is to maximize the objective, approximation algorithms for probing…

Data Structures and Algorithms · Computer Science 2021-11-04 Weina Wang , Anupam Gupta , Jalani Williams

Subsampling is a popular approach to alleviating the computational burden for analyzing massive datasets. Recent efforts have been devoted to various statistical models without explicit regularization. In this paper, we develop an efficient…

Methodology · Statistics 2022-04-12 Yunlu Chen , Nan Zhang

Compressed sensing posits that, within limits, one can undersample a sparse signal and yet reconstruct it accurately. Knowing the precise limits to such undersampling is important both for theory and practice. We present a formula that…

Information Theory · Computer Science 2013-01-09 David Donoho , Iain Johnstone , Andrea Montanari

Squeezed light enables quantum-enhanced phase estimation, with crucial applications in both fundamental physics and emerging technologies. To fully exploit the advantage provided by this approach, estimation protocols must remain optimal…

Quantum Physics · Physics 2025-10-17 Giorgio Minati , Enrico Urbani , Nicolò Spagnolo , Valeria Cimini , Fabio Sciarrino

Feature screening for ultrahigh-dimension, in general, proceeds with two essential steps. The first step is measuring and ranking the marginal dependence between response and covariates, and the second is determining the threshold. We…

Methodology · Statistics 2022-07-28 Linsui Deng , Yilin Zhang

Binary measurements arise naturally in a variety of statistical and engineering applications. They may be inherent to the problem---e.g., in determining the relationship between genetics and the presence or absence of a disease---or they…

Information Theory · Computer Science 2014-08-01 Richard Baraniuk , Simon Foucart , Deanna Needell , Yaniv Plan , Mary Wootters

Achieving ultimate bounds in estimation processes is the main objective of quantum metrology. In this context, several problems require measurement of multiple parameters by employing only a limited amount of resources. To this end,…