English
Related papers

Related papers: On optimal spatial subsample size for variance est…

200 papers

Variational methods are extremely popular in the analysis of network data. Statistical guarantees obtained for these methods typically provide asymptotic normality for the problem of estimation of global model parameters under the…

Statistics Theory · Mathematics 2021-11-08 Solenne Gaucher , Olga Klopp

In this paper we study a family of variance reduction methods with randomized batch size---at each step, the algorithm first randomly chooses the batch size and then selects a batch of samples to conduct a variance-reduced stochastic…

Machine Learning · Computer Science 2018-08-08 Xuanqing Liu , Cho-Jui Hsieh

Optimization software enables the solution of problems with millions of variables and associated parameters. These parameters are, however, often uncertain and represented with an analytical description of the parameter's distribution or…

Optimization and Control · Mathematics 2025-01-17 John R. Birge

The recently developed Distributed Block Proximal Method, for solving stochastic big-data convex optimization problems, is studied in this paper under the assumption of constant stepsizes and strongly convex (possibly non-smooth) local…

Optimization and Control · Mathematics 2020-03-06 Francesco Farina , Giuseppe Notarstefano

We explicitly quantify the empirically observed phenomenon that estimation under a stochastic block model (SBM) is hard if the model contains classes that are similar. More precisely, we consider estimation of certain functionals of random…

Statistics Theory · Mathematics 2022-04-27 Ismaël Castillo , Peter Orbanz

Consider the problem of constructing an experimental design, optimal for estimating parameters of a given statistical model with respect to a chosen criterion. To address this problem, the literature usually provides a single solution.…

Computation · Statistics 2024-11-05 Radoslav Harman , Lenka Filová , Samuel Rosa

In this paper, we develop an approach for the exact determination of the minimum sample size for the estimation of a Poisson parameter with prescribed margin of error and confidence level. The exact computation is made possible by reducing…

Statistics Theory · Mathematics 2008-06-19 Xinjia Chen

As the number of samples and dimensionality of optimization problems related to statistics an machine learning explode, block coordinate descent algorithms have gained popularity since they reduce the original problem to several smaller…

Machine Learning · Computer Science 2016-06-24 Rémi Flamary , Alain Rakotomamonjy , Gilles Gasso

Models of physics beyond the Standard Model often contain a large number of parameters. These form a high-dimensional space that is computationally intractable to fully explore. Experimental constraints project onto a subspace of viable…

High Energy Physics - Theory · Physics 2022-01-05 Jacob Hollingsworth , Michael Ratz , Philip Tanedo , Daniel Whiteson

For the representation of spin-$s$ band-limited functions on the sphere, we propose a sampling scheme with optimal number of samples equal to the number of degrees of freedom of the function in harmonic space. In comparison to the existing…

Instrumentation and Methods for Astrophysics · Physics 2018-09-06 Usama Elahi , Zubair Khalid , Rodney A. Kennedy , Jason D. McEwen

With appropriately chosen sampling probabilities, sampling-based random projection can be used to implement large-scale statistical methods, substantially reducing computational cost while maintaining low statistical error. However,…

Machine Learning · Statistics 2026-01-13 Yifan Chen , Yun Yang

Hyperspectral images provide abundant spatial and spectral information that is very valuable for material detection in diverse areas of practical science. The high-dimensions of data lead to many processing challenges that can be addressed…

Computer Vision and Pattern Recognition · Computer Science 2020-05-19 Saeideh Ghanbari Azar , Saeed Meshgini , Tohid Yousefi Rezaii , Soosan Beheshti

An image super-resolution method from multiple observation of low-resolution images is proposed. The method is based on sub-pixel accuracy block matching for estimating relative displacements of observed images, and sparse signal…

Computer Vision and Pattern Recognition · Computer Science 2014-02-18 Toshiyuki Kato , Hideitsu Hino , Noboru Murata

This work constructs Jonson-Lindenstrauss embeddings with best accuracy, as measured by variance, mean-squared error and exponential concentration of the length distortion. Lower bounds for any data and embedding dimensions are determined,…

Machine Learning · Computer Science 2021-01-05 Maciej Skorski

Big data sets must be carefully partitioned into statistically similar data subsets that can be used as representative samples for big data analysis tasks. In this paper, we propose the random sample partition (RSP) data model to represent…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-06-11 Salman Salloum , Yulin He , Joshua Zhexue Huang , Xiaoliang Zhang , Tamer Z. Emara , Chenghao Wei , Heping He

Estimation of large covariance matrices has drawn considerable recent attention, and the theoretical focus so far has mainly been on developing a minimax theory over a fixed parameter space. In this paper, we consider adaptive covariance…

Statistics Theory · Mathematics 2012-11-05 T. Tony Cai , Ming Yuan

The best techniques for the constrained maximum-entropy sampling problem, a discrete-optimization problem arising in the design of experiments, are via a variety of concave continuous relaxations of the objective function. A standard…

Optimization and Control · Mathematics 2023-02-13 Zhongzhu Chen , Marcia Fampa , Jon Lee

This work concerns the minimization of the pseudospectral abscissa of a matrix-valued function dependent on parameters analytically. The problem is motivated by robust stability and transient behavior considerations for a linear control…

Numerical Analysis · Mathematics 2024-06-21 Nicat Aliyev , Emre Mengi

The paper considers distributed stochastic optimization over randomly switching networks, where agents collaboratively minimize the average of all agents' local expectation-valued convex cost functions. Due to the stochasticity in gradient…

Optimization and Control · Mathematics 2022-04-07 Jinlong Lei , Peng Yi , Jie Chen , Yiguang Hong

Calculating a Monte Carlo standard error (MCSE) is an important step in the statistical analysis of the simulation output obtained from a Markov chain Monte Carlo experiment. An MCSE is usually based on an estimate of the variance of the…

Statistics Theory · Mathematics 2010-02-25 James M. Flegal , Galin L. Jones