English
Related papers

Related papers: Stability of Least Squares Approximation under Ran…

200 papers

The paper deals with the problem of estimating the M$^2$ (i.e. multivariate and multidimensional) spectral density function of a stationary random process or random field. We propose the $f$-truncated periodogram, i.e. a truncated…

Statistics Theory · Mathematics 2022-08-26 Lucia Falconi , Augusto Ferrante , Mattia Zorzi

We consider the problem of estimating the asymptotic variance of a function defined on a Markov chain, an important step for statistical inference of the stationary mean. We design a novel recursive estimator that requires $O(1)$…

Statistics Theory · Mathematics 2024-09-24 Shubhada Agrawal , Prashanth L. A. , Siva Theja Maguluri

For complex nonlinear systems, it is challenging to design algorithms that are fast, scalable, and give an accurate approximation of the stability region. This paper proposes a sampling-based approach to address these challenges. By…

Systems and Control · Electrical Eng. & Systems 2024-05-24 Péter Antal , Tamás Péni , Roland Tóth

The stochastic proximal point (SPP) methods have gained recent attention for stochastic optimization, with strong convergence guarantees and superior robustness to the classic stochastic gradient descent (SGD) methods showcased at little to…

Machine Learning · Statistics 2023-01-10 Xiao-Tong Yuan , Ping Li

We study proximal random reshuffling for minimizing the sum of locally Lipschitz functions and a proper lower semicontinuous convex function without assuming coercivity or the existence of limit points. The algorithmic guarantees pertaining…

Optimization and Control · Mathematics 2024-08-15 Cedric Josz , Lexiao Lai , Xiaopeng Li

We consider the problem of stable sampling of multivariate real polynomials of large degree in a general framework where the polynomials are defined on an affine real algebraic variety $M$, equipped with a weighted measure. In particular,…

Classical Analysis and ODEs · Mathematics 2018-06-04 Robert J. Berman , Joaquim Ortega-Cerdà

Method of parameterizing and smoothing the unknown underling distributions using Bernstein polynomials is proposed, verified and investigated. Any distribution with bounded and smooth enough density can be approximated by the proposed…

Methodology · Statistics 2015-06-23 Zhong Guan

Numerous dimensionality reduction problems in data analysis involve the recovery of low-dimensional models or the learning of manifolds underlying sets of data. Many manifold learning methods require the estimation of the tangent space of…

Computation · Statistics 2013-05-20 Hemant Tyagi , Elif Vural , Pascal Frossard

In this work, we examine sampling problems with non-smooth potentials. We propose a novel Markov chain Monte Carlo algorithm for sampling from non-smooth potentials. We provide a non-asymptotical analysis of our algorithm and establish a…

Machine Learning · Computer Science 2022-02-11 Jiaming Liang , Yongxin Chen

We study the following basic machine learning task: Given a fixed set of $d$-dimensional input points for a linear regression problem, we wish to predict a hidden response value for each of the points. We can only afford to attain the…

Machine Learning · Computer Science 2018-06-07 Michał Dereziński , Manfred K. Warmuth

In this paper, we propose a low-rank approximation method based on discrete least-squares for the approximation of a multivariate function from random, noisy-free observations. Sparsity inducing regularization techniques are used within…

Numerical Analysis · Mathematics 2015-12-09 Mathilde Chevreuil , Régis Lebrun , Anthony Nouy , Prashant Rai

While it is well known that nonlinear methods of approximation can often perform dramatically better than linear methods, there are still questions on how to measure the optimal performance possible for such methods. This paper studies…

Numerical Analysis · Mathematics 2020-09-22 Albert Cohen , Ronald DeVore , Guergana Petrova , Przemyslaw Wojtaszczyk

We study the problem of estimating the joint probability mass function (pmf) over two random variables. In particular, the estimation is based on the observation of $m$ samples containing both variables and $n$ samples missing one fixed…

Statistics Theory · Mathematics 2024-05-16 Hasan Sabri Melihcan Erol , Lizhong Zheng

We consider the problem of determining the optimal block (or subsample) size for a spatial subsampling method for spatial processes observed on regular grids. We derive expansions for the mean square error of the subsampling variance…

Statistics Theory · Mathematics 2007-06-13 Daniel J. Nordman , Soumendra N. Lahiri

This article uses a combination of three ideas from simulation to establish a nearly optimal polynomial upper bound for the joint density of the stable process and its associated supremum at a fixed time on the entire support of the joint…

Probability · Mathematics 2023-11-20 Jorge González Cázares , Arturo Kohatsu Higa , Aleksandar Mijatović

We consider the problem of estimating the support size of a discrete distribution whose minimum non-zero mass is at least $ \frac{1}{k}$. Under the independent sampling model, we show that the sample complexity, i.e., the minimal sample…

Statistics Theory · Mathematics 2016-12-13 Yihong Wu , Pengkun Yang

Preserving stability is a central problem in data-driven model order reduction of dynamical systems. For linear systems whose dynamics depend on geometric or physical parameters, multivariate rational approximation algorithms such as the…

Systems and Control · Electrical Eng. & Systems 2026-05-26 Antonio Carlucci

We study the approximability of two related problems on graphs with $n$ nodes and $m$ edges: $n$-Pairs Shortest Paths ($n$-PSP), where the goal is to find a shortest path between $O(n)$ prespecified pairs, and All Node Shortest Cycles…

Data Structures and Algorithms · Computer Science 2022-09-21 Mina Dalirrooyfard , Ce Jin , Virginia Vassilevska Williams , Nicole Wein

We develop a probabilistic method for assessing the tail behavior and geometric stability of one-dimensional n i.i.d. samples by tracking how their span contracts when the most extreme points are trimmed. Central to our approach is the…

Machine Learning · Statistics 2025-09-03 Erwan Dereure , Emmanuel Akame Mfoumou , David Holcman

Many modern datasets don't fit neatly into $n \times p$ matrices, but most techniques for measuring statistical stability expect rectangular data. We study methods for stability assessment on non-rectangular data, using statistical learning…

Computation · Statistics 2021-02-23 Kris Sankaran