English
Related papers

Related papers: Goldilocks and the bootstrap

200 papers

In the context of principal components analysis (PCA), the bootstrap is commonly applied to solve a variety of inference problems, such as constructing confidence intervals for the eigenvalues of the population covariance matrix $\Sigma$.…

Statistics Theory · Mathematics 2022-02-17 Junwen Yao , Miles E. Lopes

The Moment/Sum-of-squares hierarchy provides a way to compute the global minimizers of polynomial optimization problems (POP), at the cost of solving a sequence of increasingly large semidefinite programs (SDPs). We consider large-scale…

Optimization and Control · Mathematics 2023-09-13 Johannes Aspman , Gilles Bareilles , Vyacheslav Kungurtsev , Jakub Marecek , Martin Takáč

This paper considers the problem of positive semidefinite factorization (PSD factorization), a generalization of exact nonnegative matrix factorization. Given an $m$-by-$n$ nonnegative matrix $X$ and an integer $k$, the PSD factorization…

Optimization and Control · Mathematics 2018-08-29 Arnaud Vandaele , François Glineur , Nicolas Gillis

The identification of the dependent components in multiple data sets is a fundamental problem in many practical applications. The challenge in these applications is that often the data sets are high-dimensional with few observations or…

Methodology · Statistics 2023-06-02 Martin Gölz , Tanuj Hasija , Michael Muma , Abdelhak M. Zoubir

Homotopy methods are attractive due to their capability of solving difficult optimisation and optimal control problems. The underlying idea is to construct a homotopy, which may be considered as a continuous (zero) curve between the…

Optimization and Control · Mathematics 2024-12-10 Willem Esterhuizen , Kathrin Flaßkamp , Matthias Hoffmann , Karl Worthmann

In bootstrap percolation it is known that the critical percolation threshold tends to converge slowly to zero with increasing system size, or, inversely, the critical size diverges fast when the percolation probability goes to zero. To…

Mathematical Physics · Physics 2015-02-04 Aernout C. D. van Enter

When an inverse problem is solved by a gradient-based optimization algorithm, the corresponding forward and adjoint problems, which are introduced to compute the gradient, can be also solved iteratively. The idea of iterating at the same…

Numerical Analysis · Mathematics 2025-01-23 Marcella Bonazzoli , Houssem Haddar , Tuan Anh Vu

Molecular dynamics is often considered as a numerical experiment. The error bars on the results are therefore mandatory, but sometimes difficult to determine and computationally demanding. As a low-cost approach, we describe the application…

Computational Physics · Physics 2021-12-01 Desbiens N. , Arnault P. , Weens W. , Perrin G. , Dubois V

Single-level reformulations of (non-convex) distributionally robust optimization (DRO) problems are often intractable, as they contain semiinfinite dual constraints. Based on such a semiinfinite reformulation, we present a safe…

Optimization and Control · Mathematics 2025-06-09 J. Dienstbier , F. Liers , J. Rolfes

We revisit the Bootstrap Percolation model, leveraging recent mathematical advances linking it with its local counterpart. This new perspective resolves, for the first time, historic discrepancies between Monte Carlo simulations and…

Statistical Mechanics · Physics 2025-12-16 Ivailo Hartarsky , Augusto Teixeira

This paper is concerned with the adaptive numerical treatment of stochastic partial differential equations. Our method of choice is Rothe's method. We use the implicit Euler scheme for the time discretization. Consequently, in each step, an…

We propose a bootstrap-based calibrated projection procedure to build confidence intervals for single components and for smooth functions of a partially identified parameter vector in moment (in)equality models. The method controls…

Statistics Theory · Mathematics 2024-07-03 Hiroaki Kaido , Francesca Molinari , Jörg Stoye

A large number of problems in optimization, machine learning, signal processing can be effectively addressed by suitable semidefinite programming (SDP) relaxations. Unfortunately, generic SDP solvers hardly scale beyond instances with a few…

Optimization and Control · Mathematics 2016-03-15 Andrea Montanari

We systematically introduce an approach to the analysis and (numerical) solution of a broad class of nonlinear unconstrained optimal control problems, involving ordinary and distributed systems. Our approach relies on exact representations…

Optimization and Control · Mathematics 2025-02-04 Nikolay Pogodaev , Maxim Staritsyn

Semidefinite programs (SDP) are important in learning and combinatorial optimization with numerous applications. In pursuit of low-rank solutions and low complexity algorithms, we consider the Burer--Monteiro factorization approach for…

Machine Learning · Statistics 2018-03-02 Srinadh Bhojanapalli , Nicolas Boumal , Prateek Jain , Praneeth Netrapalli

We introduce a comprehensive framework for analyzing convergence rates for infinite dimensional linear programming problems (LPs) within the context of the moment-sum-of-squares hierarchy. Our primary focus is on extending the existing…

Optimization and Control · Mathematics 2025-05-09 Corbinian Schlosser , Matteo Tacchi , Alexey Lazarev

Many real-world problems, such as those with fairness constraints, involve complex expectation constraints and large datasets, necessitating the design of efficient stochastic methods to solve them. Most existing research focuses on cases…

Optimization and Control · Mathematics 2025-09-11 Wei Liu , Yangyang Xu

We consider the problem of quantifying uncertainty for the estimation error of the leading eigenvector from Oja's algorithm for streaming principal component analysis, where the data are generated IID from some unknown distribution. By…

Statistics Theory · Mathematics 2022-05-23 Robert Lunde , Purnamrita Sarkar , Rachel Ward

Spectral analysis plays a crucial role in high-dimensional statistics, where determining the asymptotic distribution of various spectral statistics remains a challenging task. Due to the difficulties of deriving the analytic form, recent…

Statistics Theory · Mathematics 2025-04-02 Guoyu Zhang , Dandan Jiang , Fang Yao

We propose a new randomized optimization method for high-dimensional problems which can be seen as a generalization of coordinate descent to random subspaces. We show that an adaptive sampling strategy for the random subspace significantly…

Optimization and Control · Mathematics 2019-12-19 Jonathan Lacotte , Mert Pilanci , Marco Pavone