English
Related papers

Related papers: Arnoldi-based Sampling for High-dimensional Optimi…

200 papers

Models of physics beyond the Standard Model often contain a large number of parameters. These form a high-dimensional space that is computationally intractable to fully explore. Experimental constraints project onto a subspace of viable…

High Energy Physics - Theory · Physics 2022-01-05 Jacob Hollingsworth , Michael Ratz , Philip Tanedo , Daniel Whiteson

We study high-dimensional distribution learning in an agnostic setting where an adversary is allowed to arbitrarily corrupt an $\varepsilon$-fraction of the samples. Such questions have a rich history spanning statistics, machine learning…

Data Structures and Algorithms · Computer Science 2019-03-18 Ilias Diakonikolas , Gautam Kamath , Daniel Kane , Jerry Li , Ankur Moitra , Alistair Stewart

Gaussian process emulators of computationally expensive computer codes provide fast statistical approximations to model physical processes. The training of these surrogates depends on the set of design points chosen to run the simulator.…

Computation · Statistics 2016-08-16 A. Garbuno-Inigo , F. A. DiazDelaO , K. M. Zuev

The minimization of convex functions which are only available through partial and noisy information is a key methodological problem in many disciplines. In this paper we consider convex optimization with noisy zero-th order information,…

Machine Learning · Computer Science 2016-05-27 Francis Bach , Vianney Perchet

Improving and optimizing oceanographic sampling is a crucial task for marine science and maritime resource management. Faced with limited resources in understanding processes in the water-column, the combination of statistics and autonomous…

Applications · Statistics 2020-08-19 Trygve Olav Fossum , Cédric Travelletti , Jo Eidsvik , David Ginsbourger , Kanna Rajan

Optimization of convex functions subject to eigenvalue constraints is intriguing because of peculiar analytical properties of eigenvalues, and is of practical interest because of wide range of applications in fields such as structural…

Numerical Analysis · Mathematics 2013-10-08 Emre Mengi

Accelerated MRI protocols routinely involve a predefined sampling pattern that undersamples the k-space. Finding an optimal pattern can enhance the reconstruction quality, however this optimization is a challenging task. To address this…

Image and Video Processing · Electrical Eng. & Systems 2024-08-30 Cagan Alkan , Morteza Mardani , Congyu Liao , Zhitao Li , Shreyas S. Vasanawala , John M. Pauly

This paper presents a robust enhancement of the Tangent space Hermite Interpolation (THI) method for manifold-valued data by integrating the multivariate Arnoldi process. To circumvent the inherent numerical instability of multivariate…

Numerical Analysis · Mathematics 2026-05-26 Yuxuan Li , Qiang Niu , Wubin Zhou

Interpolation-based trust-region methods are an important class of algorithms for Derivative-Free Optimization which rely on locally approximating an objective function by quadratic polynomial interpolation models, frequently built from…

Optimization and Control · Mathematics 2013-06-25 Afonso S. Bandeira , Katya Scheinberg , Luis Nunes Vicente

We present a novel framework for performing statistical sampling, expectation estimation, and partition function approximation using \emph{arbitrary} heuristic stochastic processes defined over discrete state spaces. Using a highly parallel…

Computation · Statistics 2015-12-04 Firas Hamze , Evgeny Andryash

The challenge of noisy multi-objective optimization lies in the constant trade-off between exploring new decision points and improving the precision of known points through resampling. This decision should take into account both the…

Machine Learning · Computer Science 2025-04-25 Timo Budszuhn , Mark Joachim Krallmann , Daniel Horn

An inverse problem of finding an unknown heat source for a class of linear parabolic equations is considered. Such problems can typically be converted to a direct problem with non-local conditions in time instead of an initial value…

Numerical Analysis · Mathematics 2023-02-16 Doghonay Arjmand , Maksat Ashyraliyev

We propose a self-tuning $\sqrt{\mathrm {Lasso}}$ method that simultaneously resolves three important practical problems in high-dimensional regression analysis, namely it handles the unknown scale, heteroscedasticity and (drastic)…

Methodology · Statistics 2014-05-27 Alexandre Belloni , Victor Chernozhukov , Lie Wang

Given a sequence of observations from a discrete-time, finite-state hidden Markov model, we would like to estimate the sampling distribution of a statistic. The bootstrap method is employed to approximate the confidence regions of a…

Computation · Statistics 2009-09-29 Cheng-Der Fuh , Inchi Hu

Optimal values and solutions of empirical approximations of stochastic optimization problems can be viewed as statistical estimators of their true values. From this perspective, it is important to understand the asymptotic behavior of these…

Optimization and Control · Mathematics 2025-07-01 Johannes Milz , Thomas M. Surowiec

We consider smooth stochastic convex optimization problems in the context of algorithms which are based on directional derivatives of the objective function. This context can be considered as an intermediate one between derivative-free…

Optimization and Control · Mathematics 2020-09-22 Pavel Dvurechensky , Eduard Gorbunov , Alexander Gasnikov

In this work we explore the fidelity of numerical approximations to the analytic spectra of hyperbolic partial differential equation systems with variable coefficients. We are particularly interested in the ability of discrete methods to…

Numerical Analysis · Mathematics 2025-08-12 Brittany A. Erickson

We develop a framework for the average-case analysis of random quadratic problems and derive algorithms that are optimal under this analysis. This yields a new class of methods that achieve acceleration given a model of the Hessian's…

Optimization and Control · Mathematics 2023-02-21 Fabian Pedregosa , Damien Scieur

Estimation of Markov Random Field and covariance models from high-dimensional data represents a canonical problem that has received a lot of attention in the literature. A key assumption, widely employed, is that of {\em sparsity} of the…

Optimization and Control · Mathematics 2018-05-16 Davoud Ataee Tarzanagh , George Michailidis

The estimation of modal parameters from a set of noisy measured data is a highly judgmental task, with user expertise playing a significant role in distinguishing between estimated physical and noise modes of a test-piece. Various methods…

Applications · Statistics 2017-09-13 Vahid Yaghoubi , Majid K. Vakilzadeh , Thomas J. S. Abrahamsson