English
Related papers

Related papers: Gordon's inequality and condition numbers in conic…

200 papers

We discuss the correspondence between Gaussian process regression and Geometric Harmonics, two similar kernel-based methods that are typically used in different contexts. Research communities surrounding the two concepts often pursue…

Machine Learning · Statistics 2021-10-07 Felix Dietrich , Juan M. Bello-Rivas , Ioannis G. Kevrekidis

We consider the problem of approximating the solution of variational problems subject to the constraint that the admissible functions must be convex. This problem is at the interface between convex analysis, convex optimization, variational…

Numerical Analysis · Mathematics 2015-03-19 Adam M. Oberman

Quantification and minimization of uncertainty is an important task in the design of electromagnetic devices, which comes with high computational effort. We propose a hybrid approach combining the reliability and accuracy of a Monte Carlo…

Machine Learning · Computer Science 2022-04-12 Mona Fuhrländer , Sebastian Schöps

A problem of the erroneous duality gap caused by the presence of symmetries is solved in this paper utilizing point group theory. The optimization problems are first divided into two classes based on their predisposition to suffer from this…

Computational Physics · Physics 2021-06-23 Miloslav Capek , Lukas Jelinek , Michal Masek

We analyze the Gaussian approximation as a method to obtain the first and second moments of a stochastic process described by a master equation. We justify the use of this approximation with ideas coming from van Kampen's expansion approach…

Statistical Mechanics · Physics 2015-05-18 Luis F. Lafuerza , Raul Toral

Both experimental and computational methods for the exploration of structure, functionality, and properties of materials often necessitate the search across broad parameter spaces to discover optimal experimental conditions and regions of…

Computational Physics · Physics 2021-08-31 Maxim Ziatdinov , Ayana Ghosh , Sergei V. Kalinin

In the present paper, we propose and analyze a novel method for estimating a univariate regression function of bounded variation. The underpinning idea is to combine two classical tools in nonparametric statistics, namely isotonic…

Statistics Theory · Mathematics 2012-11-20 Arnaud Guyader , Nicolas Jégou , Alexander B. Németh , Sándor Z. Németh

This paper deals with the construction of a metamodel (i.e. a simplified mathematical model) for a stochastic computer code (also called stochastic numerical model or stochastic simulator), where stochastic means that the code maps the…

Statistics Theory · Mathematics 2015-09-15 Thomas Browne , Bertrand Iooss , Loïc Le Gratiet , Jérome Lonchampt

Preconditioning is essential in iterative methods for solving linear systems. It is also the implicit objective in updating approximations of Jacobians in optimization methods, e.g.,in quasi-Newton methods. Motivated by the latter, we study…

Numerical Analysis · Mathematics 2024-12-24 Woosuk L. Jung , David Torregrosa-Belén , Henry Wolkowicz

The problem to express a natural number N as a product of natural numbers without regard to order corresponds to a thermally isolated non-interacting Bose gas in a one-dimensional potential with logarithmic energy eigenvalues. This…

Statistical Mechanics · Physics 2007-05-23 Christoph Weiss , Steffen Page , Martin Holthaus

We study geodesically convex (g-convex) problems that can be written as a difference of Euclidean convex functions. This structure arises in several optimization problems in statistics and machine learning, e.g., for matrix scaling,…

Optimization and Control · Mathematics 2022-10-24 Melanie Weber , Suvrit Sra

Decomposition techniques for linear programming are difficult to extend to conic optimization problems with general non-polyhedral convex cones because the conic inequalities introduce an additional nonlinear coupling between the variables.…

Optimization and Control · Mathematics 2013-06-04 Yifan Sun , Martin S. Andersen , Lieven Vandenberghe

Gaussian Process (GP) models are popular statistical surrogates used for emulating computationally expensive computer simulators. The quality of a GP model fit can be assessed by a goodness of fit measure based on optimized likelihood.…

Computation · Statistics 2013-09-27 Andrew Butler , Thomas D. Humphries , Pritam Ranjan , Ronald D. Haynes

Recent results in homotopy and solution paths demonstrate that certain well-designed greedy algorithms, with a range of values of the algorithmic parameter, can provide solution paths to a sequence of convex optimization problems. On the…

Statistics Theory · Mathematics 2009-09-29 Xiaoming Huo , Xuelei , Ni

Machine learning practitioners invest significant manual and computational resources in finding suitable learning rates for optimization algorithms. We provide a probabilistic motivation, in terms of Gaussian inference, for popular…

Machine Learning · Computer Science 2021-02-23 Filip de Roos , Carl Jidling , Adrian Wills , Thomas Schön , Philipp Hennig

This paper considers data-driven chance-constrained stochastic optimization problems in a Bayesian framework. Bayesian posteriors afford a principled mechanism to incorporate data and prior knowledge into stochastic optimization problems.…

Statistics Theory · Mathematics 2023-08-07 Prateek Jaiswal , Harsha Honnappa , Vinayak A. Rao

The bivariate Gaussian distribution has been a key model for many developments in statistics. However, many real-world phenomena generate data that follow asymmetric distributions, and consequently bivariate normal model is inappropriate in…

Methodology · Statistics 2022-12-08 Roberto Vila , Narayanaswamy Balakrishnan , Helton Saulo , Ana Protazio

We extend to Gaussian distributions a result providing smoothed analysis estimates for condition numbers given as relativized distances to illposedness. We also introduce a notion of local analysis meant to capture the behavior of these…

Numerical Analysis · Mathematics 2019-05-22 Felipe Cucker , Teresa Krick

In the last five years, the financial industry has been impacted by the emergence of digitalization and machine learning. In this article, we explore two methods that have undergone rapid development in recent years: Gaussian processes and…

Portfolio Management · Quantitative Finance 2019-03-13 Joan Gonzalvez , Edmond Lezmi , Thierry Roncalli , Jiali Xu

Prediction models are often employed in estimating parameters of optimization models. Despite the fact that in an end-to-end view, the real goal is to achieve good optimization performance, the prediction performance is measured on its own.…

Optimization and Control · Mathematics 2021-01-01 Nam Ho-Nguyen , Fatma Kılınç-Karzan