English
Related papers

Related papers: `Regression Anytime' with Brute-Force SVD Truncati…

200 papers

An algorithm is proposed, analyzed, and tested experimentally for solving stochastic optimization problems in which the decision variables are constrained to satisfy equations defined by deterministic, smooth, and nonlinear functions. It is…

Optimization and Control · Mathematics 2021-07-09 Frank E. Curtis , Daniel P. Robinson , Baoyu Zhou

We provide performance guarantees for a variant of simulation-based policy iteration for controlling Markov decision processes that involves the use of stochastic approximation algorithms along with state-of-the-art techniques that are…

Machine Learning · Computer Science 2022-10-17 Anna Winnicki , R. Srikant

We consider the stochastic approximation problem where a convex function has to be minimized, given only the knowledge of unbiased estimates of its gradients at certain points, a framework which includes machine learning methods based on…

Machine Learning · Computer Science 2013-06-11 Francis Bach , Eric Moulines

In financial engineering, prices of financial products are computed approximately many times each trading day with (slightly) different parameters in each calculation. In many financial models such prices can be approximated by means of…

Numerical Analysis · Mathematics 2024-10-24 Sebastian Becker , Arnulf Jentzen , Marvin S. Müller , Philippe von Wurstemberger

We propose an algorithm for optimizations in which the gradients contain stochastic noise. This arises, for example, in structural optimizations when computations of forces and stresses rely on methods involving Monte Carlo sampling, such…

Materials Science · Physics 2022-11-30 Siyuan Chen , Shiwei Zhang

A statistical learning approach for parametric PDEs related to Uncertainty Quantification is derived. The method is based on the minimization of an empirical risk on a selected model class and it is shown to be applicable to a broad range…

Numerical Analysis · Mathematics 2020-01-07 Martin Eigel , Reinhold Schneider , Philipp Trunschke , Sebastian Wolf

We propose a method for eliminating the truncation error associated with any subspace diagonalization calculation. The new method, called stochastic error correction, uses Monte Carlo sampling to compute the contribution of the remaining…

High Energy Physics - Lattice · Physics 2009-10-31 Dean Lee , Nathan Salwen , Mark Windoloski

A number of optimal decision problems with uncertainty can be formulated into a stochastic optimal control framework. The Least-Squares Monte Carlo (LSMC) algorithm is a popular numerical method to approach solutions of such stochastic…

Computational Finance · Quantitative Finance 2019-01-23 Zhiyi Shen , Chengguo Weng

We study linear rough partial differential equations in the setting of [Friz and Hairer, Springer, 2014, Chapter 12]. More precisely, we consider a linear parabolic partial differential equation driven by a deterministic rough path…

Probability · Mathematics 2018-03-28 Christian Bayer , Denis Belomestny , Martin Redmann , Sebastian Riedel , John Schoenmakers

In general, the pricing of variable annuities with guarantees can be done by solving the corresponding optimal stochastic control problem if the contract withdrawal strategy is assumed to be optimal. This is typically solved as a dynamic…

Pricing of Securities · Quantitative Finance 2026-05-27 Nicolas Langrené , Xiaolin Luo , Pavel V. Shevchenko , Ruiyi Zhang

We present a novel Monte Carlo based LSV calibration algorithm that applies to all stochastic volatility models, including the non-Markovian rough volatility family. Our framework overcomes the limitations of the particle method proposed by…

Mathematical Finance · Quantitative Finance 2019-10-01 Aitor Muguruza

We propose and study an asymptotically optimal Monte Carlo estimator for steady-state expectations of a d-dimensional reflected Brownian motion. Our estimator is asymptotically optimal in the sense that it requires $\tilde{O}(d)$ (up to…

Probability · Mathematics 2020-01-29 Jose Blanchet , Xinyun Chen , Peter Glynn , Nian Si

Variational inference approximates the posterior distribution of a probabilistic model with a parameterized density by maximizing a lower bound for the model evidence. Modern solutions fit a flexible approximation with stochastic gradient…

Machine Learning · Statistics 2017-07-13 Joseph Sakaya , Arto Klami

This paper introduces a novel optimization algorithm designed for nonlinear least-squares problems. The method is derived by preconditioning the gradient descent direction using the Singular Value Decomposition (SVD) of the Jacobian. This…

Numerical Analysis · Mathematics 2026-02-11 Zhipeng Chang , Wenrui Hao , Nian Liu

The stochastic gradient descent (SGD) method is a widely used approach for solving stochastic optimization problems, but its convergence is typically slow. Existing variance reduction techniques, such as SAGA, improve convergence by…

Optimization and Control · Mathematics 2025-11-21 Fabio Nobile , Matteo Raviola , Nathan Schaeffer

This paper develops algorithms for high-dimensional stochastic control problems based on deep learning and dynamic programming. Unlike classical approximate dynamic programming approaches, we first approximate the optimal policy by means of…

Probability · Mathematics 2021-09-21 Côme Huré , Huyên Pham , Achref Bachouch , Nicolas Langrené

Variational quantum algorithms are poised to have significant impact on high-dimensional optimization, with applications in classical combinatorics, quantum chemistry, and condensed matter. Nevertheless, the optimization landscape of these…

Quantum Physics · Physics 2022-02-02 Taylor L. Patti , Omar Shehab , Khadijeh Najafi , Susanne F. Yelin

We propose a methodology for computing single and multi-asset European option prices, and more generally expectations of scalar functions of (multivariate) random variables. This new approach combines the ability of Monte Carlo simulation…

Computational Finance · Quantitative Finance 2019-10-21 Damir Filipović , Kathrin Glau , Yuji Nakatsukasa , Francesco Statti

We consider the optimization of a quadratic objective function whose gradients are only accessible through a stochastic oracle that returns the gradient at any given point plus a zero-mean finite variance random error. We present the first…

Optimization and Control · Mathematics 2016-02-25 Aymeric Dieuleveut , Nicolas Flammarion , Francis Bach

We consider the problem of robustly predicting as well as the best linear combination of $d$ given functions in least squares regression, and variants of this problem including constraints on the parameters of the linear combination. For…

Statistics Theory · Mathematics 2012-02-24 Jean-Yves Audibert , Olivier Catoni