English
Related papers

Related papers: `Regression Anytime' with Brute-Force SVD Truncati…

200 papers

We consider truncated SVD (or spectral cut-off, projection) estimators for a prototypical statistical inverse problem in dimension $D$. Since calculating the singular value decomposition (SVD) only for the largest singular values is much…

Statistics Theory · Mathematics 2018-09-11 Gilles Blanchard , Marc Hoffmann , Markus Reiß

Stochastic gradient descent type methods are ubiquitous in machine learning, but they are only applicable to the optimization of differentiable functions. Proximal algorithms are more general and applicable to nonsmooth functions. We…

Optimization and Control · Mathematics 2025-05-20 Laurent Condat , Elnur Gasanov , Peter Richtárik

We consider the least-squares regression problem and provide a detailed asymptotic analysis of the performance of averaged constant-step-size stochastic gradient descent (a.k.a. least-mean-squares). In the strongly-convex case, we provide…

Machine Learning · Computer Science 2014-12-02 Alexandre Défossez , Francis Bach

In this paper we explore ways of numerically computing recursive dynamic monetary risk measures and utility functions. Computationally, this problem suffers from the curse of dimensionality and nested simulations are unfeasible if there are…

Computational Finance · Quantitative Finance 2021-04-13 Hampus Engsner

We study the Heston-Cox-Ingersoll-Ross++ stochastic-local volatility model in the context of foreign exchange markets and propose a Monte Carlo simulation scheme which combines the full truncation Euler scheme for the stochastic volatility…

Computational Finance · Quantitative Finance 2016-10-24 Andrei Cozma , Matthieu Mariapragassam , Christoph Reisinger

This paper addresses the problem of Monte Carlo approximation of posterior probability distributions. In particular, we have considered a recently proposed technique known as population Monte Carlo (PMC), which is based on an iterative…

Computation · Statistics 2016-06-03 Eugenia Koblents , Joaquín Míguez

Stochastic differential equations are often simulated with the Monte Carlo Euler method. Convergence of this method is well understood in the case of globally Lipschitz continuous coefficients of the stochastic differential equation. The…

Numerical Analysis · Mathematics 2011-11-18 Martin Hutzenthaler , Arnulf Jentzen

In this article we present and analyse new multilevel adaptations of stochastic approximation algorithms for the computation of a zero of a function $f\colon D \to \mathbb R^d$ defined on a convex domain $D\subset \mathbb R^d$, which is…

Probability · Mathematics 2017-05-04 Steffen Dereich , Thomas Mueller-Gronbach

This paper studies the use of a machine learning-based estimator as a control variate for mitigating the variance of Monte Carlo sampling. Specifically, we seek to uncover the key factors that influence the efficiency of control variates in…

Statistics Theory · Mathematics 2023-05-29 Jose Blanchet , Haoxuan Chen , Yiping Lu , Lexing Ying

In this article, we propose a new algorithm for supervised learning methods, by which one can both capture the non-linearity in data and also find the best subset model. To produce an enhanced subset of the original variables, an ideal…

Applications · Statistics 2017-01-23 Peyman Tavallali , Marianne Razavi , Sean Brady

We present a sequential Monte Carlo sampler variant of the partial rejection control algorithm, and show that this variant can be considered as a sequential Monte Carlo sampler with a modified mutation kernel. We prove that the new sampler…

Computation · Statistics 2009-11-11 G. W. Peters , Y. Fan , S. A. Sisson

We consider a class of stochastic path-dependent volatility models where the stochastic volatility, whose square follows the Cox-Ingersoll-Ross model, is multiplied by a (leverage) function of the spot price, its running maximum, and time.…

Computational Finance · Quantitative Finance 2018-10-09 Andrei Cozma , Christoph Reisinger

Monotone inclusions have a wide range of applications, including minimization, saddle-point, and equilibria problems. We introduce new stochastic algorithms, with or without variance reduction, to estimate a root of the expectation of…

Optimization and Control · Mathematics 2024-05-24 Abdurakhmon Sadiev , Laurent Condat , Peter Richtárik

We present the first finite-sample analysis of policy evaluation in robust average-reward Markov Decision Processes (MDPs). Prior work in this setting have established only asymptotic convergence guarantees, leaving open the question of…

Machine Learning · Statistics 2025-12-11 Yang Xu , Washim Uddin Mondal , Vaneet Aggarwal

We derive an efficient stochastic algorithm for inverse problems that present an unknown linear forcing term and a set of nonlinear parameters to be recovered. It is assumed that the data is noisy and that the linear part of the problem is…

Numerical Analysis · Mathematics 2019-09-17 Darko Volkov

Conventional Monte Carlo simulations are stochastic in the sense that the acceptance of a trial move is decided by comparing a computed acceptance probability with a random number, uniformly distributed between 0 and 1. Here we consider the…

Statistical Mechanics · Physics 2018-05-24 Daan Frenkel , K. Julian Schrenk , Stefano Martiniani

The accurate numerical solution of partial differential equations is a central task in numerical analysis allowing to model a wide range of natural phenomena by employing specialized solvers depending on the scenario of application. Here,…

Numerical Analysis · Mathematics 2022-12-13 Moritz Reh , Martin Gärttner

We develop a novel and single-loop variance-reduced algorithm to solve a class of stochastic nonconvex-convex minimax problems involving a nonconvex-linear objective function, which has various applications in different fields such as…

Optimization and Control · Mathematics 2020-10-27 Quoc Tran-Dinh , Deyi Liu , Lam M. Nguyen

We propose and analyse a reduced-rank method for solving least-squares regression problems with infinite dimensional output. We derive learning bounds for our method, and study under which setting statistical performance is improved in…

Machine Learning · Statistics 2022-11-17 Luc Brogat-Motte , Alessandro Rudi , Céline Brouard , Juho Rousu , Florence d'Alché-Buc

Stochastic Differential Equations (SDEs) are used as statistical models in many disciplines. However, intractable likelihood functions for SDEs make inference challenging, and we need to resort to simulation-based techniques to estimate and…

Methodology · Statistics 2014-08-12 Grant Schneider , Peter F. Craigmile , Radu Herbei