English
Related papers

Related papers: Randomized derivative-free Milstein algorithm for …

200 papers

We propose a new numerical scheme for approximating level-sets of Lipschitz multivariate functions which is robust to stochastic noise. The algorithm's main feature is an adaptive grid-based stochastic approximation strategy which…

Numerical Analysis · Mathematics 2025-09-19 Matteo Croci , Abdul-Lateef Haji-Ali , Ian C. J. Powell

This work studies the distributed empirical risk minimization (ERM) problem under differential privacy (DP) constraint. Standard distributed algorithms achieve DP typically by perturbing all local subgradients with noise, leading to…

Optimization and Control · Mathematics 2023-07-04 Changxin Liu , Karl H. Johansson , Yang Shi

Block-coordinate algorithms are recognized to furnish efficient iterative schemes for addressing large-scale problems, especially when the computation of full derivatives entails substantial memory requirements and computational efforts. In…

Optimization and Control · Mathematics 2025-04-16 Pedro Pérez-Aros , David Torregrosa-Belén

This paper provides lower bounds on the convergence rate of Derivative Free Optimization (DFO) with noisy function evaluations, exposing a fundamental and unavoidable gap between the performance of algorithms with access to gradients and…

Machine Learning · Statistics 2012-09-13 Kevin G. Jamieson , Robert D. Nowak , Benjamin Recht

This paper tackles the challenge of parameter calibration in stochastic models, particularly in scenarios where the likelihood function is unavailable in an analytical form. We introduce a gradient-based simulated parameter estimation…

Machine Learning · Statistics 2025-03-25 Zehao Li , Yijie Peng

This paper presents a randomized algorithm for computing the near-optimal low-rank dynamic mode decomposition (DMD). Randomized algorithms are emerging techniques to compute low-rank matrix approximations at a fraction of the cost of…

Numerical Analysis · Mathematics 2019-11-28 N. Benjamin Erichson , Lionel Mathelin , Steven L. Brunton , J. Nathan Kutz

Stochastic differential equations (SDEs) or diffusions are continuous-valued continuous-time stochastic processes widely used in the applied and mathematical sciences. Simulating paths from these processes is usually an intractable problem,…

Computation · Statistics 2020-05-27 Qi Wang , Vinayak Rao , Yee Whye Teh

We study the fundamental problem of high-dimensional mean estimation in a robust model where a constant fraction of the samples are adversarially corrupted. Recent work gave the first polynomial time algorithms for this problem with…

Machine Learning · Computer Science 2018-11-26 Yu Cheng , Ilias Diakonikolas , Rong Ge

We study pathwise approximation of strong solutions of scalar stochastic differential equations (SDEs) at a single time in the presence of discontinuities of the drift coefficient. Recently, it has been shown by M\"uller-Gronbach and…

Probability · Mathematics 2024-02-23 Simon Ellinger

This work proposes a machine-learning framework for constructing statistical models of errors incurred by approximate solutions to parameterized systems of nonlinear equations. These approximate solutions may arise from early termination of…

Numerical Analysis · Computer Science 2019-02-18 Brian A. Freno , Kevin T. Carlberg

We present a numerical algorithm that allows the approximation of optimal controls for stochastic reaction-diffusion equations with additive noise by first reducing the problem to controls of feedback form and then approximating the…

Optimization and Control · Mathematics 2023-09-15 Wilhelm Stannat , Alexander Vogler , Lukas Wessels

In this paper we analyse the pathwise approximation of stochastic differential equations by polynomial splines with free knots. The pathwise distance between the solution and its approximation is measured globally on the unit interval in…

Probability · Mathematics 2013-09-12 Mehdi Slassi

Asymptotic error distribution for approximation of a stochastic integral with respect to continuous semimartingale by Riemann sum with general stochastic partition is studied. Effective discretization schemes of which asymptotic conditional…

Probability · Mathematics 2010-04-14 Masaaki Fukasawa

We present a novel multilevel Monte Carlo approach for estimating quantities of interest for stochastic partial differential equations (SPDEs). Drawing inspiration from [Giles and Szpruch: Antithetic multilevel Monte Carlo estimation for…

Numerical Analysis · Mathematics 2025-04-15 Abdul-Lateef Haji-Ali , Andreas Stein

This paper deals with asymptotic errors, limit theorems for errors between numerical and exact solutions of stochastic differential equation (SDE) driven by one-dimensional fractional Brownian motion (fBm). The Euler-Maruyama, higher-order…

Numerical Analysis · Mathematics 2024-10-01 Kento Ueda

We examine a wide class of stochastic approximation algorithms for solving (stochastic) nonlinear problems on Riemannian manifolds. Such algorithms arise naturally in the study of Riemannian optimization, game theory and optimal transport,…

Optimization and Control · Mathematics 2022-12-29 Mohammad Reza Karimi , Ya-Ping Hsieh , Panayotis Mertikopoulos , Andreas Krause

This paper addresses a distributed optimization problem in a communication network where nodes are active sporadically. Each active node applies some learning method to control its action to maximize the global utility function, which is…

Optimization and Control · Mathematics 2021-04-20 Wenjie Li , Mohamad Assaad , Shiqi Zheng

Despite their empirical success, most existing listwiselearning-to-rank (LTR) models are not built to be robust to errors in labeling or annotation, distributional data shift, or adversarial data perturbations. To fill this gap, we…

Machine Learning · Computer Science 2021-09-28 Shahabeddin Sotudian , Ruidi Chen , Ioannis Paschalidis

This article proposes for stochastic partial differential equations (SPDEs) driven by additive noise, a novel approach for the approximate parameterizations of the ``small'' scales by the ``large'' ones, along with the derivaton of the…

Analysis of PDEs · Mathematics 2013-11-14 Mickaël D. Chekroun , Honghu Liu , Shouhong Wang

Understanding the behavior of stochastic gradient methods is a central problem in modern machine learning. Recent work has highlighted diagonal linear networks as a simplified yet expressive setting for analyzing the optimization and…

Optimization and Control · Mathematics 2026-05-19 Begoña García Malaxechebarría , Courtney Paquette , Maryam Fazel , Dmitriy Drusvyatskiy
‹ Prev 1 3 4 5 6 7 10 Next ›