English
Related papers

Related papers: Variance reduction using antithetic variables for …

200 papers

Optimal values and solutions of empirical approximations of stochastic optimization problems can be viewed as statistical estimators of their true values. From this perspective, it is important to understand the asymptotic behavior of these…

Optimization and Control · Mathematics 2025-07-01 Johannes Milz , Thomas M. Surowiec

We propose a stochastic variance reduced optimization algorithm for solving sparse learning problems with cardinality constraints. Sufficient conditions are provided, under which the proposed algorithm enjoys strong linear convergence…

Machine Learning · Computer Science 2017-12-27 Xingguo Li , Raman Arora , Han Liu , Jarvis Haupt , Tuo Zhao

In this work, we employ the Constraint Energy Minimizing Generalized Multiscale Finite Element Method (CEM-GMsFEM) to solve the problem of linear heterogeneous poroelasticity with coefficients of high contrast. The proposed method makes use…

Numerical Analysis · Mathematics 2019-09-04 Shubin Fu , Robert Altmann , Eric T. Chung , Roland Maier , Daniel Peterseim , Sai-Mang Pun

This work investigates the finite-horizon optimal covariance steering problem for discrete-time linear systems subject to both additive and multiplicative uncertainties as well as state and input chance constraints. In particular, a…

Optimization and Control · Mathematics 2023-01-19 Jacob Knaup , Panagiotis Tsiotras

In this work, we investigate the inverse problem of recovering a potential coefficient in an elliptic partial differential equation from the observations at deterministic sampling points in the domain subject to random noise. We employ a…

Numerical Analysis · Mathematics 2025-05-30 Bangti Jin , Qimeng Quan , Wenlong Zhang

One of the principal difficulties in stochastic homogenization is transferring quantitative ergodic information from the coefficients to the solutions, since the latter are nonlocal functions of the former. In this paper, we address this…

Analysis of PDEs · Mathematics 2017-06-07 Scott Armstrong , Tuomo Kuusi , Jean-Christophe Mourrat

We consider a stationary process (with either discrete or continuous time) and find an adaptive approximating stationary process combining approximation quality and supplementary good properties that can be interpreted as additional…

Probability · Mathematics 2020-02-19 Zakhar Kabluchko , Mikhail Lifshits

Variational inference in probabilistic graphical models aims to approximate fundamental quantities such as marginal distributions and the partition function. Popular approaches are the Bethe approximation, tree-reweighted, and other types…

Machine Learning · Statistics 2025-02-06 Harald Leisenberger , Franz Pernkopf

In the context of Discontinuous Galerkin methods, we study approximations of nonlinear variational problems associated with convex energies. We propose element-wise nonconforming finite element methods to discretize the continuous…

Numerical Analysis · Mathematics 2025-02-05 Georgios Grekas , Konstantinos Koumatos , Charalambos Makridakis , Andreas Vikelis

We propose an energy-optimized invariant energy quadratization method to solve the gradient flow models in this paper, which requires only one linear energy-optimized step to correct the auxiliary variables on each time step. In addition to…

Numerical Analysis · Mathematics 2024-04-03 Xiaoqing Meng , Aijie Cheng , Zhengguang Liu

In the context of infinitesimal strain plasticity with hardening, we derive a stochastic homogenization result. We assume that the coefficients of the equation are random functions: elasticity tensor, hardening parameter and flow-rule…

Analysis of PDEs · Mathematics 2016-04-11 M. Heida , B. Schweizer

We analyze convergence rates of stochastic optimization procedures for non-smooth convex optimization problems. By combining randomized smoothing techniques with accelerated gradient methods, we obtain convergence rates of stochastic…

Optimization and Control · Mathematics 2012-04-10 John C. Duchi , Peter L. Bartlett , Martin J. Wainwright

For finite-dimensional problems, stochastic approximation methods have long been used to solve stochastic optimization problems. Their application to infinite-dimensional problems is less understood, particularly for nonconvex objectives.…

Optimization and Control · Mathematics 2021-01-14 Caroline Geiersbach , Teresa Scarinci

We present an algorithm to approximate the solutions to variational problems where set of admissible functions consists of convex functions. The main motivator behind this numerical method is estimating solutions to Adverse Selection…

Optimization and Control · Mathematics 2008-03-07 Ivar Ekeland , Santiago Moreno

A change of variables is introduced to reduce certain nonlinear stochastic evolution equations with multiplicative noise to the corresponding deterministic equation. The result is then used to investigate a stochastic porous medium…

Probability · Mathematics 2007-07-24 S. V. Lototsky

In this work we introduce and analyze a new multiscale method for strongly nonlinear monotone equations in the spirit of the Localized Orthogonal Decomposition. A problem-adapted multiscale space is constructed by solving linear local…

Numerical Analysis · Mathematics 2020-12-16 Barbara Verfürth

Finite element simulations have been used to solve various partial differential equations (PDEs) that model physical, chemical, and biological phenomena. The resulting discretized solutions to PDEs often do not satisfy requisite physical…

Numerical Analysis · Mathematics 2022-03-17 Vidhi Zala , Robert M. Kirby , Akil Narayan

The optimization of neural wave functions in variational Monte Carlo crucially relies on a robust convergence criterion. While the energy variance is theoretically a definitive measure, its practical application as a primary convergence…

Quantum Physics · Physics 2025-11-03 Huan-Chen Shi , Er-Liang Cui , Dan Zhou

Recently, we and several other authors have written about the possibilities of using stochastic approximation techniques for fitting variational approximations to intractable Bayesian posterior distributions. Naive implementations of…

Computation · Statistics 2014-01-14 Tim Salimans , David A. Knowles

This article is the first part of a two-fold study, the objective of which is the theoretical analysis and numerical investigation of new approximate corrector problems in the context of stochastic homogenization. We present here three new…

Numerical Analysis · Mathematics 2018-07-16 Eric Cancès , Virginie Ehrlacher , Frederic Legoll , Benjamin Stamm , Shuyang Xiang