English
Related papers

Related papers: A note on stability and optimal approximation esti…

200 papers

This paper presents a comprehensive analysis of a broad range of variations of the stochastic proximal point method (SPPM). Proximal point methods have attracted considerable interest owing to their numerical stability and robustness…

Optimization and Control · Mathematics 2024-05-28 Peter Richtárik , Abdurakhmon Sadiev , Yury Demidovich

We establish weak well-posedness for critical symmetric stable driven SDEs in R d with additive noise Z, d $\ge$ 1. Namely, we study the case where the stable index of the driving process Z is $\alpha$ = 1 which exactly corresponds to the…

Probability · Mathematics 2020-01-14 Paul-Eric Chaudru de Raynal , Stephane Menozzi , Enrico Priola

We derive stability criteria for saddle points of a class of nonsmooth optimization problems in Hilbert spaces arising in PDE-constrained optimization, using metric regularity of infinite-dimensional set-valued mappings. A main ingredient…

Optimization and Control · Mathematics 2017-02-13 Christian Clason , Tuomo Valkonen

In this paper, we introduce some adaptive methods for solving variational inequalities with relatively strongly monotone operators. Firstly, we focus on the modification of the recently proposed, in smooth case [1], adaptive numerical…

Optimization and Control · Mathematics 2022-11-01 A. A. Titov , S. S. Ablaev , M. S. Alkousa , F. S. Stonyakin , A. V. Gasnikov

This paper focuses on stochastic saddle point problems with decision-dependent distributions. These are problems whose objective is the expected value of a stochastic payoff function and whose data distribution drifts in response to…

Optimization and Control · Mathematics 2022-11-15 Killian Wood , Emiliano Dall'Anese

We consider a minimal residual discretization of a simultaneous space-time variational formulation of parabolic evolution equations. Under the usual `LBB' stability condition on pairs of trial- and test spaces we show quasi-optimality of…

Numerical Analysis · Mathematics 2021-09-17 Rob Stevenson , Jan Westerdiep

Sharpness-aware minimization (SAM) is a recently proposed training method that seeks to find flat minima in deep learning, resulting in state-of-the-art performance across various domains. Instead of minimizing the loss of the current…

Machine Learning · Computer Science 2023-01-18 Hoki Kim , Jinseong Park , Yujin Choi , Jaewook Lee

We consider saddle point problems which objective functions are the average of $n$ strongly convex-concave individual components. Recently, researchers exploit variance reduction methods to solve such problems and achieve linear-convergence…

Machine Learning · Computer Science 2019-09-17 Luo Luo , Cheng Chen , Yujun Li , Guangzeng Xie , Zhihua Zhang

We present improved approximation bounds for the Moore-Penrose inverses of banded matrices, where the bandedness is induced by a metric on the index set. We show that the pseudoinverse of a banded matrix can be approximated by another…

Optimization and Control · Mathematics 2026-01-12 Sungho Shin , Wallace Gian Yion Tan , Mihai Anitescu

This paper is a survey of methods for solving smooth (strongly) monotone stochastic variational inequalities. To begin with, we give the deterministic foundation from which the stochastic methods eventually evolved. Then we review methods…

Optimization and Control · Mathematics 2023-04-04 Aleksandr Beznosikov , Boris Polyak , Eduard Gorbunov , Dmitry Kovalev , Alexander Gasnikov

Raghavendra (STOC 2008) gave an elegant and surprising result: if Khot's Unique Games Conjecture (STOC 2002) is true, then for every constraint satisfaction problem (CSP), the best approximation ratio is attained by a certain simple…

Data Structures and Algorithms · Computer Science 2010-11-01 Yuichi Yoshida

This paper develops validated computational methods for studying infinite dimensional stable manifolds at equilibrium solutions of parabolic PDEs, synthesizing disparate errors resulting from numerical approximation. To construct our…

Dynamical Systems · Mathematics 2021-07-08 Jan Bouwe van den Berg , Jonathan Jaquette , J. D. Mireles James

We propose to compute approximations to general invariant sets in dynamical systems by minimizing the distance between an appropriately selected finite set of points and its image under the dynamics. We demonstrate, through computational…

Dynamical Systems · Mathematics 2017-06-28 Oliver Junge , Ioannis G. Kevrekidis

This paper discusses the stabilizability, weak stabilizability, exact observability and robust quadratic stabilizability of linear stochastic control systems. By means of the spectrum technique of the generalized Lyapunov operator, a…

Optimization and Control · Mathematics 2023-07-19 Weihai Zhang , Bor-Sen Chen

In this work, we develop the discrete solvability analysis for perturbed saddle-point problems in Banach spaces with forcing terms regularised by means of a projector constructed using the adjoint of a weighted Cl\'ement…

Numerical Analysis · Mathematics 2026-03-12 Abeer F. Alsohaim , Tomas Führer , Ricardo Ruiz-Baier , Segundo Villa-Fuentes

This paper presents stability and accuracy analysis of a high-order explicit time stepping scheme introduced by \cite[Section 2.2]{Buvoli2019}, which exhibits superior stability compared to classical Adams-Bashforth. A conjecture that is…

Numerical Analysis · Mathematics 2026-04-01 Daopeng Yin , Liquan Mei

We study the performance of stochastic first-order methods for finding saddle points of convex-concave functions. A notorious challenge faced by such methods is that the gradients can grow arbitrarily large during optimization, which may…

Machine Learning · Computer Science 2024-06-10 Gergely Neu , Nneka Okolo

We introduce a new sequential subspace optimization method for large-scale saddle-point problems. It solves iteratively a sequence of auxiliary saddle-point problems in low-dimensional subspaces, spanned by directions derived from…

Optimization and Control · Mathematics 2020-08-24 Yoni Choukroun , Michael Zibulevsky , Pavel Kisilev

We address a numerical methodology for the computation of coarse-grained stable and unstable manifolds of saddle equilibria/stationary states of multiscale/stochastic systems for which a "good" macroscopic description in the form of…

Dynamical Systems · Mathematics 2019-09-10 Constantinos Siettos , Lucia Russo

We consider stochastic strongly-convex-strongly-concave (SCSC) saddle point (SP) problems which frequently arise in applications ranging from distributionally robust learning to game theory and fairness in machine learning. We focus on the…

Optimization and Control · Mathematics 2023-07-17 Yassine Laguel , Necdet Serhat Aybat , Mert Gürbüzbalaban