English
Related papers

Related papers: Uniform Stability for First-Order Empirical Risk M…

200 papers

We prove new optimality results for adaptive mesh refinement algorithms for non-symmetric, indefinite, and time-dependent problems by proposing a generalization of quasi-orthogonality which follows directly from the inf-sup stability of the…

Numerical Analysis · Mathematics 2022-03-22 Michael Feischl

Stochastic estimators are fundamental to large-scale optimization, where population quantities must be inferred from noisy oracle observations. Although influential methods such as momentum, SPIDER, STORM, and PAGE have been highly…

Machine Learning · Computer Science 2026-05-18 Zhankun Luo , Antesh Upadhyay , M. Berk Sahin , Sang Bin Moon , Anuran Makur , Abolfazl Hashemi

The stability analysis of model predictive control schemes without terminal constraints and/or costs has attracted considerable attention during the last years. We pursue a recently proposed approach which can be used to determine a…

Optimization and Control · Mathematics 2014-01-16 Philipp Braun , Jürgen Pannek , Karl Worthmann

Consider the problem of minimizing an expected logarithmic loss over either the probability simplex or the set of quantum density matrices. This problem includes tasks such as solving the Poisson inverse problem, computing the…

Optimization and Control · Mathematics 2024-03-12 Chung-En Tsai , Hao-Chung Cheng , Yen-Huan Li

In this thesis, we investigate a novel local projection based stabilized conforming virtual element method for the generalized Oseen problem using equal-order element pairs on general polygonal meshes. To ensure the stability, particularly…

Numerical Analysis · Mathematics 2025-09-05 Sudheer Mishra , E Natarajan

Popular machine learning estimators involve regularization parameters that can be challenging to tune, and standard strategies rely on grid search for this task. In this paper, we revisit the techniques of approximating the regularization…

Machine Learning · Statistics 2019-05-28 Eugene Ndiaye , Tam Le , Olivier Fercoq , Joseph Salmon , Ichiro Takeuchi

In this paper, we develop a method for solving the problem of minimizing the $H^2$ error norm between the transfer functions of original and reduced systems on the set of stable matrices and two Euclidean spaces. That is, we develop a…

Optimization and Control · Mathematics 2018-08-03 Kazuhiro Sato

We study the stability of entropically regularized optimal transport with respect to the marginals. Lipschitz continuity of the value and H\"older continuity of the optimal coupling in $p$-Wasserstein distance are obtained under general…

Optimization and Control · Mathematics 2022-07-06 Stephan Eckstein , Marcel Nutz

Inspired by the remarkable success of large neural networks, there has been significant interest in understanding the generalization performance of over-parameterized models. Substantial efforts have been invested in characterizing how…

Machine Learning · Computer Science 2024-01-12 Haoyuan Sun , Khashayar Gatmiry , Kwangjun Ahn , Navid Azizan

We consider the fundamental problem in non-convex optimization of efficiently reaching a stationary point. In contrast to the convex case, in the long history of this basic problem, the only known theoretical results on first-order…

Optimization and Control · Mathematics 2016-08-26 Zeyuan Allen-Zhu , Elad Hazan

Stability and error estimate for the Oseen equations in a projection based variational setup has been derived in this paper. The use of Geometric Conservation Law (GCL) provides unconditional stability whereas without using GCL we have a…

Analysis of PDEs · Mathematics 2019-05-28 Birupaksha Pal , Sashikumaar Ganesan

Recent work by Woodworth et al. (2020) shows that the optimization dynamics of gradient descent for overparameterized problems can be viewed as low-dimensional dual dynamics induced by a mirror map, explaining the implicit regularization…

Machine Learning · Computer Science 2024-10-21 Shuyang Wang , Diego Klabjan

The graduated optimization approach, also known as the continuation method, is a popular heuristic to solving non-convex problems that has received renewed interest over the last decade. Despite its popularity, very little is known in terms…

Machine Learning · Computer Science 2015-07-28 Elad Hazan , Kfir Y. Levy , Shai Shalev-Shwartz

The maximal matching problem has received considerable attention in the self-stabilizing community. Previous work has given different self-stabilizing algorithms that solves the problem for both the adversarial and fair distributed daemon,…

Data Structures and Algorithms · Computer Science 2016-08-14 Fredrik Manne , Morten Mjelde , Laurence Pilard , Sébastien Tixeuil

Stochastic optimization methods have been hugely successful in making large-scale optimization problems feasible when computing the full gradient is computationally prohibitive. Using the theory of modified equations for numerical…

Optimization and Control · Mathematics 2023-09-06 Stefano Di Giovacchino , Desmond J. Higham , Konstantinos Zygalakis

Applications such as unbalanced and fully shuffled regression can be approached by optimizing regularized optimal transport (OT) distances, such as the entropic OT and Sinkhorn distances. A common approach for this optimization is to use a…

Numerical Analysis · Mathematics 2024-10-22 Xingjie Li , Fei Lu , Molei Tao , Felix X. -F. Ye

We consider the stability of Robust Optimization problems with respect to perturbations in their uncertainty sets. We focus on Linear Optimization problems, including those with a possibly infinite number of constraints, also known as…

Optimization and Control · Mathematics 2015-09-23 Timothy C. Y. Chan , Philip Allen Mar

Euclidean distance matrix optimization with ordinal constraints (EDMOC) has found important applications in sensor network localization and molecular conformation. It can also be viewed as a matrix formulation of multidimensional scaling,…

Optimization and Control · Mathematics 2020-06-23 Sitong Lu , Miao Zhang , Qingna Li

This paper considers global optimization with a black-box unknown objective function that can be non-convex and non-differentiable. Such a difficult optimization problem arises in many real-world applications, such as parameter tuning in…

Optimization and Control · Mathematics 2016-07-19 Kenji Kawaguchi , Yu Maruyama , Xiaoyu Zheng

In this paper we develop further a method for detecting unstable periodic orbits (UPOs) by stabilising transformations, where the strategy is to transform the system of interest in such a way that the orbits become stable. The main…

Chaotic Dynamics · Physics 2015-05-13 Jonathan J. Crofts , Ruslan L. Davidchack
‹ Prev 1 4 5 6 7 8 10 Next ›