English
Related papers

Related papers: State evolution beyond first-order methods I: Rigo…

200 papers

Reasoning about degrees of belief in uncertain dynamic worlds is fundamental to many applications, such as robotics and planning, where actions modify state properties and sensors provide measurements, both of which are prone to noise. With…

Artificial Intelligence · Computer Science 2013-09-27 Vaishak Belle , Hector Levesque

Many problems in machine learning and game theory can be formulated as saddle-point problems, for which various first-order methods have been developed and proven efficient in practice. Under the general convex-concave assumption, most…

Machine Learning · Computer Science 2020-06-16 Yuan Gao , Christian Kroer , Donald Goldfarb

In this paper, the problem of state estimation, in the context of both filtering and smoothing, for nonlinear state-space models is considered. Due to the nonlinear nature of the models, the state estimation problem is generally intractable…

Machine Learning · Statistics 2021-11-24 Jarrad Courts , Adrian Wills , Thomas B. Schön

This paper focuses on regularisation methods using models up to the third order to search for up to second-order critical points of a finite-sum minimisation problem. The variant presented belongs to the framework of [3]: it employs random…

Numerical Analysis · Mathematics 2021-04-05 Stefania Bellavia , Gianmarco Gurioli , Benedetta Morini , Philippe L. Toint

We study a class of two-stage stochastic programs in which the second stage includes a set of components with uncertain capacity, and the expression for the distribution function of the uncertain capacity includes first-stage variables.…

Optimization and Control · Mathematics 2024-09-16 Hugh Medal , Samuel Affar

Motivated by recent increased interest in optimization algorithms for non-convex optimization in application to training deep neural networks and other optimization problems in data analysis, we give an overview of recent theoretical…

(Stochastic) bilevel optimization is a frequently encountered problem in machine learning with a wide range of applications such as meta-learning, hyper-parameter optimization, and reinforcement learning. Most of the existing studies on…

Machine Learning · Computer Science 2023-03-16 Meng Ding , Mingxi Lei , Yunwen Lei , Di Wang , Jinhui Xu

State resetting is a fundamental but often overlooked capability of simulators. It supports sample-based planning by allowing resets to previously encountered simulation states, and enables calibration of simulators using real data by…

Machine Learning · Computer Science 2025-11-27 Nan Jiang

Recent advances (Sherman, 2017; Sidford and Tian, 2018; Cohen et al., 2021) have overcome the fundamental barrier of dimension dependence in the iteration complexity of solving $\ell_\infty$ regression with first-order methods. Yet it…

Optimization and Control · Mathematics 2025-06-18 Cedar Site Bai , Brian Bullins

First-order methods for solving convex optimization problems have been at the forefront of mathematical optimization in the last 20 years. The rapid development of this important class of algorithms is motivated by the success stories…

Optimization and Control · Mathematics 2021-01-07 Pavel Dvurechensky , Mathias Staudigl , Shimrit Shtern

We analyze worst-case convergence guarantees of first-order optimization methods over a function class extending that of smooth and convex functions. This class contains convex functions that admit a simple quadratic upper bound. Its study…

Optimization and Control · Mathematics 2022-05-31 Baptiste Goujaud , Adrien Taylor , Aymeric Dieuleveut

Quantum states evolving at equidistant steps into a set of mutually orthogonal states of finite or infinite cardinality p exhibit an interesting physical effect. The analysis of the amplitudes of the state at half the step time with the…

Quantum Physics · Physics 2009-09-29 Hans-Rudolf Thomann

We exploit analogies between first-order algorithms for constrained optimization and non-smooth dynamical systems to design a new class of accelerated first-order algorithms for constrained optimization. Unlike Frank-Wolfe or projected…

Optimization and Control · Mathematics 2025-05-02 Michael Muehlebach , Michael I. Jordan

We develop a novel, fundamental and surprisingly simple randomized iterative method for solving consistent linear systems. Our method has six different but equivalent interpretations: sketch-and-project, constrain-and-approximate, random…

Numerical Analysis · Mathematics 2016-01-07 Robert M. Gower , Peter Richtárik

We develop a family of reformulations of an arbitrary consistent linear system into a stochastic problem. The reformulations are governed by two user-defined parameters: a positive definite matrix defining a norm, and an arbitrary discrete…

Numerical Analysis · Mathematics 2020-01-27 Peter Richtárik , Martin Takáč

We present a model of roundoff error analysis that combines simplicity with predictive power. Though not considering all sources of roundoff within an algorithm, the model is related to a recursive roundoff error analysis and therefore…

Numerical Analysis · Mathematics 2010-06-01 Folkmar Bornemann

We introduce a second-order stochastic model to explore the variability in growth of biological shapes with applications to medical imaging. Our model is a perturbation with a random force of the Hamiltonian formulation of the geodesics.…

Probability · Mathematics 2010-03-23 François-Xavier Vialard

State-space models are used in a wide range of time series analysis formulations. Kalman filtering and smoothing are work-horse algorithms in these settings. While classic algorithms assume Gaussian errors to simplify estimation, recent…

Optimization and Control · Mathematics 2018-07-02 Jonathan Jonker , Aleksandr Y. Aravkin , James V. Burke , Gianluigi Pillonetto , Sarah Webster

The class of algorithms called Hessian Estimation Evolution Strategies (HE-ESs) update the covariance matrix of their sampling distribution by directly estimating the curvature of the objective function. The approach is practically…

Optimization and Control · Mathematics 2021-06-16 Tobias Glasmachers , Oswin Krause

Robust Markov Decision Processes (MDPs) are a powerful framework for modeling sequential decision-making problems with model uncertainty. This paper proposes the first first-order framework for solving robust MDPs. Our algorithm interleaves…

Optimization and Control · Mathematics 2021-01-18 Julien Grand-Clément , Christian Kroer