English
Related papers

Related papers: An implicit algorithm for validated enclosures of …

200 papers

For a linear equality constrained convex optimization problem involving two objective functions with a ``nonsmooth" + ``nonsmooth" composite structure, we study two algorithms derived from a mixed-order dynamical system which incorporates…

Optimization and Control · Mathematics 2026-03-25 Geng-Hua Li , Hai-Yi Zhao , Xiangkai Sun

Probabilistic solvers for ordinary differential equations (ODEs) have emerged as an efficient framework for uncertainty quantification and inference on dynamical systems. In this work, we explain the mathematical assumptions and detailed…

Machine Learning · Statistics 2021-10-25 Nicholas Krämer , Nathanael Bosch , Jonathan Schmidt , Philipp Hennig

Computational fluid dynamics (CFD) is a cornerstone of classical scientific computing, and there is growing interest in whether quantum computers can accelerate such simulations. To date, the existing proposals for fault-tolerant quantum…

We consider the iterative solution of regularized saddle-point systems. When the leading block is symmetric and positive semi-definite on an appropriate subspace, Dollar, Gould, Schilders, and Wathen (2006) describe how to apply the…

Numerical Analysis · Mathematics 2021-01-06 Daniela di Serafino , Dominique Orban

We analyse errors of randomized explicit and implicit Euler schemes for approximate solving of ordinary differential equations (ODEs). We consider classes of ODEs for which the right-hand side functions satisfy Lipschitz condition globally…

Numerical Analysis · Mathematics 2021-05-03 Tomasz Bochacik , Paweł Przybyłowicz

In this paper, we develop a new type of accelerated algorithms to solve some classes of maximally monotone equations as well as monotone inclusions. Instead of using Nesterov's accelerating approach, our methods rely on a so-called…

Optimization and Control · Mathematics 2021-12-08 Quoc Tran-Dinh , Yang Luo

How can we perform efficient inference and learning in directed probabilistic models, in the presence of continuous latent variables with intractable posterior distributions, and large datasets? We introduce a stochastic variational…

Machine Learning · Statistics 2022-12-13 Diederik P Kingma , Max Welling

Incremental gradient and incremental proximal methods are a fundamental class of optimization algorithms used for solving finite sum problems, broadly studied in the literature. Yet, without strong convexity, their convergence guarantees…

Optimization and Control · Mathematics 2024-07-01 Xufeng Cai , Jelena Diakonikolas

The quasi-potential is a key function in the Large Deviation Theory. It characterizes the difficulty of the escape from the neighborhood of an attractor of a stochastic non-gradient dynamical system due to the influence of small white…

Numerical Analysis · Mathematics 2017-11-28 Daisy Dahiya , Maria Cameron

We show a novel systematic way to construct conservative finite difference schemes for quasilinear first-order system of ordinary differential equations with conserved quantities. In particular, this includes both autonomous and…

Numerical Analysis · Mathematics 2018-05-23 Andy T. S. Wan , Alexander Bihlo , Jean-Christophe Nave

This paper is an attempt to remedy the problem of slow convergence for first-order numerical algorithms by proposing an adaptive conditioning heuristic. First, we propose a parallelizable numerical algorithm that is capable of solving…

Optimization and Control · Mathematics 2021-03-02 Muhammad Adil , Sasan Tavakkol , Ramtin Madani

Ever since the original algorithm by Nesterov (1983), the true nature of the acceleration phenomenon has remained elusive, with various interpretations of why the method is actually faster. The diagnosis of the algorithm through the lens of…

Systems and Control · Electrical Eng. & Systems 2025-09-24 M Parimi , Rachit Mehra , S. R. Wagh , Amol Yerudkar , Navdeep Singh

In this paper, we consider first-order convergence theory and algorithms for solving a class of non-convex non-concave min-max saddle-point problems, whose objective function is weakly convex in the variables of minimization and weakly…

Optimization and Control · Mathematics 2021-07-08 Mingrui Liu , Hassan Rafique , Qihang Lin , Tianbao Yang

Finding robot poses and trajectories represents a foundational aspect of robot motion planning. Despite decades of research, efficiently and robustly addressing these challenges is still difficult. Existing approaches are often plagued by…

Robotics · Computer Science 2023-11-06 Chen Liang , Xifeng Gao , Kui Wu , Zherong Pan

Conservative symmetric second-order one-step integrators are derived using the Discrete Multiplier Method for a family of vortex-blob models approximating the incompressible Euler's equations on the plane. Conservative properties and second…

Numerical Analysis · Mathematics 2022-08-31 Cem Gormezano , Jean-Christophe Nave , Andy T. S. Wan

Orthogonality constraints naturally appear in many machine learning problems, from principal component analysis to robust neural network training. They are usually solved using Riemannian optimization algorithms, which minimize the…

Machine Learning · Statistics 2025-08-08 Pierre Ablin , Simon Vary , Bin Gao , P. -A. Absil

We introduce an effective algorithmic method for the computation of a lower bound for uniform expansion in one-dimensional dynamics. The approach employs interval arithmetic and thus provides a rigorous numerical result (computer-assisted…

Dynamical Systems · Mathematics 2026-01-28 Paweł Pilarczyk , Michał Palczewski , Stefano Luzzatto

Time-varying stochastic optimization problems frequently arise in machine learning practice (e.g. gradual domain shift, object tracking, strategic classification). Although most problems are solved in discrete time, the underlying process…

Machine Learning · Computer Science 2023-02-24 Subha Maity , Debarghya Mukherjee , Moulinath Banerjee , Yuekai Sun

We consider feasibility and constrained optimization problems defined over smooth and/or strongly convex sets. These notions mirror their popular function counterparts but are much less explored in the first-order optimization literature.…

Optimization and Control · Mathematics 2025-10-02 Ning Liu , Benjamin Grimmer

Probabilistic solvers for ordinary differential equations (ODEs) provide efficient quantification of numerical uncertainty associated with simulation of dynamical systems. Their convergence rates have been established by a growing body of…

Machine Learning · Statistics 2020-12-21 Nicholas Krämer , Philipp Hennig