English
Related papers

Related papers: A semi-implicit scheme based on Arrow-Hurwicz meth…

200 papers

We develop and analyze a new hybridizable discontinuous Galerkin (HDG) method for solving third-order Korteweg-de Vries type equations. The approximate solutions are defined by a discrete version of a characterization of the exact solution…

Numerical Analysis · Mathematics 2026-05-25 Bo Dong

This paper addresses smooth convexly constrained optimization problems where the Euclidean projection onto the feasible set is computationally tractable. Although momentum techniques like Polyak's heavy-ball are known for accelerating…

Optimization and Control · Mathematics 2026-03-20 Federica Donnini , Pierluigi Mansueto

Local search heuristics for non-convex optimizations are popular in applied machine learning. However, in general it is hard to guarantee that such algorithms even converge to a local minimum, due to the existence of complicated saddle…

Machine Learning · Computer Science 2016-02-19 Anima Anandkumar , Rong Ge

We propose a class of semi-Lagrangian methods of high approximation order in space and time, based on spectral element space discretizations and exponential integrators of Runge-Kutta type. We discuss the extension of these methods to the…

Numerical Analysis · Mathematics 2016-02-24 Elena Celledoni , Bawfeh Kingsley Kometa , Olivier Verdier

We prove first-order convergence of the semi-explicit Euler scheme combined with a finite element discretization in space for elliptic-parabolic problems which are weakly coupled. This setting includes poroelasticity, thermoelasticity, as…

Numerical Analysis · Mathematics 2019-09-10 Robert Altmann , Roland Maier , Benjamin Unger

We examine the behavior of accelerated gradient methods in smooth nonconvex unconstrained optimization, focusing in particular on their behavior near strict saddle points. Accelerated methods are iterative methods that typically step along…

Optimization and Control · Mathematics 2018-10-09 Michael O'Neill , Stephen J. Wright

We present a semi-Lagrangian scheme for the approximation of a class of Hamilton-Jacobi-Bellman equations on networks. The scheme is explicit and stable under some technical conditions. We prove a convergence theorem and some error…

Numerical Analysis · Mathematics 2018-04-26 Elisabetta Carlini , Adriano Festa , Nicolas Forcadel

In this paper we analyze several inexact fast augmented Lagrangian methods for solving linearly constrained convex optimization problems. Mainly, our methods rely on the combination of excessive-gap-like smoothing technique developed in…

Optimization and Control · Mathematics 2015-05-14 Andrei Patrascu , Ion Necoara , Quoc Tran-Dinh

This paper studies second-order methods for convex-concave minimax optimization. Monteiro and Svaiter (2012) proposed a method to solve the problem with an optimal iteration complexity of $\mathcal{O}(\epsilon^{-3/2})$ to find an…

Optimization and Control · Mathematics 2025-04-16 Lesi Chen , Chengchang Liu , Jingzhao Zhang

The least absolute shrinkage and selection operator (Lasso) is widely recognized across various fields of mathematics and engineering. Its variant, the generalized Lasso, finds extensive application in the fields of statistics, machine…

Optimization and Control · Mathematics 2024-03-22 Bowen Li , Bin Shi

Semi-Lagrangian schemes have proven to be very efficient to model advection problems. However most semi-Lagrangian schemes are not conservative. Here, a systematic method is introduced in order to enforce the conservative property on a…

Fluid Dynamics · Physics 2016-09-19 Alexandre Cameron , Emmanuel Dormy

This paper studies the Craig variant of the Golub-Kahan bidiagonalization algorithm as an iterative solver for linear systems with saddle point structure. Such symmetric indefinite systems in 2x2 block form arise in many applications, but…

Computational Engineering, Finance, and Science · Computer Science 2018-08-24 Mario Arioli , Carola Kruse , Ulrich Ruede , Nicolas Tardieu

Most algorithms for solving optimization problems or finding saddle points of convex-concave functions are fixed-point algorithms. In this work we consider the generic problem of finding a fixed point of an average of operators, or an…

Machine Learning · Computer Science 2020-06-17 Grigory Malinovsky , Dmitry Kovalev , Elnur Gasanov , Laurent Condat , Peter Richtárik

We consider the problem of supervised learning with convex loss functions and propose a new form of iterative regularization based on the subgradient method. Unlike other regularization approaches, in iterative regularization no constraint…

Machine Learning · Statistics 2015-04-02 Junhong Lin , Lorenzo Rosasco , Ding-Xuan Zhou

We introduce Semi-Implicit Lagrangian Voronoi Approximation (SILVA), a novel numerical method for the solution of the incompressible Euler and Navier-Stokes equations, which combines the efficiency of semi-implicit time marching schemes…

Numerical Analysis · Mathematics 2024-05-08 Ondřej Kincl , Ilya Peshkov , Walter Boscheri

We study the performance of stochastic first-order methods for finding saddle points of convex-concave functions. A notorious challenge faced by such methods is that the gradients can grow arbitrarily large during optimization, which may…

Machine Learning · Computer Science 2024-06-10 Gergely Neu , Nneka Okolo

This paper presents smoothing schemes for obtaining approximate stationary points of unconstrained or linearly-constrained composite nonconvex-concave min-max (and hence nonsmooth) problems by applying well-known algorithms to composite…

Optimization and Control · Mathematics 2021-06-18 Weiwei Kong , Renato D. C. Monteiro

Unsupervised deep learning approaches have recently become one of the crucial research areas in imaging owing to their ability to learn expressive and powerful reconstruction operators even when paired high-quality training data is scarcely…

Computer Vision and Pattern Recognition · Computer Science 2023-11-30 Marcello Carioni , Subhadip Mukherjee , Hong Ye Tan , Junqi Tang

This work introduces an empirical quadrature-based hyperreduction procedure and greedy training algorithm to effectively reduce the computational cost of solving convection-dominated problems with limited training. The proposed approach…

Numerical Analysis · Mathematics 2023-09-14 Marzieh Alireza Mirhoseini , Matthew J. Zahr

Fitting concentric geometric objects to digitized data is an important problem in many areas such as iris detection, autonomous navigation, and industrial robotics operations. There are two common approaches to fitting geometric shapes to…

Computer Vision and Pattern Recognition · Computer Science 2021-03-10 Ali A. Al-Sharadqah , Lorenzo Rull