English
Related papers

Related papers: A low complexity algorithm for non-monotonically e…

200 papers

Matrix completion is the problem of recovering a low rank matrix by observing a small fraction of its entries. A series of recent works [KOM12,JNS13,HW14] have proposed fast non-convex optimization based iterative algorithms to solve this…

Numerical Analysis · Computer Science 2014-11-06 Prateek Jain , Praneeth Netrapalli

The problem of velocity selection for reaction fronts has been intensively investigated, leading to the successful marginal stability approach for propagation into an unstable state. Because the front velocity is controlled by the leading…

Soft Condensed Matter · Physics 2009-10-31 Leonid Pechenik , Herbert Levine

Fast Fourier transform (FFT) based methods have turned out to be an effective computational approach for numerical homogenisation. In particular, Fourier-Galerkin methods are computational methods for partial differential equations that are…

Numerical Analysis · Mathematics 2020-04-22 Jaroslav Vondřejc , Dishi Liu , Martin Ladecký , Hermann G. Matthies

A general method for accelerating fixed point schemes for problems related to partial differential equations is presented in this article. The speedup is obtained by training a reduced-order model on-the-fly, removing the need to do an…

Numerical Analysis · Mathematics 2025-12-01 Philippe-André Luneau , Jean Deteix

We propose a new framework to design and analyze accelerated methods that solve general monotone equation (ME) problems $F(x)=0$. Traditional approaches include generalized steepest descent methods and inexact Newton-type methods. If $F$ is…

Optimization and Control · Mathematics 2024-07-22 Tianyi Lin , Michael. I. Jordan

We develop a new continuous-time stochastic gradient descent method for optimizing over the stationary distribution of stochastic differential equation (SDE) models. The algorithm continuously updates the SDE model's parameters using an…

Machine Learning · Computer Science 2023-08-29 Ziheng Wang , Justin Sirignano

Sequential testing problems involve a complex system with several components, each of which is "working" with some independent probability. The outcome of each component can be determined by performing a test, which incurs some cost. The…

Data Structures and Algorithms · Computer Science 2023-08-22 Rohan Ghuge , Anupam Gupta , Viswanath Nagarajan

We propose an extragradient method with stepsizes bounded away from zero for stochastic variational inequalities requiring only pseudo-monotonicity. We provide convergence and complexity analysis, allowing for an unbounded feasible set,…

Optimization and Control · Mathematics 2017-03-02 Alfredo Iusem , Alejandro Jofré , Roberto I. Oliveira , Philip Thompson

The paper looks at a scaled variant of the stochastic gradient descent algorithm for the matrix completion problem. Specifically, we propose a novel matrix-scaling of the partial derivatives that acts as an efficient preconditioning for the…

Machine Learning · Computer Science 2016-10-06 Bamdev Mishra , Rodolphe Sepulchre

A fast two-level linearized scheme with unequal time-steps is constructed and analyzed for an initial-boundary-value problem of semilinear subdiffusion equations. The two-level fast L1 formula of the Caputo derivative is derived based on…

Numerical Analysis · Mathematics 2020-12-23 Hong-lin Liao , Yonggui Yan , Jiwei Zhang

We propose a new class of semi-implicit methods for solving nonlinear fractional differential equations and study their stability. Several versions of our new schemes are proved to be unconditionally stable by choosing suitable parameters.…

Numerical Analysis · Mathematics 2018-08-14 Fanhai Zeng , Ian Turner , Kevin Burrage , George Em Karniadakis

An algorithm for a family of self-starting high-order implicit time integration schemes with controllable numerical dissipation is proposed for both linear and nonlinear transient problems. This work builds on the previous works of the…

Numerical Analysis · Mathematics 2024-09-23 Daniel O'Shea , Xiaoran Zhang , Shayan Mohammadian , Chongmin Song

When solving the Hamiltonian path problem it seems natural to be given additional precedence constraints for the order in which the vertices are visited. For example one could decide whether a Hamiltonian path exists for a fixed starting…

Discrete Mathematics · Computer Science 2025-02-28 Jesse Beisegel , Fabienne Ratajczak , Robert Scheffler

A free boundary diffusive logistic model finds application in many different fields from biological invasion to wildfire propagation. However, many of these processes show a random nature and contain uncertainties in the parameters. In this…

Numerical Analysis · Mathematics 2025-01-17 M. -C. Casabán , R. Company , V. N. Egorova , L. Jódar

We introduce new multilevel methods for solving large-scale unconstrained optimization problems. Specifically, the philosophy of multilevel methods is applied to Newton-type methods that regularize the Newton sub-problem using second order…

Optimization and Control · Mathematics 2024-07-16 Nick Tsipinakis , Panos Parpas

We consider the problem of finding \textit{semi-matching} in bipartite graphs which is also extensively studied under various names in the scheduling literature. We give faster algorithms for both weighted and unweighted case. For the…

Data Structures and Algorithms · Computer Science 2012-06-15 Jittat Fakcharoenphol , Bundit Laekhanukit , Danupon Nanongkai

We study distributed optimization problems when $N$ nodes minimize the sum of their individual costs subject to a common vector variable. The costs are convex, have Lipschitz continuous gradient (with constant $L$), and bounded gradient. We…

Information Theory · Computer Science 2014-04-15 Dusan Jakovetic , Joao Xavier , Jose M. F. Moura

This paper introduces the generalized forward-backward splitting algorithm for minimizing convex functions of the form $F + \sum_{i=1}^n G_i$, where $F$ has a Lipschitz-continuous gradient and the $G_i$'s are simple in the sense that their…

Optimization and Control · Mathematics 2014-02-11 Hugo Raguet , Jalal Fadili , Gabriel Peyré

This paper presents an algorithmic framework for solving unconstrained stochastic optimization problems using only stochastic function evaluations. We employ central finite-difference based gradient estimation methods to approximate the…

Optimization and Control · Mathematics 2025-01-14 Raghu Bollapragada , Cem Karamanli

We give quantum speedups of several general-purpose numerical optimisation methods for minimising a function $f:\mathbb{R}^n \to \mathbb{R}$. First, we show that many techniques for global optimisation under a Lipschitz constraint can be…