English
Related papers

Related papers: On the von Neumann and Frank-Wolfe Algorithms with…

200 papers

We study the Frank-Wolfe algorithm for minimizing a differentiable function with Lipschitz continuous gradient over a compact convex set. To extend classical complexity bounds to certain non-convex functions, we focus on the class of…

Optimization and Control · Mathematics 2025-07-24 R. Diaz Millan , Orizon Pereira Ferreira , Julien Ugon

Subspace learning and matrix factorization problems have great many applications in science and engineering, and efficient algorithms are critical as dataset sizes continue to grow. Many relevant problem formulations are non-convex, and in…

Numerical Analysis · Computer Science 2022-02-22 Dejiao Zhang , Laura Balzano

We present a blended conditional gradient approach for minimizing a smooth convex function over a polytope P, combining the Frank--Wolfe algorithm (also called conditional gradient) with gradient-based steps, different from away steps and…

Optimization and Control · Mathematics 2025-03-24 Gábor Braun , Sebastian Pokutta , Dan Tu , Stephen Wright

The Douglas-Rachford projection algorithm is an iterative method used to find a point in the intersection of closed constraint sets. The algorithm has been experimentally observed to solve various nonconvex feasibility problems which…

Optimization and Control · Mathematics 2020-04-06 Minh N. Dao , Matthew K. Tam

Newton's method is used to approximate roots of complex valued functions f by creating a sequence of points that converges to a root of f in the usual topology. For any field K equipped with a set of pairwise inequivalent absolute values…

Number Theory · Mathematics 2013-02-15 Xander Faber , Adam Towsley

The $\mathcal{VU}$-algorithm is a superlinearly convergent method for minimizing nonsmooth, convex functions. At each iteration, the algorithm works with a certain $\mathcal{V}$-space and its orthogonal $\U$-space, such that the…

Optimization and Control · Mathematics 2019-03-28 Warren Hare , Chayne Planiden , Claudia Sagastizábal

Our contribution in this paper is two folded. We consider first the case of linear programming with real coefficients and give a method which allows the computation of a new upper bound on the distance from the origin to a feasible point.…

Optimization and Control · Mathematics 2020-10-30 Beniamin Costandin , Marius Costandin , Petru Dobra

In this paper, a descent method for nonsmooth multiobjective optimization problems on complete Riemannian manifolds is proposed. The objective functions are only assumed to be locally Lipschitz continuous instead of convexity used in…

Optimization and Control · Mathematics 2025-01-14 Chunming Tang , Hao He , Jinbao Jian , Miantao Chao

In this paper we propose a variant of the random coordinate descent method for solving linearly constrained convex optimization problems with composite objective functions. If the smooth part of the objective function has Lipschitz…

Optimization and Control · Mathematics 2013-02-14 Ion Necoara , Andrei Patrascu

This paper considers distributed stochastic optimization, in which a number of agents cooperate to optimize a global objective function through local computations and information exchanges with neighbors over a network. Stochastic…

Optimization and Control · Mathematics 2022-08-09 Jie Hou , Xianlin Zeng , Gang Wang , Jian Sun , Jie Chen

This article presents an efficient algorithm to generate a discrete uniform distribution on a set of $p$ elements using a biased random source for $p$ prime. The algorithm generalizes Von Neumann's method and improves computational…

Probability · Mathematics 2023-01-18 Xiaoyu Lei

We consider the problem of minimizing the sum of two convex functions. One of those functions has Lipschitz-continuous gradients, and can be accessed via stochastic oracles, whereas the other is "simple". We provide a Bregman-type algorithm…

Optimization and Control · Mathematics 2024-11-26 Benjamin Dubois-Taine , Francis Bach , Quentin Berthet , Adrien Taylor

This paper formulates an elementary algorithm for resolution of singularities in a neighborhood of a singular point over a field of characteristic zero. The algorithm is composed of finite sequences of Newton polyhedra and monomial…

Algebraic Geometry · Mathematics 2014-04-29 Sheng-Ming Ma

We explore computational aspects of maximum likelihood estimation of the mixture proportions of a nonparametric finite mixture model -- a convex optimization problem with old roots in statistics and a key member of the modern data analysis…

Computation · Statistics 2023-12-11 Haoyue Wang , Shibal Ibrahim , Rahul Mazumder

We develop new accelerated first-order algorithms in the Frank-Wolfe (FW) family for minimizing smooth convex functions over compact convex sets, with a focus on two prominent constraint classes: (1) polytopes and (2) matrix domains given…

Optimization and Control · Mathematics 2025-11-05 Dan Garber

In this paper, we study the properties of the Frank-Wolfe algorithm to solve the \ExactSparse reconstruction problem. We prove that when the dictionary is quasi-incoherent, at each iteration, the Frank-Wolfe algorithm picks up an atom…

Machine Learning · Computer Science 2018-12-19 Farah Cherfaoui , Valentin Emiya , Liva Ralaivola , Sandrine Anthoine

The paper presents a new descent algorithm for locally Lipschitz continuous functions $f:X\to\mathbb{R}$. The selection of a descent direction at some iteration point $x$ combines an approximation of the set-valued gradient of $f$ on a…

Numerical Analysis · Mathematics 2019-10-25 Jan Mankau , Friedemann Schuricht

An exact algorithm is presented for solving edge weighted graph partitioning problems. The algorithm is based on a branch and bound method applied to a continuous quadratic programming formulation of the problem. Lower bounds are obtained…

Optimization and Control · Mathematics 2009-12-10 William Hager , Dzung Phan , Hongchao Zhang

By our definition, "restricted Dirichlet-to-Neumann map" (DN) means that the Dirichlet and Neumann boundary data for a Coefficient Inverse Problem (CIP) are generated by a point source running along an interval of a straight line. On the…

Numerical Analysis · Mathematics 2017-08-08 Michael V. Klibanov

This paper initiates a systematic development of a theory of non-commutative optimization. It aims to unify and generalize a growing body of work from the past few years which developed and analyzed algorithms for natural geodesically…

Optimization and Control · Mathematics 2021-07-28 Peter Bürgisser , Cole Franks , Ankit Garg , Rafael Oliveira , Michael Walter , Avi Wigderson