English
Related papers

Related papers: Stochastic Origin Frank-Wolfe for traffic assignme…

200 papers

We propose a data-driven method to solve a stochastic optimal power flow (OPF) problem based on limited information about forecast error distributions. The objective is to determine power schedules for controllable devices in a power…

Optimization and Control · Mathematics 2018-01-22 Yi Guo , Kyri Baker , Emiliano Dall'Anese , Zechun Hu , Tyler Summers

We introduce a new projection-free (Frank-Wolfe) method for optimizing structured nonconvex functions that are expressed as a difference of two convex functions. This problem class subsumes smooth nonconvex minimization, positioning our…

Optimization and Control · Mathematics 2025-12-01 Hoomaan Maskan , Yikun Hou , Suvrit Sra , Alp Yurtsever

This paper proposes a distributed stochastic projection-free algorithm for large-scale constrained finite-sum optimization whose constraint set is complicated such that the projection onto the constraint set can be expensive. The global…

Optimization and Control · Mathematics 2022-04-25 Xia Jiang , Xianlin Zeng , Lihua Xie , Jian Sun , Jie Chen

We prove that the block-coordinate Frank-Wolfe (BCFW) algorithm converges with state-of-the-art rates in both convex and nonconvex settings under a very mild "block-iterative" assumption. This appears to be the first result on BCFW…

Optimization and Control · Mathematics 2025-12-17 Gábor Braun , Jannis Halbey , Sebastian Pokutta , Zev Woodstock

Optimal power flow (OPF) problems are non-convex and large-scale optimization problems with important applications in power networks. This paper proposes the scheduled-asynchronous algorithm to solve a distributed semidefinite programming…

Optimization and Control · Mathematics 2017-10-10 Chin-Yao Chang , Jorge Cortes , Sonia Martinez

The massive integration of distributed energy resources changes the operational demands of the electric power distribution system, motivating optimization-based approaches. The added computational complexities of the resulting optimal power…

Optimization and Control · Mathematics 2023-07-04 Yunqi Luo , Rabayet Sadnan , Bala Krishnamoorthy , Anamika Dubey

Symmetric nonnegative matrix factorization has found abundant applications in various domains by providing a symmetric low-rank decomposition of nonnegative matrices. In this paper we propose a Frank-Wolfe (FW) solver to optimize the…

Machine Learning · Computer Science 2018-06-27 Han Zhao , Geoff Gordon

Federated learning (FL) has gained a lot of attention in recent years for building privacy-preserving collaborative learning systems. However, FL algorithms for constrained machine learning problems are still limited, particularly when the…

Machine Learning · Computer Science 2024-08-20 Ali Dadras , Sourasekhar Banerjee , Karthik Prakhya , Alp Yurtsever

We consider continuous-time dynamics for distributed optimization with set constraints in the paper. To handle the computational complexity of projection-based dynamics due to solving a general quadratic optimization subproblem with…

Optimization and Control · Mathematics 2022-06-24 Guanpu Chen , Peng Yi , Yiguang Hong , Jie Chen

In this paper, the online variants of the classical Frank-Wolfe algorithm are considered. We consider minimizing the regret with a stochastic cost. The online algorithms only require simple iterative updates and a non-adaptive step size…

Machine Learning · Statistics 2016-08-16 Jean Lafond , Hoi-To Wai , Eric Moulines

The Frank-Wolfe method has become increasingly useful in statistical and machine learning applications, due to the structure-inducing properties of the iterates, and especially in settings where linear minimization over the feasible set is…

Machine Learning · Computer Science 2024-12-16 Zikai Xiong , Robert M. Freund

The Frank-Wolfe algorithm has become a popular first-order optimization algorithm for it is simple and projection-free, and it has been successfully applied to a variety of real-world problems. Its main drawback however lies in its…

Optimization and Control · Mathematics 2020-06-25 Cyrille W. Combettes , Sebastian Pokutta

We present a new Frank-Wolfe (FW) type algorithm that is applicable to minimization problems with a nonsmooth convex objective. We provide convergence bounds and show that the scheme yields so-called coreset results for various Machine…

Optimization and Control · Mathematics 2017-08-23 Sathya N. Ravi , Maxwell D. Collins , Vikas Singh

Structural support vector machines (SSVMs) are amongst the best performing models for structured computer vision tasks, such as semantic image segmentation or human pose estimation. Training SSVMs, however, is computationally costly,…

Machine Learning · Computer Science 2014-11-19 Neel Shah , Vladimir Kolmogorov , Christoph H. Lampert

The sampling of probability distributions specified up to a normalization constant is an important problem in both machine learning and statistical mechanics. While classical stochastic sampling methods such as Markov Chain Monte Carlo…

Machine Learning · Statistics 2020-10-27 Hao Wu , Jonas Köhler , Frank Noé

Invented some 65 years ago in a seminal paper by Marguerite Straus-Frank and Philip Wolfe, the Frank-Wolfe method recently enjoys a remarkable revival, fuelled by the need of fast and reliable first-order optimization methods in Data…

Optimization and Control · Mathematics 2021-06-21 Immanuel. M. Bomze , Francesco Rinaldi , Damiano Zeffiro

In this paper, we study optimization methods consisting of iteratively minimizing surrogates of an objective function. By proposing several algorithmic variants and simple convergence analyses, we make two main contributions. First, we…

Machine Learning · Statistics 2013-05-15 Julien Mairal

In this paper, we consider approximate Frank-Wolfe (FW) algorithms to solve convex optimization problems over graph-structured support sets where the linear minimization oracle (LMO) cannot be efficiently obtained in general. We first…

Optimization and Control · Mathematics 2022-06-20 Baojian Zhou , Yifan Sun

We introduce a new class of Frank-Wolfe algorithms for minimizing differentiable functionals over probability measures. This framework can be shown to encompass a diverse range of tasks in areas such as artificial intelligence,…

Computation · Statistics 2021-05-13 Carson Kent , Jose Blanchet , Peter Glynn

In this paper we study stochastic quasi-Newton methods for nonconvex stochastic optimization, where we assume that noisy information about the gradients of the objective function is available via a stochastic first-order oracle (SFO). We…

Optimization and Control · Mathematics 2017-05-23 Xiao Wang , Shiqian Ma , Donald Goldfarb , Wei Liu