English
Related papers

Related papers: Stochastic Block Coordinate Frank-Wolfe Algorithm …

200 papers

In planning problems, it is often challenging to fully model the desired specifications. In particular, in human-robot interaction, such difficulty may arise due to human's preferences that are either private or complex to model.…

Robotics · Computer Science 2021-01-01 Mahsa Ghasemi , Evan Scope Crafts , Bo Zhao , Ufuk Topcu

Block coordinate descent (BCD) methods and their variants have been widely used in coping with large-scale nonconstrained optimization problems in many fields such as imaging processing, machine learning, compress sensing and so on. For…

Optimization and Control · Mathematics 2018-04-04 Daoli Zhu , Lei Zhao

We introduce a new class of Frank-Wolfe algorithms for minimizing differentiable functionals over probability measures. This framework can be shown to encompass a diverse range of tasks in areas such as artificial intelligence,…

Computation · Statistics 2021-05-13 Carson Kent , Jose Blanchet , Peter Glynn

Asynchronous parallel implementations for stochastic optimization have received huge successes in theory and practice recently. Asynchronous implementations with lock-free are more efficient than the one with writing or reading lock. In…

Machine Learning · Computer Science 2016-11-15 Bin Gu , Zhouyuan Huo , Heng Huang

This article presents a powerful algorithmic framework for big data optimization, called the Block Successive Upper bound Minimization (BSUM). The BSUM includes as special cases many well-known methods for analyzing massive data sets, such…

Optimization and Control · Mathematics 2015-11-10 Mingyi Hong , Meisam Razaviyayn , Zhi-Quan Luo , Jong-Shi Pang

The Convolutional Sparse Coding (CSC) model has recently gained considerable traction in the signal and image processing communities. By providing a global, yet tractable, model that operates on the whole image, the CSC was shown to…

Computer Vision and Pattern Recognition · Computer Science 2018-11-02 Ev Zisselman , Jeremias Sulam , Michael Elad

We present a novel algorithm to estimate the barycenter of arbitrary probability distributions with respect to the Sinkhorn divergence. Based on a Frank-Wolfe optimization strategy, our approach proceeds by populating the support of the…

Machine Learning · Statistics 2019-06-04 Giulia Luise , Saverio Salzo , Massimiliano Pontil , Carlo Ciliberto

Majorization-minimization algorithms consist of iteratively minimizing a majorizing surrogate of an objective function. Because of its simplicity and its wide applicability, this principle has been very popular in statistics and in signal…

Machine Learning · Statistics 2013-09-11 Julien Mairal

In this report, we study decentralized stochastic optimization to minimize a sum of smooth and strongly convex cost functions when the functions are distributed over a directed network of nodes. In contrast to the existing work, we use…

Machine Learning · Computer Science 2020-07-24 Muhammad I. Qureshi , Ran Xin , Soummya Kar , Usman A. Khan

In this paper, we study the problem of finding the Euclidean distance to a convex cone generated by a set of discrete points in $\mathbb{R}^n_+$. In particular, we are interested in problems where the discrete points are the set of feasible…

Optimization and Control · Mathematics 2017-04-24 Ali Fattahi , Sriram Dasu , Reza Ahmadi

Multi-objective optimization is central to many engineering and machine learning applications, where multiple objectives must be optimized in balance. While multi-gradient based optimization methods combine these objectives in each step,…

Optimization and Control · Mathematics 2026-05-13 Trang H. Tran , Luis Nunes Vicente

The paper presents various modifications of the Frank-Wolfe algorithm in the equilibrium traffic assignment problem. The Beckman model is used as a model for experiments. In this article, first of all, attention is paid to the choice of the…

Optimization and Control · Mathematics 2024-03-11 Igor N. Ignashin , Demyan V. Yarmoshik

In this work, we propose a distributed algorithm for stochastic non-convex optimization. We consider a worker-server architecture where a set of $K$ worker nodes (WNs) in collaboration with a server node (SN) jointly aim to minimize a…

Optimization and Control · Mathematics 2020-05-04 Prashant Khanduri , Pranay Sharma , Swatantra Kafle , Saikiran Bulusu , Ketan Rajawat , Pramod K. Varshney

Frank--Wolfe methods avoid projections, but over curved feasible regions the full-space linear minimization oracle (LMO) can itself become the computational bottleneck. We introduce random-subspace Frank--Wolfe (RSFW), the first…

Optimization and Control · Mathematics 2026-05-26 Pierre-Louis Poirion , Sebastian Pokutta , Akiko Takeda

We consider the problem of minimizing the sum of two convex functions. One of those functions has Lipschitz-continuous gradients, and can be accessed via stochastic oracles, whereas the other is "simple". We provide a Bregman-type algorithm…

Optimization and Control · Mathematics 2024-11-26 Benjamin Dubois-Taine , Francis Bach , Quentin Berthet , Adrien Taylor

In this paper, we study the problem of speeding up a type of optimization algorithms called Frank-Wolfe, a conditional gradient method. We develop and employ two novel inner product search data structures, improving the prior fastest…

Data Structures and Algorithms · Computer Science 2022-07-20 Zhao Song , Zhaozhuo Xu , Yuanyuan Yang , Lichen Zhang

Recent papers have shown that the Frank-Wolfe algorithm (FW) with open-loop step-sizes exhibits rates of convergence faster than the iconic $\mathcal{O}(t^{-1})$ rate. In particular, when the minimizer of a strongly convex function over a…

Optimization and Control · Mathematics 2025-01-22 Elias Wirth , Javier Pena , Sebastian Pokutta

Motivation: High-throughput experimental techniques have been producing more and more protein-protein interaction (PPI) data. PPI network alignment greatly benefits the understanding of evolutionary relationship among species, helps…

Data Structures and Algorithms · Computer Science 2016-04-13 Somaye Hashemifar , Qixing Huang , Jinbo XU

We present a new proximal bundle method for Maximum-A-Posteriori (MAP) inference in structured energy minimization problems. The method optimizes a Lagrangean relaxation of the original energy minimization problem using a multi plane…

Machine Learning · Computer Science 2019-04-08 Paul Swoboda , Vladimir Kolmogorov

Projection-free optimization algorithms, which are mostly based on the classical Frank-Wolfe method, have gained significant interest in the machine learning community in recent years due to their ability to handle convex constraints that…

Machine Learning · Computer Science 2021-02-24 Dan Garber , Ben Kretzu