English
Related papers

Related papers: Regularized Frank-Wolfe for Dense CRFs: Generalizi…

200 papers

Motivated by applications in emergency response and experimental design, we consider smooth stochastic optimization problems over probability measures supported on compact subsets of the Euclidean space. With the influence function as the…

Optimization and Control · Mathematics 2025-10-06 Di Yu , Shane G. Henderson , Raghu Pasupathy

In this paper, we consider non-convex optimization problems under \textit{unknown} yet safety-critical constraints. Such problems naturally arise in a variety of domains including robotics, manufacturing, and medical procedures, where it is…

Machine Learning · Computer Science 2020-06-25 Mohammad Fereydounian , Zebang Shen , Aryan Mokhtari , Amin Karbasi , Hamed Hassani

In this paper, we consider large-scale linearly constrained composite convex optimization problem, whose objective is a sum of a smooth function and a possibly nonsmooth function. We propose a scalable \textbf{F}rank-\textbf{W}olfe based…

Optimization and Control · Mathematics 2015-10-13 Ya-Feng Liu , Xiangfeng Wang , Xin Liu , Shiqian Ma

We study the Frank-Wolfe algorithm for minimizing a differentiable function with Lipschitz continuous gradient over a compact convex set. To extend classical complexity bounds to certain non-convex functions, we focus on the class of…

Optimization and Control · Mathematics 2025-07-24 R. Diaz Millan , Orizon Pereira Ferreira , Julien Ugon

The boosted Frank-Wolfe algorithm accelerates the classical Frank-Wolfe algorithm by better aligning the update direction with the negative gradient. Its analysis, however, has been limited to deterministic convex problems, with step sizes…

Optimization and Control · Mathematics 2026-05-26 Navil Nandhan , Abbas Khademi , Antonio Silveti-Falls

Automation of feature analysis in the dynamic image frame dataset deals with complexity of intensity mapping with normal and abnormal class. The threshold-based data clustering and feature analysis requires iterative model to learn the…

Computer Vision and Pattern Recognition · Computer Science 2023-01-20 Aatif Jamshed , Bhawna Mallick , Rajendra Kumar Bharti

This article deals with multiobjective composite optimization problems that consist of simultaneously minimizing several objective functions, each of which is composed of a combination of smooth and non-smooth functions. To tackle these…

Optimization and Control · Mathematics 2023-02-28 P. B. Assunção , O. P. Ferreira , L. F. Prudente

This paper is concerned with the Frank--Wolfe algorithm for a special class of {\it non-compact} constrained optimization problems. The notion of asymptotic cone is used to introduce this class of problems as well as to establish that the…

Optimization and Control · Mathematics 2021-09-29 O. P. Ferreira , W. S. Sosa

This paper focuses on convex constrained optimization problems, where the solution is subject to a convex inequality constraint. In particular, we aim at challenging problems for which both projection into the constrained domain and a…

Optimization and Control · Mathematics 2017-06-13 Tianbao Yang , Qihang Lin , Lijun Zhang

We propose a randomized block-coordinate variant of the classic Frank-Wolfe algorithm for convex optimization with block-separable constraints. Despite its lower iteration cost, we show that it achieves a similar convergence rate in duality…

Machine Learning · Computer Science 2013-01-15 Simon Lacoste-Julien , Martin Jaggi , Mark Schmidt , Patrick Pletscher

Maximizing a DR-submodular function subject to a general convex set is an NP-hard problem arising from many applications in combinatorial optimization and machine learning. While it is highly desirable to design efficient approximation…

Data Structures and Algorithms · Computer Science 2022-03-29 Donglei Du , Zhicheng Liu , Chenchen Wu , Dachuan Xu , Yang Zhou

We tackle robust optimization problems under objective uncertainty in the oracle model, i.e., when the deterministic problem is solved by an oracle. The oracle-based setup is favorable in many situations, e.g., when a compact formulation of…

Optimization and Control · Mathematics 2024-12-06 Mathieu Besançon , Jannis Kurtz

We propose a semi-stochastic Frank-Wolfe algorithm with away-steps for regularized empirical risk minimization and extend it to problems with block-coordinate structure. Our algorithms use adaptive step-size and we show that they converge…

Optimization and Control · Mathematics 2016-02-16 Donald Goldfarb , Garud Iyengar , Chaoxu Zhou

We address the problem of minimizing a convex smooth function $f(x)$ over a compact polyhedral set $D$ given a stochastic zeroth-order constraint feedback model. This problem arises in safety-critical machine learning applications, such as…

Optimization and Control · Mathematics 2019-12-10 Ilnura Usmanova , Andreas Krause , Maryam Kamgarpour

Modern computer vision (CV) is often based on convolutional neural networks (CNNs) that excel at hierarchical feature extraction. The previous generation of CV approaches was often based on conditional random fields (CRFs) that excel at…

Computer Vision and Pattern Recognition · Computer Science 2019-12-09 Shaofei Wang , Vishnu Lokhande , Maneesh Singh , Konrad Kording , Julian Yarkony

Frank-Wolfe algorithms have recently regained the attention of the Machine Learning community. Their solid theoretical properties and sparsity guarantees make them a suitable choice for a wide range of problems in this field. In addition,…

Machine Learning · Statistics 2015-10-27 Emanuele Frandi , Ricardo Nanculef , Johan A. K. Suykens

Learning sparse combinations is a frequent theme in machine learning. In this paper, we study its associated optimization problem in the distributed setting where the elements to be combined are not centrally located but spread over a…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-01-25 Aurélien Bellet , Yingyu Liang , Alireza Bagheri Garakani , Maria-Florina Balcan , Fei Sha

We provide a template to derive convergence rates for the following popular versions of the Frank-Wolfe algorithm on polytopes: vanilla Frank-Wolfe, Frank-Wolfe with away steps, Frank-Wolfe with blended pairwise steps, and Frank-Wolfe with…

Optimization and Control · Mathematics 2025-05-21 Elias Wirth , Javier Pena , Sebastian Pokutta

Optimal transport (OT), which provides a distance between two probability distributions by considering their spatial locations, has been applied to widely diverse applications. Computing an OT problem requires solution of linear programming…

Machine Learning · Computer Science 2021-03-11 Takumi Fukunaga , Hiroyuki Kasai

We consider the problem of minimizing a difference of (smooth) convex functions over a compact convex feasible region $P$, i.e., $\min_{x \in P} f(x) - g(x)$, with smooth $f$ and Lipschitz continuous $g$. This computational study builds…

Optimization and Control · Mathematics 2025-08-05 Sebastian Pokutta