English
Related papers

Related papers: Minding the Gaps for Block Frank-Wolfe Optimizatio…

200 papers

Training structured prediction models is time-consuming. However, most existing approaches only use a single machine, thus, the advantage of computing power and the capacity for larger data sets of multiple machines have not been exploited.…

Machine Learning · Statistics 2016-02-16 Ching-pei Lee , Kai-Wei Chang , Shyam Upadhyay , Dan Roth

This paper showcases the theoretical and numerical performance of the Sliding Frank-Wolfe, which is a novel optimization algorithm to solve the BLASSO sparse spikes super-resolution problem. The BLASSO is a continuous (i.e. off-the-grid or…

Numerical Analysis · Mathematics 2018-11-16 Quentin Denoyelle , Vincent Duval , Gabriel Peyré , Emmanuel Soubies

We study the convergence properties of the original and away-step Frank-Wolfe algorithms for linearly constrained stochastic optimization assuming the availability of unbiased objective function gradient estimates. The objective function is…

Optimization and Control · Mathematics 2025-04-08 Natthawut Boonsiriphatthanajaroen , Shane G. Henderson

In this paper, we investigate the optimal probabilistic constellation shaping design for covert communication systems from a practical view. Different from conventional covert communications with equiprobable constellations modulation, we…

Information Theory · Computer Science 2022-08-31 Shuai Ma , Yunqi Zhang , Haihong Sheng , Hang Li , Jia Shi , Long Yang , Youlong Wu , Naofal Al-Dhahir , Shiyin Li

Error bound condition has recently gained revived interest in optimization. It has been leveraged to derive faster convergence for many popular algorithms, including subgradient methods, proximal gradient method and accelerated proximal…

Optimization and Control · Mathematics 2018-10-12 Yi Xu , Tianbao Yang

Global Station Weather Forecasting (GSWF) is a key meteorological research area, critical to energy, aviation, and agriculture. Existing time series forecasting methods often ignore or unidirectionally model spatial correlation when…

Machine Learning · Computer Science 2025-09-26 Hongyi Chen , Xiucheng Li , Xinyang Chen , Yun Cheng , Jing Li , Kehai Chen , Liqiang Nie

In the context of gridless sparse optimization, the Sliding Frank Wolfe algorithm recently introduced has shown interesting analytical and practical properties. Nevertheless, is application to large data, such as in the case of 3D…

Image and Video Processing · Electrical Eng. & Systems 2020-09-14 Jean-Baptiste Courbot , Bruno Colicchio

Projection-free block-coordinate methods avoid high computational cost per iteration and at the same time exploit the particular problem structure of product domains. Frank-Wolfe-like approaches rank among the most popular ones of this…

Optimization and Control · Mathematics 2023-12-07 Immanuel Bomze , Francesco Rinaldi , Damiano Zeffiro

Federated learning (FL) has gained a lot of attention in recent years for building privacy-preserving collaborative learning systems. However, FL algorithms for constrained machine learning problems are still limited, particularly when the…

Machine Learning · Computer Science 2024-08-20 Ali Dadras , Sourasekhar Banerjee , Karthik Prakhya , Alp Yurtsever

We consider the oracle complexity of constrained convex optimization given access to a Linear Minimization Oracle (LMO) for the constraint set and a gradient oracle for the $L$-smooth, strongly convex objective. This model includes…

Optimization and Control · Mathematics 2026-02-27 Benjamin Grimmer , Ning Liu

We study Frank-Wolfe (FW) methods for constrained bilevel optimization when the lower-level problem is solved only approximately, yielding biased and inexact hypergradients. We analyze inexact variants of vanilla FW as well as away-step and…

Optimization and Control · Mathematics 2026-02-27 Anthony Palmieri , Francesco Rinaldi , Saverio Salzo , Sara Venturini

This chapter provides a self-contained introduction to the use of Bayesian inference to extract large-scale modular structures from network data, based on the stochastic blockmodel (SBM), as well as its degree-corrected and overlapping…

Machine Learning · Statistics 2023-03-23 Tiago P. Peixoto

We consider the applications of the Frank-Wolfe (FW) algorithm for Apprenticeship Learning (AL). In this setting, we are given a Markov Decision Process (MDP) without an explicit reward function. Instead, we observe an expert that acts…

Machine Learning · Computer Science 2019-11-21 Tom Zahavy , Alon Cohen , Haim Kaplan , Yishay Mansour

Minimizing a function over an intersection of convex sets is an important task in optimization that is often much more challenging than minimizing it over each individual constraint set. While traditional methods such as Frank-Wolfe (FW) or…

Optimization and Control · Mathematics 2018-04-11 Gauthier Gidel , Fabian Pedregosa , Simon Lacoste-Julien

We present a 250 line Matlab code for topology optimization for linearized buckling criteria. The code is conceived to handle stiffness, volume and Buckling Load Factors (BLFs) either as the objective function or as constraints. We use the…

Optimization and Control · Mathematics 2021-01-27 Federico Ferrari , Ole Sigmund , James K. Guest

In this paper, we propose three online algorithms for submodular maximisation. The first one, Mono-Frank-Wolfe, reduces the number of per-function gradient evaluations from $T^{1/2}$ [Chen2018Online] and $T^{3/2}$ [chen2018projection] to 1,…

Machine Learning · Computer Science 2019-10-29 Mingrui Zhang , Lin Chen , Hamed Hassani , Amin Karbasi

We study the linear convergence of variants of the Frank-Wolfe algorithms for some classes of strongly convex problems, using only affine-invariant quantities. As in Guelat & Marcotte (1986), we show the linear convergence of the standard…

Optimization and Control · Mathematics 2014-01-06 Simon Lacoste-Julien , Martin Jaggi

In this paper, we consider online continuous DR-submodular maximization with linear stochastic long-term constraints. Compared to the prior work on online submodular maximization, our setting introduces the extra complication of stochastic…

Optimization and Control · Mathematics 2021-05-24 Prasanna Sanjay Raut , Omid Sadeghi , Maryam Fazel

Generalized self-concordance is a key property present in the objective function of many important learning problems. We establish the convergence rate of a simple Frank-Wolfe variant that uses the open-loop step size strategy $\gamma_t =…

Optimization and Control · Mathematics 2024-04-09 Alejandro Carderera , Mathieu Besançon , Sebastian Pokutta

Nonnegative matrix factorization (NMF) often relies on the separability condition for tractable algorithm design. Separability-based NMF is mainly handled by two types of approaches, namely, greedy pursuit and convex programming. A notable…

Signal Processing · Electrical Eng. & Systems 2022-07-20 Tri Nguyen , Xiao Fu , Ruiyuan Wu
‹ Prev 1 8 9 10 Next ›