English
Related papers

Related papers: FrankWolfe.jl: a high-performance and flexible too…

200 papers

We study the Frank-Wolfe algorithm for minimizing a differentiable function with Lipschitz continuous gradient over a compact convex set. To extend classical complexity bounds to certain non-convex functions, we focus on the class of…

Optimization and Control · Mathematics 2025-07-24 R. Diaz Millan , Orizon Pereira Ferreira , Julien Ugon

We study a class of convex-concave saddle-point problems of the form $\min_x\max_y \langle Kx,y\rangle+f_{\cal{P}}(x)-h^\ast(y)$ where $K$ is a linear operator, $f_{\cal{P}}$ is the sum of a convex function $f$ with a Lipschitz-continuous…

Optimization and Control · Mathematics 2021-06-07 Vladimir Kolmogorov , Thomas Pock

Generalized self-concordance is a key property present in the objective function of many important learning problems. We establish the convergence rate of a simple Frank-Wolfe variant that uses the open-loop step size strategy $\gamma_t =…

Optimization and Control · Mathematics 2024-04-09 Alejandro Carderera , Mathieu Besançon , Sebastian Pokutta

We study Frank-Wolfe methods for nonconvex stochastic and finite-sum optimization problems. Frank-Wolfe methods (in the convex case) have gained tremendous recent interest in machine learning and optimization communities due to their…

Optimization and Control · Mathematics 2016-08-01 Sashank J. Reddi , Suvrit Sra , Barnabas Poczos , Alex Smola

The non-equidistant fast Fourier transform (NFFT) is an extension of the famous fast Fourier transform (FFT), which can be applied to non-equidistantly sampled data in time/space or frequency domain. It is an approximative algorithm that…

Mathematical Software · Computer Science 2023-01-31 Tobias Knopp , Marija Boberg , Mirco Grosser

Frank-Wolfe algorithms (FW) are popular first-order methods for solving constrained convex optimization problems that rely on a linear minimization oracle instead of potentially expensive projection-like oracles. Many works have identified…

Optimization and Control · Mathematics 2023-09-18 Elias Wirth , Thomas Kerdreux , Sebastian Pokutta

Classical methods to simulate quantum systems are not only a key element of the physicist's toolkit for studying many-body models but are also increasingly important for verifying and challenging upcoming quantum computers. Pauli…

Quantum Physics · Physics 2025-05-29 Manuel S. Rudolph , Tyson Jones , Yanting Teng , Armando Angrisani , Zoë Holmes

Combustion kinetic modeling is an integral part of combustion simulation, and extensive studies have been devoted to developing both high fidelity and computationally affordable models. Despite these efforts, modeling combustion kinetics is…

We introduce ACEpotentials.jl, a Julia-language software package that constructs interatomic potentials from quantum mechanical reference data using the Atomic Cluster Expansion (Drautz, 2019). As the latter provides a complete description…

We propose a rank-$k$ variant of the classical Frank-Wolfe algorithm to solve convex optimization over a trace-norm ball. Our algorithm replaces the top singular-vector computation ($1$-SVD) in Frank-Wolfe with a top-$k$ singular-vector…

Machine Learning · Computer Science 2017-11-10 Zeyuan Allen-Zhu , Elad Hazan , Wei Hu , Yuanzhi Li

Integrating computational fluid dynamics (CFD) solvers into optimization and machine-learning frameworks is hampered by the rigidity of classic computational languages and the slow performance of more flexible high-level languages. In this…

Fluid Dynamics · Physics 2025-07-22 Gabriel D. Weymouth , Bernat Font

Decentralized learning has been studied intensively in recent years motivated by its wide applications in the context of federated learning. The majority of previous research focuses on the offline setting in which the objective function is…

Machine Learning · Computer Science 2022-11-01 Tuan-Anh Nguyen , Nguyen Kim Thang , Denis Trystram

Minimizing a function over an intersection of convex sets is an important task in optimization that is often much more challenging than minimizing it over each individual constraint set. While traditional methods such as Frank-Wolfe (FW) or…

Optimization and Control · Mathematics 2018-04-11 Gauthier Gidel , Fabian Pedregosa , Simon Lacoste-Julien

One of the beauties of the projected gradient descent method lies in its rather simple mechanism and yet stable behavior with inexact, stochastic gradients, which has led to its wide-spread use in many machine learning applications.…

Optimization and Control · Mathematics 2019-10-11 Mingrui Zhang , Zebang Shen , Aryan Mokhtari , Hamed Hassani , Amin Karbasi

MomentClosure.jl is a Julia package providing automated derivation of the time-evolution equations of the moments of molecule numbers for virtually any chemical reaction network using a wide range of moment closure approximations. It…

Molecular Networks · Quantitative Biology 2021-05-13 Augustinas Sukys , Ramon Grima

Owing to their low-complexity iterations, Frank-Wolfe (FW) solvers are well suited for various large-scale learning tasks. When block-separable constraints are present, randomized block FW (RB-FW) has been shown to further reduce complexity…

Optimization and Control · Mathematics 2017-11-22 Liang Zhang , Gang Wang , Daniel Romero , Georgios B. Giannakis

Structured constraints in Machine Learning have recently brought the Frank-Wolfe (FW) family of algorithms back in the spotlight. While the classical FW algorithm has poor local convergence properties, the Away-steps and Pairwise FW…

Optimization and Control · Mathematics 2022-09-09 Fabian Pedregosa , Geoffrey Negiar , Armin Askari , Martin Jaggi

We describe the development of a multi-purpose software for Bayesian statistical inference, BAT.jl, written in the Julia language. The major design considerations and implemented algorithms are summarized here, together with a test suite…

We introduce regularized Frank-Wolfe, a general and effective algorithm for inference and learning of dense conditional random fields (CRFs). The algorithm optimizes a nonconvex continuous relaxation of the CRF inference problem using…

Machine Learning · Computer Science 2022-09-09 Đ. Khuê Lê-Huu , Karteek Alahari

We present FreeBird, an extensible Julia-based platform for computational studies of phase equilibria at generic interfaces. The package supports a range of system configurations, from atomistic solid surfaces to coarse-grained…

Statistical Mechanics · Physics 2025-12-19 Ray Yang , Junchi Chen , Douglas Thibodeaux , Robert B. Wexler