English
Related papers

Related papers: Sequential Kernel Herding: Frank-Wolfe Optimizatio…

200 papers

The Conditional Gradient (or Frank-Wolfe) method is one of the most well-known methods for solving constrained optimization problems appearing in various machine learning tasks. The simplicity of iteration and applicability to many…

Optimization and Control · Mathematics 2024-09-17 Ruslan Nazykov , Aleksandr Shestakov , Vladimir Solodkin , Aleksandr Beznosikov , Gauthier Gidel , Alexander Gasnikov

Sampling problems are widely regarded as the task for which quantum computers can most readily provide a quantum advantage. Leveraging this feature, the quantum-enhanced Markov chain Monte Carlo [Layden, D. et al., Nature 619, 282-287…

Quantum Physics · Physics 2026-02-26 Yuichiro Nakano , Ken N. Okada , Keisuke Fujii

Current gate-based quantum computers have the potential to provide a computational advantage if algorithms use quantum hardware efficiently. To make combinatorial optimization more efficient, we introduce the Filtering Variational Quantum…

Random feature approximation is arguably one of the most popular techniques to speed up kernel methods in large scale algorithms and provides a theoretical approach to the analysis of deep neural networks. We analyze generalization…

Machine Learning · Computer Science 2023-08-30 Mike Nguyen , Nicole Mücke

We present an extension of many-body downfolding methods to reduce the resources required in the quantum phase estimation (QPE) algorithm. In this paper, we focus on the Schrieffer--Wolff (SW) transformation of the electronic Hamiltonians…

Quantum Physics · Physics 2022-11-22 Karol Kowalski , Nicholas P. Bauman

This work proposes a new algorithm for training a re-weighted L2 Support Vector Machine (SVM), inspired on the re-weighted Lasso algorithm of Cand\`es et al. and on the equivalence between Lasso and SVM shown recently by Jaggi. In…

Machine Learning · Computer Science 2018-04-16 Carlos M. Alaíz , Johan A. K. Suykens

The co-localization problem is a model that simultaneously localizes objects of the same class within a series of images or videos. In \cite{joulin2014efficient}, authors present new variants of the Frank-Wolfe algorithm (aka conditional…

Computer Vision and Pattern Recognition · Computer Science 2023-07-11 Hamid Nazari

Frank-Wolfe (FW) algorithms have been often proposed over the last few years as efficient solvers for a variety of optimization problems arising in the field of Machine Learning. The ability to work with cheap projection-free iterations and…

Machine Learning · Statistics 2015-10-27 Emanuele Frandi , Ricardo Nanculef , Stefano Lodi , Claudio Sartori , Johan A. K. Suykens

We propose a simple iterative algorithm to construct the optimal multi-configuration approximation of an $N$-fermion wave function. That is, $M\geq N $ single-particle orbitals are sought iteratively so that the projection of the given wave…

Quantum Physics · Physics 2014-01-10 J. M. Zhang , Marcus Kollar

The Frank-Wolfe method and its extensions are well-suited for delivering solutions with desirable structural properties, such as sparsity or low-rank structure. We introduce a new variant of the Frank-Wolfe method that combines Frank-Wolfe…

Optimization and Control · Mathematics 2019-06-11 Paul Grigas , Alfonso Lobos , Nathan Vermeersch

A broad class of convex optimization problems can be formulated as a semidefinite program (SDP), minimization of a convex function over the positive-semidefinite cone subject to some affine constraints. The majority of classical SDP solvers…

Optimization and Control · Mathematics 2019-10-30 Francesco Locatello , Alp Yurtsever , Olivier Fercoq , Volkan Cevher

The stochastic Frank-Wolfe method has recently attracted much general interest in the context of optimization for statistical and machine learning due to its ability to work with a more general feasible region. However, there has been a…

Optimization and Control · Mathematics 2019-11-06 Haihao Lu , Robert M. Freund

We present a new step-size strategy based on the secant method for Frank-Wolfe algorithms. This strategy, which requires mild assumptions about the function under consideration, can be applied to any Frank-Wolfe algorithm. It is as…

Optimization and Control · Mathematics 2025-06-11 Deborah Hendrych , Mathieu Besançon , David Martínez-Rubio , Sebastian Pokutta

The Frank-Wolfe method is a popular method in sparse constrained optimization, due to its fast per-iteration complexity. However, the tradeoff is that its worst case global convergence is comparatively slow, and importantly, is…

Optimization and Control · Mathematics 2022-05-25 Zhaoyue Chen , Yifan Sun

We study the approximation of expectations $\E(f(X))$ for Gaussian random elements $X$ with values in a separable Hilbert space $H$ and Lipschitz continuous functionals $f \colon H \to \R$. We consider restricted Monte Carlo algorithms,…

Numerical Analysis · Mathematics 2018-02-15 Michael B. Giles , Mario Hefter , Lukas Mayer , Klaus Ritter

The article presents a study of the Particle Swarm optimization method for scheduling problem. To improve the method's performance a restriction of particles' velocity and an evolutionary meta-optimization were realized. The approach…

Neural and Evolutionary Computing · Computer Science 2020-06-22 Pavel Matrenin , Viktor Sekaev

Mixed-integer nonlinear optimization encompasses a broad class of problems that present both theoretical and computational challenges. We propose a new type of method to solve these problems based on a branch-and-bound algorithm with convex…

Optimization and Control · Mathematics 2024-07-19 Deborah Hendrych , Hannah Troppens , Mathieu Besançon , Sebastian Pokutta

Decentralized optimization algorithms have received much attention due to the recent advances in network information processing. However, conventional decentralized algorithms based on projected gradient descent are incapable of handling…

Optimization and Control · Mathematics 2018-08-29 Hoi-To Wai , Jean Lafond , Anna Scaglione , Eric Moulines

Algorithms based on Monte-Carlo sampling have been widely adapted in robotics and other areas of engineering due to their performance robustness. However, these sampling-based approaches have high computational requirements, making them…

Robotics · Computer Science 2020-07-16 Yanqi Liu , Giuseppe Calderoni , R. Iris Bahar

We present a novel algorithm to estimate the barycenter of arbitrary probability distributions with respect to the Sinkhorn divergence. Based on a Frank-Wolfe optimization strategy, our approach proceeds by populating the support of the…

Machine Learning · Statistics 2019-06-04 Giulia Luise , Saverio Salzo , Massimiliano Pontil , Carlo Ciliberto