English
Related papers

Related papers: Frank-Wolfe algorithm for learning SVM-type multi-…

200 papers

Conditional Gradient algorithms (aka Frank-Wolfe algorithms) form a classical set of methods for constrained smooth convex minimization due to their simplicity, the absence of projection steps, and competitive numerical performance. While…

Optimization and Control · Mathematics 2021-10-20 Thomas Kerdreux , Alexandre d'Aspremont , Sebastian Pokutta

We propose a novel generalization of the conditional gradient (CG / Frank-Wolfe) algorithm for minimizing a smooth function $f$ under an intersection of compact convex sets, using a first-order oracle for $\nabla f$ and linear minimization…

Optimization and Control · Mathematics 2024-10-11 Zev Woodstock , Sebastian Pokutta

Frank-Wolfe (FW) algorithms have been often proposed over the last few years as efficient solvers for a variety of optimization problems arising in the field of Machine Learning. The ability to work with cheap projection-free iterations and…

Machine Learning · Statistics 2015-10-27 Emanuele Frandi , Ricardo Nanculef , Stefano Lodi , Claudio Sartori , Johan A. K. Suykens

Support vector machine (SVM) is a particularly powerful and flexible supervised learning model that analyzes data for both classification and regression, whose usual algorithm complexity scales polynomially with the dimension of data space…

Machine Learning · Computer Science 2023-03-08 Chen Ding , Tian-Yi Bao , He-Liang Huang

The support vector machine (SVM) was originally designed for binary classifications. A lot of effort has been put to generalize the binary SVM to multiclass SVM (MSVM) which are more complex problems. Initially, MSVMs were solved by…

Machine Learning · Statistics 2015-12-01 Yangyang Xu , Ioannis Akrotirianakis , Amit Chakraborty

Discriminative clustering has been successfully applied to a number of weakly-supervised learning tasks. Such applications include person and action recognition, text-to-video alignment, object co-segmentation and colocalization in videos…

Computer Vision and Pattern Recognition · Computer Science 2017-07-31 Antoine Miech , Jean-Baptiste Alayrac , Piotr Bojanowski , Ivan Laptev , Josef Sivic

Projection-free optimization via different variants of the Frank-Wolfe (FW), a.k.a. Conditional Gradient method has become one of the cornerstones in optimization for machine learning since in many cases the linear minimization oracle is…

Optimization and Control · Mathematics 2020-06-30 Pavel Dvurechensky , Petr Ostroukhov , Kamil Safin , Shimrit Shtern , Mathias Staudigl

Metarounding is an approach to convert an approximation algorithm for linear optimization over some combinatorial classes to an online linear optimization algorithm for the same class. We propose a new metarounding algorithm under a natural…

Data Structures and Algorithms · Computer Science 2023-11-21 Ryotaro Mitsuboshi , Kohei Hatano , Eiji Takimoto

This paper showcases the theoretical and numerical performance of the Sliding Frank-Wolfe, which is a novel optimization algorithm to solve the BLASSO sparse spikes super-resolution problem. The BLASSO is a continuous (i.e. off-the-grid or…

Numerical Analysis · Mathematics 2018-11-16 Quentin Denoyelle , Vincent Duval , Gabriel Peyré , Emmanuel Soubies

We study a class of convex-concave saddle-point problems of the form $\min_x\max_y \langle Kx,y\rangle+f_{\cal{P}}(x)-h^\ast(y)$ where $K$ is a linear operator, $f_{\cal{P}}$ is the sum of a convex function $f$ with a Lipschitz-continuous…

Optimization and Control · Mathematics 2021-06-07 Vladimir Kolmogorov , Thomas Pock

We introduce an advanced, swift pattern recognition strategy for various multiple robotics during curve negotiation. This method, leveraging a sophisticated k-means clustering-enhanced Support Vector Machine algorithm, distinctly…

Robotics · Computer Science 2024-05-07 Rui Liu , Xuanzhen Xu , Yuwei Shen , Armando Zhu , Chang Yu , Tianjian Chen , Ye Zhang

The paper presents various modifications of the Frank-Wolfe algorithm in the equilibrium traffic assignment problem. The Beckman model is used as a model for experiments. In this article, first of all, attention is paid to the choice of the…

Optimization and Control · Mathematics 2024-03-11 Igor N. Ignashin , Demyan V. Yarmoshik

Model merging has emerged as a promising approach for multi-task learning (MTL), offering a data-efficient alternative to conventional fine-tuning. However, with the rapid development of the open-source AI ecosystem and the increasing…

Machine Learning · Computer Science 2025-10-01 Hao Mark Chen , Shell Xu Hu , Wayne Luk , Timothy Hospedales , Hongxiang Fan

This study proposes an airborne multisensor management algorithm for target tracking, taking each of multiple unmanned aircraft as a sensor. The purpose of the algorithm is to determine the configuration of the sensor deployment and to…

Multiagent Systems · Computer Science 2018-07-24 Youngjoo Kim , Hyochoong Bang

This paper analyzes the convergence rates of the {\it Frank-Wolfe } method for solving convex constrained multiobjective optimization. We establish improved convergence rates under different assumptions on the objective function, the…

Optimization and Control · Mathematics 2024-06-11 Douglas S. Gonçalves , Max L. N. Gonçalves , Jefferson G. Melo

Decentralized optimization algorithms have received much attention due to the recent advances in network information processing. However, conventional decentralized algorithms based on projected gradient descent are incapable of handling…

Optimization and Control · Mathematics 2018-08-29 Hoi-To Wai , Jean Lafond , Anna Scaglione , Eric Moulines

We develop parallel and distributed Frank-Wolfe algorithms; the former on shared memory machines with mini-batching, and the latter in a delayed update framework. Whenever possible, we perform computations asynchronously, which helps attain…

Machine Learning · Statistics 2016-02-16 Yu-Xiang Wang , Veeranjaneyulu Sadhanala , Wei Dai , Willie Neiswanger , Suvrit Sra , Eric P. Xing

The minimum volume enclosing ellipsoid (MVEE) problem is an optimization problem in the basis of many practical problems. This paper describes some new properties of this model and proposes a first-order oracle algorithm, the Adjusted…

Optimization and Control · Mathematics 2018-04-03 Jie Tao , Wei Zhang , Chao Lu

Considering the classification problem, we summarize the nonparallel support vector machines with the nonparallel hyperplanes to two types of frameworks. The first type constructs the hyperplanes separately. It solves a series of small…

Machine Learning · Computer Science 2021-06-28 Chun-Na Li , Yuan-Hai Shao , Huajun Wang , Yu-Ting Zhao , Ling-Wei Huang , Naihua Xiu , Nai-Yang Deng

Multivariate data analysis techniques have the potential to improve physics analyses in many ways. The common classification problem of signal/background discrimination is one example. The Support Vector Machine learning algorithm is a…

High Energy Physics - Experiment · Physics 2009-11-07 A. Vaiciulis