中文
相关论文

相关论文: New Variants of Frank-Wolfe Algorithm for Video Co…

200 篇论文

In this paper, we study optimization methods consisting of iteratively minimizing surrogates of an objective function. By proposing several algorithmic variants and simple convergence analyses, we make two main contributions. First, we…

机器学习 · 统计学 2013-05-15 Julien Mairal

The conditional gradient idea proposed by Marguerite Frank and Philip Wolfe in 1956 was so well received by the community that new algorithms (also called Frank--Wolfe type algorithms) are still being actively created. In this paper, we…

最优化与控制 · 数学 2023-05-26 Aleksandr Lobanov , Anton Anikin , Alexander Gasnikov , Alexander Gornov , Sergey Chukanov

We propose a new version of the Frank-Wolfe method, called the (L0, L1)-Frank-Wolfe algorithm, developed for optimization problems with (L0, L1)-smooth objectives. We establish that this algorithm achieves superior theoretical convergence…

最优化与控制 · 数学 2026-05-21 A. A. Vyguzov , F. S. Stonyakin

We address the problem of minimizing a convex smooth function $f(x)$ over a compact polyhedral set $D$ given a stochastic zeroth-order constraint feedback model. This problem arises in safety-critical machine learning applications, such as…

最优化与控制 · 数学 2019-12-10 Ilnura Usmanova , Andreas Krause , Maryam Kamgarpour

This paper focuses on convex constrained optimization problems, where the solution is subject to a convex inequality constraint. In particular, we aim at challenging problems for which both projection into the constrained domain and a…

最优化与控制 · 数学 2017-06-13 Tianbao Yang , Qihang Lin , Lijun Zhang

This paper presents a novel framework in which image cosegmentation and colocalization are cast into a single optimization problem that integrates information from low level appearance cues with that of high level localization cues in a…

计算机视觉与模式识别 · 计算机科学 2017-05-18 Abhishek Sharma

This paper showcases the theoretical and numerical performance of the Sliding Frank-Wolfe, which is a novel optimization algorithm to solve the BLASSO sparse spikes super-resolution problem. The BLASSO is a continuous (i.e. off-the-grid or…

数值分析 · 数学 2018-11-16 Quentin Denoyelle , Vincent Duval , Gabriel Peyré , Emmanuel Soubies

Deep neural networks is today one of the most popular choices in classification, regression and function approximation. However, the training of such deep networks is far from trivial as there are often millions of parameters to tune.…

机器学习 · 计算机科学 2020-06-09 Jakob Stigenberg

Learning a deep neural network requires solving a challenging optimization problem: it is a high-dimensional, non-convex and non-smooth minimization problem with a large number of terms. The current practice in neural network optimization…

机器学习 · 计算机科学 2021-02-23 Leonard Berrada , Andrew Zisserman , M. Pawan Kumar

The Frank-Wolfe method (a.k.a. conditional gradient algorithm) for smooth optimization has regained much interest in recent years in the context of large scale optimization and machine learning. A key advantage of the method is that it…

最优化与控制 · 数学 2015-08-17 Dan Garber , Elad Hazan

Object proposals for detecting moving or static video objects need to address issues such as speed, memory complexity and temporal consistency. We propose an efficient Video Object Proposal (VOP) generation method and show its efficacy in…

计算机视觉与模式识别 · 计算机科学 2016-01-22 Subarna Tripathi , Serge Belongie , Youngbae Hwang , Truong Nguyen

We study the convergence properties of the original and away-step Frank-Wolfe algorithms for linearly constrained stochastic optimization assuming the availability of unbiased objective function gradient estimates. The objective function is…

最优化与控制 · 数学 2025-04-08 Natthawut Boonsiriphatthanajaroen , Shane G. Henderson

We propose a rank-$k$ variant of the classical Frank-Wolfe algorithm to solve convex optimization over a trace-norm ball. Our algorithm replaces the top singular-vector computation ($1$-SVD) in Frank-Wolfe with a top-$k$ singular-vector…

机器学习 · 计算机科学 2017-11-10 Zeyuan Allen-Zhu , Elad Hazan , Wei Hu , Yuanzhi Li

This paper focuses on the problem of \emph{constrained} \emph{stochastic} optimization. A zeroth order Frank-Wolfe algorithm is proposed, which in addition to the projection-free nature of the vanilla Frank-Wolfe algorithm makes it gradient…

最优化与控制 · 数学 2019-02-20 Anit Kumar Sahu , Manzil Zaheer , Soummya Kar

This paper studies the empirical efficacy and benefits of using projection-free first-order methods in the form of Conditional Gradients, a.k.a. Frank-Wolfe methods, for training Neural Networks with constrained parameters. We draw…

机器学习 · 计算机科学 2020-10-22 Sebastian Pokutta , Christoph Spiegel , Max Zimmer

This work addresses the joint object discovery problem in videos while utilizing multiple object-related cues. In contrast to the usual spatial fusion approach, a novel appearance fusion approach is presented here. Specifically, this paper…

计算机视觉与模式识别 · 计算机科学 2020-07-21 Koteswar Rao Jerripothula

The Frank-Wolfe (FW) method is a popular algorithm for solving large-scale convex optimization problems appearing in structured statistical learning. However, the traditional Frank-Wolfe method can only be applied when the feasible region…

最优化与控制 · 数学 2021-10-11 Haoyue Wang , Haihao Lu , Rahul Mazumder

We propose a variant of the Frank-Wolfe algorithm for solving a class of sparse/low-rank optimization problems. Our formulation includes Elastic Net, regularized SVMs and phase retrieval as special cases. The proposed Primal-Dual Block…

机器学习 · 计算机科学 2019-06-07 Qi Lei , Jiacheng Zhuo , Constantine Caramanis , Inderjit S. Dhillon , Alexandros G. Dimakis

The optimal transport (OT) problem has been used widely for machine learning. It is necessary for computation of an OT problem to solve linear programming with tight mass-conservation constraints. These constraints prevent its application…

机器学习 · 计算机科学 2022-05-30 Takumi Fukunaga , Hiroyuki Kasai

Object recognition and localization are important tasks in computer vision. The focus of this work is the incorporation of contextual information in order to improve object recognition and localization. For instance, it is natural to expect…

计算机视觉与模式识别 · 计算机科学 2013-12-23 Samy Bengio , Jeff Dean , Dumitru Erhan , Eugene Ie , Quoc Le , Andrew Rabinovich , Jonathon Shlens , Yoram Singer