中文
相关论文

相关论文: Frank-Wolfe Network: An Interpretable Deep Structu…

200 篇论文

In this paper, we study the problem of speeding up a type of optimization algorithms called Frank-Wolfe, a conditional gradient method. We develop and employ two novel inner product search data structures, improving the prior fastest…

数据结构与算法 · 计算机科学 2022-07-20 Zhao Song , Zhaozhuo Xu , Yuanyuan Yang , Lichen Zhang

This paper showcases the theoretical and numerical performance of the Sliding Frank-Wolfe, which is a novel optimization algorithm to solve the BLASSO sparse spikes super-resolution problem. The BLASSO is a continuous (i.e. off-the-grid or…

数值分析 · 数学 2018-11-16 Quentin Denoyelle , Vincent Duval , Gabriel Peyré , Emmanuel Soubies

We study the linear convergence of variants of the Frank-Wolfe algorithms for some classes of strongly convex problems, using only affine-invariant quantities. As in Guelat & Marcotte (1986), we show the linear convergence of the standard…

最优化与控制 · 数学 2014-01-06 Simon Lacoste-Julien , Martin Jaggi

The Frank-Wolfe method (a.k.a. conditional gradient algorithm) for smooth optimization has regained much interest in recent years in the context of large scale optimization and machine learning. A key advantage of the method is that it…

最优化与控制 · 数学 2015-08-17 Dan Garber , Elad Hazan

Deep learning techniques have been successfully applied in many areas of computer vision, including low-level image restoration problems. For image super-resolution, several models based on deep neural networks have been recently proposed…

计算机视觉与模式识别 · 计算机科学 2015-10-16 Zhaowen Wang , Ding Liu , Jianchao Yang , Wei Han , Thomas Huang

As edge computing capabilities increase, model learning deployments in diverse edge environments have emerged. In experimental design networks, introduced recently, network routing and rate allocation are designed to aid the transfer of…

网络与互联网体系结构 · 计算机科学 2024-01-11 Yuanyuan Li , Lili Su , Carlee Joe-Wong , Edmund Yeh , Stratis Ioannidis

Frank--Wolfe methods avoid projections, but over curved feasible regions the full-space linear minimization oracle (LMO) can itself become the computational bottleneck. We introduce random-subspace Frank--Wolfe (RSFW), the first…

最优化与控制 · 数学 2026-05-26 Pierre-Louis Poirion , Sebastian Pokutta , Akiko Takeda

In this paper, we consider approximate Frank-Wolfe (FW) algorithms to solve convex optimization problems over graph-structured support sets where the linear minimization oracle (LMO) cannot be efficiently obtained in general. We first…

最优化与控制 · 数学 2022-06-20 Baojian Zhou , Yifan Sun

Networks are a unifying framework for modeling complex systems and network inference problems are frequently encountered in many fields. Here, I develop and apply a generative approach to network inference (RCweb) for the case when the…

机器学习 · 统计学 2014-07-01 Nikolai Slavov

We analyze two novel randomized variants of the Frank-Wolfe (FW) or conditional gradient algorithm. While classical FW algorithms require solving a linear minimization problem over the domain at each iteration, the proposed method only…

最优化与控制 · 数学 2018-03-21 Thomas Kerdreux , Fabian Pedregosa , Alexandre d'Aspremont

The problem of maximizing the $p$-th power of a $p$-norm over a halfspace-presented polytope in $\R^d$ is a convex maximization problem which plays a fundamental role in computational convexity. It has been shown in 1986 that this problem…

计算复杂性 · 计算机科学 2013-07-25 Christian Knauer , Stefan König , Daniel Werner

Frank-Wolfe algorithm (FW) and its variants have gained a surge of interests in machine learning community due to its projection-free property. Recently people have reduced the gradient evaluation complexity of FW algorithm to…

机器学习 · 统计学 2018-05-22 Yan Li , Chao Qu , Huan Xu

We revisit the Frank-Wolfe (FW) optimization under strongly convex constraint sets. We provide a faster convergence rate for FW without line search, showing that a previously overlooked variant of FW is indeed faster than the standard…

机器学习 · 计算机科学 2019-02-01 Jarrid Rector-Brooks , Jun-Kun Wang , Barzan Mozafari

Sparse representations of images are useful in many computer vision applications. Sparse coding with an $l_1$ penalty and a learned linear dictionary requires regularization of the dictionary to prevent a collapse in the $l_1$ norms of the…

计算机视觉与模式识别 · 计算机科学 2022-09-09 Katrina Evtimova , Yann LeCun

Training deep neural networks with an $L_0$ regularization is one of the prominent approaches for network pruning or sparsification. The method prunes the network during training by encouraging weights to become exactly zero. However,…

机器学习 · 计算机科学 2021-07-02 Yang Li , Shihao Ji

An extension of the Frank-Wolfe Algorithm (FWA), also known as Conditional Gradient algorithm, is proposed. In its standard form, the FWA allows to solve constrained optimization problems involving $\beta$-smooth cost functions, calling at…

最优化与控制 · 数学 2024-03-28 Guilherme Mazanti , Thibault Moquet , Laurent Pfeiffer

In this paper, we investigate a neural network-based learning approach towards solving an integer-constrained programming problem using very limited training. To be specific, we introduce a symmetric and decomposed neural network structure,…

机器学习 · 计算机科学 2020-11-30 Zhou Zhou , Shashank Jere , Lizhong Zheng , Lingjia Liu

This paper analyzes the convergence rates of the {\it Frank-Wolfe } method for solving convex constrained multiobjective optimization. We establish improved convergence rates under different assumptions on the objective function, the…

最优化与控制 · 数学 2024-06-11 Douglas S. Gonçalves , Max L. N. Gonçalves , Jefferson G. Melo

In this short paper we bridge two seemingly unrelated sparse approximation topics: continuous sparse coding and low-rank approximations. We show that for a specific choice of continuous dictionary, linear systems with nuclear-norm…

信息论 · 计算机科学 2020-09-15 Clement Elvira , Jeremy E. Cohen , Cedric Herzet , Remi Gribonval

To the best of our knowledge, there are no methods today for training differentially private regression models on sparse input data. To remedy this, we adapt the Frank-Wolfe algorithm for $L_1$ penalized linear regression to be aware of…

机器学习 · 计算机科学 2023-11-01 Edward Raff , Amol Khanna , Fred Lu