中文
相关论文

相关论文: Deterministic and Stochastic Frank-Wolfe Recursion…

200 篇论文

We consider continuous-time dynamics for distributed optimization with set constraints in the paper. To handle the computational complexity of projection-based dynamics due to solving a general quadratic optimization subproblem with…

最优化与控制 · 数学 2022-06-24 Guanpu Chen , Peng Yi , Yiguang Hong , Jie Chen

Estimating causal effects from observational data is challenging due to selection bias, which leads to imbalanced covariate distributions across treatment groups. Propensity score-based weighting methods are widely used to address this…

机器学习 · 计算机科学 2025-08-08 Ahmad Saeed Khan , Erik Schaffernicht , Johannes Andreas Stork

We introduce a globally-convergent algorithm for optimizing the tree-reweighted (TRW) variational objective over the marginal polytope. The algorithm is based on the conditional gradient method (Frank-Wolfe) and moves pseudomarginals within…

机器学习 · 统计学 2015-11-26 Rahul G. Krishnan , Simon Lacoste-Julien , David Sontag

This paper studies the performative prediction problem where a learner aims to minimize the expected loss with a decision-dependent data distribution. Such setting is motivated when outcomes can be affected by the prediction model, e.g., in…

最优化与控制 · 数学 2024-05-24 Haitong Liu , Qiang Li , Hoi-To Wai

We propose a simple variant of the generalized Frank-Wolfe method for solving strongly convex composite optimization problems, by introducing an additional averaging step on the dual variables. We show that in this variant, one can choose a…

最优化与控制 · 数学 2022-10-27 Renbo Zhao , Qiuyun Zhu

Frank-Wolfe algorithms (FW) are popular first-order methods for solving constrained convex optimization problems that rely on a linear minimization oracle instead of potentially expensive projection-like oracles. Many works have identified…

最优化与控制 · 数学 2023-09-18 Elias Wirth , Thomas Kerdreux , Sebastian Pokutta

Recently the away-step Frank-Wolfe algoritm for constrained multiobjective optimization has been shown linear convergence rate over a polytope which is generated by finite points set. In this paper we design a decomposition-invariant…

最优化与控制 · 数学 2024-09-10 Zhuoxin Fan , Liping Tang

In this paper we consider Sparse Fourier Transform (SFT) algorithms for approximately computing the best $s$-term approximation of the Discrete Fourier Transform (DFT) $\mathbf{\hat{f}} \in \mathbb{C}^N$ of any given input vector…

数值分析 · 数学 2017-06-12 Sami Merhi , Ruochuan Zhang , Mark A. Iwen , Andrew Christlieb

The Frank-Wolfe method (a.k.a. conditional gradient algorithm) for smooth optimization has regained much interest in recent years in the context of large scale optimization and machine learning. A key advantage of the method is that it…

最优化与控制 · 数学 2015-08-17 Dan Garber , Elad Hazan

We present new results for the Frank-Wolfe method (also known as the conditional gradient method). We derive computational guarantees for arbitrary step-size sequences, which are then applied to various step-size rules, including simple…

最优化与控制 · 数学 2014-06-03 Robert M. Freund , Paul Grigas

This paper showcases the theoretical and numerical performance of the Sliding Frank-Wolfe, which is a novel optimization algorithm to solve the BLASSO sparse spikes super-resolution problem. The BLASSO is a continuous (i.e. off-the-grid or…

数值分析 · 数学 2018-11-16 Quentin Denoyelle , Vincent Duval , Gabriel Peyré , Emmanuel Soubies

We study the effects of constrained optimization formulations and Frank-Wolfe algorithms for obtaining interpretable neural network predictions. Reformulating the Rate-Distortion Explanations (RDE) method for relevance attribution as a…

机器学习 · 计算机科学 2022-02-01 Jan Macdonald , Mathieu Besançon , Sebastian Pokutta

This article is concerned with the numerical solution of subspace optimization problems, consisting of minimizing a smooth functional over the set of orthogonal projectors of fixed rank. Such problems are encountered in particular in…

数值分析 · 数学 2022-10-17 Eric Cancès , Gaspard Kemlin , Antoine Levitt

We study the Frank-Wolfe algorithm for minimizing a differentiable function with Lipschitz continuous gradient over a compact convex set. To extend classical complexity bounds to certain non-convex functions, we focus on the class of…

最优化与控制 · 数学 2025-07-24 R. Diaz Millan , Orizon Pereira Ferreira , Julien Ugon

In this paper, we focus on solving a distributed convex aggregative optimization problem in a network, where each agent has its own cost function which depends not only on its own decision variables but also on the aggregated function of…

最优化与控制 · 数学 2022-07-26 Tongyu Wang , Peng Yi

Memory is a key computational bottleneck when solving large-scale convex optimization problems such as semidefinite programs (SDPs). In this paper, we focus on the regime in which storing an $n\times n$ matrix decision variable is…

最优化与控制 · 数学 2021-08-25 Nimita Shinde , Vishnu Narayanan , James Saunderson

We study the convergence properties of the original and away-step Frank-Wolfe algorithms for linearly constrained stochastic optimization assuming the availability of unbiased objective function gradient estimates. The objective function is…

最优化与控制 · 数学 2025-04-08 Natthawut Boonsiriphatthanajaroen , Shane G. Henderson

When the nonconvex problem is complicated by stochasticity, the sample complexity of stochastic first-order methods may depend linearly on the problem dimension, which is undesirable for large-scale problems. In this work, we propose…

最优化与控制 · 数学 2024-10-01 Yue Xie , Jiawen Bi , Hongcheng Liu

Existing deterministic variational inference approaches for diffusion processes use simple proposals and target the marginal density of the posterior. We construct the variational process as a controlled version of the prior process and…

机器学习 · 计算机科学 2021-03-02 Christian Wildner , Heinz Koeppl

We consider the problem of learning a high-dimensional but low-rank matrix from a large-scale dataset distributed over several machines, where low-rankness is enforced by a convex trace norm constraint. We propose DFW-Trace, a distributed…

分布式、并行与集群计算 · 计算机科学 2018-05-15 Wenjie Zheng , Aurélien Bellet , Patrick Gallinari