English
Related papers

Related papers: Quadratic Decomposable Submodular Function Minimiz…

200 papers

For many applications in signal processing and machine learning, we are tasked with minimizing a large sum of convex functions subject to a large number of convex constraints. In this paper, we devise a new random projection method (RPM) to…

Optimization and Control · Mathematics 2024-04-08 Zhichun Yang , Fu-quan Xia , Kai Tu , Man-Chung Yue

The original simplicial method (OSM), a variant of the classic Kelley's cutting plane method, has been shown to converge to the minimizer of a composite convex and submodular objective, though no rate of convergence for this method was…

Optimization and Control · Mathematics 2018-12-19 Song Zhou , Swati Gupta , Madeleine Udell

In this work, we propose ultra-low-complexity design solutions for multi-group multicast beamforming in large-scale systems. For the quality-of-service (QoS) problem, by utilizing the optimal multicast beamforming structure obtained…

Information Theory · Computer Science 2023-04-17 Chong Zhang , Min Dong , Ben Liang

Submodular function minimization (SFM) is a fundamental and efficiently solvable problem class in combinatorial optimization with a multitude of applications in various fields. Surprisingly, there is only very little known about constraint…

Data Structures and Algorithms · Computer Science 2018-11-27 Martin Nägele , Benny Sudakov , Rico Zenklusen

We propose the first adversarially robust algorithm for monotone submodular maximization under single and multiple knapsack constraints with scalable implementations in distributed and streaming settings. For a single knapsack constraint,…

Data Structures and Algorithms · Computer Science 2019-05-08 Dmitrii Avdiukhin , Slobodan Mitrović , Grigory Yaroslavtsev , Samson Zhou

For a quadratic matrix polynomial dependent on parameters and a given tolerance $\epsilon > 0$, the minimization of the $\epsilon$-pseudospectral abscissa over the set of permissible parameter values is discussed, with applications in…

Numerical Analysis · Mathematics 2025-09-03 Volker Mehrmann , Emre Mengi

We study a general class of convex submodular optimization problems with indicator variables. Many applications such as the problem of inferring Markov random fields (MRFs) with a sparsity or robustness prior can be naturally modeled in…

Optimization and Control · Mathematics 2025-07-08 Andres Gomez , Shaoning Han

For the binary classification problem, a novel nonlinear kernel-free quadratic hyper-surface support vector machine with 0-1 loss function (QSSVM$_{0/1}$) is proposed. Specifically, the task of QSSVM$_{0/1}$ is to seek a quadratic…

Optimization and Control · Mathematics 2024-04-17 Mingyang Wu , Zhixia Yang , Junyou Ye

Nonnegative matrix factorization is the following problem: given a nonnegative input matrix $V$ and a factorization rank $K$, compute two nonnegative matrices, $W$ with $K$ columns and $H$ with $K$ rows, such that $WH$ approximates $V$ as…

Optimization and Control · Mathematics 2025-01-10 Valentin Leplat , Yurii Nesterov , Nicolas Gillis , François Glineur

Despite there being significant work on developing spectral, and metric embedding based approximation algorithms for hypergraph generalizations of conductance, little is known regarding the approximability of hypergraph partitioning…

Data Structures and Algorithms · Computer Science 2023-07-27 Antares Chen , Lorenzo Orecchia , Erasmo Tani

The stochastic subgradient method is a widely-used algorithm for solving large-scale optimization problems arising in machine learning. Often these problems are neither smooth nor convex. Recently, Davis et al. [1-2] characterized the…

Optimization and Control · Mathematics 2021-02-25 Shixiang Chen , Alfredo Garcia , Shahin Shahrampour

This paper considers stochastic convex optimization problems with two sets of constraints: (a) deterministic constraints on the domain of the optimization variable, which are difficult to project onto; and (b) deterministic or stochastic…

Optimization and Control · Mathematics 2022-05-25 Zeeshan Akhtar , Ketan Rajawat

Multi-access edge computing (MEC) and network function virtualization (NFV) are promising technologies to support emerging IoT applications, especially those computation-intensive. In NFV-enabled MEC environment, service function chain…

Artificial Intelligence · Computer Science 2022-05-23 Xinhan Wang , Huanlai Xing , Fuhong Song , Shouxi Luo , Penglin Dai , Bowen Zhao

Mirror descent (MD) is a powerful first-order optimization technique that subsumes several optimization algorithms including gradient descent (GD). In this work, we develop a semi-definite programming (SDP) framework to analyze the…

Optimization and Control · Mathematics 2022-01-19 Youbang Sun , Mahyar Fazlyab , Shahin Shahrampour

Symmetric nonnegative matrix factorization has found abundant applications in various domains by providing a symmetric low-rank decomposition of nonnegative matrices. In this paper we propose a Frank-Wolfe (FW) solver to optimize the…

Machine Learning · Computer Science 2018-06-27 Han Zhao , Geoff Gordon

A Semi-supervised Segmentation Fusion algorithm is proposed using consensus and distributed learning. The aim of Unsupervised Segmentation Fusion (USF) is to achieve a consensus among different segmentation outputs obtained from different…

Computer Vision and Pattern Recognition · Computer Science 2015-02-27 Mete Ozay

This paper considers the decentralized optimization problem of minimizing a finite sum of strongly convex and twice continuously differentiable functions over a fixed-connected undirected network. A fully decentralized primal-dual…

Optimization and Control · Mathematics 2024-10-02 Liping Wang , Hao Wu , Hongchao Zhang

We study the safe reinforcement learning problem with nonlinear function approximation, where policy optimization is formulated as a constrained optimization problem with both the objective and the constraint being nonconvex functions. For…

Machine Learning · Computer Science 2019-10-29 Ming Yu , Zhuoran Yang , Mladen Kolar , Zhaoran Wang

The matrix low-rank approximation problem with additional convex constraints can find many applications and has been extensively studied before. However, this problem is shown to be nonconvex and NP-hard; most of the existing solutions are…

Numerical Analysis · Computer Science 2015-12-08 Ying Zhang

Distributed consensus optimization has received considerable attention in recent years; several distributed consensus-based algorithms have been proposed for (nonsmooth) convex and (smooth) nonconvex objective functions. However, the…

Optimization and Control · Mathematics 2019-11-05 Vyacheslav Kungurtsev