English
Related papers

Related papers: Corporate Needs You to Find the Difference: Revisi…

200 papers

We introduce a new approach to decomposable submodular function minimization (DSFM) that exploits incidence relations. Incidence relations describe which variables effectively influence the component functions, and when properly utilized,…

Machine Learning · Computer Science 2018-09-26 Pan Li , Olgica Milenkovic

Subspace segmentation or subspace learning is a challenging and complicated task in machine learning. This paper builds a primary frame and solid theoretical bases for the minimal subspace segmentation (MSS) of finite samples. Existence and…

Machine Learning · Computer Science 2019-09-10 Zhenyue Zhang , Yuqing Xia

Submodularity is a discrete domain functional property that can be interpreted as mimicking the role of the well-known convexity/concavity properties in the continuous domain. Submodular functions exhibit strong structure that lead to…

Signal Processing · Electrical Eng. & Systems 2023-07-19 Ehsan Tohidi , Rouhollah Amiri , Mario Coutino , David Gesbert , Geert Leus , Amin Karbasi

Continuous DR-submodular functions are a class of functions that satisfy the Diminishing Returns (DR) property, which implies that they are concave along non-negative directions. Existing works have studied monotone continuous DR-submodular…

Machine Learning · Computer Science 2022-05-31 Omid Sadeghi , Maryam Fazel

We address a large-scale and nonconvex optimization problem, involving an aggregative term. This term can be interpreted as the sum of the contributions of N agents to some common good, with N large. We investigate a relaxation of this…

Optimization and Control · Mathematics 2023-06-19 J. Frédéric Bonnans , Kang Liu , Nadia Oudjane , Laurent Pfeiffer , Cheng Wan

A wide variety of problems in machine learning, including exemplar clustering, document summarization, and sensor placement, can be cast as constrained submodular maximization problems. Unfortunately, the resulting submodular optimization…

Machine Learning · Computer Science 2015-04-23 Rafael da Ponte Barbosa , Alina Ene , Huy L. Nguyen , Justin Ward

Given a graph and an integer $k$, Densest $k$-Subgraph is the algorithmic task of finding the subgraph on $k$ vertices with the maximum number of edges. This is a fundamental problem that has been subject to intense study for decades, with…

Computational Complexity · Computer Science 2023-03-31 Chris Jones , Aaron Potechin , Goutham Rajendran , Jeff Xu

In this paper, we introduce a new class of nonsmooth convex functions called SOS-convex semialgebraic functions extending the recently proposed notion of SOS-convex polynomials. This class of nonsmooth convex functions covers many common…

Optimization and Control · Mathematics 2017-02-09 N. H. Chieu , J. W. Feng , W. Gao , G. Li , D. Wu

Feature selection (FS) is a fundamental challenge in machine learning, particularly for high-dimensional tabular data, where interpretability and computational efficiency are critical. Existing FS methods often cannot automatically detect…

Machine Learning · Computer Science 2026-04-22 Witold Wydmański , Marek Śmieja

A common problem with segmentation of medical images using neural networks is the difficulty to obtain a significant number of pixel-level annotated data for training. To address this issue, we proposed a semi-supervised segmentation…

Computer Vision and Pattern Recognition · Computer Science 2023-02-23 Ange Lou , Kareem Tawfik , Xing Yao , Ziteng Liu , Jack Noble

We extend the work of Narasimhan and Bilmes [30] for minimizing set functions representable as a dierence between submodular functions. Similar to [30], our new algorithms are guaranteed to monotonically reduce the objective function at…

Machine Learning · Computer Science 2014-08-12 Rishabh Iyer , Jeff A. Bilmes

Upper semicontinuous (usc) functions arise in the analysis of maximization problems, distributionally robust optimization, and function identification, which includes many problems of nonparametric statistics. We establish that every usc…

Optimization and Control · Mathematics 2019-07-09 Johannes O. Royset

Submodular functions are discrete analogs of convex functions, which have applications in various fields, including machine learning and computer vision. However, in large-scale applications, solving Submodular Function Minimization (SFM)…

Machine Learning · Statistics 2018-06-08 Weizhong Zhang , Bin Hong , Lin Ma , Wei Liu , Tong Zhang

In this paper, we propose the first exact algorithm for minimizing the difference of two submodular functions (D.S.), i.e., the discrete version of the D.C. programming problem. The developed algorithm is a branch-and-bound-based algorithm…

Data Structures and Algorithms · Computer Science 2011-08-23 Yoshinobu Kawahara , Takashi Washio

Optimization of DR-submodular functions has experienced a notable surge in significance in recent times, marking a pivotal development within the domain of non-convex optimization. Motivated by real-world scenarios, some recent works have…

Machine Learning · Computer Science 2024-01-18 Loay Mualem , Murad Tukan , Moran Fledman

We consider the maximization of a submodular objective function $f:2^U\to\mathbb{R}_{\geq 0}$, where the objective $f$ is not accessed as a value oracle but instead subject to noisy queries. We introduce a versatile adaptive sampling…

Data Structures and Algorithms · Computer Science 2024-04-11 Wenjing Chen , Shuo Xing , Victoria G. Crawford

This paper studies the computational complexity of a robust variant of a two-stage submodular minimization problem that we call Robust Submodular Minimizer. In this problem, we are given $k$ submodular functions~$f_1,\dots,f_k$ over a set…

Data Structures and Algorithms · Computer Science 2024-07-30 Naonori Kakimura , Ildikó Schlotter

The problem of maximizing non-negative submodular functions has been studied extensively in the last few years. However, most papers consider submodular set functions. Recently, several advances have been made for the more general case of…

Discrete Mathematics · Computer Science 2016-11-29 Corinna Gottschalk , Britta Peis

Many data-fitting applications require the solution of an optimization problem involving a sum of large number of functions of high dimensional parameter. Here, we consider the problem of minimizing a sum of $n$ functions over a convex…

Optimization and Control · Mathematics 2016-02-29 Farbod Roosta-Khorasani , Michael W. Mahoney

A broad class of convex optimization problems can be formulated as a semidefinite program (SDP), minimization of a convex function over the positive-semidefinite cone subject to some affine constraints. The majority of classical SDP solvers…

Optimization and Control · Mathematics 2019-10-30 Francesco Locatello , Alp Yurtsever , Olivier Fercoq , Volkan Cevher