English
Related papers

Related papers: Revisiting Decomposable Submodular Function Minimi…

200 papers

We develop a new method which extends Dynamic Mode Decomposition (DMD) to incorporate the effect of control to extract low-order models from high-dimensional, complex systems. DMD finds spatial-temporal coherent modes, connects local-linear…

Optimization and Control · Mathematics 2014-09-24 Joshua L. Proctor , Steven L. Brunton , J. Nathan Kutz

Symmetric submodular functions are an important family of submodular functions capturing many interesting cases including cut functions of graphs and hypergraphs. Maximization of such functions subject to various constraints receives little…

Data Structures and Algorithms · Computer Science 2016-04-19 Moran Feldman

We consider robust submodular maximization problems (RSMs), where given a set of $m$ monotone submodular objective functions, the robustness is with respect to the worst-case (scaled) objective function. The model we consider generalizes…

Optimization and Control · Mathematics 2023-06-12 Hsin-Yi Huang , Hao-Hsiang Wu , Simge Kucukyavuz

Submodular Functions are a special class of set functions, which generalize several information-theoretic quantities such as entropy and mutual information [1]. Submodular functions have subgradients and subdifferentials [2] and admit…

Discrete Mathematics · Computer Science 2020-07-01 Rishabh Iyer , Jeff Bilmes

Submodular functions, defined on continuous or discrete domains, arise in numerous applications. We study the minimization of the difference of two submodular (DS) functions, over both domains, extending prior work restricted to set…

Optimization and Control · Mathematics 2025-11-05 George Orfanides , Tim Hoheisel , Marwa El Halabi

Signal decomposition and multiscale signal analysis provide many useful tools for time-frequency analysis. We proposed a random feature method for analyzing time-series data by constructing a sparse approximation to the spectrogram. The…

Signal Processing · Electrical Eng. & Systems 2023-03-17 Nicholas Richardson , Hayden Schaeffer , Giang Tran

Reduced-order models have long been used to understand the behavior of nonlinear partial differential equations (PDEs). Naturally, reduced-order modeling techniques come at the price of computational accuracy for a decrease in computation…

Numerical Analysis · Mathematics 2023-07-26 Jovan Žigić

Dynamic mode decomposition (DMD) is a recently developed tool for the analysis of the behavior of complex dynamical systems. In this paper, we will propose an extension of DMD that exploits low-rank tensor decompositions of potentially…

Numerical Analysis · Mathematics 2019-08-14 Stefan Klus , Patrick Gelß , Sebastian Peitz , Christof Schütte

We extend the work of Narasimhan and Bilmes [30] for minimizing set functions representable as a difference between submodular functions. Similar to [30], our new algorithms are guaranteed to monotonically reduce the objective function at…

Data Structures and Algorithms · Computer Science 2013-08-27 Rishabh Iyer , Jeff Bilmes

This paper is concerned with the analysis of convergent sequential and parallel overlapping domain decomposition methods for the minimization of functionals formed by a discrepancy term with respect to data and a total variation constraint.…

Numerical Analysis · Mathematics 2009-05-15 Massimo Fornasier , Andreas Langer , Carola-Bibiane Schönlieb

Low-rank decomposition has emerged as a vital tool for enhancing parameter efficiency in neural network architectures, gaining traction across diverse applications in machine learning. These techniques significantly lower the number of…

Machine Learning · Computer Science 2025-03-18 Yiping Ji , Hemanth Saratchandran , Cameron Gordon , Zeyu Zhang , Simon Lucey

Submodular set-functions have many applications in combinatorial optimization, as they can be minimized and approximately maximized in polynomial time. A key element in many of the algorithms and analyses is the possibility of extending the…

Machine Learning · Computer Science 2016-02-24 Francis Bach

This paper bridges discrete and continuous optimization approaches for decomposable submodular function minimization, in both the standard and parametric settings. We provide improved running times for this problem by reducing it to a…

Data Structures and Algorithms · Computer Science 2021-03-08 Kyriakos Axiotis , Adam Karczmarz , Anish Mukherjee , Piotr Sankowski , Adrian Vladu

We consider a class of structured fractional minimization problems, in which the numerator part of the objective is the sum of a differentiable convex function and a convex non-smooth function, while the denominator part is a convex or…

Optimization and Control · Mathematics 2023-03-27 Ganzhao Yuan

Deep matrix factorizations (deep MFs) are recent unsupervised data mining techniques inspired by constrained low-rank approximations. They aim to extract complex hierarchies of features within high-dimensional datasets. Most of the loss…

Machine Learning · Computer Science 2023-01-26 Pierre De Handschutter , Nicolas Gillis

Submodular function minimization is well studied, and existing algorithms solve it exactly or up to arbitrary accuracy. However, in many applications, such as structured sparse learning or batch Bayesian optimization, the objective function…

Machine Learning · Computer Science 2022-03-10 Marwa El Halabi , Stefanie Jegelka

We consider the submodular function minimization (SFM) and the quadratic minimization problemsregularized by the Lov'asz extension of the submodular function. These optimization problemsare intimately related; for example,min-cut problems…

Optimization and Control · Mathematics 2018-02-07 K. S. Sesh Kumar , Francis Bach

In this paper, we propose the first exact algorithm for minimizing the difference of two submodular functions (D.S.), i.e., the discrete version of the D.C. programming problem. The developed algorithm is a branch-and-bound-based algorithm…

Data Structures and Algorithms · Computer Science 2011-08-23 Yoshinobu Kawahara , Takashi Washio

This paper considers inference for a function of a parameter vector in a partially identified model with many moment inequalities. This framework allows the number of moment conditions to grow with the sample size, possibly at exponential…

Statistics Theory · Mathematics 2018-07-02 Alexandre Belloni , Federico Bugni , Victor Chernozhukov

This two-part paper develops novel methodologies for using fractional programming (FP) techniques to design and optimize communication systems. Part I of this paper proposes a new quadratic transform for FP and treats its application for…

Information Theory · Computer Science 2018-05-09 Kaiming Shen , Wei Yu