English
Related papers

Related papers: A note on the Minimum Norm Point algorithm

200 papers

For many optimization problems in machine learning, finding an optimal solution is computationally intractable and we seek algorithms that perform well in practice. Since computational intractability often results from pathological…

Machine Learning · Computer Science 2021-02-25 Eric Balkanski , Sharon Qian , Yaron Singer

Submodular optimization is a fundamental problem with many applications in machine learning, often involving decision-making over datasets with sensitive attributes such as gender or age. In such settings, it is often desirable to produce a…

Machine Learning · Computer Science 2024-07-09 Wenjing Chen , Shuo Xing , Samson Zhou , Victoria G. Crawford

Submodularity in combinatorial optimization has been a topic of many studies and various algorithmic techniques exploiting submodularity of a studied problem have been proposed. It is therefore natural to ask, in cases where the cost…

Data Structures and Algorithms · Computer Science 2023-05-19 Martin Böhm , Jarosław Byrka , Mateusz Lewandowski , Jan Marcinkowski

This paper proposes several novel optimization algorithms for minimizing a nonlinear objective function. The algorithms are enlightened by the optimal state trajectory of an optimal control problem closely related to the minimized objective…

Optimization and Control · Mathematics 2025-04-01 Hongxia Wang , Yeming Xu , Ziyuan Guo , Huanshui Zhang

Submodular functions can be exactly minimized in polynomial time, and the special case that graph cuts solve with max flow \cite{KZ:PAMI04} has had significant impact in computer vision \cite{BVZ:PAMI01,Kwatra:SIGGRAPH03,Rother:GrabCut04}.…

Computer Vision and Pattern Recognition · Computer Science 2013-10-02 Alexander Fix , Thorsten Joachims , Sam Park , Ramin Zabih

We study the problem of maximizing a function that is approximately submodular under a cardinality constraint. Approximate submodularity implicitly appears in a wide range of applications as in many cases errors in evaluation of a…

Data Structures and Algorithms · Computer Science 2024-11-19 Thibaut Horel , Yaron Singer

A novel neural network (NN) approach is proposed for constrained optimization. The proposed method uses a specially designed NN architecture and training/optimization procedure called Neural Optimization Machine (NOM). The objective…

Machine Learning · Statistics 2022-08-10 Jie Chen , Yongming Liu

We introduce a new class of functions that can be minimized in polynomial time in the value oracle model. These are functions $f$ satisfying $f(x)+f(y)\ge f(x \sqcap y)+f(x \sqcup y)$ where the domain of each variable $x_i$ corresponds to…

Discrete Mathematics · Computer Science 2011-04-15 Vladimir Kolmogorov

Submodular functions are a broad class of set functions, which naturally arise in diverse areas. Many algorithms have been suggested for the maximization of these functions. Unfortunately, once the function deviates from submodularity, the…

Discrete Mathematics · Computer Science 2017-07-17 Lin Chen , Moran Feldman , Amin Karbasi

We consider the minimum-norm-point (MNP) problem over polyhedra, a well-studied problem that encompasses linear programming. We present a general algorithmic framework that combines two fundamental approaches for this problem: active set…

Optimization and Control · Mathematics 2023-08-15 Satoru Fujishige , Tomonari Kitahara , László A. Végh

Several large-scale machine learning tasks, such as data summarization, can be approached by maximizing functions that satisfy submodularity. These optimization problems often involve complex side constraints, imposed by the underlying…

Data Structures and Algorithms · Computer Science 2021-02-15 Francesco Quinzan , Vanja Doskoč , Andreas Göbel , Tobias Friedrich

The submodular partitioning problem asks to minimize, over all partitions $P$ of a ground set $V$, the sum of a given submodular function $f$ over the parts of $P$. The problem has seen considerable work in approximability, as it…

Data Structures and Algorithms · Computer Science 2025-07-03 Kristóf Bérczi , Karthekeyan Chandrasekaran , Tamás Király , Daniel P. Szabo

Submodular function maximization is a fundamental combinatorial optimization problem with plenty of applications -- including data summarization, influence maximization, and recommendation. In many of these problems, the goal is to find a…

Data Structures and Algorithms · Computer Science 2023-09-04 Yanhao Wang , Yuchen Li , Francesco Bonchi , Ying Wang

In this paper, we consider two variants of the concept of sharp minimum for mathematical programming problems with quasiconvex objective function and inequality constraints. It investigated the problem of describing a variant of a simple…

Optimization and Control · Mathematics 2023-12-29 S. M. Puchinin , E. R. Korolkov , F. S. Stonyakin , M. S. Alkousa , A. A Vyguzov

Set function optimization is essential in AI and machine learning. We focus on a subadditive set function that generalizes submodularity, and examine the subadditivity of non-submodular functions. We also deal with a minimax subadditive…

Data Structures and Algorithms · Computer Science 2019-08-27 Kiyohito Nagano , Akihiro Kishimoto

We give an improved branch-and-bound solver for the multiterminal cut problem, based on the recent work of Henzinger et al.. We contribute new, highly effective data reduction rules to transform the graph into a smaller equivalent instance.…

Data Structures and Algorithms · Computer Science 2020-04-27 Monika Henzinger , Alexander Noe , Christian Schulz

We study the worst-case adaptive optimization problem with budget constraint that is useful for modeling various practical applications in artificial intelligence and machine learning. We investigate the near-optimality of greedy algorithms…

Artificial Intelligence · Computer Science 2017-05-24 Nguyen Viet Cuong , Huan Xu

Submodular maximization has been widely studied over the past decades, mostly because of its numerous applications in real-world problems. It is well known that the standard greedy algorithm guarantees a worst-case approximation factor of…

Data Structures and Algorithms · Computer Science 2020-02-12 Alfredo Torrico , Mohit Singh , Sebastian Pokutta

We consider the problem of selecting a minimum size subset of nodes in a network, that allows to activate all the nodes of the network. We present a fast and simple algorithm that, in real-life networks, produces solutions that outperform…

Data Structures and Algorithms · Computer Science 2016-10-18 Gennaro Cordasco , Luisa Gargano , Adele Anna Rescigno

Solving stochastic optimization problems under partial observability, where one needs to adaptively make decisions with uncertain outcomes, is a fundamental but notoriously difficult challenge. In this paper, we introduce the concept of…

Machine Learning · Computer Science 2017-12-07 Daniel Golovin , Andreas Krause