English
Related papers

Related papers: On Minimization of a Quadratic Binary Functional

200 papers

We present a practical and powerful new framework for both unconstrained and constrained submodular function optimization based on discrete semidifferentials (sub- and super-differentials). The resulting algorithms, which repeatedly compute…

Data Structures and Algorithms · Computer Science 2013-08-13 Rishabh Iyer , Stefanie Jegelka , Jeff Bilmes

We consider a class of distributed submodular maximization problems in which each agent must choose a single strategy from its strategy set. The global objective is to maximize a submodular function of the strategies chosen by each agent.…

Data Structures and Algorithms · Computer Science 2017-06-14 Bahman Gharesifard , Stephen L. Smith

We provide theoretical bounds on the worst case performance of the greedy algorithm in seeking to maximize a normalized, monotone, but not necessarily submodular objective function under a simple partition matroid constraint. We also…

Systems and Control · Electrical Eng. & Systems 2022-10-19 Benjamin Biggs , James McMahon , Philip Baldoni , Daniel J. Stilwell

We address the problem of minimizing a convex function over the space of large matrices with low rank. While this optimization problem is hard in general, we propose an efficient greedy algorithm and derive its formal approximation…

Machine Learning · Computer Science 2011-06-09 Shai Shalev-Shwartz , Alon Gonen , Ohad Shamir

Migration presents sweeping societal challenges that have recently attracted significant attention from the scientific community. One of the prominent approaches that have been suggested employs optimization and machine learning to match…

Computer Science and Game Theory · Computer Science 2019-11-20 Paul Gölz , Ariel D. Procaccia

In this note we study multiple-ratio fractional 0--1 programs, a broad class of NP-hard combinatorial optimization problems. In particular, under some relatively mild assumptions we provide a complete characterization of the conditions,…

Optimization and Control · Mathematics 2020-12-15 Shaoning Han , Andres Gomez , Oleg A Prokopyev

Many algorithms for maximizing a monotone submodular function subject to a knapsack constraint rely on the natural greedy heuristic. We present a novel refined analysis of this greedy heuristic which enables us to: $(1)$ reduce the…

Data Structures and Algorithms · Computer Science 2021-03-16 Ariel Kulik , Roy Schwartz , Hadas Shachnai

Submodular maximization has been widely studied over the past decades, mostly because of its numerous applications in real-world problems. It is well known that the standard greedy algorithm guarantees a worst-case approximation factor of…

Data Structures and Algorithms · Computer Science 2020-02-12 Alfredo Torrico , Mohit Singh , Sebastian Pokutta

We consider learning of submodular functions from data. These functions are important in machine learning and have a wide range of applications, e.g. data summarization, feature selection and active learning. Despite their combinatorial…

Machine Learning · Statistics 2018-06-18 Sebastian Tschiatschek , Aytunc Sahin , Andreas Krause

The problem of finding out the global minimum of a multiextremal functional is discussed. One frequently faces with such a functional in various applications. We propose a procedure, which depends on the dimensionality of the problem…

Neural and Evolutionary Computing · Computer Science 2007-05-23 L. B. Litinskii , B. M. Magomedov

We study the worst-case adaptive optimization problem with budget constraint that is useful for modeling various practical applications in artificial intelligence and machine learning. We investigate the near-optimality of greedy algorithms…

Artificial Intelligence · Computer Science 2017-05-24 Nguyen Viet Cuong , Huan Xu

Marginal optima are minima or maxima of a function with many nearly flat directions. In settings with many competing optima, marginal ones tend to attract algorithms and physical dynamics. Often, the important family of marginal attractors…

Disordered Systems and Neural Networks · Physics 2024-12-03 Jaron Kent-Dobias

Submodular functions and their optimization have found applications in diverse settings ranging from machine learning and data mining to game theory and economics. In this work, we consider the constrained maximization of a submodular…

Data Structures and Algorithms · Computer Science 2025-07-15 Moran Feldman , Alan Kuhnle

Motivated by, e.g., sensitivity analysis and end-to-end learning, the demand for differentiable optimization algorithms has been significantly increasing. In this paper, we establish a theoretically guaranteed versatile framework that makes…

Data Structures and Algorithms · Computer Science 2020-06-15 Shinsaku Sakaue

We analyze the performance of the greedy algorithm, and also a discrete semi-gradient based algorithm, for maximizing the sum of a suBmodular and suPermodular (BP) function (both of which are non-negative monotone non-decreasing) under two…

Discrete Mathematics · Computer Science 2018-01-24 Wenruo Bai , Jeffrey A. Bilmes

We introduce a new convex optimization problem, termed quadratic decomposable submodular function minimization. The problem is closely related to decomposable submodular function minimization and arises in many learning on graphs and…

Machine Learning · Computer Science 2018-10-12 Pan Li , Niao He , Olgica Milenkovic

Greedy algorithms are a fundamental category of algorithms in mathematics and computer science, characterized by their iterative, locally optimal decision-making approach, which aims to find global optima. In this review, we will discuss…

Functional Analysis · Mathematics 2024-12-09 Andrea García

A number of scientific fields rely on placing permanent magnets in order to produce a desired magnetic field. We have shown in recent work that the placement process can be formulated as sparse regression. However, binary, grid-aligned…

Plasma Physics · Physics 2023-02-15 Alan A. Kaptanoglu , Rory Conlin , Matt Landreman

In many prediction problems, it is not uncommon that the number of variables used to construct a forecast is of the same order of magnitude as the sample size, if not larger. We then face the problem of constructing a prediction in the…

Statistics Theory · Mathematics 2016-02-08 Alessio Sancetta

Common computational problems, such as parameter estimation in dynamic models and PDE constrained optimization, require data fitting over a set of auxiliary parameters subject to physical constraints over an underlying state. Naive…

Optimization and Control · Mathematics 2017-09-19 Aleksandr Y. Aravkin , Dmitriy Drusvyatskiy , Tristan van Leeuwen