English
Related papers

Related papers: Incremental-Decremental Maximization

200 papers

In this paper, we consider an adaptive approach to address optimization problems with uncertain cost parameters. Here, the decision maker selects an initial decision, observes the realization of the uncertain cost parameters, and then is…

Computational Complexity · Computer Science 2013-12-17 Ebrahim Nasrabadi , James B. Orlin

A differentially private selection algorithm outputs from a finite set the item that approximately maximizes a data-dependent quality function. The most widely adopted mechanisms tackling this task are the pioneering exponential mechanism…

Cryptography and Security · Computer Science 2022-08-05 Gonzalo Munilla Garrido , Florian Matthes

We develop a system-theoretic framework for the structured analysis of distributed optimization algorithms with decomposable cost functions. We model such algorithms as a network of interacting dynamical systems and derive tests for…

Optimization and Control · Mathematics 2026-04-14 Aron Karakai , Jaap Eising , Andrea Martinelli , Florian Dörfler

Optimization is an important module of modern machine learning applications. Tremendous efforts have been made to accelerate optimization algorithms. A common formulation is achieving a lower loss at a given time. This enables a…

Machine Learning · Computer Science 2025-05-29 Zhonglin Xie , Yiman Fong , Haoran Yuan , Zaiwen Wen

In this paper, we focus on applications in machine learning, optimization, and control that call for the resilient selection of a few elements, e.g. features, sensors, or leaders, against a number of adversarial denial-of-service attacks or…

Optimization and Control · Mathematics 2017-11-01 Vasileios Tzoumas , Konstantinos Gatsis , Ali Jadbabaie , George J. Pappas

In dynamic submodular maximization, the goal is to maintain a high-value solution over a sequence of element insertions and deletions with a fast update time. Motivated by large-scale applications and the fact that dynamic data often…

Data Structures and Algorithms · Computer Science 2024-03-11 Arpit Agarwal , Eric Balkanski

A water company decides to expand its network with a set of water lines, but it cannot build them all at once. However, it starts reaping benefits from a partial expansion. In what order should the company build the lines? We formalize a…

Optimization and Control · Mathematics 2022-07-27 J. Carlos Martinez Mori , Samitha Samaranayake

This paper explores numerical methods for solving a convex differentiable semi-infinite program. We introduce a primal-dual gradient method which performs three updates iteratively: a momentum gradient ascend step to update the constraint…

Optimization and Control · Mathematics 2024-07-23 Yao Yao , Qihang Lin , Tianbao Yang

New contributions in the field of iterative optimisation heuristics are often made in an iterative manner. Novel algorithmic ideas are not proposed in isolation, but usually as an extension of a preexisting algorithm. Although these…

Neural and Evolutionary Computing · Computer Science 2023-04-20 Diederick Vermetten , Fabio Caraffini , Anna V. Kononova , Thomas Bäck

We study the incremental knapsack problem, where one wishes to sequentially pack items into a knapsack whose capacity expands over a finite planning horizon, with the objective of maximizing time-averaged profits. While various…

Data Structures and Algorithms · Computer Science 2020-10-16 Ali Aouad , Danny Segev

In this paper we propose a general algorithmic framework for first-order methods in optimization in a broad sense, including minimization problems, saddle-point problems and variational inequalities. This framework allows to obtain many…

We study a cache network in which intermediate nodes equipped with caches can serve requests. We model the problem of jointly optimizing caching and routing decisions with link capacity constraints over an arbitrary network topology. This…

Networking and Internet Architecture · Computer Science 2023-02-07 Yuanyuan Li , Yuchao Zhang , Stratis Ioannidis , Jon Crowcroft

Submodular optimization generalizes many classic problems in combinatorial optimization and has recently found a wide range of applications in machine learning (e.g., feature engineering and active learning). For many large-scale…

Data Structures and Algorithms · Computer Science 2023-04-11 Matthew Fahrbach , Vahab Mirrokni , Morteza Zadimoghaddam

A recently introduced general-purpose heuristic for finding high-quality solutions for many hard optimization problems is reviewed. The method is inspired by recent progress in understanding far-from-equilibrium phenomena in terms of {\em…

Neural and Evolutionary Computing · Computer Science 2007-05-23 Stefan Boettcher , Allon G. Percus

A deterministic approximation algorithm is presented for the maximization of non-monotone submodular functions over a ground set of size $n$ subject to cardinality constraint $k$; the algorithm is based upon the idea of interlacing two…

Data Structures and Algorithms · Computer Science 2019-10-28 Alan Kuhnle

This paper provides an algorithmic framework for obtaining fast distributed algorithms for a highly-dynamic setting, in which *arbitrarily many* edge changes may occur in each round. Our algorithm significantly improves upon prior work in…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-10-13 Keren Censor-Hillel , Neta Dafni , Victor I. Kolobov , Ami Paz , Gregory Schwartzman

We consider learning of submodular functions from data. These functions are important in machine learning and have a wide range of applications, e.g. data summarization, feature selection and active learning. Despite their combinatorial…

Machine Learning · Statistics 2018-06-18 Sebastian Tschiatschek , Aytunc Sahin , Andreas Krause

We propose a decomposition framework for the parallel optimization of the sum of a differentiable {(possibly nonconvex)} function and a nonsmooth (possibly nonseparable), convex one. The latter term is usually employed to enforce structure…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-07-19 Amir Daneshmand , Francisco Facchinei , Vyacheslav Kungurtsev , Gesualdo Scutari

We consider the problem of maximizing a fractionally subadditive function under a knapsack constraint that grows over time. An incremental solution to this problem is given by an order in which to include the elements of the ground set, and…

Data Structures and Algorithms · Computer Science 2023-05-25 Yann Disser , Max Klimm , Annette Lutz , David Weckbecker

The optimization of dynamic problems is both widespread and difficult. When conducting dynamic optimization, a balance between reinitialization and computational expense has to be found. There are multiple approaches to this. In parallel…

Neural and Evolutionary Computing · Computer Science 2014-01-21 Ronald Hochreiter , Christoph Waldhauser