English
Related papers

Related papers: The Power of Adaptivity for Stochastic Submodular …

200 papers

This work proposes an adaptive framework to solve a robust structural shape optimization problem governed by linear elasticity models that account for uncertainties in the loading and material inputs. A posteriori error estimators are…

Optimization and Control · Mathematics 2026-02-06 Oğuz Han Altıntaş , Hamdullah Yücel

Greedy algorithms are widely used for problems in machine learning such as feature selection and set function optimization. Unfortunately, for large datasets, the running time of even greedy algorithms can be quite high. This is because for…

Machine Learning · Statistics 2017-03-09 Rajiv Khanna , Ethan Elenberg , Alexandros G. Dimakis , Sahand Negahban , Joydeep Ghosh

We consider the problem of fitting variational posterior approximations using stochastic optimization methods. The performance of these approximations depends on (1) how well the variational family matches the true posterior…

Motivated by applications in machine learning, such as subset selection and data summarization, we consider the problem of maximizing a monotone submodular function subject to mixed packing and covering constraints. We present a tight…

Data Structures and Algorithms · Computer Science 2018-12-20 Eyal Mizrachi , Roy Schwartz , Joachim Spoerhase , Sumedha Uniyal

This paper develops an adaptive proximal alternating direction method of multipliers (ADMM) for solving linearly constrained, composite optimization problems under the assumption that the smooth component of the objective is weakly convex,…

Optimization and Control · Mathematics 2026-05-04 Leandro Farias Maia , David H. Gutman , Renato D. C. Monteiro , Gilson N. Silva

Context: Adaptive monitoring is a method used in a variety of domains for responding to changing conditions. It has been applied in different ways, from monitoring systems' customization to re-composition, in different application domains.…

Software Engineering · Computer Science 2018-09-05 Edith Zavala , Xavier Franch , Jordi Marco

We develop and analyze a set of new sequential simulation-optimization algorithms for large-scale multi-dimensional discrete optimization via simulation problems with a convexity structure. The "large-scale" notion refers to that the…

Optimization and Control · Mathematics 2022-01-20 Haixiang Zhang , Zeyu Zheng , Javad Lavaei

In this paper we study the problem of model reduction by moment matching for stochastic systems. We characterize the mathematical object which generalizes the notion of moment to stochastic differential equations and we find a class of…

Systems and Control · Electrical Eng. & Systems 2021-05-06 Giordano Scarciotti , Andrew R. Teel

In this paper, we study the classic submodular maximization problem subject to a group equality constraint under both non-adaptive and adaptive settings. It has been shown that the utility function of many machine learning applications,…

Machine Learning · Computer Science 2023-08-30 Shaojie Tang , Jing Yuan

A variety of large-scale machine learning problems can be cast as instances of constrained submodular maximization. Existing approaches for distributed submodular maximization have a critical drawback: The capacity - number of instances…

Machine Learning · Statistics 2016-06-01 Mario Lucic , Olivier Bachem , Morteza Zadimoghaddam , Andreas Krause

We consider the problem of covering multiple submodular constraints. Given a finite ground set $N$, a cost function $c: N \rightarrow \mathbb{R}_+$, $r$ monotone submodular functions $f_1,f_2,\ldots,f_r$ over $N$ and requirements…

Data Structures and Algorithms · Computer Science 2025-09-04 Tanvi Bajpai , Chandra Chekuri , Pooja Kulkarni

We introduce the Adaptive Skills, Adaptive Partitions (ASAP) framework that (1) learns skills (i.e., temporally extended actions or options) as well as (2) where to apply them. We believe that both (1) and (2) are necessary for a truly…

Machine Learning · Computer Science 2016-06-08 Daniel J. Mankowitz , Timothy A. Mann , Shie Mannor

Adaptive robust optimization problems have received significant attention in recent years, but remain notoriously difficult to solve when recourse decisions are discrete in nature. In this paper, we propose new reformulation techniques for…

Optimization and Control · Mathematics 2024-03-29 Merve Bodur , Timothy C. Y. Chan , Ian Yihang Zhu

Adaptive networks have the capability to pursue solutions of global stochastic optimization problems by relying only on local interactions within neighborhoods. The diffusion of information through repeated interactions allows for globally…

Multiagent Systems · Computer Science 2021-03-30 Stefan Vlaski , Ali H. Sayed

We propose a new method to design adaptation algorithms that guarantee a certain prescribed level of performance and are applicable to systems with nonconvex parameterization. The main idea behind the method is, given the desired…

Optimization and Control · Mathematics 2007-05-23 I. Y. Tyukin , D. V. Prokhorov , Cees van Leeuwen

Consider a kidney-exchange application where we want to find a max-matching in a random graph. To find whether an edge $e$ exists, we need to perform an expensive test, in which case the edge $e$ appears independently with a \emph{known}…

Data Structures and Algorithms · Computer Science 2019-02-07 Domagoj Bradac , Sahil Singla , Goran Zuzic

The problem of searching for an unknown object occurs in important applications ranging from security, medicine and defense. Sensors with the capability to process information rapidly require adaptive algorithms to control their search in…

Information Theory · Computer Science 2015-08-18 Huanyu Ding , David A. Castañón

Balkanski and Singer [5] recently initiated the study of adaptivity (or parallelism) for constrained submodular function maximization, and studied the setting of a cardinality constraint. Very recent improvements for this problem by…

Data Structures and Algorithms · Computer Science 2018-11-20 Chandra Chekuri , Kent Quanrud

We study the worst-case adaptive optimization problem with budget constraint that is useful for modeling various practical applications in artificial intelligence and machine learning. We investigate the near-optimality of greedy algorithms…

Artificial Intelligence · Computer Science 2017-05-24 Nguyen Viet Cuong , Huan Xu

This paper is devoted to a new modification of a recently proposed adaptive stochastic mirror descent algorithm for constrained convex optimization problems in the case of several convex functional constraints. Algorithms, standard and its…

Optimization and Control · Mathematics 2020-01-22 Mohammad S. Alkousa