English
Related papers

Related papers: A Performance Bound for the Greedy Algorithm in a …

200 papers

Submodular optimization is a special class of combinatorial optimization arising in several machine learning problems, but also in cooperative control of complex systems. In this paper, we consider agents in an asynchronous, unreliable and…

Systems and Control · Computer Science 2018-12-17 Andrea Testa , Ivano Notarnicola , Giuseppe Notarstefano

Chance constraints are frequently used to limit the probability of constraint violations in real-world optimization problems where the constraints involve stochastic components. We study chance-constrained submodular optimization problems,…

Optimization and Control · Mathematics 2023-09-27 Xiankun Yan , Anh Viet Do , Feng Shi , Xiaoyu Qin , Frank Neumann

The total effective resistance, also called the Kirchhoff index, provides a robustness measure for a graph $G$. We consider two optimization problems of adding $k$ new edges to $G$ such that the resulting graph has minimal total effective…

Social and Information Networks · Computer Science 2023-09-18 Maria Predari , Lukas Berner , Robert Kooij , Henning Meyerhenke

In this paper, we study the non-monotone adaptive submodular maximization problem subject to a cardinality constraint. We first revisit the adaptive random greedy algorithm proposed in \citep{gotovos2015non}, where they show that this…

Machine Learning · Computer Science 2020-12-16 Shaojie Tang

We consider the bandit optimization problem with the reward function defined over graph-structured data. This problem has important applications in molecule design and drug discovery, where the reward is naturally invariant to graph…

Machine Learning · Computer Science 2022-10-13 Parnian Kassraie , Andreas Krause , Ilija Bogunovic

Utilizing the capabilities of configurable sensing systems requires addressing difficult information gathering problems. Near-optimal approaches exist for sensing systems without internal states. However, when it comes to optimizing the…

Systems and Control · Computer Science 2013-09-24 Nikolay Atanasov , Jerome Le Ny , Kostas Daniilidis , George J. Pappas

It was recently shown that a version of the greedy algorithm gives a construction of fault-tolerant spanners that is size-optimal, at least for vertex faults. However, the algorithm to construct this spanner is not polynomial-time, and the…

Data Structures and Algorithms · Computer Science 2020-05-26 Michael Dinitz , Caleb Robelle

Subset selection is an interesting and important topic in the field of evolutionary multi-objective optimization (EMO). Especially, in an EMO algorithm with an unbounded external archive, subset selection is an essential post-processing…

Neural and Evolutionary Computing · Computer Science 2021-09-23 Weiyu Chen , Hisao Ishibuchi , Ke Shang

Data-dependent greedy algorithms in kernel spaces are known to provide fast converging interpolants, while being extremely easy to implement and efficient to run. Despite this experimental evidence, no detailed theory has yet been…

Numerical Analysis · Mathematics 2022-10-31 Tizian Wenzel , Gabriele Santin , Bernard Haasdonk

In a model of network communication based on a random walk in an undirected graph, what subset of nodes (subject to constraints on the set size), enable the fastest spread of information? The dynamics of spread is described by a process…

Discrete Mathematics · Computer Science 2016-02-23 Fern Y. Hunt

Methods for solving PDEs using neural networks have recently become a very important topic. We provide an a priori error analysis for such methods which is based on the $\mathcal{K}_1(\mathbb{D})$-norm of the solution. We show that the…

Numerical Analysis · Mathematics 2022-07-15 Qingguo Hong , Jonathan W. Siegel , Jinchao Xu

We consider the problem of contextual bandits where actions are subsets of a ground set and mean rewards are modeled by an unknown monotone submodular function that belongs to a class $\mathcal{F}$. We allow time-varying matroid constraints…

Machine Learning · Computer Science 2021-12-07 Dean P. Foster , Alexander Rakhlin

In a standard NP-complete optimization problem we introduce an interpolating algorithm between the quick decrease along the gradient (greedy dynamics) and a slow decrease close to the level curves (reluctant dynamics). We find that for a…

Mathematical Physics · Physics 2007-05-23 P. Contucci , C. Giardina' , C. Giberti , F. Unguendoli , C. Vernia

We hypothesize that due to the greedy nature of learning in multi-modal deep neural networks, these models tend to rely on just one modality while under-fitting the other modalities. Such behavior is counter-intuitive and hurts the models'…

Machine Learning · Computer Science 2022-09-20 Nan Wu , Stanisław Jastrzębski , Kyunghyun Cho , Krzysztof J. Geras

We investigate the performance of m-th order consensus systems with stochastic external perturbations, where a subset of leader nodes incorporates absolute information into their control laws. The system performance is measured by its…

Optimization and Control · Mathematics 2019-06-13 Erika Mackin , Stacy Patterson

In the context of Gaussian conditioning, greedy algorithms iteratively select the most informative measurements, given an observed Gaussian random variable. However, the convergence analysis for conditioning Gaussian random variables…

Statistics Theory · Mathematics 2025-02-18 Daniel Winkle , Ingo Steinwart , Bernard Haasdonk

The greedy algorithm adapted from Kruskal's algorithm is an efficient and folklore way to produce a $k$-spanner with girth at least $k+2$. The greedy algorithm has shown to be `existentially optimal', while it's not `universally optimal'…

Data Structures and Algorithms · Computer Science 2024-11-05 Yeyuan Chen

For years, there has been interest in approximation methods for solving dynamic programming problems, because of the inherent complexity in computing optimal solutions characterized by Bellman's principle of optimality. A wide range of…

Optimization and Control · Mathematics 2020-06-18 Yajing Liu , Edwin Chong , Ali Pezeshki , Zhenliang Zhang

The selection problem of an optimal set of sensors estimating the snapshot of high-dimensional data is considered. The objective functions based on various criteria of optimal design are adopted to the greedy method: D-optimality,…

Signal Processing · Electrical Eng. & Systems 2021-04-09 Kumi Nakai , Keigo Yamada , Takayuki Nagata , Yuji Saito , Taku Nonomura

Greedy layer-wise or module-wise training of neural networks is compelling in constrained and on-device settings where memory is limited, as it circumvents a number of problems of end-to-end back-propagation. However, it suffers from a…

Machine Learning · Computer Science 2023-10-06 Skander Karkar , Ibrahim Ayed , Emmanuel de Bézenac , Patrick Gallinari