English
Related papers

Related papers: Sparsity-Constrained Linear Quadratic Regulation P…

200 papers

We propose a new concept named adaptive submodularity ratio to study the greedy policy for sequential decision making. While the greedy policy is known to perform well for a wide variety of adaptive stochastic optimization problems in…

Machine Learning · Computer Science 2019-04-25 Kaito Fujii , Shinsaku Sakaue

We study the optimization problem of choosing strings of finite length to maximize string submodular functions on string matroids, which is a broader class of problems than maximizing set submodular functions on set matroids. We provide a…

Data Structures and Algorithms · Computer Science 2023-09-08 Brandon Van Over , Bowen Li , Edwin K. P. Chong , Ali Pezeshki

We study sparse approximate solutions to convex optimization problems. It is known that in many engineering applications researchers are interested in an approximate solution of an optimization problem as a linear combination of elements…

Machine Learning · Statistics 2012-06-05 V. N. Temlyakov

The greedy algorithm for monotone submodular function maximization subject to cardinality constraint is guaranteed to approximate the optimal solution to within a $1-1/e$ factor. Although it is well known that this guarantee is essentially…

Data Structures and Algorithms · Computer Science 2022-02-15 Aviad Rubinstein , Junyao Zhao

Consider the problem of choosing a set of actions to optimize an objective function that is a real-valued polymatroid function subject to matroid constraints. The greedy strategy provides an approximate solution to the optimization problem,…

Optimization and Control · Mathematics 2018-05-24 Yajing Liu , Edwin K. P. Chong , Ali Pezeshki

Finding diverse solutions to optimization problems has been of practical interest for several decades, and recently enjoyed increasing attention in research. While submodular optimization has been rigorously studied in many fields, its…

Data Structures and Algorithms · Computer Science 2023-07-18 Anh Viet Do , Mingyu Guo , Aneta Neumann , Frank Neumann

For many optimization problems in machine learning, finding an optimal solution is computationally intractable and we seek algorithms that perform well in practice. Since computational intractability often results from pathological…

Machine Learning · Computer Science 2021-02-25 Eric Balkanski , Sharon Qian , Yaron Singer

The submodular maximization problem is widely applicable in many engineering problems where objectives exhibit diminishing returns. While this problem is known to be NP-hard for certain subclasses of objective functions, there is a greedy…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-07-01 Haoyuan Sun , David Grimsman , Jason R Marden

Weak submodularity is a natural relaxation of the diminishing return property, which is equivalent to submodularity. Weak submodularity has been used to show that many (monotone) functions that arise in practice can be efficiently maximized…

Data Structures and Algorithms · Computer Science 2020-09-24 Richard Santiago , Yuichi Yoshida

This work provides performance guarantees for the greedy solution of experimental design problems. In particular, it focuses on A- and E-optimal designs, for which typical guarantees do not apply since the mean-square error and the maximum…

Machine Learning · Computer Science 2018-02-01 Luiz F. O. Chamon , Alejandro Ribeiro

We consider the control of discrete-time linear dynamical systems using sparse inputs where we limit the number of active actuators at every time step. We develop an algorithm for determining a sparse actuator schedule that ensures the…

Systems and Control · Electrical Eng. & Systems 2024-07-02 Krishna Praveen V. S. Kondapi , Chandrasekhar Sriram , Geethu Joseph , Chandra R. Murthy

We study the following problem: Given a variable of interest, we would like to find a best linear predictor for it by choosing a subset of $k$ relevant variables obeying a matroid constraint. This problem is a natural generalization of…

Data Structures and Algorithms · Computer Science 2023-01-19 Theophile Thiery , Justin Ward

We study submodular maximization problems with matroid constraints, in particular, problems where the objective can be expressed via compositions of analytic and multilinear functions. We show that for functions of this form, the so-called…

Machine Learning · Computer Science 2024-12-17 Gözde Özcan , Armin Moharrer , Stratis Ioannidis

The Column Subset Selection Problem provides a natural framework for unsupervised feature selection. Despite being a hard combinatorial optimization problem, there exist efficient algorithms that provide good approximations. The drawback of…

Machine Learning · Computer Science 2018-04-13 Bruno Ordozgoiti , Alberto Mozo , Jesús García López de Lacalle

Considering the set cover problem, by modifying the approach that gives a logarithmic approximation guarantee for the greedy algorithm, we obtain an estimation of the greedy algorithm's accuracy for a particular input. We compare the…

Data Structures and Algorithms · Computer Science 2019-02-13 Alexander Prolubnikov

We study a pair of budget- and performance-constrained weak-submodular maximization problems. For computational efficiency, we explore the use of stochastic greedy algorithms which limit the search space via random sampling instead of the…

Optimization and Control · Mathematics 2026-03-06 Ege C. Kaya , Michael Hibbard , Takashi Tanaka , Ufuk Topcu , Abolfazl Hashemi

In many prediction problems, it is not uncommon that the number of variables used to construct a forecast is of the same order of magnitude as the sample size, if not larger. We then face the problem of constructing a prediction in the…

Statistics Theory · Mathematics 2016-02-08 Alessio Sancetta

We study the performance of the certainty equivalent controller on Linear Quadratic (LQ) control problems with unknown transition dynamics. We show that for both the fully and partially observed settings, the sub-optimality gap between the…

Optimization and Control · Mathematics 2019-06-25 Horia Mania , Stephen Tu , Benjamin Recht

We study the problem of incorporating risk while making combinatorial decisions under uncertainty. We formulate a discrete submodular maximization problem for selecting a set using Conditional-Value-at-Risk (CVaR), a risk metric commonly…

Robotics · Computer Science 2022-03-21 Lifeng Zhou , Pratap Tokekar

The problem of column subset selection has recently attracted a large body of research, with feature selection serving as one obvious and important application. Among the techniques that have been applied to solve this problem, the greedy…

Data Structures and Algorithms · Computer Science 2021-11-16 Jason Altschuler , Aditya Bhaskara , Gang Fu , Vahab Mirrokni , Afshin Rostamizadeh , Morteza Zadimoghaddam