English
Related papers

Related papers: Average-Case Performance of Rollout Algorithms for…

200 papers

The design of online algorithms has tended to focus on algorithms with worst-case guarantees, e.g., bounds on the competitive ratio. However, it is well-known that such algorithms are often overly pessimistic, performing sub-optimally on…

Data Structures and Algorithms · Computer Science 2020-12-11 Ali Zeynali , Bo Sun , Mohammad Hajiesmaili , Adam Wierman

We develop a novel mathematical programming approximation framework to tackle the stochastic knapsack problem. In this problem, the decision maker considers items for which either weights or values, or both, are random. The aim is to select…

Optimization and Control · Mathematics 2025-12-18 Roberto Rossi , Steven D. Prestwich , S. Armagan Tarim

This paper concerns rollout and certainty-equivalent rollout policies for stochastic shortest path problems with absorbing terminal states. The main result provides a direct non-asymptotic performance certificate for a fixed rollout policy:…

Optimization and Control · Mathematics 2026-05-25 Anders Hansson , Bo Wahlberg

Many problems in signal processing and machine learning can be formalized as weak submodular optimization tasks. For such problems, a simple greedy algorithm (\textsc{Greedy}) is guaranteed to find a solution achieving the objective with a…

Discrete Mathematics · Computer Science 2021-11-24 Abolfazl Hashemi , Haris Vikalo , Gustavo de Veciana

We consider a selfish variant of the knapsack problem. In our version, the items are owned by agents, and each agent can misrepresent the set of items she owns---either by avoiding reporting some of them (understating), or by reporting…

Computer Science and Game Theory · Computer Science 2016-03-01 Itai Feigenbaum , Matthew P. Johnson

The problem of selecting a small-size representative summary of a large dataset is a cornerstone of machine learning, optimization and data science. Motivated by applications to recommendation systems and other scenarios with query-limited…

Data Structures and Algorithms · Computer Science 2019-10-15 Dmitrii Avdiukhin , Grigory Yaroslavtsev , Samson Zhou

The stochastic knapsack has been used as a model in wide ranging applications from dynamic resource allocation to admission control in telecommunication. In recent years, a variation of the model has become a basic tool in studying problems…

Pricing of Securities · Quantitative Finance 2008-12-02 Grace Lin , Yingdong Lu , David Yao

Greedy algorithms are widely used for problems in machine learning such as feature selection and set function optimization. Unfortunately, for large datasets, the running time of even greedy algorithms can be quite high. This is because for…

Machine Learning · Statistics 2017-03-09 Rajiv Khanna , Ethan Elenberg , Alexandros G. Dimakis , Sahand Negahban , Joydeep Ghosh

Submodular maximization generalizes many fundamental problems in discrete optimization, including Max-Cut in directed/undirected graphs, maximum coverage, maximum facility location and marketing over social networks. In this paper we…

Data Structures and Algorithms · Computer Science 2011-01-18 Ariel Kulik , Hadas Shachnai , Tami Tamir

This work presents an empirical analysis of exact algorithms for the unbounded knapsack problem, which includes seven algorithms from the literature, two commercial solvers, and more than ten thousand instances. The terminating step-off, a…

Data Structures and Algorithms · Computer Science 2019-03-22 Henrique Becker , Luciana S. Buriol

Competitive analysis of online algorithms has commonly been applied to understand the behaviour of real-time systems during overload conditions. While competitive analysis provides insight into the behaviour of certain algorithms, it is…

Performance · Computer Science 2018-06-06 Sathish Gopalakrishnan

We study the Min-Weighted Sum Bin Packing problem, a variant of the classical Bin Packing problem in which items have a weight, and each item induces a cost equal to its weight multiplied by the index of the bin in which it is packed. This…

Data Structures and Algorithms · Computer Science 2023-04-06 Guillaume Sagnol

The goal of a sequential decision making problem is to design an interactive policy that adaptively selects a group of items, each selection is based on the feedback from the past, in order to maximize the expected utility of selected…

Data Structures and Algorithms · Computer Science 2022-09-13 Shaojie Tang

The submodular maximization problem is widely applicable in many engineering problems where objectives exhibit diminishing returns. While this problem is known to be NP-hard for certain subclasses of objective functions, there is a greedy…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-07-01 Haoyuan Sun , David Grimsman , Jason R Marden

We provide finite-sample performance guarantees for control policies executed on stochastic robotic systems. Given an open- or closed-loop policy and a finite set of trajectory rollouts under the policy, we bound the expected value,…

Robotics · Computer Science 2024-06-17 Joseph A. Vincent , Aaron O. Feldman , Mac Schwager

The problem of column subset selection has recently attracted a large body of research, with feature selection serving as one obvious and important application. Among the techniques that have been applied to solve this problem, the greedy…

Data Structures and Algorithms · Computer Science 2021-11-16 Jason Altschuler , Aditya Bhaskara , Gang Fu , Vahab Mirrokni , Afshin Rostamizadeh , Morteza Zadimoghaddam

In resource allocation, we often require that the output allocation of an algorithm is stable against input perturbation because frequent reallocation is costly and untrustworthy. Varma and Yoshida (SODA'21) formalized this requirement for…

Data Structures and Algorithms · Computer Science 2024-05-24 Soh Kumabe , Yuichi Yoshida

We study the problem of maximizing a non-monotone submodular function under multiple knapsack constraints. We propose a simple discrete greedy algorithm to approach this problem, and prove that it yields strong approximation guarantees for…

Machine Learning · Computer Science 2020-02-19 Vanja Doskoč , Tobias Friedrich , Andreas Göbel , Frank Neumann , Aneta Neumann , Francesco Quinzan

We consider an extension of the rollout algorithm that applies to constrained deterministic dynamic programming, including challenging combinatorial optimization problems. The algorithm relies on a suboptimal policy, called base heuristic.…

Optimization and Control · Mathematics 2020-04-28 Dimitri Bertsekas

Quality diversity (QD) algorithms have been shown to be very successful when dealing with problems in areas such as robotics, games and combinatorial optimization. They aim to maximize the quality of solutions for different regions of the…

Neural and Evolutionary Computing · Computer Science 2022-07-29 Adel Nikfarjam , Anh Viet Do , Frank Neumann