English
Related papers

Related papers: Pandora's Box Problem with Order Constraints

200 papers

We study the Pandora's Box problem in an online learning setting with semi-bandit feedback. In each round, the learner sequentially pays to open up to $n$ boxes with unknown reward distributions, observes rewards upon opening, and decides…

Machine Learning · Computer Science 2025-10-27 Junyan Liu , Ziyun Chen , Kun Wang , Haipeng Luo , Lillian J. Ratliff

Bayesian optimization is a technique for efficiently optimizing unknown functions in a black-box manner. To handle practical settings where gathering data requires use of finite resources, it is desirable to explicitly incorporate function…

Machine Learning · Computer Science 2025-01-17 Qian Xie , Raul Astudillo , Peter I. Frazier , Ziv Scully , Alexander Terenin

In this paper, we study the Markovian Pandora's Box Problem, where decisions are governed by both order constraints and Markovianly correlated rewards, structured within a shared directed acyclic graph. To the best of our knowledge,…

Computer Science and Game Theory · Computer Science 2025-02-04 Yuanyuan Yang , Ruimin Zhang , Jamie Morgenstern , Haifeng Xu

We consider max-weighted matching with costs for learning the weights, modeled as a "Pandora's Box" on each endpoint of an edge. Each vertex has an initially-unknown value for being matched to a neighbor, and an algorithm must pay some cost…

Data Structures and Algorithms · Computer Science 2025-06-30 Robin Bowers , Bo Waggoner

We consider a class of optimization problems over stochastic variables where the algorithm can learn information about the value of any variable through a series of costly steps; we model this information acquisition process as a Markov…

Data Structures and Algorithms · Computer Science 2025-07-25 Shuchi Chawla , Dimitris Christou , Amit Harlev , Ziv Scully

A decisionmaker faces $n$ alternatives, each of which represents a potential reward. After investing costly resources into investigating the alternatives, the decisionmaker may select one, or more generally a feasible subset, and obtain the…

Computer Science and Game Theory · Computer Science 2026-04-02 Robin Bowers , Elias Lindgren , Bo Waggoner

We formalize the problem of selecting the optimal set of options for planning as that of computing the smallest set of options so that planning converges in less than a given maximum of value-iteration passes. We first show that the problem…

Artificial Intelligence · Computer Science 2019-03-19 Yuu Jinnai , David Abel , D Ellis Hershkowitz , Michael Littman , George Konidaris

Optimising queries in real-world situations under imperfect conditions is still a problem that has not been fully solved. We consider finding the optimal order in which to execute a given set of selection operators under partial ignorance…

Databases · Computer Science 2015-07-30 Khaled H. Alyoubi , Sven Helmer , Peter T. Wood

In delegation problems, a principal does not have the resources necessary to complete a particular task, so they delegate the task to an untrusted agent whose interests may differ from their own. Given any family of such problems and space…

Computer Science and Game Theory · Computer Science 2022-02-22 Curtis Bechtel , Shaddin Dughmi , Neel Patel

We present two first-order, sequential optimization algorithms to solve constrained optimization problems. We consider a black-box setting with a priori unknown, non-convex objective and constraint functions that have Lipschitz continuous…

Optimization and Control · Mathematics 2020-11-19 Abraham P. Vinod , Arie Israel , Ufuk Topcu

In this paper, we introduce a family of sequential decision-making problems, collectively termed the Keychain Problem, that involve exploring a set of actions to maximize expected payoff when only a subset of actions are available in each…

Computer Science and Game Theory · Computer Science 2026-02-13 Ramiro N. Deo-Campo Vuong , Robert Kleinberg , Aditya Prasad , Eric Xiao , Haifeng Xu

In this paper, we discuss a stochastic decision problem of optimally selecting the order in which to try $n$ opportunities that may yield an uncertain reward in the future. The motivation came out from pure curiosity, after an informal…

Computer Science and Game Theory · Computer Science 2016-09-27 Giuseppe C. Calafiore

We study a natural application of contract design in the context of sequential exploration problems. In our principal-agent setting, a search task is delegated to an agent. The agent performs a sequential exploration of $n$ boxes, suffers…

Computer Science and Game Theory · Computer Science 2025-01-27 Martin Hoefer , Conrad Schecker , Kevin Schewior

Resource-constrained classification tasks are common in real-world applications such as allocating tests for disease diagnosis, hiring decisions when filling a limited number of positions, and defect detection in manufacturing settings…

Machine Learning · Computer Science 2023-11-22 Danit Shifman Abukasis , Izack Cohen , Xiaochen Xian , Kejun Huang , Gonen Singer

In automated machine learning, scientific discovery, and other applications of Bayesian optimization, deciding when to stop evaluating expensive black-box functions in a cost-aware manner is an important but underexplored practical…

Machine Learning · Computer Science 2025-12-29 Qian Xie , Linda Cai , Alexander Terenin , Peter I. Frazier , Ziv Scully

The Prophet Inequality and Pandora's Box problems are fundamental stochastic problem with applications in Mechanism Design, Online Algorithms, Stochastic Optimization, Optimal Stopping, and Operations Research. A usual assumption in these…

Data Structures and Algorithms · Computer Science 2023-12-08 Khashayar Gatmiry , Thomas Kesselheim , Sahil Singla , Yifan Wang

The assortment problem in revenue management is the problem of deciding which subset of products to offer to consumers in order to maximise revenue. A simple and natural strategy is to select the best assortment out of all those that are…

Data Structures and Algorithms · Computer Science 2019-02-22 Gerardo Berbeglia , Gwenaël Joret

Randomized mechanisms, which map a set of bids to a probability distribution over outcomes rather than a single outcome, are an important but ill-understood area of computational mechanism design. We investigate the role of randomized…

Computer Science and Game Theory · Computer Science 2009-04-17 Patrick Briest , Shuchi Chawla , Robert Kleinberg , S. Matthew Weinberg

Motivated by hiring pipelines, we study three selection and ordering problems in which applicants for a finite set of positions must be interviewed or sent offers. There is a finite time budget for interviewing/sending offers, and every…

Data Structures and Algorithms · Computer Science 2023-10-30 Boris Epstein , Will Ma

We investigate the role of inaccurate priors for the classical Pandora's box problem. In the classical Pandora's box problem we are given a set of boxes each with a known cost and an unknown value sampled from a known distribution. We…

Data Structures and Algorithms · Computer Science 2025-02-07 Kiarash Banihashem , Xiang Chen , MohammadTaghi Hajiaghayi , Sungchul Kim , Kanak Mahadik , Ryan Rossi , Tong Yu