English
Related papers

Related papers: Adversarial Knapsack for Sequential Competitive Re…

200 papers

We consider contextual bandits with knapsacks, with an underlying structure between rewards generated and cost vectors suffered. We do so motivated by sales with commercial discounts. At each round, given the stochastic i.i.d.\ context…

Machine Learning · Computer Science 2022-10-03 Zhen Li , Gilles Stoltz

In the knapsack problem under explorable uncertainty, we are given a knapsack instance with uncertain item profits. Instead of having access to the precise profits, we are only given uncertainty intervals that are guaranteed to contain the…

Data Structures and Algorithms · Computer Science 2025-07-04 Jens Schlöter

In this paper, we study the following robust optimization problem. Given an independence system and candidate objective functions, we choose an independent set, and then an adversary chooses one objective function, knowing our choice. Our…

Data Structures and Algorithms · Computer Science 2018-05-22 Yasushi Kawase , Hanna Sumita

We consider the problem of sequential evaluation, in which an evaluator observes candidates in a sequence and assigns scores to these candidates in an online, irrevocable fashion. Motivated by the psychology literature that has studied…

Machine Learning · Statistics 2023-11-20 Jingyan Wang , Ashwin Pananjady

We study a two-player discounted zero-sum stochastic game model for dynamic operational planning in military campaigns. At each stage, the players manage multiple commanders who order military actions on objectives that have an open line of…

Computer Science and Game Theory · Computer Science 2024-03-04 Joseph E. McCarthy , Mathieu Dahan , Chelsea C. White

We present prior robust algorithms for a large class of resource allocation problems where requests arrive one-by-one (online), drawn independently from an unknown distribution at every step. We design a single algorithm that, for every…

Data Structures and Algorithms · Computer Science 2019-03-12 Nikhil R. Devanur , Kamal Jain , Balasubramanian Sivan , Christopher A. Wilkens

We consider the problem of learning to choose actions using contextual information when provided with limited feedback in the form of relative pairwise comparisons. We study this problem in the dueling-bandits framework of Yue et al.…

Machine Learning · Computer Science 2015-06-16 Miroslav Dudík , Katja Hofmann , Robert E. Schapire , Aleksandrs Slivkins , Masrour Zoghi

Existing language agents often encounter difficulties in dynamic adversarial games due to poor strategic reasoning. To mitigate this limitation, a promising approach is to allow agents to learn from game interactions automatically, without…

Computation and Language · Computer Science 2025-10-21 Yikai Zhang , Ye Rong , Siyu Yuan , Jiangjie Chen , Jian Xie , Yanghua Xiao

We study a multi-leader single-follower congestion game where multiple users (leaders) choose one resource out of a set of resources and, after observing the realized loads, an adversary (single-follower) attacks the resources with maximum…

Computer Science and Game Theory · Computer Science 2021-12-15 Tobias Harks , Mona Henle , Max Klimm , Jannik Matuschke , Anja Schedel

In adversarial interactions, one is often required to make strategic decisions over multiple periods of time, wherein decisions made earlier impact a player's competitive standing as well as how choices are made in later stages. In this…

Computer Science and Game Theory · Computer Science 2022-09-14 Rahul Chandan , Keith Paarporn , Mahnoosh Alizadeh , Jason R. Marden

In this paper, we investigate a practical demand side management scenario where the selfish consumers compete to minimize their individual energy cost through scheduling their future energy consumption profiles. We propose an instantaneous…

Optimization and Control · Mathematics 2014-06-25 He Chen , Yonghui Li , Raymond H. Y. Louie , Branka Vucetic

In this paper we address the computational feasibility of the class of decision theoretic models referred to as adversarial risk analyses (ARA). These are models where a decision must be made with consideration for how an intelligent…

General Economics · Economics 2021-10-26 Michael Macgregor Perry , Hadi El-Amine

Recent years have seen a significant amount of interests in Sequential Recommendation (SR), which aims to understand and model the sequential user behaviors and the interactions between users and items over time. Surprisingly, despite the…

Information Retrieval · Computer Science 2022-02-02 Dadong Miao , Yanan Wang , Guoyu Tang , Lin Liu , Sulong Xu , Bo Long , Yun Xiao , Lingfei Wu , Yunjiang Jiang

We study a non-cooperative two-sided facility location game in which facilities and clients behave strategically. This is in contrast to many other facility location games in which clients simply visit their closest facility. Facility…

Computer Science and Game Theory · Computer Science 2024-06-14 Simon Krogmann , Pascal Lenzner , Alexander Skopalik

A central problem in sequential decision making is to develop algorithms that are practical and computationally efficient, yet support the use of flexible, general-purpose models. Focusing on the contextual bandit problem, recent progress…

Machine Learning · Computer Science 2022-07-14 Yinglun Zhu , Dylan J. Foster , John Langford , Paul Mineiro

We explore a class of stochastic multiplayer games where each player in the game aims to optimize its objective under uncertainty and adheres to some expectation constraints. The study employs an offline learning paradigm, leveraging a…

Optimization and Control · Mathematics 2025-09-09 Yuanhanqing Huang , Jianghai Hu

Addressing a complex real-world optimization problem is a challenging task. The chance-constrained knapsack problem with correlated uniform weights plays an important role in the case where dependent stochastic components are considered. We…

Data Structures and Algorithms · Computer Science 2021-02-12 Yue Xie , Aneta Neumann , Frank Neumann , Andrew M. Sutton

Ensuring robust decision-making in multi-agent systems is challenging when agents have distinct, possibly conflicting objectives and lack full knowledge of each other's strategies. This is apparent in safety-critical applications such as…

Systems and Control · Electrical Eng. & Systems 2025-10-20 Francesco Bianchin , Robert Lefringhausen , Elisa Gaetan , Samuel Tesfazgi , Sandra Hirche

Bandits with Knapsacks (BwK), the generalization of the Bandits problem under global budget constraints, has received a lot of attention in recent years. Previous work has focused on one of the two extremes: Stochastic BwK where the rewards…

Machine Learning · Computer Science 2023-09-06 Giannis Fikioris , Éva Tardos

Card games are widely used to study sequential decision-making under uncertainty, with real-world analogues in negotiation, finance, and cybersecurity. These games typically fall into three categories based on the flow of control: strictly…

Computer Science and Game Theory · Computer Science 2025-10-31 Will Wolf