English
Related papers

Related papers: Fighting Pickpocketing using a Choice-based Resour…

200 papers

Data-poisoning attacks can disrupt the efficient operations of transportation systems by misdirecting traffic flows via falsified data. One challenge in countering these attacks is to reduce the uncertainties on the types of attacks, such…

Optimization and Control · Mathematics 2024-09-12 Yue Yu , Adam J. Thorpe , Jesse Milzman , David Fridovich-Keil , Ufuk Topcu

In this work, we are interested on the analysis of competing marketing campaigns between an incumbent who dominates the market and a challenger who wants to enter the market. We are interested in (a) the simultaneous decision of how many…

Social and Information Networks · Computer Science 2015-07-31 Alonso Silva , Antonia Maria Masucci

Motivated by practical applications, chiefly clinical trials, we study the regret achievable for stochastic bandits under the constraint that the employed policy must split trials into a small number of batches. We propose a simple policy,…

Statistics Theory · Mathematics 2016-03-30 Vianney Perchet , Philippe Rigollet , Sylvain Chassang , Erik Snowberg

Massive practical works addressed by Deep Q-network (DQN) algorithm have indicated that stochastic policy, despite its simplicity, is the most frequently used exploration approach. However, most existing stochastic exploration approaches…

Machine Learning · Computer Science 2022-06-22 Wenhui Huang , Cong Zhang , Jingda Wu , Xiangkun He , Jie Zhang , Chen Lv

For multiple emergencies caused by natural disasters, it is crucial to allocate resources equitably to each emergency location, especially when the availability of resources is limited in quantity. This paper has developed a multi-event…

Computer Science and Game Theory · Computer Science 2021-12-03 Rudrashis Majumder , Rakesh R Warier , Debasish Ghose

We consider the problem of online allocation (matching and assortments) of reusable resources where customers arrive sequentially in an adversarial fashion and allocated resources are used or rented for a stochastic duration that is drawn…

Data Structures and Algorithms · Computer Science 2022-07-20 Vineet Goyal , Garud Iyengar , Rajan Udwani

We formulate and study the algorithmic mechanism design problem for a general class of resource allocation settings, where the center redistributes the private resources brought by individuals. Money transfer is forbidden. Distinct from the…

Computer Science and Game Theory · Computer Science 2015-03-24 Qipeng Liu , Yicheng Liu , Pingzhong Tang

In green security, defenders must forecast adversarial behavior, such as poaching, illegal logging, and illegal fishing, to plan effective patrols. These behavior are often highly uncertain and complex. Prior work has leveraged game theory…

Computers and Society · Computer Science 2025-10-21 Lingkai Kong , Haichuan Wang , Yuqi Pan , Cheol Woo Kim , Mingxiao Song , Alayna Nguyen , Tonghan Wang , Haifeng Xu , Milind Tambe

Batch policy optimization considers leveraging existing data for policy construction before interacting with an environment. Although interest in this problem has grown significantly in recent years, its theoretical foundations remain…

Machine Learning · Computer Science 2021-04-07 Chenjun Xiao , Yifan Wu , Tor Lattimore , Bo Dai , Jincheng Mei , Lihong Li , Csaba Szepesvari , Dale Schuurmans

Assigning resources in business processes execution is a repetitive task that can be effectively automated. However, different automation methods may give varying results that may not be optimal. Proper resource allocation is crucial as it…

Machine Learning · Computer Science 2021-04-02 Kamil Żbikowski , Michał Ostapowicz , Piotr Gawrysiak

This paper introduces the first asymptotically optimal strategy for a multi armed bandit (MAB) model under side constraints. The side constraints model situations in which bandit activations are limited by the availability of certain…

Machine Learning · Statistics 2025-02-10 Apostolos N. Burnetas , Odysseas Kanavetas , Michael N. Katehakis

Selecting the combination of security controls that will most effectively protect a system's assets is a difficult task. If the wrong controls are selected, the system may be left vulnerable to cyber-attacks that can impact the…

Cryptography and Security · Computer Science 2024-10-31 Dylan Léveillé , Jason Jaskolka

We consider the problem of reward maximization in the dueling bandit setup along with constraints on resource consumption. As in the classic dueling bandits, at each round the learner has to choose a pair of items from a set of $K$ items…

Machine Learning · Computer Science 2023-12-29 Rohan Deb , Aadirupa Saha

Many policies allocate harms or benefits that are uncertain in nature: they produce distributions over the population in which individuals have different probabilities of incurring harm or benefit. Comparing different policies thus involves…

Computers and Society · Computer Science 2021-03-11 Hoda Heidari , Solon Barocas , Jon Kleinberg , Karen Levy

This paper studies the SI1SI2S spreading model of two competing behaviors over a bilayer network. We address the problem of determining resource allocation strategies which design a spreading network so as to ensure the extinction of a…

Optimization and Control · Mathematics 2015-12-17 Nicholas J. Watkins , Cameron Nowzari , Victor M. Preciado , George J. Pappas

Reinforcement learning can greatly benefit from the use of options as a way of encoding recurring behaviours and to foster exploration. An important open problem is how can an agent autonomously learn useful options when solving particular…

Machine Learning · Computer Science 2020-01-07 Manuel Del Verme , Bruno Castro da Silva , Gianluca Baldassarre

We introduce the model selection problem in pure exploration linear bandits, where the learner needs to adapt to the instance-dependent complexity measure of the smallest hypothesis class containing the true model. We design algorithms in…

Machine Learning · Statistics 2022-03-18 Yinglun Zhu , Julian Katz-Samuels , Robert Nowak

This paper considers the security investment problem over a network in which the resource owners aim to allocate their constrained security resources to heterogeneous targets strategically. Investing in each target makes it less vulnerable,…

Social and Information Networks · Computer Science 2023-02-20 Jason Hughes , Juntao Chen

This paper investigates the problem of synthesizing proactive defense systems in which the defender can allocate deceptive targets and modify the cost of actions for the attacker who aims to compromise security assets in this system. We…

Multiagent Systems · Computer Science 2023-01-05 Haoxiang Ma , Shuo Han , Nandi Leslie , Charles Kamhoua , Jie Fu

Cyber attacks continue to be a cause of concern despite advances in cyber defense techniques. Although cyber attacks cannot be fully prevented, standard decision-making frameworks typically focus on how to prevent them from succeeding,…

Systems and Control · Electrical Eng. & Systems 2025-09-16 Faezeh Shojaeighadikolaei , Shouhuai Xu , Keith Paarporn