English
Related papers

Related papers: Ordering Selection Operators Using the Minmax Regr…

200 papers

We consider a discrete-time bipartite matching model with random arrivals of units of supply and demand that can wait in queues located at the nodes in the network. A control policy determines which are matched at each time. The focus is on…

Discrete Mathematics · Computer Science 2016-06-28 Ana Bušić , Sean Meyn

Online learning aims to perform nearly as well as the best hypothesis in hindsight. For some hypothesis classes, though, even finding the best hypothesis offline is challenging. In such offline cases, local search techniques are often…

Artificial Intelligence · Computer Science 2012-06-18 Michael Bowling , Martin Zinkevich

As artificial agents become increasingly capable, what internal structure is *necessary* for an agent to act competently under uncertainty? Classical results show that optimal control can be *implemented* using belief states or world…

Machine Learning · Computer Science 2026-04-03 Aran Nayebi

This paper studies a penalized statistical decision rule for the treatment assignment problem. Consider the setting of a utilitarian policy maker who must use sample data to allocate a binary treatment to members of a population, based on…

Statistics Theory · Mathematics 2020-12-10 Eric Mbakop , Max Tabord-Meehan

We study the dynamic assortment planning problem, where for each arriving customer, the seller offers an assortment of substitutable products and customer makes the purchase among offered products according to an uncapacitated multinomial…

Machine Learning · Statistics 2019-02-11 Xi Chen , Yining Wang , Yuan Zhou

As machine learning is increasingly used to help make decisions, there is a demand for these decisions to be explainable. Arguably, the most explainable machine learning models use decision rules. This paper focuses on decision sets, a type…

Artificial Intelligence · Computer Science 2020-07-31 Jinqiang Yu , Alexey Ignatiev , Peter J. Stuckey , Pierre Le Bodic

We improve the theoretical and empirical performance of neural-network(NN)-based active learning algorithms for the non-parametric streaming setting. In particular, we introduce two regret metrics by minimizing the population loss that are…

Machine Learning · Computer Science 2023-01-18 Yikun Ban , Yuheng Zhang , Hanghang Tong , Arindam Banerjee , Jingrui He

Policy optimization methods are popular reinforcement learning algorithms in practice. Recent works have built theoretical foundation for them by proving $\sqrt{T}$ regret bounds even when the losses are adversarial. Such bounds are tight…

Machine Learning · Computer Science 2023-02-21 Christoph Dann , Chen-Yu Wei , Julian Zimmert

In this paper, we provide a generic anytime lower bounding procedure for minmax regret optimization problems. We show that the lower bound obtained is always at least as accurate as the lower bound recently proposed by Chassein and Goerigk…

Data Structures and Algorithms · Computer Science 2017-07-12 Hugo Gilbert , Olivier Spanjaard

We consider distributed kernel bandits where $N$ agents aim to collaboratively maximize an unknown reward function that lies in a reproducing kernel Hilbert space. Each agent sequentially queries the function to obtain noisy observations at…

Machine Learning · Computer Science 2024-02-21 Nikola Pavlovic , Sudeep Salgia , Qing Zhao

We consider a fair resource allocation problem in the no-regret setting against an unrestricted adversary. The objective is to allocate resources equitably among several agents in an online fashion so that the difference of the aggregate…

Machine Learning · Computer Science 2023-03-14 Abhishek Sinha , Ativ Joshi , Rajarshi Bhattacharjee , Cameron Musco , Mohammad Hajiesmaili

We consider the problem of static assortment optimization, where the goal is to find the assortment of size at most $C$ that maximizes revenues. This is a fundamental decision problem in the area of Operations Management. It has been shown…

Methodology · Statistics 2011-08-19 Vivek Farias , Srikanth Jagabathula , Devavrat Shah

Stochastic shortest path (SSP) is a well-known problem in planning and control, in which an agent has to reach a goal state in minimum total expected cost. In the learning formulation of the problem, the agent is unaware of the environment…

Machine Learning · Computer Science 2020-02-25 Alon Cohen , Haim Kaplan , Yishay Mansour , Aviv Rosenberg

We study the problem of multi-agent control of a dynamical system with known dynamics and adversarial disturbances. Our study focuses on optimal control without centralized precomputed policies, but rather with adaptive control policies for…

Optimization and Control · Mathematics 2022-07-27 Udaya Ghai , Udari Madhushani , Naomi Leonard , Elad Hazan

In this paper we consider multi-objective reinforcement learning where the objectives are balanced using preferences. In practice, the preferences are often given in an adversarial manner, e.g., customers can be picky in many applications.…

Machine Learning · Computer Science 2021-10-29 Jingfeng Wu , Vladimir Braverman , Lin F. Yang

We present an efficient reinforcement learning algorithm that learns the optimal admission control policy in a partially observable queueing network. Specifically, only the arrival and departure times from the network are observable, and…

Machine Learning · Computer Science 2023-08-07 Jonatha Anselmi , Bruno Gaujal , Louis-Sébastien Rebuffi

The primary focus of this paper is on designing an inexact first-order algorithm for solving constrained nonlinear optimization problems. By controlling the inexactness of the subproblem solution, we can significantly reduce the…

Optimization and Control · Mathematics 2019-11-19 Hao Wang , Fan Zhang , Jiashan Wang , Yuyang Rong

Policy Optimization (PO) is a widely used approach to address continuous control tasks. In this paper, we introduce the notion of mediator feedback that frames PO as an online learning problem over the policy space. The additional available…

Machine Learning · Computer Science 2020-12-16 Alberto Maria Metelli , Matteo Papini , Pierluca D'Oro , Marcello Restelli

We introduce a novel theoretical framework for Return On Investment (ROI) maximization in repeated decision-making. Our setting is motivated by the use case of companies that regularly receive proposals for technological innovations and…

Machine Learning · Computer Science 2021-12-24 Nicolò Cesa-Bianchi , Tommaso Cesari , Yishay Mansour , Vianney Perchet

We study a novel problem of fairness in ranking aimed at minimizing the amount of individual unfairness introduced when enforcing group-fairness constraints. Our proposal is rooted in the distributional maxmin fairness theory, which uses…

Machine Learning · Computer Science 2021-06-18 David Garcia-Soriano , Francesco Bonchi