English
Related papers

Related papers: Refined approachability algorithms and application…

200 papers

In a multi-follower Bayesian Stackelberg game, a leader plays a mixed strategy over $L$ actions to which $n\ge 1$ followers, each having one of $K$ possible private types, best respond. The leader's optimal strategy depends on the…

Computer Science and Game Theory · Computer Science 2026-03-03 Gerson Personnat , Tao Lin , Safwan Hossain , David C. Parkes

We consider prediction with expert advice when data are generated from distributions varying arbitrarily within an unknown constraint set. This semi-adversarial setting includes (at the extremes) the classical i.i.d. setting, when the…

Machine Learning · Statistics 2022-07-25 Blair Bilodeau , Jeffrey Negrea , Daniel M. Roy

A recurring challenge in preference fine-tuning (PFT) is handling $\textit{intransitive}$ (i.e., cyclic) preferences. Intransitive preferences often stem from either $\textit{(i)}$ inconsistent rankings along a single objective or…

Machine Learning · Computer Science 2026-05-07 Jiahao Zhang , Lujing Zhang , Keltin Grimes , Zhuohao Yu , Gokul Swamy , Zhiwei Steven Wu

We study the problem of online learning with non-convex losses, where the learner has access to an offline optimization oracle. We show that the classical Follow the Perturbed Leader (FTPL) algorithm achieves optimal regret rate of…

Machine Learning · Computer Science 2019-09-24 Arun Sai Suggala , Praneeth Netrapalli

We provide a necessary and sufficient condition under which a convex set is approachable in a game with partial monitoring, i.e.\ where players do not observe their opponents' moves but receive random signals. This condition is an extension…

Computer Science and Game Theory · Computer Science 2011-02-23 Vianney Perchet

Adversarial regularization has been shown to improve the generalization performance of deep learning models in various natural language processing tasks. Existing works usually formulate the method as a zero-sum game, which is solved by…

Machine Learning · Computer Science 2022-04-21 Simiao Zuo , Chen Liang , Haoming Jiang , Xiaodong Liu , Pengcheng He , Jianfeng Gao , Weizhu Chen , Tuo Zhao

In the classic expert problem, $\Phi$-regret measures the gap between the learner's total loss and that achieved by applying the best action transformation $\phi \in \Phi$. A recent work by Lu et al., [2025] introduces an adaptive algorithm…

Machine Learning · Computer Science 2025-12-16 Soumita Hait , Ping Li , Haipeng Luo , Mengxiao Zhang

We study the problem of multi-agent reinforcement learning (MARL) with adaptivity constraints -- a new problem motivated by real-world applications where deployments of new policies are costly and the number of policy updates must be…

Machine Learning · Computer Science 2024-02-05 Dan Qiao , Yu-Xiang Wang

This paper examines the Random Utility Model (RUM) in repeated stochastic choice settings where decision-makers lack full information about payoffs. We propose a gradient-based learning algorithm that embeds RUM into an online…

Theoretical Economics · Economics 2025-06-23 Emerson Melo

Reachable set computation is an important tool for analyzing control systems. Simulating a control system can show general trends, but a formal tool like reachability analysis can provide guarantees of correctness. Reachability analysis for…

Systems and Control · Electrical Eng. & Systems 2025-05-07 Chelsea Sidrane , Jana Tumova

We introduce the concept of attainable sets of payoffs in two-player repeated games with vector payoffs. A set of payoff vectors is called {\em attainable} if player 1 can ensure that there is a finite horizon $T$ such that after time $T$…

Optimization and Control · Mathematics 2014-03-07 Dario Bauso , Ehud Lehrer , Eilon Solan , Xavier Venel

We propose an optimal iterative scheme for federated transfer learning, where a central planner has access to datasets ${\cal D}_1,\dots,{\cal D}_N$ for the same learning model $f_{\theta}$. Our objective is to minimize the cumulative…

Machine Learning · Computer Science 2024-10-04 Xuwei Yang , Anastasis Kratsios , Florian Krach , Matheus Grasselli , Aurelien Lucchi

Most learning algorithms with formal regret guarantees assume that all mistakes are recoverable and essentially rely on trying all possible behaviors. This approach is problematic when some mistakes are "catastrophic", i.e., irreparable. We…

Machine Learning · Computer Science 2025-08-07 Benjamin Plaut , Hanlin Zhu , Stuart Russell

Latent world models can contain the state needed for control, yet their terminal-cost interface can expose the planner to the wrong decision-relevant information. In common latent MPC, candidate sequences are ranked by Euclidean distance…

Machine Learning · Computer Science 2026-05-22 Liangyu Li , Shengzhi Wang , Qingwen Liu

Reinforcement Learning (RL) is a general framework concerned with an agent that seeks to maximize rewards in an environment. The learning typically happens through trial and error using explorative methods, such as epsilon-greedy. There are…

Machine Learning · Computer Science 2022-10-06 Per-Arne Andersen , Morten Goodwin , Ole-Christoffer Granmo

Hybrid Reinforcement Learning (RL), where an agent learns from both an offline dataset and online explorations in an unknown environment, has garnered significant recent interest. A crucial question posed by Xie et al. (2022) is whether…

Machine Learning · Statistics 2024-08-09 Kevin Tan , Wei Fan , Yuting Wei

The Colonel Blotto game, introduced by Borel in the 1920s, is often used for modeling various real-life settings, such as elections, lobbying, etc. The game is based on the allocation of limited resources by players to a set of fields. Each…

Theoretical Economics · Economics 2024-07-25 Sidarth Erat

In many online sequential decision-making scenarios, a learner's choices affect not just their current costs but also the future ones. In this work, we look at one particular case of such a situation where the costs depend on the time…

Machine Learning · Computer Science 2023-12-12 Vijeth Hebbar , Cedric Langbort

In this paper we consider multi-objective reinforcement learning where the objectives are balanced using preferences. In practice, the preferences are often given in an adversarial manner, e.g., customers can be picky in many applications.…

Machine Learning · Computer Science 2021-10-29 Jingfeng Wu , Vladimir Braverman , Lin F. Yang

Inverse reinforcement learning (IRL) denotes a powerful family of algorithms for recovering a reward function justifying the behavior demonstrated by an expert agent. A well-known limitation of IRL is the ambiguity in the choice of the…

Machine Learning · Computer Science 2023-04-26 Alberto Maria Metelli , Filippo Lazzati , Marcello Restelli