English
Related papers

Related papers: Information Design with Unknown Prior

200 papers

Existing online learning algorithms for adversarial Markov Decision Processes achieve ${O}(\sqrt{T})$ regret after $T$ rounds of interactions even if the loss functions are chosen arbitrarily by an adversary, with the caveat that the…

Machine Learning · Computer Science 2023-10-27 Tiancheng Jin , Junyan Liu , Chloé Rouyer , William Chang , Chen-Yu Wei , Haipeng Luo

Automated bidding to optimize online advertising with various constraints, e.g. ROI constraints and budget constraints, is widely adopted by advertisers. A key challenge lies in designing algorithms for non-truthful mechanisms with ROI…

Computer Science and Game Theory · Computer Science 2025-10-21 Yuan Deng , Yilin Li , Wei Tang , Hanrui Zhang

We enable efficient and effective coordination in unpredictable environments, i.e., in environments whose future evolution is unknown a priori and even adversarial. We are motivated by the future of autonomy that involves multiple robots…

Systems and Control · Electrical Eng. & Systems 2023-02-21 Zirui Xu , Hongyu Zhou , Vasileios Tzoumas

The dynamics of individuals is of essential importance for understanding the evolution of social systems. Most existing models assume that individuals in diverse systems, ranging from social networks to e-commerce, all tend to what is…

Physics and Society · Physics 2017-02-22 Matus Medo , Manuel S. Mariani , An Zeng , Yi-Cheng Zhang

The contextual duelling bandit problem models adaptive recommender systems, where the algorithm presents a set of items to the user, and the user's choice reveals their preference. This setup is well suited for implicit choices users make…

Machine Learning · Computer Science 2025-08-27 Suryanarayana Sankagiri , Jalal Etesami , Pouria Fatemi , Matthias Grossglauser

In the random-order model for online learning, the sequence of losses is chosen upfront by an adversary and presented to the learner after a random permutation. Any random-order input is \emph{asymptotically} equivalent to a stochastic…

Machine Learning · Computer Science 2025-10-06 Martino Bernasconi , Andrea Celli , Riccardo Colini-Baldeschi , Federico Fusco , Stefano Leonardi , Matteo Russo

Most learning algorithms with formal regret guarantees assume that all mistakes are recoverable and essentially rely on trying all possible behaviors. This approach is problematic when some mistakes are "catastrophic", i.e., irreparable. We…

Machine Learning · Computer Science 2025-08-07 Benjamin Plaut , Hanlin Zhu , Stuart Russell

Most microeconomic models of interest involve optimizing a piecewise linear function. These include contract design in hidden-action principal-agent problems, selling an item in posted-price auctions, and bidding in first-price auctions.…

Computer Science and Game Theory · Computer Science 2025-03-04 Francesco Bacchiocchi , Matteo Castiglioni , Alberto Marchesi , Nicola Gatti

Many multiagent applications require an agent to learn quickly how to interact with previously unknown other agents. To address this problem, researchers have studied learning algorithms which compute posterior beliefs over a hypothesised…

Artificial Intelligence · Computer Science 2019-07-12 Stefano V. Albrecht , Jacob W. Crandall , Subramanian Ramamoorthy

Prediction-oriented machine learning is becoming increasingly valuable to organizations, as it may drive applications in crucial business areas. However, decision-makers from companies across various industries are still largely reluctant…

Software Engineering · Computer Science 2023-06-22 Giacomo Welsch , Peter Kowalczyk

We study the problems of offline and online contextual optimization with feedback information, where instead of observing the loss, we observe, after-the-fact, the optimal action an oracle with full knowledge of the objective function would…

Machine Learning · Computer Science 2023-07-04 Omar Besbes , Yuri Fonseca , Ilan Lobel

We consider the problem of online classification under a privacy constraint. In this setting a learner observes sequentially a stream of labelled examples $(x_t, y_t)$, for $1 \leq t \leq T$, and returns at each iteration $t$ a hypothesis…

Machine Learning · Computer Science 2021-06-28 Noah Golowich , Roi Livni

Optimal designs are usually model-dependent and likely to be sub-optimal if the postulated model is not correctly specified. In practice, it is common that a researcher has a list of candidate models at hand and a design has to be found…

Statistics Theory · Mathematics 2023-03-29 Mingyao Ai , Holger Dette , Zhengfu Liu , Jun Yu

Human decision making is well known to be imperfect and the ability to analyse such processes individually is crucial when attempting to aid or improve a decision-maker's ability to perform a task, e.g. to alert them to potential biases or…

Machine Learning · Computer Science 2022-10-03 Alex J. Chan , Alicia Curth , Mihaela van der Schaar

Online linear programming plays an important role in both revenue management and resource allocation, and recent research has focused on developing efficient first-order online learning algorithms. Despite the empirical success of…

Machine Learning · Statistics 2025-01-07 Wenzhi Gao , Dongdong Ge , Chenyu Xue , Chunlin Sun , Yinyu Ye

We propose information-directed sampling -- a new approach to online optimization problems in which a decision-maker must balance between exploration and exploitation while learning from partial feedback. Each action is sampled in a manner…

Machine Learning · Computer Science 2017-07-10 Daniel Russo , Benjamin Van Roy

We study the problem of learning Markov decision processes with finite state and action spaces when the transition probability distributions and loss functions are chosen adversarially and are allowed to change with time. We introduce an…

Machine Learning · Computer Science 2013-03-14 Yasin Abbasi-Yadkori , Peter L. Bartlett , Csaba Szepesvari

Using recent machine learning results that present an information-theoretic perspective on underfitting and overfitting, we prove that deciding whether an encodable learning algorithm will always underfit a dataset, even if given unlimited…

Machine Learning · Computer Science 2021-02-11 Sonia Sehra , David Flores , George D. Montanez

We extend and combine several tools of the literature to design fast, adaptive, anytime and scale-free online learning algorithms. Scale-free regret bounds must scale linearly with the maximum loss, both toward large losses and toward very…

Machine Learning · Computer Science 2024-10-22 Laurent Orseau , Marcus Hutter

We propose a new partial-observability model for online learning problems where the learner, besides its own loss, also observes some noisy feedback about the other actions, depending on the underlying structure of the problem. We represent…

Machine Learning · Computer Science 2026-04-16 Tomáš Kocák , Gergely Neu , Michal Valko
‹ Prev 1 8 9 10 Next ›