English
Related papers

Related papers: Learning Best Response Strategies for Agents in Ad…

200 papers

Many payment platforms hold large-scale marketing campaigns, which allocate incentives to encourage users to pay through their applications. To maximize the return on investment, incentive allocations are commonly solved in a two-stage…

Machine Learning · Computer Science 2022-01-03 Xuanying Chen , Zhining Liu , Li Yu , Sen Li , Lihong Gu , Xiaodong Zeng , Yize Tan , Jinjie Gu

We investigate the mechanism design problem faced by a principal who hires \emph{multiple} agents to gather and report costly information. Then, the principal exploits the information to make an informed decision. We model this problem as a…

Computer Science and Game Theory · Computer Science 2023-07-13 Federico Cacciamani , Matteo Castiglioni , Nicola Gatti

Digital advertising platforms operate millisecond-level auctions through Real-Time Bidding (RTB) systems, where advertisers compete for ad impressions through algorithmic bids. This dynamic mechanism enables precise audience targeting but…

Machine Learning · Computer Science 2025-08-11 Pusen Dong , Chenglong Cao , Xinyu Zhou , Jirong You , Linhe Xu , Feifan Xu , Shuo Yuan

In programmatic advertising, ad slots are usually sold using second-price (SP) auctions in real-time. The highest bidding advertiser wins but pays only the second-highest bid (known as the winning price). In SP, for a single item, the…

Machine Learning · Computer Science 2020-01-22 Aritra Ghosh , Saayan Mitra , Somdeb Sarkhel , Jason Xie , Gang Wu , Viswanathan Swaminathan

We consider the learning dynamics of a single reinforcement learning optimal execution trading agent when it interacts with an event driven agent-based financial market model. Trading takes place asynchronously through a matching engine in…

Trading and Market Microstructure · Quantitative Finance 2023-11-23 Matthew Dicks , Andrew Paskaramoorthy , Tim Gebbie

In online display advertising, guaranteed contracts and real-time bidding (RTB) are two major ways to sell impressions for a publisher. For large publishers, simultaneously selling impressions through both guaranteed contracts and in-house…

Computer Science and Game Theory · Computer Science 2022-03-15 Di Wu , Cheng Chen , Xiujun Chen , Junwei Pan , Xun Yang , Qing Tan , Jian Xu , Kuang-Chih Lee

In E-commerce advertising, where product recommendations and product ads are presented to users simultaneously, the traditional setting is to display ads at fixed positions. However, under such a setting, the advertising system loses the…

Machine Learning · Computer Science 2019-09-04 Weixun Wang , Junqi Jin , Jianye Hao , Chunjie Chen , Chuan Yu , Weinan Zhang , Jun Wang , Xiaotian Hao , Yixi Wang , Han Li , Jian Xu , Kun Gai

We propose a multi-agent distributed reinforcement learning algorithm that balances between potentially conflicting short-term reward and sparse, delayed long-term reward, and learns with partial information in a dynamic environment. We…

Machine Learning · Computer Science 2022-04-06 Jing Tan , Ramin Khalili , Holger Karl

Conversational agents struggle to handle long conversations due to context window limitations. Therefore, memory systems are developed to leverage essential historical information. Existing memory systems typically follow a pipeline of…

Computation and Language · Computer Science 2026-01-30 Yimin Deng , Yuqing Fu , Derong Xu , Yejing Wang , Wei Ni , Jingtong Gao , Xiaopeng Li , Chengxu Liu , Xiao Han , Guoshuai Zhao , Xiangyu Zhao , Li Zhu , Xueming Qian

Reinforcement learning algorithms in multi-agent systems deliver highly resilient and adaptable solutions for common problems in telecommunications,aerospace, and industrial robotics. However, achieving an optimal global goal remains a…

Multiagent Systems · Computer Science 2021-05-18 Changgang Zheng , Shufan Yang , Juan Parra-Ullauri , Antonio Garcia-Dominguez , Nelly Bencomo

When a game involves many agents or when communication between agents is not possible, it is useful to resort to distributed learning where each agent acts in complete autonomy without any information on the other agents' situations.…

Optimization and Control · Mathematics 2025-09-24 Jérôme Taupin , Xavier Leturc , Christophe J. Le Martret

In this work, we propose a novel memory-based multi-agent meta-learning architecture and learning procedure that allows for learning of a shared communication policy that enables the emergence of rapid adaptation to new and unseen…

We study an online learning problem on dynamic pricing and resource allocation, where we make joint pricing and inventory decisions to maximize the overall net profit. We consider the stochastic dependence of demands on the price, which…

Machine Learning · Computer Science 2025-05-23 Jianyu Xu , Xuan Wang , Yu-Xiang Wang , Jiashuo Jiang

We study the incentivized information acquisition problem, where a principal hires an agent to gather information on her behalf. Such a problem is modeled as a Stackelberg game between the principal and the agent, where the principal…

Machine Learning · Computer Science 2023-08-08 Siyu Chen , Jibang Wu , Yifan Wu , Zhuoran Yang

Agent-based models (ABMs) have shown promise for modelling various real world phenomena incompatible with traditional equilibrium analysis. However, a critical concern is the manual definition of behavioural rules in ABMs. Recent…

Multiagent Systems · Computer Science 2024-02-02 Benjamin Patrick Evans , Sumitra Ganesh

Popular methods in cooperative Multi-Agent Reinforcement Learning with partially observable environments typically allow agents to act independently during execution, which may limit the coordinated effect of the trained policies. However,…

Multiagent Systems · Computer Science 2025-07-22 Faizan Contractor , Li Li , Ranwa Al Mallah

We define and analyze a multi-agent multi-armed bandit problem in which decision-making agents can observe the choices and rewards of their neighbors. Neighbors are defined by a network graph with heterogeneous and stochastic…

Optimization and Control · Mathematics 2019-05-22 Udari Madhushani , Naomi Ehrich Leonard

In online advertising, auto-bidding has become an essential tool for advertisers to optimize their preferred ad performance metrics by simply expressing high-level campaign objectives and constraints. Previous works designed auto-bidding…

Multiagent Systems · Computer Science 2022-01-06 Chao Wen , Miao Xu , Zhilin Zhang , Zhenzhe Zheng , Yuhui Wang , Xiangyu Liu , Yu Rong , Dong Xie , Xiaoyang Tan , Chuan Yu , Jian Xu , Fan Wu , Guihai Chen , Xiaoqiang Zhu , Bo Zheng

Decision makers often aim to learn a treatment assignment policy under a capacity constraint on the number of agents that they can treat. When agents can respond strategically to such policies, competition arises, complicating estimation of…

Machine Learning · Statistics 2025-03-31 Roshni Sahoo , Stefan Wager

In various real-world scenarios, interactions among agents often resemble the dynamics of general-sum games, where each agent strives to optimize its own utility. Despite the ubiquitous relevance of such settings, decentralized machine…

Computer Science and Game Theory · Computer Science 2024-05-03 Milad Aghajohari , Juan Agustin Duque , Tim Cooijmans , Aaron Courville