English
Related papers

Related papers: Learning Best Response Strategies for Agents in Ad…

200 papers

The E-commerce advertising platforms typically sell commercial traffic through either second-price auction (SPA) or first-price auction (FPA). SPA was historically prevalent due to its dominant strategy incentive-compatible (DSIC) for…

Computer Science and Game Theory · Computer Science 2025-10-20 Qi Li , Wendong Huang , Qichen Ye , Wutong Xu , Cheems Wang , Rongquan Bai , Wei Yuan , Guan Wang , Chuan Yu , Jian Xu

LLM agents in markets present algorithmic collusion risks. While prior work shows LLM agents reach supracompetitive prices through tacit coordination, existing research focuses on hand-crafted prompts. The emerging paradigm of prompt…

Artificial Intelligence · Computer Science 2026-04-21 Yingtao Tian

Online platforms in the Internet Economy commonly incorporate recommender systems that recommend products (or "arms") to users (or "agents"). A key challenge in this domain arises from myopic agents who are naturally incentivized to exploit…

Information Retrieval · Computer Science 2024-06-19 Xiaowu Dai , Wenlu Xu , Yuan Qi , Michael I. Jordan

This study addresses the challenges of dynamics and complexity in intelligent human-computer interaction and proposes a reinforcement learning-based optimization framework to improve long-term returns and overall experience. Human-computer…

Human-Computer Interaction · Computer Science 2025-11-03 Rui Liu , Yifan Zhuang , Runsheng Zhang

Real-time bidding (RTB) has become a major paradigm of display advertising. Each ad impression generated from a user visit is auctioned in real time, where demand-side platform (DSP) automatically provides bid price usually relying on the…

Information Retrieval · Computer Science 2022-12-26 Zhimeng Jiang , Kaixiong Zhou , Mi Zhang , Rui Chen , Xia Hu , Soo-Hyun Choi

This paper explores how ad platforms can utilize Bayesian persuasion within blockchain-based auction systems to strategically influence advertiser behavior despite increased transparency. By integrating game-theoretic models with machine…

General Economics · Economics 2024-12-10 Xinyu Li

We consider the budget optimization problem faced by an advertiser participating in repeated sponsored search auctions, seeking to maximize the number of clicks attained under that budget. We cast the budget optimization problem as a Markov…

Computer Science and Game Theory · Computer Science 2012-10-19 Kareem Amin , Michael Kearns , Peter Key , Anton Schwaighofer

Multi-agent reinforcement learning systems aim to provide interacting agents with the ability to collaboratively learn and adapt to the behaviour of other agents. In many real-world applications, the agents can only acquire a partial view…

Machine Learning · Computer Science 2018-12-04 Ozsel Kilinc , Giovanni Montana

Companies like Google and Microsoft run billions of auctions every day to sell advertising opportunities. Any change to the rules of these auctions can have a tremendous effect on the revenue of the company and the welfare of the…

Computer Science and Game Theory · Computer Science 2019-11-07 Saeed Alaei , Ashwinkumar Badanidiyuru , Mohammad Mahdian , Sadra Yazdanbod

Communication is essential for coordination among humans and animals. Therefore, with the introduction of intelligent agents into the world, agent-to-agent and agent-to-human communication becomes necessary. In this paper, we first study…

Multiagent Systems · Computer Science 2021-03-04 Varun Bhatt , Michael Buro

Considering that the decision-making environment faced by reinforcement learning (RL) agents is full of Knightian uncertainty, this paper describes the exploratory state dynamics equation in Knightian uncertainty to study the…

Optimization and Control · Mathematics 2026-01-27 Ziyu Li , Chen Fei , Weiyin Fei

Autonomous agents (robots) face tremendous challenges while interacting with heterogeneous human agents in close proximity. One of these challenges is that the autonomous agent does not have an accurate model tailored to the specific human…

Robotics · Computer Science 2023-04-25 Shuangge Wang , Yiwei Lyu , John M. Dolan

Multi-agent systems are prevalent in a wide range of domains including power systems, vehicular networks, and robotics. Two important problems to solve in these types of systems are how the intentions of non-coordinating agents can be…

Multiagent Systems · Computer Science 2025-09-30 Benjamin Alcorn , Eman Hammad

We study a game between autobidding algorithms that compete in an online advertising platform. Each autobidder is tasked with maximizing its advertiser's total value over multiple rounds of a repeated auction, subject to budget and…

Computer Science and Game Theory · Computer Science 2024-12-03 Brendan Lucier , Sarath Pattathil , Aleksandrs Slivkins , Mengxiao Zhang

We study the stochastic Multiplayer Multi-Armed Bandit (MMAB) problem, where multiple players select arms to maximize their cumulative rewards. Collisions occur when two or more players select the same arm, resulting in no reward, and are…

Machine Learning · Computer Science 2025-10-09 Daoyuan Zhou , Xuchuang Wang , Lin Yang , Yang Gao

Algorithmic collusion has emerged as a central question in AI: Will the interaction between different AI agents deployed in markets lead to collusion? More generally, understanding how emergent behavior, be it a cartel or market dominance…

Multiagent Systems · Computer Science 2025-10-31 Ziyi Wang , Carmine Ventre , Maria Polukarov

We consider the problem of learning by demonstration from agents acting in unknown stochastic Markov environments or games. Our aim is to estimate agent preferences in order to construct improved policies for the same task that the agents…

Machine Learning · Computer Science 2014-08-12 Aristide Tossou , Christos Dimitrakakis

We consider the problem of learning by demonstration from agents acting in unknown stochastic Markov environments or games. Our aim is to estimate agent preferences in order to construct improved policies for the same task that the agents…

Machine Learning · Statistics 2013-07-16 Aristide C. Y. Tossou , Christos Dimitrakakis

We consider the issue of a market maker acting at the same time in the lit and dark pools of an exchange. The exchange wishes to establish a suitable make-take fees policy to attract transactions on its venues. We first solve the stochastic…

Mathematical Finance · Quantitative Finance 2019-12-04 Bastien Baldacci , Iuliia Manziuk , Thibaut Mastrolia , Mathieu Rosenbaum

We investigate brokerage between traders from an online learning perspective. At any round $t$, two traders arrive with their private valuations, and the broker proposes a trading price. Unlike other bilateral trade problems already studied…

Machine Learning · Computer Science 2023-10-19 Nataša Bolić , Tommaso Cesari , Roberto Colomboni