English
Related papers

Related papers: MoTiAC: Multi-Objective Actor-Critics for Real-Tim…

200 papers

In recent years, RTB(Real Time Bidding) becomes a popular online advertisement trading method. During the auction, each DSP(Demand Side Platform) is supposed to evaluate current opportunity and respond with an ad and corresponding bid…

Machine Learning · Statistics 2017-12-29 Huahui Liu , Mingrui Zhu , Xiaonan Meng , Yi Hu , Hao Wang

Recently, there has been an increasing interest in automated prompt optimization based on reinforcement learning (RL). This approach offers important advantages, such as generating interpretable prompts and being compatible with black-box…

Machine Learning · Computer Science 2023-10-26 Dong-Ki Kim , Sungryull Sohn , Lajanugen Logeswaran , Dongsub Shim , Honglak Lee

Role-playing agents (RPAs) require balancing multiple objectives, such as instruction following, persona consistency, and stylistic fidelity, which are not always perfectly aligned across different dimensions. While prior work has primarily…

Computation and Language · Computer Science 2026-04-23 Chonghua Liao , Ke Wang , Yuchuan Wu , Ruoran Li , Fei Huang , Yongbin Li

Online advertising platforms often face a common challenge: the cold start problem. Insufficient behavioral data (clicks) makes accurate click-through rate (CTR) forecasting of new ads challenging. CTR for "old" items can also be…

Machine Learning · Computer Science 2025-02-05 Anastasiia Soboleva , Andrey Pudovikov , Roman Snetkov , Alina Babenko , Egor Samosvat , Yuriy Dorn

Traditional reinforcement learning (RL) methods typically employ a fixed control loop, where each cycle corresponds to an action. This rigidity poses challenges in practical applications, as the optimal control frequency is task-dependent.…

Machine Learning · Computer Science 2024-06-04 Dong Wang , Giovanni Beltrame

One of the widely used peak reduction methods in smart grids is demand response, where one analyzes the shift in customers' (agents') usage patterns in response to the signal from the distribution company. Often, these signals are in the…

Machine Learning · Computer Science 2023-02-27 Sanjay Chandlekar , Arthik Boroju , Shweta Jain , Sujit Gujar

Reinforcement learning agent-based simulation (RL-ABS) has become an important tool for electricity market mechanism analysis and evaluation. In the modeling of monotone, bounded, multi-segment stepwise bids, existing methods typically let…

Artificial Intelligence · Computer Science 2026-04-14 Zunnan Xu , Zhaoxia Jing , Zhanhua Pan

We consider the problem of using logged data to make predictions about what would happen if we changed the `rules of the game' in a multi-agent system. This task is difficult because in many cases we observe actions individuals take but not…

Computer Science and Game Theory · Computer Science 2019-04-05 Alexander Peysakhovich , Christian Kroer , Adam Lerer

Auto-bidding systems are widely used in advertising to automatically determine bid values under constraints such as total budget and Return-on-Spend (RoS) targets. Existing works often assume that the value of an ad impression, such as the…

Machine Learning · Computer Science 2026-02-03 Jiale Han , Chun Gan , Chengcheng Zhang , Jie He , Zhangang Lin , Ching Law , Xiaowu Dai

Advertisement auctions play a crucial role in revenue generation for e-commerce companies. To make the bidding procedure scalable to thousands of auctions, the automatic bidding (autobidding) algorithms are actively developed in the…

Computer Science and Game Theory · Computer Science 2025-10-23 Andrey Pudovikov , Alexandra Khirianova , Ekaterina Solodneva , Aleksandr Katrutsa , Egor Samosvat , Yuriy Dorn

We consider the problem of bidding in online advertising, where an advertiser aims to maximize value while adhering to budget and Return-on-Spend (RoS) constraints. Unlike prior work that assumes knowledge of the value generated by winning…

Machine Learning · Computer Science 2025-03-06 Sushant Vijayan , Zhe Feng , Swati Padmanabhan , Karthikeyan Shanmugam , Arun Suggala , Di Wang

The next frontier of online advertising is revenue generation from LLM-generated content. We consider a setting where advertisers aim to influence the responses of an LLM to align with their interests, while platforms seek to maximize…

Computer Science and Game Theory · Computer Science 2025-02-13 Ermis Soumalias , Michael J. Curry , Sven Seuken

We study an online learning problem on dynamic pricing and resource allocation, where we make joint pricing and inventory decisions to maximize the overall net profit. We consider the stochastic dependence of demands on the price, which…

Machine Learning · Computer Science 2025-05-23 Jianyu Xu , Xuan Wang , Yu-Xiang Wang , Jiashuo Jiang

The AI4GCC competition presents a bold step forward in the direction of integrating machine learning with traditional economic policy analysis. Below, we highlight two potential areas for improvement that could enhance the competition's…

Artificial Intelligence · Computer Science 2023-08-11 Marco Jiralerspong , Gauthier Gidel

Over the past decade, bidding in power markets has attracted widespread attention. Reinforcement Learning (RL) has been widely used for power market bidding as a powerful AI tool to make decisions under real-world uncertainties. However,…

Machine Learning · Computer Science 2024-10-16 Jinyu Liu , Hongye Guo , Yun Li , Qinghu Tang , Fuquan Huang , Tunan Chen , Haiwang Zhong , Qixin Chen

Bidding strategies that help advertisers determine bidding prices are receiving increasing attention as more and more ad impressions are sold through real-time bidding systems. This paper first describes the problem and challenges of…

Computer Science and Game Theory · Computer Science 2022-12-06 Mengjuan Liu , Zhengning Hu , Zhi Lai , Daiwei Zheng , Xuyun Nie

Learning to Rank (LTR) technique is ubiquitous in the Information Retrieval system nowadays, especially in the Search Ranking application. The query-item relevance labels typically used to train the ranking model are often noisy…

Information Retrieval · Computer Science 2022-07-11 Debabrata Mahapatra , Chaosheng Dong , Yetian Chen , Deqiang Meng , Michinari Momma

Real time bidding (RTB) enables demand side platforms (bidders) to scale ad campaigns across multiple publishers affiliated to an RTB ad exchange. While driving multiple campaigns for mobile app install ads via RTB, the bidder typically has…

Computer Science and Game Theory · Computer Science 2018-11-13 Anit Kumar Sahu , Shaunak Mishra , Narayan Bhamidipati

We study a real-time bidding problem resulting from a set of contractual obligations stipulating that a firm win a specified number of heterogeneous impressions or ad placements over a defined duration in a real-time auction. The contracts…

Systems and Control · Electrical Eng. & Systems 2020-12-21 R. J. Kinnear , R. R. Mazumdar , P. Marbach

Traditional auction theory posits that bid value exhibits a positive correlation with the probability of securing the auctioned object in ascending auctions. However, under uncertainty and incomplete information, as is characteristic in…

Theoretical Economics · Economics 2025-12-19 Dipankar Das