English
Related papers

Related papers: MoTiAC: Multi-Objective Actor-Critics for Real-Tim…

200 papers

It is a very challenging task to identify the objectives on which a certain decision was based, in particular if several, potentially conflicting criteria are equally important and a continuous set of optimal compromise decisions exists.…

Optimization and Control · Mathematics 2021-03-05 Bennet Gebken , Sebastian Peitz

In multi-agent reinforcement learning, multiple agents learn simultaneously while interacting with a common environment and each other. Since the agents adapt their policies during learning, not only the behavior of a single agent becomes…

Artificial Intelligence · Computer Science 2022-04-13 Yuan Tian , Klaus-Rudolf Kladny , Qin Wang , Zhiwu Huang , Olga Fink

Automated bidding, an emerging intelligent decision making paradigm powered by machine learning, has become popular in online advertising. Advertisers in automated bidding evaluate the cumulative utilities and have private financial…

Computer Science and Game Theory · Computer Science 2023-08-22 Yidan Xing , Zhilin Zhang , Zhenzhe Zheng , Chuan Yu , Jian Xu , Fan Wu , Guihai Chen

Intelligent robots provide a new insight into efficiency improvement in industrial and service scenarios to replace human labor. However, these scenarios include dense and dynamic obstacles that make motion planning of robots challenging.…

Robotics · Computer Science 2021-02-08 Chengmin Zhou , Bingding Huang , Pasi Fränti

Auto-bidding systems aim to maximize advertiser value over long horizons under budget constraints and ratio targets such as cost-per-acquisition, yet future traffic and auction dynamics are non-stationary and uncertain. Existing approaches…

Artificial Intelligence · Computer Science 2026-05-28 Eunseok Yang , Xingdong Zuo , Kyung-Min Kim

Deep reinforcement learning (RL) algorithms can use high-capacity deep networks to learn directly from image observations. However, these high-dimensional observation spaces present a number of challenges in practice, since the policy must…

Machine Learning · Computer Science 2020-10-27 Alex X. Lee , Anusha Nagabandi , Pieter Abbeel , Sergey Levine

Ranking is a fundamental and widely studied problem in scenarios such as search, advertising, and recommendation. However, joint optimization for multi-scenario ranking, which aims to improve the overall performance of several ranking…

Artificial Intelligence · Computer Science 2018-09-18 Jun Feng , Heng Li , Minlie Huang , Shichen Liu , Wenwu Ou , Zhirong Wang , Xiaoyan Zhu

Bid shading plays a crucial role in Real-Time Bidding (RTB) by adaptively adjusting the bid to avoid advertisers overspending. Existing mainstream two-stage methods, which first model bid landscapes and then optimize surplus using…

Computer Science and Game Theory · Computer Science 2026-04-30 Yinqiu Huang , Hao Ma , Wenshuai Chen , Zongwei Wang , Shuli Wang , Yongqiang Zhang , Xue Wei , Yinhua Zhu , Haitao Wang , Xingxing Wang

Internet live streaming is widely used in online entertainment and e-commerce, where live advertising is an important marketing tool for anchors. An advertising campaign hopes to maximize the effect (such as conversions) under constraints…

Machine Learning · Statistics 2025-08-11 Bo Yang , Ruixuan Luo , Junqi Jin , Han Zhu

In computational advertising, a challenging problem is how to recommend the bid for advertisers to achieve the best return on investment (ROI) given budget constraint. This paper presents a bid recommendation scenario that discovers the…

Information Retrieval · Computer Science 2022-12-29 Deguang Kong , Konstantin Shmakov , Jian Yang

We improve the best known competitive ratio (from 1/4 to 1/2), for the online multi-unit allocation problem, where the objective is to maximize the single-price revenue. Moreover, the competitive ratio of our algorithm tends to 1, as the…

Computer Science and Game Theory · Computer Science 2009-01-13 Sourav Chakraborty , Nikhil Devanur

With the recent prevalence of reinforcement learning (RL), there have been tremendous interests in utilizing RL for ads allocation in recommendation platforms (e.g., e-commerce and news feed sites). To achieve better allocation, the input…

Machine Learning · Computer Science 2022-08-12 Ze Wang , Guogang Liao , Xiaowen Shi , Xiaoxu Wu , Chuheng Zhang , Yongkang Wang , Xingxing Wang , Dong Wang

The development of reinforced learning methods has extended application to many areas including algorithmic trading. In this paper trading on the stock exchange is interpreted into a game with a Markov property consisting of states,…

Trading and Market Microstructure · Quantitative Finance 2020-02-28 Evgeny Ponomarev , Ivan Oseledets , Andrzej Cichocki

In classic reinforcement learning (RL) and decision making problems, policies are evaluated with respect to a scalar reward function, and all optimal policies are the same with regards to their expected return. However, many real-world…

Machine Learning · Computer Science 2023-11-02 Han Shao , Lee Cohen , Avrim Blum , Yishay Mansour , Aadirupa Saha , Matthew R. Walter

This paper describes a study of agent bidding strategies, assuming combinatorial valuations for complementary and substitutable goods, in three auction environments: sequential auctions, simultaneous auctions, and the Trading Agent…

Computer Science and Game Theory · Computer Science 2012-07-19 Amy Greenwald , Justin Boyan

Market making (MM) is an important research topic in quantitative finance, the agent needs to continuously optimize ask and bid quotes to provide liquidity and make profits. The limit order book (LOB) contains information on all active…

Computational Finance · Quantitative Finance 2023-05-26 Hong Guo , Jianwu Lin , Fanlin Huang

Recent works have demonstrated that using reinforcement learning (RL) with multiple quality rewards can improve the quality of generated images in text-to-image (T2I) generation. However, manually adjusting reward weights poses challenges…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Seung Hyun Lee , Yinxiao Li , Junjie Ke , Innfarn Yoo , Han Zhang , Jiahui Yu , Qifei Wang , Fei Deng , Glenn Entis , Junfeng He , Gang Li , Sangpil Kim , Irfan Essa , Feng Yang

Reinforcement learning (RL) provides an appealing formalism for learning control policies from experience. However, the classic active formulation of RL necessitates a lengthy active exploration process for each behavior, making it…

Machine Learning · Computer Science 2021-04-27 Ashvin Nair , Abhishek Gupta , Murtaza Dalal , Sergey Levine

Trading markets represent a real-world financial application to deploy reinforcement learning agents, however, they carry hard fundamental challenges such as high variance and costly exploration. Moreover, markets are inherently a…

Machine Learning · Computer Science 2021-07-20 Yue Gao , Kry Yik Chau Lui , Pablo Hernandez-Leal

In Multi-objective Reinforcement Learning (MORL) agents are tasked with optimising decision-making behaviours that trade-off between multiple, possibly conflicting, objectives. MORL based on decomposition is a family of solution methods…

Machine Learning · Computer Science 2025-06-17 Yucheng Shi , David Lynch , Alexandros Agapitos