English
Related papers

Related papers: Q-Regularized Generative Auto-Bidding: From Subopt…

200 papers

We propose a novel approach to optimize fleet management by combining multi-agent reinforcement learning with graph neural network. To provide ride-hailing service, one needs to optimize dynamic resources and demands over spatial domain.…

Machine Learning · Computer Science 2021-08-09 Juhyeon Kim , Kihyun Kim

Traffic allocation is a process of redistributing natural traffic to products by adjusting their positions in the post-search phase, aimed at effectively fostering merchant growth, precisely meeting customer demands, and ensuring the…

Machine Learning · Computer Science 2024-07-23 Peng Cheng , Huimu Wang , Jinyuan Zhao , Yihao Wang , Enqiang Xu , Yu Zhao , Zhuojian Xiao , Songlin Wang , Guoyu Tang , Lin Liu , Sulong Xu

We present a novel definition of the reinforcement learning state, actions and reward function that allows a deep Q-network (DQN) to learn to control an optimization hyperparameter. Using Q-learning with experience replay, we train two DQNs…

Optimization and Control · Mathematics 2016-06-21 Samantha Hansen

Notifications are an important communication channel for delivering timely and relevant information. Optimizing their delivery involves addressing complex sequential decision-making challenges under constraints such as message utility and…

This paper introduces a reinforcement learning (RL) approach to address the challenges associated with configuring and optimizing genetic algorithms (GAs) for solving difficult combinatorial or non-linear problems. The proposed RL+GA method…

Large Language Models (LLMs) have shown remarkable performance on general Question Answering (QA), yet they often struggle in domain-specific scenarios where accurate and up-to-date information is required. Retrieval-Augmented Generation…

Computation and Language · Computer Science 2026-02-13 Haoyue Bai , Haoyu Wang , Shengyu Chen , Zhengzhang Chen , Lu-An Tang , Wei Cheng , Haifeng Chen , Yanjie Fu

In this paper, a new population-guided parallel learning scheme is proposed to enhance the performance of off-policy reinforcement learning (RL). In the proposed scheme, multiple identical learners with their own value-functions and…

Machine Learning · Computer Science 2020-01-10 Whiyoung Jung , Giseung Park , Youngchul Sung

Reinforcement learning continuously optimizes decision-making based on real-time feedback reward signals through continuous interaction with the environment, demonstrating strong adaptive and self-learning capabilities. In recent years, it…

Robotics · Computer Science 2024-08-15 Zixiang Wang , Hao Yan , Yining Wang , Zhengjia Xu , Zhuoyue Wang , Zhizhong Wu

Generative auto-bidding has demonstrated strong performance in online advertising, yet it often suffers from data scarcity in small-scale settings with limited advertiser participation. While cross-task data sharing is a natural remedy to…

Machine Learning · Computer Science 2026-02-10 Yiqin Lv , Zhiyu Mou , Miao Xu , Jinghao Chen , Qi Wang , Yixiu Mao , Yun Qu , Rongquan Bai , Chuan Yu , Jian Xu , Bo Zheng , Xiangyang Ji

Bidding optimization is one of the most critical problems in online advertising. Sponsored search (SS) auction, due to the randomness of user query behavior and platform nature, usually adopts keyword-level bidding strategies. In contrast,…

Artificial Intelligence · Computer Science 2018-03-02 Jun Zhao , Guang Qiu , Ziyu Guan , Wei Zhao , Xiaofei He

Offline reinforcement learning (RL) tries to learn the near-optimal policy with recorded offline experience without online exploration. Current offline RL research includes: 1) generative modeling, i.e., approximating a policy using fixed…

Machine Learning · Computer Science 2021-06-23 Hua Wei , Deheng Ye , Zhao Liu , Hao Wu , Bo Yuan , Qiang Fu , Wei Yang , Zhenhui Li

This study presents a novel computer system performance optimization and adaptive workload management scheduling algorithm based on Q-learning. In modern computing environments, characterized by increasing data volumes, task complexity, and…

Machine Learning · Computer Science 2024-11-11 Pochun Li , Yuyang Xiao , Jinghua Yan , Xuan Li , Xiaoye Wang

Auction-based recommender systems are prevalent in online advertising platforms, but they are typically optimized to allocate recommendation slots based on immediate expected return metrics, neglecting the downstream effects of…

Information Retrieval · Computer Science 2023-08-01 Ruiyang Xu , Jalaj Bhandari , Dmytro Korenkevych , Fan Liu , Yuchen He , Alex Nikulkov , Zheqing Zhu

Learning to bid in repeated first-price auctions is a fundamental problem at the interface of game theory and machine learning, which has seen a recent surge in interest due to the transition of display advertising to first-price auctions.…

Computer Science and Game Theory · Computer Science 2024-07-09 Rachitesh Kumar , Jon Schneider , Balasubramanian Sivan

Unmanned Aerial Vehicles need an online path planning capability to move in high-risk missions in unknown and complex environments to complete them safely. However, many algorithms reported in the literature may not return reliable…

Training a task-completion dialogue agent via reinforcement learning (RL) is costly because it requires many interactions with real users. One common alternative is to use a user simulator. However, a user simulator usually lacks the…

Computation and Language · Computer Science 2018-05-24 Baolin Peng , Xiujun Li , Jianfeng Gao , Jingjing Liu , Kam-Fai Wong , Shang-Yu Su

Policy gradient is an efficient technique for improving a policy in a reinforcement learning setting. However, vanilla online variants are on-policy only and not able to take advantage of off-policy data. In this paper we describe a new…

Machine Learning · Computer Science 2017-04-10 Brendan O'Donoghue , Remi Munos , Koray Kavukcuoglu , Volodymyr Mnih

Q-Learning is a fundamental off-policy reinforcement learning (RL) algorithm that has the objective of approximating action-value functions in order to learn optimal policies. Nonetheless, it has difficulties in reconciling bias with…

Machine Learning · Computer Science 2024-11-22 Mahammad Humayoo

We investigate the use of Reinforcement Learning for the optimal execution of meta-orders, where the objective is to execute incrementally large orders while minimizing implementation shortfall and market impact over an extended period of…

Trading and Market Microstructure · Quantitative Finance 2025-11-20 Tomas Espana , Yadh Hafsi , Fabrizio Lillo , Edoardo Vittori

Reinforcement learning (RL) is an effective technique for training decision-making agents through interactions with their environment. The advent of deep learning has been associated with highly notable successes with sequential decision…

Machine Learning · Computer Science 2021-05-25 Michael Tashman , John Hoffman , Jiayi Xie , Fengdan Ye , Atefeh Morsali , Lee Winikor , Rouzbeh Gerami