English
Related papers

Related papers: Marketing Budget Allocation with Offline Constrain…

200 papers

We propose a data augmentation method for offline reinforcement learning, motivated by active positioning problems. Particularly, our approach enables the training of off-policy models from a limited number of suboptimal trajectories. We…

Machine Learning · Computer Science 2026-05-14 Tobias Schmähling , Matthias Burkhardt , Tobias Windisch

Real-time bidding has emerged as an effective online advertising technique. With real-time bidding, advertisers can position ads per impression, enabling them to optimise ad campaigns by targeting specific audiences in real-time. This paper…

Information Retrieval · Computer Science 2023-05-09 Parikshit Sharma

We consider reinforcement learning (RL) methods in offline domains without additional online data collection, such as mobile health applications. Most of existing policy optimization algorithms in the computer science literature are…

Machine Learning · Statistics 2022-07-28 Chengchun Shi , Shikai Luo , Yuan Le , Hongtu Zhu , Rui Song

Pre-training with offline data and online fine-tuning using reinforcement learning is a promising strategy for learning control policies by leveraging the best of both worlds in terms of sample efficiency and performance. One natural…

Artificial Intelligence · Computer Science 2025-09-01 Haichao Zhang , We Xu , Haonan Yu

In offline reinforcement learning, a policy needs to be learned from a single pre-collected dataset. Typically, policies are thus regularized during training to behave similarly to the data generating policy, by adding a penalty based on a…

Machine Learning · Computer Science 2021-07-13 Phillip Swazinna , Steffen Udluft , Daniel Hein , Thomas Runkler

Marketing optimization, commonly formulated as an online budget allocation problem, has emerged as a pivotal factor in driving user growth. Most existing research addresses this problem by following the principle of 'first predict then…

Machine Learning · Computer Science 2025-06-03 Xiaohan Wang , Yu Zhang , Guibin Jiang , Bing Cheng , Wei Lin

Offline model-based optimization (MBO) seeks to discover high-performing designs using only a fixed dataset of past evaluations. Most existing methods rely on learning a surrogate model via regression and implicitly assume that good…

Machine Learning · Computer Science 2026-03-05 Shen-Huan Lyu , Rong-Xi Tan , Ke Xue , Yi-Xiao He , Yu Huang , Qingfu Zhang , Chao Qian

Today's top advertisers typically manage hundreds of campaigns simultaneously and consistently launch new ones throughout the year. A crucial challenge for marketing managers is determining the optimal allocation of limited budgets across…

Machine Learning · Statistics 2024-09-04 Lin Ge , Yang Xu , Jianing Chu , David Cramer , Fuhong Li , Kelly Paulson , Rui Song

Real-time bidding (RTB) is an important mechanism in online display advertising, where a proper bid for each page view plays an essential role for good marketing results. Budget constrained bidding is a typical scenario in RTB where the…

Artificial Intelligence · Computer Science 2018-10-24 Di Wu , Xiujun Chen , Xun Yang , Hao Wang , Qing Tan , Xiaoxun Zhang , Jian Xu , Kun Gai

The dynamic portfolio optimization problem in finance frequently requires learning policies that adhere to various constraints, driven by investor preferences and risk. We motivate this problem of finding an allocation policy within a…

Artificial Intelligence · Computer Science 2020-12-23 Nymisha Bandi , Theja Tulabandhula

Offline-to-online reinforcement learning harnesses the stability of offline pretraining and the flexibility of online fine-tuning. A key challenge lies in the non-stationary distribution shift between offline datasets and the evolving…

Machine Learning · Computer Science 2026-05-15 Letian Yang , Xu Liu , Yiqiang Lu , Jian Liu , Weiqiang Wang , Shuai Li

Marketing is an important mechanism to increase user engagement and improve platform revenue, and heterogeneous causal learning can help develop more effective strategies. Most decision-making problems in marketing can be formulated as…

Machine Learning · Computer Science 2022-12-01 Hao Zhou , Shaoming Li , Guibin Jiang , Jiaqi Zheng , Dong Wang

Transfer learning significantly accelerates the reinforcement learning process by exploiting relevant knowledge from previous experiences. The problem of optimally selecting source policies during the learning process is of great importance…

Artificial Intelligence · Computer Science 2017-09-26 Siyuan Li , Chongjie Zhang

By reusing data throughout training, off-policy deep reinforcement learning algorithms offer improved sample efficiency relative to on-policy approaches. For continuous action spaces, the most popular methods for off-policy learning include…

Machine Learning · Computer Science 2023-12-01 Jared Markowitz , Jesse Silverberg , Gary Collins

With the continuous development of machine learning technology, major e-commerce platforms have launched recommendation systems based on it to serve a large number of customers with different needs more efficiently. Compared with…

Machine Learning · Computer Science 2020-12-14 Yang Yu , Zhenhao Gu , Rong Tao , Jingtian Ge , Kenglun Chang

In a sequential decision-making problem, off-policy evaluation estimates the expected cumulative reward of a target policy using logged trajectory data generated from a different behavior policy, without execution of the target policy.…

Machine Learning · Computer Science 2022-11-04 Jie Wang , Rui Gao , Hongyuan Zha

We utilize an offline reinforcement learning (RL) model for sequential targeted promotion in the presence of budget constraints in a real-world business environment. In our application, the mobile app aims to boost customer retention by…

Machine Learning · Computer Science 2022-07-19 Fanglin Chen , Xiao Liu , Bo Tang , Feiyu Xiong , Serim Hwang , Guomian Zhuang

We study the problem of representation transfer in offline Reinforcement Learning (RL), where a learner has access to episodic data from a number of source tasks collected a priori, and aims to learn a shared representation to be used in…

Machine Learning · Computer Science 2024-02-21 Avinandan Bose , Simon Shaolei Du , Maryam Fazel

Offline reinforcement learning endeavors to leverage offline datasets to craft effective agent policy without online interaction, which imposes proper conservative constraints with the support of behavior policies to tackle the…

Machine Learning · Computer Science 2024-11-12 Yunpeng Qing , Shunyu liu , Jingyuan Cong , Kaixuan Chen , Yihe Zhou , Mingli Song

Offline reinforcement learning enables agents to leverage large pre-collected datasets of environment transitions to learn control policies, circumventing the need for potentially expensive or unsafe online data collection. Significant…

Machine Learning · Computer Science 2022-03-17 Cong Lu , Philip J. Ball , Jack Parker-Holder , Michael A. Osborne , Stephen J. Roberts