中文
相关论文

相关论文: Deep Reinforcement Learning for Sponsored Search R…

200 篇论文

Strategic recommendations (SR) refer to the problem where an intelligent agent observes the sequential behaviors and activities of users and decides when and how to interact with them to optimize some long-term objectives, both for the user…

机器学习 · 计算机科学 2020-09-17 Georgios Theocharous , Yash Chandak , Philip S. Thomas , Frits de Nijs

This paper describes a purely data-driven solution to a class of sequential decision-making problems with a large number of concurrent online decisions, with applications to computing systems and operations research. We assume that while…

人工智能 · 计算机科学 2019-10-02 Hardik Meisheri , Vinita Baniwal , Nazneen N Sultana , Balaraman Ravindran , Harshad Khadilkar

We consider the problem of bidding in online advertising, where an advertiser aims to maximize value while adhering to budget and Return-on-Spend (RoS) constraints. Unlike prior work that assumes knowledge of the value generated by winning…

机器学习 · 计算机科学 2025-03-06 Sushant Vijayan , Zhe Feng , Swati Padmanabhan , Karthikeyan Shanmugam , Arun Suggala , Di Wang

The online advertising market, with its thousands of auctions run per second, presents a daunting challenge for advertisers who wish to optimize their spend under a budget constraint. Thus, advertising platforms typically provide automated…

机器学习 · 计算机科学 2023-10-17 Dmytro Korenkevych , Frank Cheng , Artsiom Balakir , Alex Nikulkov , Lingnan Gao , Zhihao Cen , Zuobing Xu , Zheqing Zhu

Reinforcement learning (RL) for auto-bidding has shifted from using simplistic offline simulators (Simulation-based RL Bidding, SRLB) to offline RL on fixed real datasets (Offline RL Bidding, ORLB). However, ORLB policies are limited by the…

机器学习 · 计算机科学 2025-06-24 Zhiyu Mou , Miao Xu , Wei Chen , Rongquan Bai , Chuan Yu , Jian Xu

Reinforcement learning (RL) has been widely applied in recommendation systems due to its potential in optimizing the long-term engagement of users. From the perspective of RL, recommendation can be formulated as a Markov decision process…

信息检索 · 计算机科学 2023-10-26 Chengpeng Li , Zhengyi Yang , Jizhi Zhang , Jiancan Wu , Dingxian Wang , Xiangnan He , Xiang Wang

Deep reinforcement learning (DRL) has recently shown its success in tackling complex combinatorial optimization problems. When these problems are extended to multiobjective ones, it becomes difficult for the existing DRL approaches to…

人工智能 · 计算机科学 2022-02-15 Zizhen Zhang , Zhiyuan Wu , Hang Zhang , Jiahai Wang

We study the budget allocation problem in online marketing campaigns that utilize previously collected offline data. We first discuss the long-term effect of optimizing marketing budget allocation decisions in the offline setting. To…

机器学习 · 计算机科学 2023-09-07 Tianchi Cai , Jiyan Jiang , Wenpeng Zhang , Shiji Zhou , Xierui Song , Li Yu , Lihong Gu , Xiaodong Zeng , Jinjie Gu , Guannan Zhang

Search Engine marketing teams in the e-commerce industry manage global search engine traffic to their websites with the aim to optimize long-term profitability by delivering the best possible customer experience on Search Engine Results…

信息检索 · 计算机科学 2025-06-30 Purak Jain , Sandeep Appala

In the Real-Time Bidding (RTB), advertisers are increasingly relying on bid optimization to gain more conversions (i.e trade or arrival). Currently, the efficiency of bid optimization is still challenged by the (1) sparse feedback, (2) the…

计算机科学与博弈论 · 计算机科学 2022-06-28 Xiao Wang , Shaoguo Liu , Yidong Jia , Yuxin Fu , Yufang Yu , Liang Wang , Bo Zheng

Nowadays, a significant share of the business-to-consumer sector is based on online platforms like Amazon and Alibaba and uses AI for pricing strategies. This has sparked debate on whether pricing algorithms may tacitly collude to set…

综合经济学 · 经济学 2025-03-17 Shidi Deng , Maximilian Schiffer , Martin Bichler

Deep reinforcement learning (DRL) is a well-suited approach to financial decision-making, where an agent makes decisions based on its trading strategy developed from market observations. Existing DRL intraday trading strategies mainly use…

交易与市场微观结构 · 定量金融 2024-06-13 Sven Goluža , Tomislav Kovačević , Tessa Bauman , Zvonko Kostanjčar

Artificial Intelligence (AI) and Machine Learning (ML) are transforming the domain of Quantitative Trading (QT) through the deployment of advanced algorithms capable of sifting through extensive financial datasets to pinpoint lucrative…

交易与市场微观结构 · 定量金融 2023-12-27 Maochun Xu , Zixun Lan , Zheng Tao , Jiawei Du , Zongao Ye

We present LADDER, the first deep reinforcement learning agent that can successfully learn control policies for large-scale real-world problems directly from raw inputs composed of high-level semantic information. The agent is based on an…

机器学习 · 计算机科学 2017-09-04 Yu Wang , Jiayi Liu , Yuxiang Liu , Jun Hao , Yang He , Jinghe Hu , Weipeng P. Yan , Mantian Li

A deep reinforcement learning (DRL) agent observes its states through observations, which may contain natural measurement errors or adversarial noises. Since the observations deviate from the true states, they can mislead the agent into…

机器学习 · 计算机科学 2021-07-15 Huan Zhang , Hongge Chen , Chaowei Xiao , Bo Li , Mingyan Liu , Duane Boning , Cho-Jui Hsieh

The battery energy storage system (BESS) has immense potential for enhancing grid reliability and security through its participation in the electricity market. BESS often seeks various revenue streams by taking part in multiple markets to…

系统与控制 · 电气工程与系统科学 2024-03-01 Jinhao Li , Changlong Wang , Yanru Zhang , Hao Wang

Recommender systems play a crucial role in mitigating the problem of information overload by suggesting users' personalized items or services. The vast majority of traditional recommender systems consider the recommendation procedure as a…

机器学习 · 计算机科学 2019-06-28 Xiangyu Zhao , Liang Zhang , Long Xia , Zhuoye Ding , Dawei Yin , Jiliang Tang

Ad auctions in sponsored search support ``broad match'' that allows an advertiser to target a large number of queries while bidding only on a limited number. While giving more expressiveness to advertisers, this feature makes it challenging…

计算机科学与博弈论 · 计算机科学 2009-01-26 Eyal Even-dar , Yishay Mansour , Vahab Mirrokni , S. Muthukrishnan , Uri Nadav

Finding optimal bidding strategies for generation units in electricity markets would result in higher profit. However, it is a challenging problem due to the system uncertainty which is due to the unknown other generation units' strategies.…

人工智能 · 计算机科学 2022-08-15 Pegah Rokhforoz , Olga Fink

We develop a portfolio allocation framework that leverages deep learning techniques to address challenges arising from high-dimensional, non-stationary, and low-signal-to-noise market information. Our approach includes a dynamic embedding…

投资组合管理 · 定量金融 2025-01-31 Jinghai He , Cheng Hua , Chunyang Zhou , Zeyu Zheng