English
Related papers

Related papers: Online Model Evaluation in a Large-Scale Computati…

200 papers

Most of the work in the auction design literature assumes that bidders behave rationally based on the information available for every individual auction, and the revelation principle enables designers to restrict their efforts to incentive…

Computer Science and Game Theory · Computer Science 2024-05-14 Juncheng Li , Pingzhong Tang

In this paper, we initiate the study of the multiplicative bidding language adopted by major Internet search companies. In multiplicative bidding, the effective bid on a particular search auction is the product of a base bid and bid…

Data Structures and Algorithms · Computer Science 2014-04-29 MohammadHossein Bateni , Jon Feldman , Vahab Mirrokni , Sam Chiu-wai Wong

Online A/B testing, the gold standard for evaluating new advertising policies, consumes substantial engineering resources and risks significant revenue loss from deploying underperforming variations. This motivates the use of Off-Policy…

Machine Learning · Computer Science 2025-12-04 Hongseon Yeom , Jaeyoul Shin , Soojin Min , Jeongmin Yoon , Seunghak Yu , Dongyeop Kang

A critical challenge in recommender systems is to establish reliable relationships between offline and online metrics that predict real-world performance. Motivated by recent advances in Pareto front approximation, we introduce a pragmatic…

Information Retrieval · Computer Science 2025-07-15 Timo Wilm , Philipp Normann

Machine Learning (ML) models are increasingly used to support or substitute decision making. In applications where skilled experts are a limited resource, it is crucial to reduce their burden and automate decisions when the performance of…

Machine Learning · Computer Science 2024-10-01 Mirabel Reid , Tom Sühr , Claire Vernade , Samira Samadi

In this paper we introduce a discrete time competing virus model and the assumptions necessary for the model to be well posed. We analyze the system exploring its different equilibria. We provide necessary and sufficient conditions for the…

Systems and Control · Electrical Eng. & Systems 2020-01-30 Philip E. Pare , Damir Vrabac , Henrik Sandberg , Karl H. Johansson

The effectiveness of recommendation systems is pivotal to user engagement and satisfaction in online platforms. As these recommendation systems increasingly influence user choices, their evaluation transcends mere technical performance and…

Information Retrieval · Computer Science 2024-01-15 Aryan Jadon , Avinash Patil

Online advertising in E-commerce platforms provides sellers an opportunity to achieve potential audiences with different target goals. Ad serving systems (like display and search advertising systems) that assign ads to pages should satisfy…

Machine Learning · Computer Science 2019-10-09 Chao Wei , Weiru Zhang , Shengjie Sun , Fei Li , Xiaonan Meng , Yi Hu , Hao Wang

With expansion of the video advertising market, research to predict the effects of video advertising is getting more attention. Although effect prediction of image advertising has been explored a lot, prediction for video advertising is…

Computer Vision and Pattern Recognition · Computer Science 2020-12-23 Jun Ikeda , Hiroyuki Seshime , Xueting Wang , Toshihiko Yamasaki

Given $k$ pre-trained classifiers and a stream of unlabeled data examples, how can we actively decide when to query a label so that we can distinguish the best model from the rest while making a small number of queries? Answering this…

Machine Learning · Computer Science 2021-04-20 Mohammad Reza Karimi , Nezihe Merve Gürel , Bojan Karlaš , Johannes Rausch , Ce Zhang , Andreas Krause

Auction-based recommender systems are prevalent in online advertising platforms, but they are typically optimized to allocate recommendation slots based on immediate expected return metrics, neglecting the downstream effects of…

Information Retrieval · Computer Science 2023-08-01 Ruiyang Xu , Jalaj Bhandari , Dmytro Korenkevych , Fan Liu , Yuchen He , Alex Nikulkov , Zheqing Zhu

Online advertising platforms use automated auctions to connect advertisers with potential customers, requiring effective bidding strategies to maximize profits. Accurate ad impact estimation requires considering three key factors: delayed…

Machine Learning · Computer Science 2025-10-24 Yuwei Cheng , Zifeng Zhao , Haifeng Xu

Budget management strategies in repeated auctions have received growing attention in online advertising markets. However, previous work on budget management in online bidding mainly focused on second-price auctions. The rapid shift from…

Computer Science and Game Theory · Computer Science 2023-04-27 Qian Wang , Zongjun Yang , Xiaotie Deng , Yuqing Kong

In this paper, we deal with the uncertainty of bidding for display advertising. Similar to the financial market trading, real-time bidding (RTB) based display advertising employs an auction mechanism to automate the impression level media…

Computer Science and Game Theory · Computer Science 2017-01-23 Haifeng Zhang , Weinan Zhang , Yifei Rong , Kan Ren , Wenxin Li , Jun Wang

Real-Time Bidding (RTB) is an important mechanism in modern online advertising systems. Advertisers employ bidding strategies in RTB to optimize their advertising effects subject to various financial requirements, especially the…

Machine Learning · Computer Science 2022-07-19 Haozhe Wang , Chao Du , Panyan Fang , Shuo Yuan , Xuming He , Liang Wang , Bo Zheng

We present a unified framework for Batch Online Learning (OL) for Click Prediction in Search Advertisement. Machine Learning models once deployed, show non-trivial accuracy and calibration degradation over time due to model staleness. It is…

Machine Learning · Computer Science 2018-09-14 Rishabh Iyer , Nimit Acharya , Tanuja Bompada , Denis Charles , Eren Manavoglu

Adaptive designs are increasingly used in clinical trials and online experiments to improve participant outcomes by dynamically updating treatment allocation as data accumulate. In practice, experimenters often consider multiple candidate…

Methodology · Statistics 2026-04-08 Wenxin Zhang , Aaron Hudson , Maya Petersen , Mark van der Laan

The search engine evaluation research has quite a lot metrics available to it. Only recently, the question of the significance of individual metrics started being raised, as these metrics' correlations to real-world user experiences or…

Information Retrieval · Computer Science 2013-02-12 Pavel Sirotkin

Online advertising has recently grown into a highly competitive and complex multi-billion-dollar industry, with advertisers bidding for ad slots at large scales and high frequencies. This has resulted in a growing need for efficient…

Machine Learning · Computer Science 2023-07-04 Zhe Feng , Swati Padmanabhan , Di Wang

Online political advertising is a central aspect of modern election campaigning for influencing public opinion. Computational analysis of political ads is of utmost importance in political science to understand the characteristics of…

Computation and Language · Computer Science 2021-05-27 Danae Sánchez Villegas , Saeid Mokaram , Nikolaos Aletras