English
Related papers

Related papers: Offline Evaluation of Reward-Optimizing Recommende…

200 papers

Online optimization has emerged as powerful tool in large scale optimization. In this paper, we introduce efficient online algorithms based on the alternating directions method (ADM). We introduce a new proof technique for ADM in the batch…

Machine Learning · Computer Science 2012-07-03 Huahua Wang , Arindam Banerjee

In this study, we aim to enhance the arithmetic reasoning ability of Large Language Models (LLMs) through zero-shot prompt optimization. We identify a previously overlooked objective of query dependency in such optimization and elucidate…

Computation and Language · Computer Science 2024-03-08 Hao Sun , Alihan Hüyük , Mihaela van der Schaar

Model-based approaches are becoming increasingly popular in the field of offline reinforcement learning, with high potential in real-world applications due to the model's capability of thoroughly utilizing the large historical datasets…

Machine Learning · Computer Science 2023-05-08 Haoyang He

This paper proposes a novel framework to evaluate fluid simulation methods based on crowd-sourced user studies in order to robustly gather large numbers of opinions. The key idea for a robust and reliable evaluation is to use a reference…

Graphics · Computer Science 2020-11-23 Kiwon Um , Xiangyu Hu , Nils Thuerey

Automated platforms which support users in finding a mutually beneficial match, such as online dating and job recruitment sites, are becoming increasingly popular. These platforms often include recommender systems that assist users in…

Artificial Intelligence · Computer Science 2018-07-04 Akiva Kleinerman , Ariel Rosenfeld , Sarit Kraus

The extension of classical online algorithms when provided with predictions is a new and active research area. In this paper, we extend the primal-dual method for online algorithms in order to incorporate predictions that advise the online…

Machine Learning · Computer Science 2020-10-23 Étienne Bamas , Andreas Maggiori , Ola Svensson

The effectiveness of recommendation systems is pivotal to user engagement and satisfaction in online platforms. As these recommendation systems increasingly influence user choices, their evaluation transcends mere technical performance and…

Information Retrieval · Computer Science 2024-01-15 Aryan Jadon , Avinash Patil

While imitation learning requires access to high-quality data, offline reinforcement learning (RL) should, in principle, perform similarly or better with substantially lower data quality by using a value function. However, current results…

Machine Learning · Computer Science 2024-10-30 Seohong Park , Kevin Frans , Sergey Levine , Aviral Kumar

Offline Reinforcement Learning (RL) aims to learn a near-optimal policy from a fixed dataset of transitions collected by another policy. This problem has attracted a lot of attention recently, but most existing methods with strong…

Machine Learning · Computer Science 2023-05-23 Germano Gabbianelli , Gergely Neu , Nneka Okolo , Matteo Papini

Many real-world classification problems are significantly class-imbalanced to detriment of the class of interest. The standard set of proper evaluation metrics is well-known but the usual assumption is that the test dataset imbalance equals…

Machine Learning · Computer Science 2020-04-16 Jan Brabec , Tomáš Komárek , Vojtěch Franc , Lukáš Machlica

Offline reinforcement learning (RL) aims at learning a good policy from a batch of collected data, without extra interactions with the environment during training. However, current offline RL benchmarks commonly have a large reality gap,…

Machine Learning · Computer Science 2021-02-09 Rongjun Qin , Songyi Gao , Xingyuan Zhang , Zhen Xu , Shengkai Huang , Zewen Li , Weinan Zhang , Yang Yu

Offline optimization aims to maximize a black-box objective function with a static dataset and has wide applications. In addition to the objective function being black-box and expensive to evaluate, numerous complex real-world problems…

Machine Learning · Computer Science 2024-06-07 Ke Xue , Rong-Xi Tan , Xiaobin Huang , Chao Qian

$ $The classical theory of statistical estimation aims to estimate a parameter of interest under data generated from a fixed design ("offline estimation"), while the contemporary theory of online learning provides algorithms for estimation…

Machine Learning · Statistics 2024-04-17 Dylan J. Foster , Yanjun Han , Jian Qian , Alexander Rakhlin

Simulators are the most dominant and eminent tool for analyzing and investigating different type of networks. The simulations can be executed with less cost as compared to large scale experiment as less computational resources are required…

Networking and Internet Architecture · Computer Science 2014-05-05 Mansoor Ebrahim , Shujaat Khan , Syed Sheraz Ul Hasan Mohani

Though competitive analysis has been a very useful performance measure for the quality of online algorithms, it is recognized that it sometimes fails to distinguish between algorithms of different quality in practice. A number of…

Data Structures and Algorithms · Computer Science 2015-03-19 Joan Boyar , Kim S. Larsen , Abyayananda Maiti

This paper addresses the design and analysis of feedback-based online algorithms to control systems or networked systems based on performance objectives and engineering constraints that may evolve over time. The emerging time-varying convex…

Optimization and Control · Mathematics 2019-03-27 Andrey Bernstein , Emiliano Dall'Anese , Andrea Simonetto

Online experiments (A/B tests) are widely regarded as the gold standard for evaluating recommender system variants and guiding launch decisions. However, a variety of biases can distort the results of the experiment and mislead…

Information Retrieval · Computer Science 2025-09-03 Chen Zheng , Zhenyu Zhao

Offline policy evaluation is a fundamental statistical problem in reinforcement learning that involves estimating the value function of some decision-making policy given data collected by a potentially different policy. In order to tackle…

Machine Learning · Computer Science 2022-12-20 Juan C. Perdomo , Akshay Krishnamurthy , Peter Bartlett , Sham Kakade

Selecting the optimal recommender via online exploration-exploitation is catching increasing attention where the traditional A/B testing can be slow and costly, and offline evaluations are prone to the bias of history data. Finding the…

Information Retrieval · Computer Science 2022-03-29 Da Xu , Chuanwei Ruan , Evren Korpeoglu , Sushant Kumar , Kannan Achan

In this paper, we develop a recommender system for a game that suggests potential items to players based on their interactive behaviors to maximize revenue for the game provider. Our approach is built on a reinforcement learning-based…

Artificial Intelligence · Computer Science 2021-11-18 Hung Nguyen , Minh Nguyen , Long Pham , Jennifer Adorno Nieves