English
Related papers

Related papers: Cache-Aware Reinforcement Learning in Large-Scale …

200 papers

We investigate reinforcement learning (RL) for privileged planning in autonomous driving. State-of-the-art approaches for this task are rule-based, but these methods do not scale to the long tail. RL, on the other hand, is scalable and does…

Machine Learning · Computer Science 2025-08-22 Bernhard Jaeger , Daniel Dauner , Jens Beißwenger , Simon Gerstenecker , Kashyap Chitta , Andreas Geiger

In Federated Learning (FL), the data in each client is typically assumed fixed or static. However, data often comes in an incremental manner in real-world applications, where the data domain may increase dynamically. In this work, we study…

Machine Learning · Computer Science 2024-06-04 Yichen Li , Qunwei Li , Haozhao Wang , Ruixuan Li , Wenliang Zhong , Guannan Zhang

We consider in this work Edge Computing (EC) in a multi-tenant environment: the resource owner, i.e., the Network Operator (NO), virtualizes the resources and lets third party Service Providers (SPs - tenants) run their services, which can…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-01-25 Ayoub Ben-Ameur , Andrea Araldo , Tijani Chahed

"High Quality Related Search Query Suggestions" task aims at recommending search queries which are real, accurate, diverse, relevant and engaging. Obtaining large amounts of query-quality human annotations is expensive. Prior work on…

Information Retrieval · Computer Science 2021-08-11 Praveen Kumar Bodigutla

Online recommender systems (RS) aim to match user needs with the vast amount of resources available on various platforms. A key challenge is to model user preferences accurately under the condition of data sparsity. To address this…

Information Retrieval · Computer Science 2023-09-20 Ning Wu , Ming Gong , Linjun Shou , Jian Pei , Daxin Jiang

Aggregated search aims to construct search result pages (SERPs) from blue-links and heterogeneous modules (such as news, images, and videos). Existing studies have largely ignored the correlations between blue-links and heterogeneous…

Information Retrieval · Computer Science 2019-08-09 Xinting Huang , Jianzhong Qi , Yu Sun , Rui Zhang , Hai-Tao Zheng

Traditional multi-agent reinforcement learning (MARL) algorithms, such as independent Q-learning, struggle when presented with partially observable scenarios, and where agents are required to develop delicate action sequences. This is often…

Machine Learning · Computer Science 2022-11-21 F. Bredell , H. A. Engelbrecht , J. C. Schoeman

We introduce ROLL, an efficient, scalable, and user-friendly library designed for Reinforcement Learning Optimization for Large-scale Learning. ROLL caters to three primary user groups: tech pioneers aiming for cost-effective,…

The scaling law, which indicates that model performance improves with increasing dataset and model capacity, has fueled a growing trend in expanding recommendation models in both industry and academia. However, the advent of large-scale…

Information Retrieval · Computer Science 2026-01-30 Qihang Yu , Kairui Fu , Zhaocheng Du , Yuxuan Si , Kaiyuan Li , Weihao Zhao , Zhicheng Zhang , Jieming Zhu , Quanyu Dai , Zhenhua Dong , Shengyu Zhang , Kun Kuang , Fei Wu

In recent years, there has been a growing interest in utilizing reinforcement learning (RL) to optimize long-term rewards in recommender systems. Since industrial recommender systems are typically designed as multi-stage systems, RL methods…

Information Retrieval · Computer Science 2024-01-15 Gengrui Zhang , Yao Wang , Xiaoshuang Chen , Hongyi Qian , Kaiqiao Zhan , Ben Wang

Recommendation system is able to shape user demands, which can be used for boosting caching gain. In this paper, we jointly optimize content caching and recommendation at base stations to maximize the caching gain meanwhile not compromising…

Networking and Internet Architecture · Computer Science 2018-10-29 Dong Liu , Chenyang Yang

Intelligent recommendation technology has been playing an increasingly important role in various industry applications such as e-commerce product promotion and Internet advertisement display. Besides users' feedbacks (e.g., numerical…

Information Retrieval · Computer Science 2014-07-11 Weike Pan

Existing recommendation algorithms mostly focus on optimizing traditional recommendation measures, such as the accuracy of rating prediction in terms of RMSE or the quality of top-$k$ recommendation lists in terms of precision, recall, MAP,…

Information Retrieval · Computer Science 2019-02-05 Changhua Pei , Xinru Yang , Qing Cui , Xiao Lin , Fei Sun , Peng Jiang , Wenwu Ou , Yongfeng Zhang

While Reinforcement Learning (RL) achieves tremendous success in sequential decision-making problems of many domains, it still faces key challenges of data inefficiency and the lack of interpretability. Interestingly, many researchers have…

Artificial Intelligence · Computer Science 2023-06-02 Yan Zeng , Ruichu Cai , Fuchun Sun , Libo Huang , Zhifeng Hao

This paper presents a Multi-Agent approach to the problem of recommending training courses to engineering professionals. The recommendation system is built as a proof of concept and limited to the electrical and mechanical engineering…

Artificial Intelligence · Computer Science 2016-11-17 Vukosi N. Marivate , George Ssali , Tshilidzi Marwala

Critique-guided reinforcement learning (RL) has emerged as a powerful paradigm for training LLM agents by augmenting sparse outcome rewards with natural-language feedback. However, current methods often rely on static or offline critic…

Artificial Intelligence · Computer Science 2026-04-15 Zhicong Li , Lingjie Jiang , Yulan Hu , Xingchen Zeng , Yixia Li , Xiangwen Zhang , Guanhua Chen , Zheng Pan , Xin Li , Yong Liu

Executing workflows on volunteer computing resources where individual tasks may be forced to relinquish their resource for the resource's primary use leads to unpredictability and often significantly increases execution time. Task…

Performance · Computer Science 2022-09-28 Andrew Stephen McGough , Matthew Forshaw

Large language model-empowered agentic recommender systems (ARS) reformulate recommendation as a multi-turn interaction between a recommender agent and a user agent, enabling iterative preference elicitation and refinement beyond…

Information Retrieval · Computer Science 2026-04-21 Zongwei Wang , Min Gao , Hongzhi Yin , Junliang Yu , Tong Chen , Quoc Viet Hung Nguyen , Shazia Sadiq , Tianrui Li

Joint caching and recommendation has been recently proposed for increasing the efficiency of mobile edge caching. While previous works assume collaboration between mobile network operators and content providers (who control the…

Networking and Internet Architecture · Computer Science 2018-06-08 Savvas Kastanakis , Pavlos Sermpezis , Vasileios Kotronis , Xenofontas Dimitropoulos

Current advances in recommender systems have been remarkably successful in optimizing immediate engagement. However, long-term user engagement, a more desirable performance metric, remains difficult to improve. Meanwhile, recent…

Information Retrieval · Computer Science 2023-06-05 Wanqi Xue , Qingpeng Cai , Zhenghai Xue , Shuo Sun , Shuchang Liu , Dong Zheng , Peng Jiang , Kun Gai , Bo An