English
Related papers

Related papers: Climber: Toward Efficient Scaling Laws for Large R…

200 papers

Recent advances in machine learning are consistently enabled by increasing amounts of computation. Reinforcement learning (RL) and population-based methods in particular pose unique challenges for efficiency and flexibility to the…

Machine Learning · Computer Science 2020-03-26 Jiale Zhi , Rui Wang , Jeff Clune , Kenneth O. Stanley

Large Language Models (LLMs) have a natural role in answering complex queries about data streams, but the high computational cost of LLM inference makes them infeasible in many such tasks. We propose online cascade learning, the first…

Machine Learning · Computer Science 2024-06-19 Lunyiu Nie , Zhimin Ding , Erdong Hu , Christopher Jermaine , Swarat Chaudhuri

Industry-scale recommender systems face a core challenge: representing entities with high cardinality, such as users or items, using dense embeddings that must be accessible during both training and inference. However, as embedding sizes…

Information Retrieval · Computer Science 2025-05-19 Petr Kasalický , Martin Spišák , Vojtěch Vančura , Daniel Bohuněk , Rodrigo Alves , Pavel Kordík

Attaining prototypical features to represent class distributions is well established in representation learning. However, learning prototypes online from streaming data proves a challenging endeavor as they rapidly become outdated, caused…

Computer Vision and Pattern Recognition · Computer Science 2021-10-20 Matthias De Lange , Tinne Tuytelaars

Large language models have achieved remarkable success in various tasks but suffer from high computational costs during inference, limiting their deployment in resource-constrained applications. To address this issue, we propose a novel…

Computation and Language · Computer Science 2025-09-11 Wenhao Zheng , Yixiao Chen , Weitong Zhang , Souvik Kundu , Yun Li , Zhengzhong Liu , Eric P. Xing , Hongyi Wang , Huaxiu Yao

Inference-time scaling has emerged as a powerful way to improve large language model (LLM) performance by generating multiple candidate responses and selecting among them. However, existing work on dynamic allocation for test-time compute…

Machine Learning · Computer Science 2025-09-15 Jenny Y. Huang , Mehul Damani , Yousef El-Kurdi , Ramon Astudillo , Wei Sun

In this study, we introduce Convolutional Transformer Neural Collaborative Filtering (CTNCF), a novel approach aimed at enhancing recommendation systems by effectively capturing high-order structural information in user-item interactions.…

Artificial Intelligence · Computer Science 2024-12-03 Pang Li , Shahrul Azman Mohd Noah , Hafiz Mohd Sarim

Modern recommender systems operate in uniquely dynamic settings: user interests, item pools, and popularity trends shift continuously, and models must adapt in real time without forgetting past preferences. While existing tutorials on…

Information Retrieval · Computer Science 2025-07-08 Hyunsik Yoo , SeongKu Kang , Hanghang Tong

In recent years, recommender systems have advanced rapidly, where embedding learning for users and items plays a critical role. A standard method learns a unique embedding vector for each user and item. However, such a method has two…

Artificial Intelligence · Computer Science 2023-02-13 Yizhou Chen , Guangda Huzhang , Anxiang Zeng , Qingtao Yu , Hui Sun , Heng-yi Li , Jingyi Li , Yabo Ni , Han Yu , Zhiming Zhou

Automatic resource scaling is one advantage of Cloud systems. Cloud systems are able to scale the number of physical machines depending on user requests. Therefore, accurate request prediction brings a great improvement in Cloud systems'…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-07-10 Min Sang Yoon , Ahmed E. Kamal , Zhengyuan Zhu

Online stores and service providers rely heavily on recommendation softwares to guide users through the vast amount of available products. Consequently, the field of recommender systems has attracted increased attention from the industry…

Information Retrieval · Computer Science 2022-10-17 Abdullah Alhadlaq , Said Kerrache , Hatim Aboalsamh

Neural personalized recommendation is the corner-stone of a wide collection of cloud services and products, constituting significant compute demand of the cloud infrastructure. Thus, improving the execution efficiency of neural…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-01-10 Udit Gupta , Samuel Hsia , Vikram Saraph , Xiaodong Wang , Brandon Reagen , Gu-Yeon Wei , Hsien-Hsin S. Lee , David Brooks , Carole-Jean Wu

To balance effectiveness and efficiency in recommender systems, multi-stage pipelines employ lightweight two-tower models for large-scale candidate retrieval. However, their isolated architecture inherently hampers representation capacity,…

Information Retrieval · Computer Science 2026-04-29 Lixiang Wang , Shaoyun Shi , Peng Wang , Wenjin Wu , Peng Jiang

Scaling recommendation models is a central challenge in recommender systems. Recently, RankMixer has emerged as an effective solution, operating on a unified token representation and alternating between token mixing and per-token…

Machine Learning · Computer Science 2026-05-25 Guoming Li , Shangyu Zhang , Junwei Pan , Wentao Ning , Jin Chen , Gengsheng Xue , Chao Zhou , Shudong Huang , Haijie Gu , Menglin Yang

Recommender systems aim to fulfill the user's daily demands. While most existing research focuses on maximizing the user's engagement with the system, it has recently been pointed out that how frequently the users come back for the service…

Information Retrieval · Computer Science 2024-06-11 Ziru Liu , Shuchang Liu , Bin Yang , Zhenghai Xue , Qingpeng Cai , Xiangyu Zhao , Zijian Zhang , Lantao Hu , Han Li , Peng Jiang

We propose a streaming submodular maximization algorithm "stream clipper" that performs as well as the offline greedy algorithm on document/video summarization in practice. It adds elements from a stream either to a solution set $S$ or to…

Machine Learning · Statistics 2018-02-14 Tianyi Zhou , Jeff Bilmes

Behavioral software models play a key role in many software engineering tasks; unfortunately, these models either are not available during software development or, if available, quickly become outdated as implementations evolve. Model…

Software Engineering · Computer Science 2022-04-14 Donghwan Shin , Domenico Bianculli , Lionel Briand

Decision tree classifiers are a widely used tool in data stream mining. The use of confidence intervals to estimate the gain associated with each split leads to very effective methods, like the popular Hoeffding tree algorithm. From a…

Machine Learning · Statistics 2016-04-13 Rocco De Rosa

Influence maximization is the problem of finding a small subset of nodes in a network that can maximize the diffusion of information. Recently, it has also found application in HIV prevention, substance abuse prevention, micro-finance…

Artificial Intelligence · Computer Science 2021-07-09 Dexun Li , Meghna Lowalekar , Pradeep Varakantham

Modeling high-order feature interactions efficiently is a central challenge in click-through rate and conversion rate prediction. Modern industrial recommender systems are predominantly built upon deep learning recommendation models, where…

Information Retrieval · Computer Science 2026-02-13 Heng Yu , Xiangjun Zhou , Jie Xia , Heng Zhao , Anxin Wu , Yu Zhao , Dongying Kong