English
Related papers

Related papers: Efficient Cold-Start Recommendation via BPE Token-…

200 papers

Sequence models for binary analysis are bottlenecked by byte-level tokenization: raw bytes waste precious context window capacity for transformers and other neural network architectures, and many existing text-oriented tokenizers fail on…

Machine Learning · Computer Science 2025-11-25 Michael J. Bommarito

Large Language Models (LLMs) have advanced recommendation capabilities through enhanced reasoning, but pose significant challenges for real-world deployment due to high inference costs. Conversely, while Small Language Models (SLMs) offer…

Computation and Language · Computer Science 2025-10-13 Prosenjit Biswas , Pervez Shaik , Abhinav Thorat , Ravi Kolla , Niranjan Pedanekar

For many recommender systems, the primary data source is a historical record of user clicks. The associated click matrix is often very sparse, as the number of users x products can be far larger than the number of clicks. Such sparsity is…

Information Retrieval · Computer Science 2024-12-12 Julien Monteil , Volodymyr Vaskovych , Wentao Lu , Anirban Majumder , Anton van den Hengel

State-of-the-art language models are autoregressive and operate on subword units known as tokens. Specifically, one must encode the conditioning string into a list of tokens before passing to the language models for next-token prediction.…

Computation and Language · Computer Science 2024-07-09 Buu Phan , Marton Havasi , Matthew Muckley , Karen Ullrich

Item recommendation task predicts a personalized ranking over a set of items for each individual user. One paradigm is the rating-based methods that concentrate on explicit feedbacks and hence face the difficulties in collecting them.…

Information Retrieval · Computer Science 2021-01-15 Guang-Neng Hu , Xin-Yu Dai

For tackling the well known cold-start user problem in model-based recommender systems, one approach is to recommend a few items to a cold-start user and use the feedback to learn a profile. The learned profile can then be used to make good…

Information Retrieval · Computer Science 2017-03-02 Sampoorna Biswas , Laks V. S. Lakshmanan , Senjuti Basu Ray

When adapting Large Language Models for Recommendation (LLMRec), it is crucial to integrate collaborative information. Existing methods achieve this by learning collaborative embeddings in LLMs' latent space from scratch or by mapping from…

Information Retrieval · Computer Science 2024-06-06 Yang Zhang , Keqin Bao , Ming Yan , Wenjie Wang , Fuli Feng , Xiangnan He

To alleviate the problem of information explosion, recommender systems are widely deployed to provide personalized information filtering services. Usually, embedding tables are employed in recommender systems to transform high-dimensional…

Information Retrieval · Computer Science 2024-08-07 Shiwei Li , Huifeng Guo , Xing Tang , Ruiming Tang , Lu Hou , Ruixuan Li , Rui Zhang

Multi-agent systems must decide which agent is the most appropriate for a given task. We propose a novel architecture for recommending which LLM agent out of many should perform a task given a natural language prompt by extending the…

Machine Learning · Computer Science 2025-01-24 Joshua Park , Yongfeng Zhang

Large Language Models (LLM) hold immense promise for real-world applications, but their generic knowledge often falls short of domain-specific needs. Fine-tuning, a common approach, can suffer from catastrophic forgetting and hinder…

Information Retrieval · Computer Science 2024-08-19 Emile Contal , Garrin McGoldrick

Prompt-based methods leverage the knowledge of pre-trained language models (PLMs) trained with a masked language modeling (MLM) objective; however, these methods are sensitive to template, verbalizer, and few-shot instance selection,…

Computation and Language · Computer Science 2025-07-02 Mohna Chakraborty , Adithya Kulkarni , Qi Li

Deploying large language models (LLMs) on edge devices is crucial for delivering fast responses and ensuring data privacy. However, the limited storage, weight, and power of edge devices make it difficult to deploy LLM-powered applications.…

Hardware Architecture · Computer Science 2025-06-04 Chunlin Tian , Xinpeng Qin , Kahou Tam , Li Li , Zijian Wang , Yuanzhe Zhao , Minglei Zhang , Chengzhong Xu

This paper proposes Text mAtching based SequenTial rEcommendation model (TASTE), which maps items and users in an embedding space and recommends items by matching their text representations. TASTE verbalizes items and user-item interactions…

Information Retrieval · Computer Science 2023-08-29 Zhenghao Liu , Sen Mei , Chenyan Xiong , Xiaohua Li , Shi Yu , Zhiyuan Liu , Yu Gu , Ge Yu

Large language models (LLMs) have recently enabled remarkable progress in text representation. However, their embeddings are typically high-dimensional, leading to substantial storage and retrieval overhead. Although recent approaches such…

Information Retrieval · Computer Science 2026-04-28 Zhibo Zhang , Yang Xu , Kai Ming Ting , Cam-Tu Nguyen

Content-based recommendation systems play a crucial role in delivering personalized content to users in the digital world. In this work, we introduce EmbSum, a novel framework that enables offline pre-computations of users and candidate…

Information Retrieval · Computer Science 2024-08-20 Chiyu Zhang , Yifei Sun , Minghao Wu , Jun Chen , Jie Lei , Muhammad Abdul-Mageed , Rong Jin , Angli Liu , Ji Zhu , Sem Park , Ning Yao , Bo Long

As the ever-increasing token limits of large language models (LLMs) have enabled long context as input, prompting with single data samples might no longer an efficient way. A straightforward strategy improving efficiency is to batch data…

Computation and Language · Computer Science 2024-07-16 Jianzhe Lin , Maurice Diesendruck , Liang Du , Robin Abraham

Modern techniques in Content-based Recommendation (CBR) leverage item content information to provide personalized services to users, but suffer from resource-intensive training on large datasets. To address this issue, we explore the…

Information Retrieval · Computer Science 2025-02-11 Jiahao Wu , Qijiong Liu , Hengchang Hu , Wenqi Fan , Shengcai Liu , Qing Li , Xiao-Ming Wu , Ke Tang

Large Language Models (LLMs) have demonstrated remarkable capabilities in handling long context inputs, but this comes at the cost of increased computational resources and latency. Our research introduces a novel approach for the long…

Computation and Language · Computer Science 2024-09-27 Zhenmei Shi , Yifei Ming , Xuan-Phi Nguyen , Yingyu Liang , Shafiq Joty

In recent years, recommender systems have advanced rapidly, where embedding learning for users and items plays a critical role. A standard method learns a unique embedding vector for each user and item. However, such a method has two…

Artificial Intelligence · Computer Science 2023-02-13 Yizhou Chen , Guangda Huzhang , Anxiang Zeng , Qingtao Yu , Hui Sun , Heng-yi Li , Jingyi Li , Yabo Ni , Han Yu , Zhiming Zhou

A major challenge in collaborative filtering methods is how to produce recommendations for cold items (items with no ratings), or integrate cold item into an existing catalog. Over the years, a variety of hybrid recommendation models have…

Information Retrieval · Computer Science 2021-12-15 Oren Barkan , Roy Hirsch , Ori Katz , Avi Caciularu , Jonathan Weill , Noam Koenigstein