English
Related papers

Related papers: Order-agnostic Identifier for Large Language Model…

200 papers

One of the most striking findings in modern research on large language models (LLMs) is that scaling up compute during training leads to better results. However, less attention has been given to the benefits of scaling compute during…

Computation and Language · Computer Science 2024-11-21 Sean Welleck , Amanda Bertsch , Matthew Finlayson , Hailey Schoelkopf , Alex Xie , Graham Neubig , Ilia Kulikov , Zaid Harchaoui

Recent recommender systems increasingly leverage embeddings from large pre-trained language models (PLMs). However, such embeddings exhibit two key limitations: (1) PLMs are not explicitly optimized to produce structured and discriminative…

Computation and Language · Computer Science 2026-01-19 Guy Hadad , Neomi Rabaev , Bracha Shapira

Contrastive learning (CL) has shown its power in recommendation. However, most CL-based recommendation models build their CL tasks merely focusing on the user's aspects, ignoring the rich diverse information in items. In this work, we…

Information Retrieval · Computer Science 2023-01-18 Ruobing Xie , Zhijie Qiu , Bo Zhang , Leyu Lin

Transformer-based sequential recommenders, such as SASRec or BERT4Rec, typically rely solely on learned item ID embeddings, making them vulnerable to the item cold-start problem, particularly in environments with dynamic item catalogs.…

Information Retrieval · Computer Science 2025-08-27 Jan Malte Lichtenberg , Antonio De Candia , Matteo Ruffini

The paradigm shift from item-centric ranking to answer-centric synthesis is redefining the role of search engines. While recent industrial progress has applied generative techniques to closed-set item ranking in e-commerce, research and…

Computation and Language · Computer Science 2026-03-12 Wei Wu , Peilun Zhou , Liyi Chen , Qimeng Wang , Chengqiang Lu , Yan Gao , Yi Wu , Yao Hu , Hui Xiong

Generative recommendation (GR) aligns with advances in generative AI by casting next-item prediction as token-level generation rather than score-based ranking. Most GR methods adopt a two-stage pipeline: (i) \textit{item tokenization},…

Information Retrieval · Computer Science 2026-02-26 Zhenxiang Xu , Jiawei Chen , Sirui Chen , Yong He , Jieyu Yang , Chuan Yuan , Ke Ding , Can Wang

Learning the user-item relevance hidden in implicit feedback data plays an important role in modern recommender systems. Neural sequential recommendation models, which formulates learning the user-item relevance as a sequential…

Information Retrieval · Computer Science 2022-03-01 Jingwei Zhuo , Bin Liu , Xiang Li , Han Zhu , Xiaoqiang Zhu

Generative Recommendation (GR) has emerged as a new paradigm in recommender systems. This approach relies on quantized representations to discretize item features, modeling users' historical interactions as sequences of discrete tokens.…

Information Retrieval · Computer Science 2025-11-25 Fuwei Zhang , Xiaoyu Liu , Dongbo Xi , Jishen Yin , Huan Chen , Peng Yan , Fuzhen Zhuang , Zhao Zhang

Attribute-aware sequential recommendation entails predicting the next item a user will interact with based on a chronologically ordered history of past interactions, enriched with item attributes. Existing methods typically leverage…

Information Retrieval · Computer Science 2026-05-08 Shereen Elsayed , Ngoc Son Le , Ahmed Rashed , Lars Schmidt-Thieme

Large-language Models (LLMs) have been extremely successful at tasks like complex dialogue understanding, reasoning and coding due to their emergent abilities. These emergent abilities have been extended with multi-modality to include…

Information Retrieval · Computer Science 2025-05-19 Li Yang , Anushya Subbiah , Hardik Patel , Judith Yue Li , Yanwei Song , Reza Mirghaderi , Vikram Aggarwal , Qifan Wang

Recent advancements in large language model-based recommendation systems often represent items as text or semantic IDs and generate recommendations in an auto-regressive manner. However, due to the left-to-right greedy decoding strategy and…

Information Retrieval · Computer Science 2025-11-19 Mengyao Gao , Chongming Gao , Haoyan Liu , Qingpeng Cai , Peng Jiang , Jiajia Chen , Shuai Yuan , Xiangnan He

Large Language Models (LLMs) have recently garnered significant attention in various domains, including recommendation systems. Recent research leverages the capabilities of LLMs to improve the performance and user modeling aspects of…

Information Retrieval · Computer Science 2024-11-05 Lei Chen , Chen Gao , Xiaoyi Du , Hengliang Luo , Depeng Jin , Yong Li , Meng Wang

Semantic ID-based recommendation models tokenize each item into a small number of discrete tokens that preserve specific semantics, leading to better performance, scalability, and memory efficiency. While recent models adopt a generative…

Information Retrieval · Computer Science 2025-06-09 Yupeng Hou , Jiacheng Li , Ashley Shin , Jinsung Jeon , Abhishek Santhanam , Wei Shao , Kaveh Hassani , Ning Yao , Julian McAuley

Large Language Models (LLMs) have shown strong potential for recommendation by framing item prediction as a token-by-token language generation task. However, existing methods treat all item tokens equally, simply pursuing likelihood…

Computation and Language · Computer Science 2025-10-31 Zijie Lin , Yang Zhang , Xiaoyan Zhao , Fengbin Zhu , Fuli Feng , Tat-Seng Chua

Federated recommendation facilitates collaborative model training across distributed clients while keeping sensitive user interaction data local. Conventional approaches typically rely on synchronizing high-dimensional item representations…

Information Retrieval · Computer Science 2026-02-26 Yuchun Tu , Zhiwei Li , Bingli Sun , Yixuan Li , Xiao Song

Large Language Models (LLMs) pose a new paradigm of modeling and computation for information tasks. Recommendation systems are a critical application domain poised to benefit significantly from the sequence modeling capabilities and world…

Federated sequential recommendation (FedSeqRec) aims to perform next-item prediction while keeping user data decentralised, yet model quality is frequently constrained by fragmented, noisy, and homogeneous interaction logs stored on…

Large Language Model (LLM)-based generative recommendation has achieved notable success, yet its practical deployment is costly particularly due to excessive inference latency caused by autoregressive decoding. For lossless LLM decoding…

Information Retrieval · Computer Science 2025-02-27 Xinyu Lin , Chaoqun Yang , Wenjie Wang , Yongqi Li , Cunxiao Du , Fuli Feng , See-Kiong Ng , Tat-Seng Chua

Generative Recommendation (GenRec) models reformulate recommendation as a sequence generation task, representing items as discrete Semantic IDs used symmetrically as both inputs and prediction targets. We identify a critical dual-stage…

Information Retrieval · Computer Science 2026-05-15 Bin Huang , Xin Wang , Junwei Pan , Yongqi Zhou , Yifeng Zhou , Zhixiang Feng , Shudong Huang , Haijie Gu , Wenwu Zhu

Referring segmentation grounds natural-language queries to pixel-level masks, but extending it to complex scenarios with multiple instances, cross-category groups, or open-ended target sets remains challenging. Previous Large Vision…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Zhixiong Zhang , Yizhuo Li , Shuangrui Ding , Yuhang Zang , Shengyuan Ding , Long Xing , Yibin Wang , Qiaosheng Zhang , Jiaqi Wang