English
Related papers

Related papers: Sparse Meets Dense: Unified Generative Recommendat…

200 papers

Sequential dense retrieval models utilize advanced sequence learning techniques to compute item and user representations, which are then used to rank relevant items for a user through inner product computation between the user and all item…

Modern recommender systems perform large-scale retrieval by first embedding queries and item candidates in the same unified space, followed by approximate nearest neighbor search to select top candidates given a query embedding. In this…

A new method for combining several initial estimators of the regression function is introduced. Instead of building a linear or convex optimized combination over a collection of basic estimators $r_1,\dots,r_M$, we use them as a collective…

Statistics Theory · Mathematics 2019-05-24 Gérard Biau , Aurélie Fischer , Benjamin Guedj , James Malley

There are a wide range of applications that involve multi-modal data, such as cross-modal retrieval, visual question-answering, and image captioning. Such applications are primarily dependent on aligned distributions of the different…

Machine Learning · Computer Science 2020-05-26 Vishaal Udandarao , Abhishek Maiti , Deepak Srivatsav , Suryatej Reddy Vyalla , Yifang Yin , Rajiv Ratn Shah

Learned sparse and dense representations capture different successful approaches to text retrieval and the fusion of their results has proven to be more effective and robust. Prior work combines dense and sparse retrievers by fusing their…

Information Retrieval · Computer Science 2021-12-10 Sheng-Chieh Lin , Jimmy Lin

Expansion-enhanced sparse lexical representation improves information retrieval (IR) by minimizing vocabulary mismatch problems during lexical matching. In this paper, we explore the potential of jointly learning dense semantic…

Machine Learning · Computer Science 2024-05-24 Biplob Biswas , Rajiv Ramnath

Generative Retrieval (GR), autoregressively decoding relevant document identifiers given a query, has been shown to perform well under the setting of small-scale corpora. By memorizing the document corpus with model parameters, GR…

Information Retrieval · Computer Science 2024-01-22 Peiwen Yuan , Xinglin Wang , Shaoxiong Feng , Boyuan Pan , Yiwei Li , Heda Wang , Xupeng Miao , Kan Li

Sequential recommender systems rank relevant items by modeling a user's interaction history and computing the inner product between the resulting user representation and stored item embeddings. To avoid the significant memory overhead of…

Traditional information retrieval is based on sparse bag-of-words vector representations of documents and queries. More recent deep-learning approaches have used dense embeddings learned using a transformer-based large language model. We…

Information Retrieval · Computer Science 2024-01-09 Priyanka Mandikal , Raymond Mooney

Identifying relevant research concepts is crucial for effective scientific search. However, primary sparse retrieval methods often lack concept-aware representations. To address this, we propose CASPER, a sparse retrieval model for…

Information Retrieval · Computer Science 2026-01-16 Lam Thanh Do , Linh Van Nguyen , Jiayu Li , David Fu , Kevin Chen-Chuan Chang

Generative recommendation represents each item as a semantic ID, i.e., a sequence of discrete tokens, and generates the next item through autoregressive decoding. While effective, existing autoregressive models face two intrinsic…

Information Retrieval · Computer Science 2025-11-12 Teng Shi , Chenglei Shen , Weijie Yu , Shen Nie , Chongxuan Li , Xiao Zhang , Ming He , Yan Han , Jun Xu

Generative Recommendation (GR) has become a promising end-to-end approach with high FLOPS utilization for resource-efficient recommendation. Despite the effectiveness, we show that current GR models suffer from a critical \textbf{bias…

Information Retrieval · Computer Science 2026-02-05 Xinyu Lin , Pengyuan Liu , Wenjie Wang , Yicheng Hu , Chen Xu , Fuli Feng , Qifan Wang , Tat-Seng Chua

Multimodal representations that enable cross-modal retrieval are widely used. However, these often lack interpretability making it difficult to explain the retrieved results. Solutions such as learning sparse disentangled representations…

Information Retrieval · Computer Science 2025-06-25 Prachi J , Sumit Bhatia , Srikanta Bedathur

Session-based Recommendation (SBR) refers to the task of predicting the next item based on short-term user behaviors within an anonymous session. However, session embedding learned by a non-linear encoder is usually not in the same…

Information Retrieval · Computer Science 2022-04-26 Yupeng Hou , Binbin Hu , Zhiqiang Zhang , Wayne Xin Zhao

Industry-scale recommender systems face a core challenge: representing entities with high cardinality, such as users or items, using dense embeddings that must be accessible during both training and inference. However, as embedding sizes…

Information Retrieval · Computer Science 2025-05-19 Petr Kasalický , Martin Spišák , Vojtěch Vančura , Daniel Bohuněk , Rodrigo Alves , Pavel Kordík

Federated sequential recommendation distributes model training across user devices so that behavioural data remains local, reducing privacy risks. Yet, this setting introduces two intertwined difficulties. On the one hand, individual…

Information Retrieval · Computer Science 2026-03-02 Minh Hieu Nguyen

While dense retrieval models, which embed queries and documents into a shared low-dimensional space, have gained widespread popularity, they were shown to exhibit important theoretical limitations and considerably lag behind traditional…

Information Retrieval · Computer Science 2026-04-09 Adrian Bracher , Svitlana Vakulenko

Existing pseudo label generation methods for point weakly supervised object detection are inadequate in low data volume and dense object detection tasks. We consider the generation of weakly supervised pseudo labels as the model's sparse…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Chuyang Shang , Tian Ma , Wanzhu Ren , Yuancheng Li , Jiayi Yang

We propose a new supervised learning algorithm, for classification and regression problems where two or more preliminary predictors are available. We introduce \texttt{KernelCobra}, a non-linear learning strategy for combining an arbitrary…

Machine Learning · Computer Science 2020-02-05 Benjamin Guedj , Bhargav Srinivasa Desikan

We present Cross-lingual Open-Retrieval Answer Generation (CORA), the first unified many-to-many question answering (QA) model that can answer questions across many languages, even for ones without language-specific annotated data or…

Computation and Language · Computer Science 2021-10-29 Akari Asai , Xinyan Yu , Jungo Kasai , Hannaneh Hajishirzi
‹ Prev 1 2 3 10 Next ›