English
Related papers

Related papers: Facet-Aware Multi-Head Mixture-of-Experts Model fo…

200 papers

Characterizing users' interests accurately plays a significant role in an effective recommender system. The sequential recommender system can learn powerful hidden representations of users from successive user-item interactions and dynamic…

Social and Information Networks · Computer Science 2020-11-24 Lingxiao Zhang , Jiangpeng Yan , Yujiu Yang , Xiu Li

The main idea of multimodal recommendation is the rational utilization of the item's multimodal information to improve the recommendation performance. Previous works directly integrate item multimodal features with item ID embeddings,…

Information Retrieval · Computer Science 2023-04-25 Yan Zhou , Jie Guo , Hao Sun , Bin Song , Fei Richard Yu

The training paradigm integrating large language models (LLM) is gradually reshaping sequential recommender systems (SRS) and has shown promising results. However, most existing LLM-enhanced methods rely on rich textual information on the…

Information Retrieval · Computer Science 2024-10-17 Dugang Liu , Shenxian Xian , Xiaolin Lin , Xiaolian Zhang , Hong Zhu , Yuan Fang , Zhen Chen , Zhong Ming

While Dense Retrieval Models (DRMs) have advanced Information Retrieval (IR), one limitation of these neural models is their narrow generalizability and robustness. To cope with this issue, one can leverage the Mixture-of-Experts (MoE)…

Information Retrieval · Computer Science 2024-12-17 Effrosyni Sokli , Pranav Kasela , Georgios Peikos , Gabriella Pasi

Most existing recommendation approaches implicitly treat user tastes as unimodal, resulting in an average-of-tastes representations when multiple distinct interests are present. We show that appropriately modelling the multi-faceted nature…

Information Retrieval · Computer Science 2018-01-30 Maciej Kula

Mixture-of-experts (MoE) is gaining increasing attention due to its unique properties and remarkable performance, especially for language tasks. By sparsely activating a subset of parameters for each token, MoE architecture could increase…

Computation and Language · Computer Science 2025-06-24 Ka Man Lo , Zeyu Huang , Zihan Qiu , Zili Wang , Jie Fu

Recently, the Efficient Manifold Density Estimator (EMDE) model has been introduced. The model exploits Local Sensitive Hashing and Count-Min Sketch algorithms, combining them with a neural network to achieve state-of-the-art results on…

Information Retrieval · Computer Science 2020-06-18 Barbara Rychalska , Dominika Basaj , Jacek Dąbrowski , Michał Daniluk

Sequential recommendation task aims to predict user preference over items in the future given user historical behaviors. The order of user behaviors implies that there are resourceful sequential patterns embedded in the behavior history…

Information Retrieval · Computer Science 2019-11-12 Jiarui Qin , Kan Ren , Yuchen Fang , Weinan Zhang , Yong Yu

Federated Recommendation (FR) is a new learning paradigm to tackle the learn-to-rank problem in a privacy-preservation manner. How to integrate multi-modality features into federated recommendation is still an open challenge in terms of…

Information Retrieval · Computer Science 2026-03-02 Chunxu Zhang , Weipeng Zhang , Guodong Long , Zhiheng Xue , Riting Xia , Bo Yang

Matrix factorization (MF), a cornerstone of recommender systems, decomposes user-item interaction matrices into latent representations. Traditional MF approaches, however, employ a two-stage, non-end-to-end paradigm, sequentially performing…

Information Retrieval · Computer Science 2025-04-22 Shangde Gao , Ke Liu , Yichao Fu , Hongxia Xu , Jian Wu

Recommender systems have been gaining increasing research attention over the years. Most existing recommendation methods focus on capturing users' personalized preferences through historical user-item interactions, which may potentially…

Information Retrieval · Computer Science 2023-08-21 Jiazheng Jing , Yinan Zhang , Xin Zhou , Zhiqi Shen

With the prosperity of business intelligence, recommender systems have evolved into a new stage that we not only care about what to recommend, but why it is recommended. Explainability of recommendations thus emerges as a focal point of…

Information Retrieval · Computer Science 2020-09-24 Guannan Liu , Liang Zhang , Junjie Wu , Xiao Fang

One of the key challenges in Sequential Recommendation (SR) is how to extract and represent user preferences. Traditional SR methods rely on the next item as the supervision signal to guide preference extraction and representation. We…

Information Retrieval · Computer Science 2021-06-24 Muyang Ma , Pengjie Ren , Zhumin Chen , Zhaochun Ren , Huasheng Liang , Jun Ma , Maarten de Rijke

Repeat consumption, such as repurchasing items and relistening songs, is a common scenario in daily life. To model repeat consumption, the repeat-aware recommendation has been proposed to predict which item will be re-interacted based on…

Information Retrieval · Computer Science 2025-06-11 Shigang Quan , Shui Liu , Zhenzhe Zheng , Fan Wu

This paper proposes Text mAtching based SequenTial rEcommendation model (TASTE), which maps items and users in an embedding space and recommends items by matching their text representations. TASTE verbalizes items and user-item interactions…

Information Retrieval · Computer Science 2023-08-29 Zhenghao Liu , Sen Mei , Chenyan Xiong , Xiaohua Li , Shi Yu , Zhiyuan Liu , Yu Gu , Ge Yu

Sequential recommendation aims to recommend the next item of users' interest based on their historical interactions. Recently, the self-attention mechanism has been adapted for sequential recommendation, and demonstrated state-of-the-art…

Information Retrieval · Computer Science 2022-09-19 Bo Peng , Srinivasan Parthasarathy , Xia Ning

Combining existing pre-trained expert LLMs is a promising avenue for scalably tackling large-scale and diverse tasks. However, selecting task-level experts is often too coarse-grained, as heterogeneous tasks may require different expertise…

Computation and Language · Computer Science 2025-07-22 Justin Chih-Yao Chen , Sukwon Yun , Elias Stengel-Eskin , Tianlong Chen , Mohit Bansal

Multi-modal named entity recognition (NER) and relation extraction (RE) aim to leverage relevant image information to improve the performance of NER and RE. Most existing efforts largely focused on directly extracting potentially useful…

Computation and Language · Computer Science 2022-12-06 Xinyu Wang , Jiong Cai , Yong Jiang , Pengjun Xie , Kewei Tu , Wei Lu

Modern Sequential Recommendation (SR) models commonly utilize modality features to represent items, motivated in large part by recent advancements in language and vision modeling. To do so, several works completely replace ID embeddings…

Machine Learning · Computer Science 2026-01-06 Liam Collins , Bhuvesh Kumar , Clark Mingxuan Ju , Tong Zhao , Donald Loveland , Leonardo Neves , Neil Shah

The semantic representation of deep features is essential for image context understanding, and effective fusion of features with different semantic representations can significantly improve the model's performance on salient object…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Han Sun , Jun Cen , Ningzhong Liu , Dong Liang , Huiyu Zhou