English
Related papers

Related papers: Pre-training Graph Transformer with Multimodal Sid…

200 papers

Session-based recommender systems typically focus on using only the triplet (user_id, timestamp, item_id) to make predictions of users' next actions. In this paper, we aim to utilize side information to help recommender systems catch…

Information Retrieval · Computer Science 2024-06-04 Yukun Jiang , Leo Guo , Xinyi Chen , Jing Xi Liu

Sequential recommender systems rank relevant items by modeling a user's interaction history and computing the inner product between the resulting user representation and stored item embeddings. To avoid the significant memory overhead of…

Large Language Models (LLMs) possess human-level cognitive and decision-making capabilities, making them a key technology for 6G. However, applying LLMs to the communication domain faces three major challenges: 1) Inadequate communication…

Information Theory · Computer Science 2025-02-27 Feibo Jiang , Wanyun Zhu , Li Dong , Kezhi Wang , Kun Yang , Cunhua Pan , Octavia A. Dobre

In this paper, we introduce a new vision-language pre-trained model -- ImageBERT -- for image-text joint embedding. Our model is a Transformer-based model, which takes different modalities as input and models the relationship between them.…

Computer Vision and Pattern Recognition · Computer Science 2020-01-24 Di Qi , Lin Su , Jia Song , Edward Cui , Taroon Bharti , Arun Sacheti

Learning transferable representation of knowledge graphs (KGs) is challenging due to the heterogeneous, multi-relational nature of graph structures. Inspired by Transformer-based pretrained language models' success on learning transferable…

Computation and Language · Computer Science 2023-03-29 Sanxing Chen , Hao Cheng , Xiaodong Liu , Jian Jiao , Yangfeng Ji , Jianfeng Gao

Multimodal emotion recognition study is hindered by the lack of labelled corpora in terms of scale and diversity, due to the high annotation cost and label ambiguity. In this paper, we propose a pre-training model \textbf{MEmoBERT} for…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Jinming Zhao , Ruichen Li , Qin Jin , Xinchao Wang , Haizhou Li

Recent advancements in graph neural networks (GNNs) have significantly enhanced the prediction of material properties by modeling crystal structures as graphs. However, GNNs often struggle to capture global structural characteristics, such…

Machine Learning · Computer Science 2025-08-11 Jaewan Lee , Changyoung Park , Hongjun Yang , Sungbin Lim , Woohyung Lim , Sehui Han

Graph Neural Networks (GNNs) have become powerful tools in modeling graph-structured data in recommender systems. However, real-life recommendation scenarios usually involve heterogeneous relationships (e.g., social-aware user influence,…

Information Retrieval · Computer Science 2023-03-03 Mengru Chen , Chao Huang , Lianghao Xia , Wei Wei , Yong Xu , Ronghua Luo

Graphs can model complex relationships between objects, enabling a myriad of Web applications such as online page/article classification and social recommendation. While graph neural networks(GNNs) have emerged as a powerful tool for graph…

Machine Learning · Computer Science 2023-02-28 Zemin Liu , Xingtong Yu , Yuan Fang , Xinming Zhang

Representation learning on user-item graph for recommendation has evolved from using single ID or interaction history to exploiting higher-order neighbors. This leads to the success of graph convolution networks (GCNs) for recommendation…

Information Retrieval · Computer Science 2021-06-21 Jiancan Wu , Xiang Wang , Fuli Feng , Xiangnan He , Liang Chen , Jianxun Lian , Xing Xie

In many recommendations, a handful of popular items (e.g., movies / television shows, news, etc.) can be dominant in recommendations for many users. However, we know that in a large catalog of items, users are likely interested in more than…

Information Retrieval · Computer Science 2024-07-30 Qiuling Xu , Pannaga Shivaswamy , Xiangyu Zhang

Accurate news representation is critical for news recommendation. Most of existing news representation methods learn news representations only from news texts while ignore the visual information in news like images. In fact, users may click…

Information Retrieval · Computer Science 2022-03-24 Chuhan Wu , Fangzhao Wu , Tao Qi , Yongfeng Huang

Session-based recommendation is a practical recommendation task that predicts the next item based on an anonymous behavior sequence, and its performance relies heavily on the transition information between items in the sequence. The SOTA…

Information Retrieval · Computer Science 2022-04-06 Ansong Li

The goal of session-based recommendation (SR) models is to utilize the information from past actions (e.g. item/product clicks) in a session to recommend items that a user is likely to click next. Recently it has been shown that the…

Information Retrieval · Computer Science 2021-03-05 Priyanka Gupta , Diksha Garg , Pankaj Malhotra , Lovekesh Vig , Gautam Shroff

Explainability and effectiveness are two key aspects for building recommender systems. Prior efforts mostly focus on incorporating side information to achieve better recommendation performance. However, these methods have some weaknesses:…

Information Retrieval · Computer Science 2019-03-12 Weizhi Ma , Min Zhang , Yue Cao , Woojeong , Jin , Chenyang Wang , Yiqun Liu , Shaoping Ma , Xiang Ren

Sequential recommendation aims to model dynamic user behavior from historical interactions. Existing methods rely on either explicit item IDs or general textual features for sequence modeling to understand user preferences. While promising,…

Information Retrieval · Computer Science 2023-05-30 Jiacheng Li , Ming Wang , Jin Li , Jinmiao Fu , Xin Shen , Jingbo Shang , Julian McAuley

Embedding based product recommendations have gained popularity in recent years due to its ability to easily integrate to large-scale systems and allowing nearest neighbor searches in real-time. The bulk of studies in this area has…

Information Retrieval · Computer Science 2022-11-30 Giorgi Kvernadze , Putu Ayu G. Sudyanti , Nishan Subedi , Mohammad Hajiaghayi

With the advent of the era of foundation models, pre-training and fine-tuning have become common paradigms. Recently, parameter-efficient fine-tuning has garnered widespread attention due to its better balance between the number of…

Computer Vision and Pattern Recognition · Computer Science 2024-08-02 Bin Cheng , Jiaxuan Lu

As an important branch in Recommender System, occasional group recommendation has received more and more attention. In this scenario, each occasional group (cold-start group) has no or few historical interacted items. As each occasional…

Information Retrieval · Computer Science 2022-07-22 Bowen Hao , Hongzhi Yin , Cuiping Li , Hong Chen

While many BERT-based cross-modal pre-trained models produce excellent results on downstream understanding tasks like image-text retrieval and VQA, they cannot be applied to generation tasks directly. In this paper, we propose XGPT, a new…

Computation and Language · Computer Science 2020-03-05 Qiaolin Xia , Haoyang Huang , Nan Duan , Dongdong Zhang , Lei Ji , Zhifang Sui , Edward Cui , Taroon Bharti , Xin Liu , Ming Zhou