English
Related papers

Related papers: Pre-training Graph Transformer with Multimodal Sid…

200 papers

Person re-identification (re-ID) via 3D skeleton data is an emerging topic with prominent advantages. Existing methods usually design skeleton descriptors with raw body joints or perform skeleton sequence representation learning. However,…

Computer Vision and Pattern Recognition · Computer Science 2023-08-01 Haocong Rao , Chunyan Miao

In this paper, we study the problem of recommendation system where the users and items to be recommended are rich data structures with multiple entity types and with multiple sources of side-information in the form of graphs. We provide a…

Generative Recommendation (GR) has emerged as a promising paradigm by formulating item recommendation as a sequence-to-sequence generation task over item identifiers. Recent studies have incorporated multimodal signals to provide richer…

Information Retrieval · Computer Science 2026-05-20 Wei Chen , Xingyu Guo , Shuang Li , Fuwei Zhang , Meng Yuan , Jing Fan , Zhao Zhang , Deqing Wang , Fuzhen Zhuang

Multimodal recommender systems (MMRSs) enhance collaborative filtering by leveraging item-side modalities, but their reliance on a fixed set of modalities and task-specific objectives limits both modality extensibility and task…

Information Retrieval · Computer Science 2026-02-25 Jiwoo Kang , Yeon-Chang Lee

ChatGPT has achieved remarkable success in natural language understanding. Considering that recommendation is indeed a conversation between users and the system with items as words, which has similar underlying pattern with ChatGPT, we…

Information Retrieval · Computer Science 2024-04-16 Yabin Zhang , Wenhui Yu , Erhan Zhang , Xu Chen , Lantao Hu , Peng Jiang , Kun Gai

Social recommendation based on social network has achieved great success in improving the performance of recommendation system. Since social network (user-user relations) and user-item interactions are both naturally represented as…

Information Retrieval · Computer Science 2021-09-27 Yiming Zhang , Lingfei Wu , Qi Shen , Yitong Pang , Zhihua Wei , Fangli Xu , Ethan Chang , Bo Long

Peptides are essential in biological processes and therapeutics. In this study, we introduce Multi-Peptide, an innovative approach that combines transformer-based language models with Graph Neural Networks (GNNs) to predict peptide…

Quantitative Methods · Quantitative Biology 2024-07-08 Srivathsan Badrinarayanan , Chakradhar Guntuboina , Parisa Mollaei , Amir Barati Farimani

Knowledge graph (KG) enhanced recommendation has demonstrated improved performance in the recommendation system (RecSys) and attracted considerable research interest. Recently the literature has adopted neural graph networks (GNNs) on the…

Information Retrieval · Computer Science 2022-11-15 Liangwei Yang , Shen Wang , Jibing Gong , Shaojie Zheng , Shuying Du , Zhiwei Liu , Philip S. Yu

Preference-conditioned image generation seeks to adapt generative models to individual users, producing outputs that reflect personal aesthetic choices beyond the given textual prompt. Despite recent progress, existing approaches either…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Wenyi Mo , Tianyu Zhang , Yalong Bai , Ligong Han , Ying Ba , Dimitris N. Metaxas

Multi-modal pre-training and knowledge discovery are two important research topics in multi-modal machine learning. Nevertheless, none of existing works make attempts to link knowledge discovery with knowledge guided multi-modal…

Computation and Language · Computer Science 2022-06-14 Zhihao Fan , Zhongyu Wei , Jingjing Chen , Siyuan Wang , Zejun Li , Jiarong Xu , Xuanjing Huang

The ``pre-train, prompt" paradigm, designed to bridge the gap between pre-training tasks and downstream objectives, has been extended from the NLP domain to the graph domain and has achieved remarkable progress. Current mainstream graph…

Computation and Language · Computer Science 2026-01-27 Ziyu Zheng , Yaming Yang , Ziyu Guan , Wei Zhao , Xinyan Huang , Weigang Lu

Suggesting complementary clothing items to compose an outfit is a process of emerging interest, yet it involves a fine understanding of fashion trends and visual aesthetics. Previous works have mainly focused on recommendation by scoring…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Federico Becattini , Federico Maria Teotini , Alberto Del Bimbo

Discovering distinct features and their relations from data can help us uncover valuable knowledge crucial for various tasks, e.g., classification. In neuroimaging, these features could help to understand, classify, and possibly prevent…

Machine Learning · Computer Science 2022-02-15 Usman Mahmood , Zening Fu , Vince Calhoun , Sergey Plis

Graphs are ubiquitous for modeling complex relationships between objects across various fields. Graph neural networks (GNNs) have become a mainstream technique for graph-based applications, but their performance heavily relies on abundant…

Machine Learning · Computer Science 2025-02-27 Xingtong Yu , Jie Zhang , Yuan Fang , Renhe Jiang

Grounded on pre-trained language models (PLMs), dense retrieval has been studied extensively on plain text. In contrast, there has been little research on retrieving data with multiple aspects using dense models. In the scenarios such as…

Information Retrieval · Computer Science 2023-08-23 Xiaojie Sun , Keping Bi , Jiafeng Guo , Xinyu Ma , Fan Yixing , Hongyu Shan , Qishen Zhang , Zhongyi Liu

This paper utilizes well-designed item-item path modelling between consecutive items with attention mechanisms to sequentially model dynamic user-item evolutions on dynamic knowledge graph for explainable recommendations. Compared with…

Social and Information Networks · Computer Science 2021-01-06 Hongxu Chen , Yicong Li , Xiangguo Sun , Guandong Xu , Hongzhi Yin

Bundle recommendation aims to recommend a bundle of items for a user to consume as a whole. Existing solutions integrate user-item interaction modeling into bundle recommendation by sharing model parameters or learning in a multi-task…

Information Retrieval · Computer Science 2020-05-08 Jianxin Chang , Chen Gao , Xiangnan He , Yong Li , Depeng Jin

The burgeoning presence of Large Language Models (LLM) is propelling the development of personalized recommender systems. Most existing LLM-based methods fail to sufficiently explore the multi-view graph structure correlations inherent in…

Information Retrieval · Computer Science 2025-07-30 Xu Guo , Tong Zhang , Yuanzhi Wang , Chenxu Wang , Fuyun Wang , Xudong Wang , Xiaoya Zhang , Xin Liu , Zhen Cui

Protein post-translational modification (PTM) site prediction is a fundamental task in bioinformatics. Several computational methods have been developed to predict PTM sites. However, existing methods ignore the structure information and…

Quantitative Methods · Quantitative Biology 2024-01-19 Zhengyi Li , Menglu Li , Lida Zhu , Wen Zhang

The recommendation system is not only a problem of inductive statistics from data but also a cognitive task that requires reasoning ability. The most advanced graph neural networks have been widely used in recommendation systems because…

Artificial Intelligence · Computer Science 2023-07-12 Bang Chen , Wei Peng , Maonian Wu , Bo Zheng , Shaojun Zhu