English
Related papers

Related papers: Structurally Refined Graph Transformer for Multimo…

200 papers

In modern e-commerce, item content features in various modalities offer accurate yet comprehensive information to recommender systems. The majority of previous work either focuses on learning effective item representation during modelling…

Information Retrieval · Computer Science 2024-08-15 Hao Wu , Alejandro Ariza-Casabona , Bartłomiej Twardowski , Tri Kurniawan Wijaya

The recommender system (RS) has been an integral toolkit of online services. They are equipped with various deep learning techniques to model user preference based on identifier and attribute information. With the emergence of multimedia…

Information Retrieval · Computer Science 2024-09-05 Qidong Liu , Jiaxi Hu , Yutian Xiao , Xiangyu Zhao , Jingtong Gao , Wanyu Wang , Qing Li , Jiliang Tang

Leveraging information across diverse modalities is known to enhance performance on multimodal segmentation tasks. However, effectively fusing information from different modalities remains challenging due to the unique characteristics of…

Computer Vision and Pattern Recognition · Computer Science 2024-04-22 Md Kaykobad Reza , Ashley Prater-Bennette , M. Salman Asif

Recommender systems (RSs) offer personalized navigation experiences on online platforms, but recommendation remains a challenging task, particularly in specific scenarios and domains. Multimodality can help tap into richer information…

Sequential recommender systems aim to predict a user's future interests by extracting temporal patterns from their behavioral history. Existing approaches typically employ transformer-based architectures to process long sequences of user…

Information Retrieval · Computer Science 2026-02-24 Adamya Shyam , Venkateswara Rao Kagita , Bharti Rana , Vikas Kumar

The use of multimodal data in assisted diagnosis and segmentation has emerged as a prominent area of interest in current research. However, one of the primary challenges is how to effectively fuse multimodal features. Most of the current…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Xinxin Fan , Lin Liu , Haoran Zhang

Multimodal sequential recommendation (MSR) leverages diverse item modalities to improve recommendation accuracy, while achieving effective and adaptive fusion remains challenging. Existing MSR models often overlook synergistic information…

Information Retrieval · Computer Science 2026-01-19 Xinyi Zhang , Yutong Li , Peijie Sun , Letian Sha , Zhongxuan Han

Conversational Recommender Systems (CRSs) aim to provide personalized recommendations by interacting with users through conversations. Most existing studies of CRS focus on extracting user preferences from conversational contexts. However,…

Information Retrieval · Computer Science 2025-04-28 Yibiao Wei , Jie Zou , Weikang Guo , Guoqing Wang , Xing Xu , Yang Yang

Multimodal recommendation systems can learn users' preferences from existing user-item interactions as well as the semantics of multimodal data associated with items. Many existing methods model this through a multimodal user-item graph,…

Social and Information Networks · Computer Science 2024-12-19 Jun Hu , Bryan Hooi , Bingsheng He , Yinwei Wei

Accurate user and item embedding learning is crucial for modern recommender systems. However, most existing recommendation techniques have thus far focused on modeling users' preferences over singular type of user-item interactions. Many…

Information Retrieval · Computer Science 2021-10-11 Lianghao Xia , Chao Huang , Yong Xu , Peng Dai , Xiyue Zhang , Hongsheng Yang , Jian Pei , Liefeng Bo

Multimodal recommendation systems are increasingly popular for their potential to improve performance by integrating diverse data types. However, the actual benefits of this integration remain unclear, raising questions about when and how…

Information Retrieval · Computer Science 2025-08-08 Hongyu Zhou , Yinan Zhang , Aixin Sun , Zhiqi Shen

With the explosive growth of online information, recommender systems play a key role to alleviate such information overload. Due to the important application value of recommender systems, there have always been emerging works in this field.…

Information Retrieval · Computer Science 2022-04-05 Shiwen Wu , Fei Sun , Wentao Zhang , Xu Xie , Bin Cui

Graph Transformers have garnered significant attention for learning graph-structured data, thanks to their superb ability to capture long-range dependencies among nodes. However, the quadratic space and time complexity hinders the…

Information Retrieval · Computer Science 2024-05-08 Huiyuan Chen , Zhe Xu , Chin-Chia Michael Yeh , Vivian Lai , Yan Zheng , Minghua Xu , Hanghang Tong

Pedestrian trajectory prediction, vital for selfdriving cars and socially-aware robots, is complicated due to intricate interactions between pedestrians, their environment, and other Vulnerable Road Users. This paper presents GSGFormer, an…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Zhongchang Luo , Marion Robin , Pavan Vasishta

Traffic forecasting has emerged as a crucial research area in the development of smart cities. Although various neural networks with intricate architectures have been developed to address this problem, they still face two key challenges: i)…

Machine Learning · Computer Science 2024-08-27 Jianxiang Zhou , Erdong Liu , Wei Chen , Siru Zhong , Yuxuan Liang

Multimodal recommender systems (MRS) integrate heterogeneous user and item data, such as text, images, and structured information, to enhance recommendation performance. The emergence of large language models (LLMs) introduces new…

Information Retrieval · Computer Science 2025-05-16 Alejo Lopez-Avila , Jinhua Du

Recommender Systems (RSs) have become the cornerstone of various applications such as e-commerce and social media platforms. The evolution of RSs is paramount in the digital era, in which personalised user experience is tailored to the…

Information Retrieval · Computer Science 2025-12-09 Tendai Mukande , Esraa Ali , Annalina Caputo , Ruihai Dong , Noel OConnor

Sequential Recommendation (SR) aims to predict future user-item interactions based on historical interactions. While many SR approaches concentrate on user IDs and item IDs, the human perception of the world through multi-modal signals,…

Information Retrieval · Computer Science 2024-10-08 Youhua Li , Hanwen Du , Yongxin Ni , Yuanqi He , Junchen Fu , Xiangyan Liu , Qi Guo

Recommendation Systems are effective in managing the ever-increasing amount of multimodal data available today and help users discover interesting new items. These systems can handle various media types such as images, text, audio, and…

Machine Learning · Computer Science 2026-03-03 Haimonti Dutta , Pruthvi Moluguri , Jin Dai , Saurabh Amarnath Mahindre

Data collected by different modalities can provide a wealth of complementary information, such as hyperspectral image (HSI) to offer rich spectral-spatial properties, synthetic aperture radar (SAR) to provide structural information about…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Jiaqi Yang , Bo Du , Rong Liu , Zhu Mao , Liangpei Zhang