English
Related papers

Related papers: MM-GEF: Multi-modal representation meet collaborat…

200 papers

Recently, maximizing mutual information has emerged as a powerful method for unsupervised graph representation learning. The existing methods are typically effective to capture information from the topology view but ignore the feature view.…

Machine Learning · Computer Science 2022-10-12 Xiaolong Fan , Maoguo Gong , Yue Wu , Hao Li

In the health domain, decisions are often based on different data modalities. Thus, when creating prediction models, multimodal fusion approaches that can extract and combine relevant features from different data modalities, can be highly…

Artificial Intelligence · Computer Science 2024-02-20 Mafalda Malafaia , Thalea Schlender , Peter A. N. Bosman , Tanja Alderliesten

Recent studies empirically indicate that language models (LMs) encode rich world knowledge beyond mere semantics, attracting significant attention across various fields. However, in the recommendation domain, it remains uncertain whether…

Information Retrieval · Computer Science 2025-04-22 Leheng Sheng , An Zhang , Yi Zhang , Yuxin Chen , Xiang Wang , Tat-Seng Chua

In e-commerce, where users face a vast array of possible item choices, recommender systems are vital for helping them discover suitable items they might otherwise overlook. While many recommender systems primarily rely on a user's purchase…

Information Retrieval · Computer Science 2025-08-29 Kyungho Kim , Sunwoo Kim , Geon Lee , Kijung Shin

An Item based recommender system works by computing a similarity between items, which can exploit past user interactions (collaborative filtering) or item features (content based filtering). Collaborative algorithms have been proven to…

Information Retrieval · Computer Science 2019-07-12 Maurizio Ferrari Dacrema , Alberto Gasparin , Paolo Cremonesi

Although large-scale visual foundation models (VFMs) achieve remarkable performance in semantic understanding, they still underperform in instance-aware dense prediction tasks. They exhibit different biases in representation: for instance,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Yachan Guo , JoseLuis Gomez Zurita , Danna Xue , Yi Xiao , AntonioManuel Lopez Pena

In this work, we present a multi-modal model for commercial product classification, that combines features extracted by multiple neural network models from textual (CamemBERT and FlauBERT) and visual data (SE-ResNeXt-50), using simple…

Artificial Intelligence · Computer Science 2022-07-12 Tsegaye Misikir Tashu , Sara Fattouh , Peter Kiss , Tomas Horvath

In recent years, artificial intelligence has played an important role on accelerating the whole process of drug discovery. Various of molecular representation schemes of different modals (e.g. textual sequence or graph) are developed. By…

Machine Learning · Computer Science 2022-11-28 Tianyu Wu , Yang Tang , Qiyu Sun , Luolin Xiong

In real-world recommendation scenarios, users engage with items through various types of behaviors. Leveraging diversified user behavior information for learning can enhance the recommendation of target behaviors (e.g., buy), as…

Information Retrieval · Computer Science 2025-02-05 Chenhao Zhai , Chang Meng , Yu Yang , Kexin Zhang , Xuhao Zhao , Xiu Li

Multi-Modal Relation Extraction (MMRE) aims at identifying the relation between two entities in texts that contain visual clues. Rich visual content is valuable for the MMRE task, but existing works cannot well model finer associations…

Computation and Language · Computer Science 2023-06-21 Qian Li , Shu Guo , Cheng Ji , Xutan Peng , Shiyao Cui , Jianxin Li

Automatically understanding the contents of an image is a highly relevant problem in practice. In e-commerce and social media settings, for example, a common problem is to automatically categorize user-provided pictures. Nowadays, a…

Computer Vision and Pattern Recognition · Computer Science 2022-10-24 Koby Bibas , Oren Sar Shalom , Dietmar Jannach

Learning a good representation of text is key to many recommendation applications. Examples include news recommendation where texts to be recommended are constantly published everyday. However, most existing recommendation techniques, such…

Information Retrieval · Computer Science 2017-06-27 Ting Chen , Liangjie Hong , Yue Shi , Yizhou Sun

Multi-Modal Entity Alignment aims to discover identical entities across heterogeneous knowledge graphs. While recent studies have delved into fusion paradigms to represent entities holistically, the elimination of features irrelevant to…

Computation and Language · Computer Science 2024-07-24 Yani Huang , Xuefeng Zhang , Richong Zhang , Junfan Chen , Jaein Kim

Sequential fashion recommendation is of great significance in online fashion shopping, which accounts for an increasing portion of either fashion retailing or online e-commerce. The key to building an effective sequential fashion…

Information Retrieval · Computer Science 2021-06-01 Yujuan Ding , Yunshan Ma , Wai Keung Wong , Tat-Seng Chua

The burgeoning presence of Large Language Models (LLM) is propelling the development of personalized recommender systems. Most existing LLM-based methods fail to sufficiently explore the multi-view graph structure correlations inherent in…

Information Retrieval · Computer Science 2025-07-30 Xu Guo , Tong Zhang , Yuanzhi Wang , Chenxu Wang , Fuyun Wang , Xudong Wang , Xiaoya Zhang , Xin Liu , Zhen Cui

Temporal collaborative filtering (TCF) methods aim at modelling non-static aspects behind recommender systems, such as the dynamics in users' preferences and social trends around items. State-of-the-art TCF methods employ recurrent neural…

Artificial Intelligence · Computer Science 2020-10-14 Esther Rodrigo Bonet , Duc Minh Nguyen , Nikos Deligiannis

Recommendation systems have faced significant challenges in cold-start scenarios, where new items with a limited history of interaction need to be effectively recommended to users. Though multimodal data (e.g., images, text, audio, etc.)…

Information Retrieval · Computer Science 2025-08-12 Van-Khang Nguyen , Duc-Hoang Pham , Huy-Son Nguyen , Cam-Van Thi Nguyen , Hoang-Quynh Le , Duc-Trong Le

Recent advancements in Multimodal Large Language Models (MLLMs) have demonstrated significant potential in recommendation systems. However, the effective application of MLLMs to multimodal sequential recommendation remains unexplored: A)…

Information Retrieval · Computer Science 2025-12-25 Haoyu Wang , Yitong Wang , Jining Wang

The trend of data mining using deep learning models on graph neural networks has proven effective in identifying object features through signal encoders and decoders, particularly in recommendation systems utilizing collaborative filtering…

Information Retrieval · Computer Science 2025-03-27 Manh Mai Van , Tin T. Tran

Recommender systems have been actively studied and applied in various domains to deal with information overload. Although there are numerous studies on recommender systems for movies, music, and e-commerce, comparatively less attention has…

Information Retrieval · Computer Science 2024-04-04 Minjoo Choi , Seonmi Kim , Yejin Kim , Youngbin Lee , Joohwan Hong , Yongjae Lee