English
Related papers

Related papers: Latent Structure Mining with Contrastive Modality …

200 papers

Multimodal recommendation is commonly framed as a feature fusion problem, where textual and visual signals are combined to better model user preference. However, the effectiveness of multimodal recommendation may depend not only on how…

Information Retrieval · Computer Science 2026-03-16 Ty Valencia , Burak Barlas , Varun Singhal , Ruchir Bhatia , Wei Yang

Conventional multimodal recommender systems predominantly leverage Bayesian Personalized Ranking (BPR) optimization to learn item representations by amalgamating item identity (ID) embeddings with multimodal features. Nevertheless, our…

Information Retrieval · Computer Science 2025-05-09 Xin Zhou , Xiaoxiong Zhang , Dusit Niyato , Zhiqi Shen

Artwork recommendation is challenging because it requires understanding how users interact with highly subjective content, the complexity of the concepts embedded within the artwork, and the emotional and cognitive reflections they may…

Information Retrieval · Computer Science 2023-03-21 Bereket A. Yilma , Luis A. Leiva

Multimodal information (e.g., visual, acoustic, and textual) has been widely used to enhance representation learning for micro-video recommendation. For integrating multimodal information into a joint representation of micro-video,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Han Liu , Yinwei Wei , Fan Liu , Wenjie Wang , Liqiang Nie , Tat-Seng Chua

Latent spaces offer an efficient and effective means of summarizing data while implicitly preserving meta-information through relational encoding. We leverage these meta-embeddings to develop a modality-agnostic, unified encoder. Our method…

Signal Processing · Electrical Eng. & Systems 2025-07-22 Abdullah Ahmed , Jeremy Gummeson

This paper proposes a method for representation learning of multimodal data using contrastive losses. A traditional approach is to contrast different modalities to learn the information shared between them. However, that approach could fail…

Computer Vision and Pattern Recognition · Computer Science 2021-07-07 Yunze Liu , Qingnan Fan , Shanghang Zhang , Hao Dong , Thomas Funkhouser , Li Yi

Learning a good representation of text is key to many recommendation applications. Examples include news recommendation where texts to be recommended are constantly published everyday. However, most existing recommendation techniques, such…

Information Retrieval · Computer Science 2017-06-27 Ting Chen , Liangjie Hong , Yue Shi , Yizhou Sun

Food recommendation systems serve as pivotal components in the realm of digital lifestyle services, designed to assist users in discovering recipes and food items that resonate with their unique dietary predilections. Typically, multi-modal…

Information Retrieval · Computer Science 2025-02-28 Yixin Zhang , Xin Zhou , Qianwen Meng , Fanglin Zhu , Yonghui Xu , Zhiqi Shen , Lizhen Cui

The integration of different imaging modalities, such as structural, diffusion tensor, and functional magnetic resonance imaging, with deep learning models has yielded promising outcomes in discerning phenotypic characteristics and…

Image and Video Processing · Electrical Eng. & Systems 2024-10-08 Zhiyuan Li , Hailong Li , Anca L. Ralescu , Jonathan R. Dillman , Mekibib Altaye , Kim M. Cecil , Nehal A. Parikh , Lili He

Sequential recommender systems rank relevant items by modeling a user's interaction history and computing the inner product between the resulting user representation and stored item embeddings. To avoid the significant memory overhead of…

This paper studies the item-to-item recommendation problem in recommender systems from a new perspective of metric learning via implicit feedback. We develop and investigate a personalizable deep metric model that captures both the internal…

Information Retrieval · Computer Science 2022-03-24 Trong Nghia Hoang , Anoop Deoras , Tong Zhao , Jin Li , George Karypis

Semantically connecting users and items is a fundamental problem for the matching stage of an industrial recommender system. Recent advances in this topic are based on multi-channel retrieval to efficiently measure users' interest on items…

Information Retrieval · Computer Science 2022-02-15 Yujie Lu , Ping Nie , Shengyu Zhang , Ming Zhao , Ruobing Xie , William Yang Wang , Yi Ren

The rise of online multi-modal sharing platforms like TikTok and YouTube has enabled personalized recommender systems to incorporate multiple modalities (such as visual, textual, and acoustic) into user representations. However, addressing…

Information Retrieval · Computer Science 2024-06-18 Yangqin Jiang , Lianghao Xia , Wei Wei , Da Luo , Kangyi Lin , Chao Huang

Many latent (factorized) models have been proposed for recommendation tasks like collaborative filtering and for ranking tasks like document or image retrieval and annotation. Common to all those methods is that during inference the items…

Machine Learning · Computer Science 2012-10-19 Jason Weston , John Blitzer

Many tasks in music information retrieval, such as recommendation, and playlist generation for online radio, fall naturally into the query-by-example setting, wherein a user queries the system by providing a song, and the system responds…

Multimedia · Computer Science 2011-05-13 Brian McFee , Luke Barrington , Gert Lanckriet

Despite the success of conventional collaborative filtering (CF) approaches for recommendation systems, they exhibit limitations in leveraging semantic knowledge within the textual attributes of users and items. Recent focus on the…

Information Retrieval · Computer Science 2024-08-19 Zhongzhou Liu , Hao Zhang , Kuicai Dong , Yuan Fang

Traditional Collaborative Filtering (CF) based methods are applied to understand the personal preferences of users/customers for items or products from the rating matrix. Usually, the rating matrix is sparse in nature. So there are some…

Information Retrieval · Computer Science 2022-10-12 Supriyo Mandal , Abyayananda Maiti

Session-based recommendation techniques aim to capture dynamic user behavior by analyzing past interactions. However, existing methods heavily rely on historical item ID sequences to extract user preferences, leading to challenges such as…

Information Retrieval · Computer Science 2023-07-21 Zhipeng Zhang , Piao Tong , Yingwei Ma , Qiao Liu , Xujiang Liu , Xu Luo

Bundle recommendation seeks to recommend a bundle of related items to users to improve both user experience and the profits of platform. Existing bundle recommendation models have progressed from capturing only user-bundle interactions to…

Information Retrieval · Computer Science 2024-01-12 Yunshan Ma , Yingzhi He , Xiang Wang , Yinwei Wei , Xiaoyu Du , Yuyangzi Fu , Tat-Seng Chua

The interactions of users and items in recommender system could be naturally modeled as a user-item bipartite graph. In recent years, we have witnessed an emerging research effort in exploring user-item graph for collaborative filtering…

Machine Learning · Computer Science 2019-11-26 Xiao Wang , Ruijia Wang , Chuan Shi , Guojie Song , Qingyong Li