English
Related papers

Related papers: Multimodal Pre-training Framework for Sequential R…

200 papers

Recently, significant progress has been made in multi-modal continual learning, aiming to learn new tasks sequentially in multi-modal settings while preserving performance on previously learned ones. However, existing methods mainly focus…

Multimedia · Computer Science 2026-03-10 Yuyang Hong , Qi Yang , Tao Zhang , Zili Wang , Zhaojin Fu , Kun Ding , Bin Fan , Shiming Xiang

With the development of multimedia systems, multimodal recommendations are playing an essential role, as they can leverage rich contexts beyond interactions. Existing methods mainly regard multimodal information as an auxiliary, using them…

Information Retrieval · Computer Science 2024-08-02 Yifan Liu , Kangning Zhang , Xiangyuan Ren , Yanhua Huang , Jiarui Jin , Yingjie Qin , Ruilong Su , Ruiwen Xu , Yong Yu , Weinan Zhang

Multimodal sentence embedding models typically leverage image-caption pairs in addition to textual data during training. However, such pairs often contain noise, including redundant or irrelevant information on either the image or caption…

Computation and Language · Computer Science 2025-08-04 Kaiyan Zhao , Zhongtao Miao , Yoshimasa Tsuruoka

Due to the incapability of one sensory measurement to provide enough information for condition monitoring of some complex engineered industrial mechanisms and also for overcoming the misleading noise of a single sensor, multiple sensors are…

Machine Learning · Computer Science 2023-11-07 Ardavan Modarres , Vahid Mohammad-Zadeh Eivaghi , Mahdi Aliyari Shoorehdeli , Ashkan Moosavian

Unsupervised pre-training has shown great success in skeleton-based action understanding recently. Existing works typically train separate modality-specific models, then integrate the multi-modal information for action understanding by a…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Shengkai Sun , Daizong Liu , Jianfeng Dong , Xiaoye Qu , Junyu Gao , Xun Yang , Xun Wang , Meng Wang

Self-supervised learning has proven to be an effective way to learn representations in domains where annotated labels are scarce, such as medical imaging. A widely adopted framework for this purpose is contrastive learning and it has been…

Computer Vision and Pattern Recognition · Computer Science 2024-02-23 Hugo Figueiras , Helena Aidos , Nuno Cruz Garcia

ID-based Recommender Systems (RecSys), where each item is assigned a unique identifier and subsequently converted into an embedding vector, have dominated the designing of RecSys. Though prevalent, such ID-based paradigm is not suitable for…

Information Retrieval · Computer Science 2023-12-19 Youhua Li , Hanwen Du , Yongxin Ni , Pengpeng Zhao , Qi Guo , Fajie Yuan , Xiaofang Zhou

Sequential recommendation (SR) systems excel at capturing users' dynamic preferences by leveraging their interaction histories. Most existing SR systems assign a single embedding vector to each item to represent its features, adopting…

Information Retrieval · Computer Science 2026-01-21 Mingrui Liu , Sixiao Zhang , Cheng Long

This paper studies the multi-modal recommendation problem, where the item multi-modality information (e.g., images and textual descriptions) is exploited to improve the recommendation accuracy. Besides the user-item interaction graph,…

Information Retrieval · Computer Science 2023-05-02 Xin Zhou , Hongyu Zhou , Yong Liu , Zhiwei Zeng , Chunyan Miao , Pengwei Wang , Yuan You , Feijun Jiang

The recent advent of self-supervised pre-training techniques has led to a surge in the use of multimodal learning in form document understanding. However, existing approaches that extend the mask language modeling to other modalities…

A fundamental challenge for sequential recommenders is to capture the sequential patterns of users toward modeling how users transit among items. In many practical scenarios, however, there are a great number of cold-start users with only…

Information Retrieval · Computer Science 2021-07-15 Jianling Wang , Kaize Ding , James Caverlee

Masked image modelling (e.g., Masked AutoEncoder) and contrastive learning (e.g., Momentum Contrast) have shown impressive performance on unsupervised visual representation learning. This work presents Masked Contrastive Representation…

Computer Vision and Pattern Recognition · Computer Science 2022-11-14 Yuchong Yao , Nandakishor Desai , Marimuthu Palaniswami

Sequential recommendation aims to capture users' dynamic interest and predicts the next item of users' preference. Most sequential recommendation methods use a deep neural network as sequence encoder to generate user and item…

Information Retrieval · Computer Science 2023-05-17 Hanwen Du , Huanhuan Yuan , Pengpeng Zhao , Fuzhen Zhuang , Guanfeng Liu , Lei Zhao , Victor S. Sheng

Session-based recommendation systems(SBRS) are more suitable for the current e-commerce and streaming media recommendation scenarios and thus have become a hot topic. The data encountered by SBRS is typically highly sparse, which also…

Information Retrieval · Computer Science 2023-08-31 Zihan Wang , Gang Wu , Haotong Wang

Cross-domain recommendation (CDR) is a task that aims to improve the recommendation performance in a target domain by leveraging the information from source domains. Contrastive learning methods have been widely adopted among intra-domain…

Information Retrieval · Computer Science 2025-02-25 Heng Chang , Liang Gu , Cheng Hu , Zhinan Zhang , Hong Zhu , Yuhui Xu , Yuan Fang , Zhen Chen

Conversational recommender systems (CRS) aim to recommend suitable items to users through natural language conversations. For developing effective CRSs, a major technical issue is how to accurately infer user preference from very limited…

Computation and Language · Computer Science 2023-05-31 Yuanhang Zhou , Kun Zhou , Wayne Xin Zhao , Cheng Wang , Peng Jiang , He Hu

Sequential recommendation (SR) aims to capture users' dynamic interests and sequential patterns based on their historical interactions. Recently, the powerful capabilities of large language models (LLMs) have driven their adoption in SR.…

Information Retrieval · Computer Science 2025-09-03 Yuhao Wang , Junwei Pan , Xinhang Li , Maolin Wang , Yuan Wang , Yue Liu , Dapeng Liu , Jie Jiang , Xiangyu Zhao

This paper proposes a method for representation learning of multimodal data using contrastive losses. A traditional approach is to contrast different modalities to learn the information shared between them. However, that approach could fail…

Computer Vision and Pattern Recognition · Computer Science 2021-07-07 Yunze Liu , Qingnan Fan , Shanghang Zhang , Hao Dong , Thomas Funkhouser , Li Yi

In the landscape of Recommender System (RS) applications, reinforcement learning (RL) has recently emerged as a powerful tool, primarily due to its proficiency in optimizing long-term rewards. Nevertheless, it suffers from instability in…

Information Retrieval · Computer Science 2024-06-11 Ziru Liu , Shuchang Liu , Zijian Zhang , Qingpeng Cai , Xiangyu Zhao , Kesen Zhao , Lantao Hu , Peng Jiang , Kun Gai

Personalized recommendation stands as a ubiquitous channel for users to explore information or items aligned with their interests. Nevertheless, prevailing recommendation models predominantly rely on unique IDs and categorical features for…

Information Retrieval · Computer Science 2024-05-14 Jieming Zhu , Chuhan Wu , Rui Zhang , Zhenhua Dong
‹ Prev 1 8 9 10 Next ›