English
Related papers

Related papers: Multi-Modal Self-Supervised Learning for Recommend…

200 papers

Semi-supervised learning (SSL) has become a promising direction for medical image segmentation, enabling models to learn from limited labeled data alongside abundant unlabeled samples. However, existing SSL approaches for multi-modal…

Computer Vision and Pattern Recognition · Computer Science 2025-12-11 Tien-Dat Chung , Ba-Thinh Lam , Thanh-Huy Nguyen , Thien Nguyen , Nguyen Lan Vi Vu , Hoang-Loc Cao , Phat Kim Huynh , Min Xu

The goal of sequential recommendation (SR) is to predict a user's potential interested items based on her/his historical interaction sequences. Most existing sequential recommenders are developed based on ID features, which, despite their…

Information Retrieval · Computer Science 2023-10-24 Jinpeng Wang , Ziyun Zeng , Yunxiao Wang , Yuting Wang , Xingyu Lu , Tianxiang Li , Jun Yuan , Rui Zhang , Hai-Tao Zheng , Shu-Tao Xia

Personalized recommendation serves as a ubiquitous channel for users to discover information tailored to their interests. However, traditional recommendation models primarily rely on unique IDs and categorical features for user-item…

Information Retrieval · Computer Science 2024-07-04 Qijiong Liu , Jieming Zhu , Yanting Yang , Quanyu Dai , Zhaocheng Du , Xiao-Ming Wu , Zhou Zhao , Rui Zhang , Zhenhua Dong

Due to the ever-growing diversity of the data source, multi-modality feature learning has attracted more and more attention. However, most of these methods are designed by jointly learning feature representation from multi-modalities that…

Computer Vision and Pattern Recognition · Computer Science 2020-06-09 Danfeng Hong , Jocelyn Chanussot , Naoto Yokoya , Jian Kang , Xiao Xiang Zhu

Joint-embedding self-supervised learning (SSL), the key paradigm for unsupervised representation learning from visual data, learns from invariances between semantically-related data pairs. We study the one-to-many mapping problem in SSL,…

Machine Learning · Computer Science 2026-02-03 Yipeng Zhang , Hafez Ghaemi , Jungyoon Lee , Shahab Bakhtiari , Eilif B. Muller , Laurent Charlin

Multi-modal semantic understanding requires integrating information from different modalities to extract users' real intention behind words. Most previous work applies a dual-encoder structure to separately encode image and text, but fails…

Computation and Language · Computer Science 2024-03-12 Ming Zhang , Ke Chang , Yunfang Wu

This paper presents a study on semi-supervised learning to solve the visual attribute prediction problem. In many applications of vision algorithms, the precise recognition of visual attributes of objects is important but still challenging.…

Computer Vision and Pattern Recognition · Computer Science 2020-07-15 Minchul Shin

Automatic emotion recognition is an active research topic with wide range of applications. Due to the high manual annotation cost and inevitable label ambiguity, the development of emotion recognition dataset is limited in both scale and…

Audio and Speech Processing · Electrical Eng. & Systems 2020-09-08 Jingjun Liang , Ruichen Li , Qin Jin

The abundance of user-generated data in social media has incentivized the development of methods to infer the latent attributes of users, which are crucially useful for personalization, advertising and recommendation. However, the current…

Social and Information Networks · Computer Science 2016-06-27 Richard J. Oentaryo , Ee-Peng Lim , Freddy Chong Tat Chua , Jia-Wei Low , David Lo

In recent years, the rapid growth of online multimedia services, such as e-commerce platforms, has necessitated the development of personalised recommendation approaches that can encode diverse content about each item. Indeed, modern…

Information Retrieval · Computer Science 2023-11-06 Zixuan Yi , Zijun Long , Iadh Ounis , Craig Macdonald , Richard Mccreadie

The rapid advances in e-commerce and Web 2.0 technologies have greatly increased the impact of commercial advertisements on the general public. As a key enabling technology, a multitude of recommender systems exists which analyzes user…

Artificial Intelligence · Computer Science 2017-09-13 Nikhita Vedula , Wei Sun , Hyunhwan Lee , Harsh Gupta , Mitsunori Ogihara , Joseph Johnson , Gang Ren , Srinivasan Parthasarathy

Personalized recommender systems play a crucial role in capturing users' evolving preferences over time to provide accurate and effective recommendations on various online platforms. However, many recommendation models rely on a single type…

Information Retrieval · Computer Science 2023-10-23 Wei Wei , Lianghao Xia , Chao Huang

Recent semi-supervised learning (SSL) methods are commonly based on pseudo labeling. Since the SSL performance is greatly influenced by the quality of pseudo labels, mutual learning has been proposed to effectively suppress the noises in…

Computer Vision and Pattern Recognition · Computer Science 2021-12-28 Pan Zhang , Bo Zhang , Ting Zhang , Dong Chen , Fang Wen

Unsupervised learning is a challenging task due to the lack of labels. Multiple Object Tracking (MOT), which inevitably suffers from mutual object interference, occlusion, etc., is even more difficult without label supervision. In this…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Sha Meng , Dian Shao , Jiacheng Guo , Shan Gao

Multimedia content is of predominance in the modern Web era. In real scenarios, multiple modalities reveal different aspects of item attributes and usually possess different importance to user purchase decisions. However, it is difficult…

Information Retrieval · Computer Science 2023-06-27 Jinghao Zhang , Qiang Liu , Shu Wu , Liang Wang

Identifying highlight moments of raw video materials is crucial for improving the efficiency of editing videos that are pervasive on internet platforms. However, the extensive work of manually labeling footage has created obstacles to…

Computer Vision and Pattern Recognition · Computer Science 2024-12-06 Tingtian Li , Zixun Sun , Xinyu Xiao

Self-supervised learning (SSL) has revolutionized learning from large-scale unlabeled datasets, yet the intrinsic relationship between pretraining data and the learned representations remains poorly understood. Traditional supervised…

Machine Learning · Computer Science 2024-12-24 Nidhin Harilal , Amit Kiran Rege , Reza Akbarian Bafghi , Maziar Raissi , Claire Monteleoni

Self-supervised learning (SSL) approaches have shown promising capabilities in learning the representation from unlabeled data. Amongst them, momentum-based frameworks have attracted significant attention. Despite being a great success,…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Trung X. Pham , Axi Niu , Zhang Kang , Sultan Rizky Madjid , Ji Woo Hong , Daehyeok Kim , Joshua Tian Jin Tee , Chang D. Yoo

Self-supervised Learning (SSL) including the mainstream contrastive learning has achieved great success in learning visual representations without data annotations. However, most of methods mainly focus on the instance level information…

Computer Vision and Pattern Recognition · Computer Science 2021-07-26 Mingkai Zheng , Shan You , Fei Wang , Chen Qian , Changshui Zhang , Xiaogang Wang , Chang Xu

With the rapid development of mobile Internet and big data, a huge amount of data is generated in the network, but the data that users are really interested in a very small portion. To extract the information that users are interested in…

Information Retrieval · Computer Science 2022-05-09 Bo Liu