English
Related papers

Related papers: Distribution-Guided Auto-Encoder for User Multimod…

200 papers

Multi-interest candidate matching plays a pivotal role in personalized recommender systems, as it captures diverse user interests from their historical behaviors. Most existing methods utilize attention mechanisms to generate interest…

Information Retrieval · Computer Science 2025-02-14 Yankun Le , Haoran Li , Baoyuan Ou , Yingjie Qin , Zhixuan Yang , Ruilong Su , Fu Zhang

Multi-modal fusion has shown initial promising results for object detection of autonomous driving perception. However, many existing fusion schemes do not consider the quality of each fusion input and may suffer from adverse conditions on…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Yang Lou , Qun Song , Qian Xu , Rui Tan , Jianping Wang

With the recently increasing capabilities of modern vehicles, novel approaches for interaction emerged that go beyond traditional touch-based and voice command approaches. Therefore, hand gestures, head pose, eye gaze, and speech have been…

Human-Computer Interaction · Computer Science 2022-11-08 Amr Gomaa

In the sequential recommendation task, the recommender generally learns multiple embeddings from a user's historical behaviors, to catch the diverse interests of the user. Nevertheless, the existing approaches just extract each interest…

Information Retrieval · Computer Science 2023-10-17 Liangliang Chen , Hongzhan Lin , Jinshan Ma , Guang Chen

Most existing recommender systems represent a user's preference with a feature vector, which is assumed to be fixed when predicting this user's preferences for different items. However, the same vector cannot accurately capture a user's…

Information Retrieval · Computer Science 2019-08-22 Fan Liu , Zhiyong Cheng , Changchang Sun , Yinglong Wang , Liqiang Nie , Mohan Kankanhalli

Cross-domain recommendation aims to leverage knowledge from multiple domains to alleviate the data sparsity and cold-start problems in traditional recommender systems. One popular paradigm is to employ overlapping user representations to…

Information Retrieval · Computer Science 2023-01-30 Chuang Zhao , Hongke Zhao , Ming He , Jian Zhang , Jianping Fan

Multimodal recommender systems enhance personalized recommendations in e-commerce and online advertising by integrating visual, textual, and user-item interaction data. However, existing methods often overlook two critical biases: (i) modal…

Information Retrieval · Computer Science 2025-10-15 Jie Yang , Chenyang Gu , Zixuan Liu

Masked Autoencoders (MAE) play a pivotal role in learning potent representations, delivering outstanding results across various 3D perception tasks essential for autonomous driving. In real-world driving scenarios, it's commonplace to…

Computer Vision and Pattern Recognition · Computer Science 2024-08-26 Jian Zou , Tianyu Huang , Guanglei Yang , Zhenhua Guo , Tao Luo , Chun-Mei Feng , Wangmeng Zuo

While recommender systems with multi-modal item representations (image, audio, and text), have been widely explored, learning recommendations from multi-modal user interactions (e.g., clicks and speech) remains an open problem. We study the…

Information Retrieval · Computer Science 2024-05-08 Simone Borg Bruun , Krisztian Balog , Maria Maistro

To achieve continuous massive data transmission with significantly reduced data payload, the users can adopt semantic communication techniques to compress the redundant information by transmitting semantic features instead. However, current…

Signal Processing · Electrical Eng. & Systems 2024-01-30 Youcheng Zeng , Xinxin He , Xu Chen , Haonan Tong , Zhaohui Yang , Yijun Guo , Jianjun Hao

Incorporating multi-modal features as side information has recently become a trend in recommender systems. To elucidate user-item preferences, recent studies focus on fusing modalities via concatenation, element-wise sum, or attention…

Information Retrieval · Computer Science 2024-12-20 Rongqing Kenneth Ong , Andy W. H. Khong

Learning interpretable and disentangled representations of data is a key topic in machine learning research. Variational Autoencoder (VAE) is a scalable method for learning directed latent variable models of complex data. It employs a clear…

Machine Learning · Computer Science 2020-06-04 Andriy Serdega , Dae-Shik Kim

Multi-modal stance detection (MSD) aims to determine an author's stance toward a given target using both textual and visual content. While recent methods leverage multi-modal fusion and prompt-based learning, most fail to distinguish…

Multimedia · Computer Science 2026-01-30 Zhiyu Xie , Fuqiang Niu , Genan Dai , Qianlong Wang , Li Dong , Bowen Zhang , Hu Huang

Long-standing data sparsity and cold-start constitute thorny and perplexing problems for the recommendation systems. Cross-domain recommendation as a domain adaptation framework has been utilized to efficiently address these challenging…

Information Retrieval · Computer Science 2024-10-28 Alexandros Gkillas , Dimitrios Kosmopoulos

In the big data era, integrating diverse data modalities poses significant challenges, particularly in complex fields like healthcare. This paper introduces a new process model for multimodal Data Fusion for Data Mining, integrating…

Artificial Intelligence · Computer Science 2024-06-04 David Restrepo , Chenwei Wu , Constanza Vásquez-Venegas , Luis Filipe Nakayama , Leo Anthony Celi , Diego M López

The main idea of multimodal recommendation is the rational utilization of the item's multimodal information to improve the recommendation performance. Previous works directly integrate item multimodal features with item ID embeddings,…

Information Retrieval · Computer Science 2023-04-25 Yan Zhou , Jie Guo , Hao Sun , Bin Song , Fei Richard Yu

Cross-modal retrieval relies on accurate models to retrieve relevant results for queries across modalities such as image, text, and video. In this paper, we build upon previous work by tackling the difficulty of evaluating models both…

Multimedia · Computer Science 2020-10-20 Tony Zhao , Jaeyoung Choi , Gerald Friedland

Multi-modal sequential recommendation (SR) leverages multi-modal data to learn more comprehensive item features and user preferences than traditional SR methods, which has become a critical topic in both academia and industry. Existing…

Information Retrieval · Computer Science 2025-01-31 Shengzhe Zhang , Liyi Chen , Dazhong Shen , Chao Wang , Hui Xiong

In recent years, deep neural networks have yielded state-of-the-art performance on several tasks. Although some recent works have focused on combining deep learning with recommendation, we highlight three issues of existing models. First,…

Machine Learning · Computer Science 2018-12-20 Qibing Li , Xiaolin Zheng , Xinyue Wu

The increasing availability and diversity of multimodal data in recommender systems offer new avenues for enhancing recommendation accuracy and user satisfaction. However, these systems must contend with high-dimensional, sparse user-item…

Information Retrieval · Computer Science 2024-12-04 Yasser Khalafaoui , Martino Lovisetto , Basarab Matei , Nistor Grozavu