English
Related papers

Related papers: Multimodal Fusion And Sparse Attention-based Align…

200 papers

Sequential Recommendation (SR) learns user preferences from their historical interaction sequences and provides personalized suggestions. In real-world scenarios, most items exhibit sparse interactions, known as the tail-item problem. This…

Information Retrieval · Computer Science 2026-04-07 Zhifu Wei , Yizhou Dang , Guibing Guo , Chuang Zhao , Zhu Sun

Session-based recommendation aims to predict a user's next action based on previous actions in the current session. The major challenge is to capture authentic and complete user preferences in the entire session. Recent work utilizes graph…

Information Retrieval · Computer Science 2022-01-11 Jiayan Guo , Yaming Yang , Xiangchen Song , Yuan Zhang , Yujing Wang , Jing Bai , Yan Zhang

Sequential recommendation (SR) systems excel at capturing users' dynamic preferences by leveraging their interaction histories. Most existing SR systems assign a single embedding vector to each item to represent its features, adopting…

Information Retrieval · Computer Science 2026-01-21 Mingrui Liu , Sixiao Zhang , Cheng Long

Sequential Recommendation (SR) models user dynamics and predicts the next preferred items based on the user history. Existing SR methods model the 'was interacted before' item-item transitions observed in sequences, which can be viewed as…

Information Retrieval · Computer Science 2022-11-01 Ziwei Fan , Zhiwei Liu , Chen Wang , Peijie Huang , Hao Peng , Philip S. Yu

Recently, research using point clouds has been increasing with the development of 3D scanner technology. According to this trend, the demand for high-quality point clouds is increasing, but there is still a problem with the high cost of…

Computer Vision and Pattern Recognition · Computer Science 2022-08-24 Hyungjun Lee , Sejoon Lim

With the hardware development of mobile devices, it is possible to build the recommendation models on the mobile side to utilize the fine-grained features and the real-time feedbacks. Compared to the straightforward mobile-based modeling…

Information Retrieval · Computer Science 2021-09-28 Zeyuan Chen , Jiangchao Yao , Feng Wang , Kunyang Jia , Bo Han , Wei Zhang , Hongxia Yang

Multimodal Sentiment Analysis (MSA) aims to predict sentiment from language, acoustic, and visual data in videos. However, imbalanced unimodal performance often leads to suboptimal fused representations. Existing approaches typically adopt…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Dingkang Yang , Mingcheng Li , Xuecheng Wu , Zhaoyu Chen , Kaixun Jiang , Keliang Liu , Peng Zhai , Lihua Zhang

This paper introduces the M&M model, a novel multimodal-multitask learning framework, applied to the AVCAffe dataset for cognitive load assessment (CLA). M&M uniquely integrates audiovisual cues through a dual-pathway architecture,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Long Nguyen-Phuoc , Renald Gaboriau , Dimitri Delacroix , Laurent Navarro

Event classification is inherently sequential and multimodal. Therefore, deep neural models need to dynamically focus on the most relevant time window and/or modality of a video. In this study, we propose the Multi-level Attention Fusion…

Computer Vision and Pattern Recognition · Computer Science 2021-06-15 Mathilde Brousmiche , Jean Rouat , Stéphane Dupont

Lifelong user interest modeling is crucial for industrial recommender systems, yet existing approaches rely predominantly on ID-based features, suffering from poor generalization on long-tail items and limited semantic expressiveness. While…

Information Retrieval · Computer Science 2025-12-09 Bin Wu , Feifan Yang , Zhangming Chan , Yu-Ran Gu , Jiawei Feng , Chao Yi , Xiang-Rong Sheng , Han Zhu , Jian Xu , Mang Ye , Bo Zheng

Session-based Recurrent Neural Networks (RNNs) are gaining increasing popularity for recommendation task, due to the high autocorrelation of user's behavior on the latest session and the effectiveness of RNN to capture the sequence order…

Machine Learning · Computer Science 2019-09-13 Mei Wang , Weizhi Li , Yan Yan

Sequential recommendation aims to identify and recommend the next few items for a user that the user is most likely to purchase/review, given the user's purchase/rating trajectories. It becomes an effective tool to help users select…

Information Retrieval · Computer Science 2021-01-05 Bo Peng , Zhiyun Ren , Srinivasan Parthasarathy , Xia Ning

Existing item-based collaborative filtering (ICF) methods leverage only the relation of collaborative similarity. Nevertheless, there exist multiple relations between items in real-world scenarios. Distinct from the collaborative similarity…

Information Retrieval · Computer Science 2019-05-14 Xin Xin , Xiangnan He , Yongfeng Zhang , Yongdong Zhang , Joemon Jose

Aggregating information from features across different layers is an essential operation for dense prediction models. Despite its limited expressiveness, feature concatenation dominates the choice of aggregation operations. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2023-01-20 Yung-Hsu Yang , Thomas E. Huang , Min Sun , Samuel Rota Bulò , Peter Kontschieder , Fisher Yu

Video-based person re-identification (reID) aims at matching the same person across video clips. It is a challenging task due to the existence of redundancy among frames, newly revealed appearance, occlusion, and motion blurs. In this…

Computer Vision and Pattern Recognition · Computer Science 2020-03-30 Zhizheng Zhang , Cuiling Lan , Wenjun Zeng , Zhibo Chen

Human-interaction-involved applications underscore the need for Multi-modal Sentiment Analysis (MSA). Although many approaches have been proposed to address the subtle emotions in different modalities, the power of explanations and temporal…

Computation and Language · Computer Science 2025-12-30 Dongning Rao , Yunbiao Zeng , Zhihua Jiang , Jujian Lv

Conventional methods for student modeling, which involve predicting grades based on measured activities, struggle to provide accurate results for minority/underrepresented student groups due to data availability biases. In this paper, we…

Multimodal information (e.g., visual, acoustic, and textual) has been widely used to enhance representation learning for micro-video recommendation. For integrating multimodal information into a joint representation of micro-video,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Han Liu , Yinwei Wei , Fan Liu , Wenjie Wang , Liqiang Nie , Tat-Seng Chua

In sequence to sequence learning, the self-attention mechanism proves to be highly effective, and achieves significant improvements in many tasks. However, the self-attention mechanism is not without its own flaws. Although self-attention…

Computation and Language · Computer Science 2019-11-22 Guangxiang Zhao , Xu Sun , Jingjing Xu , Zhiyuan Zhang , Liangchen Luo

Visual question answering (VQA) is challenging because it requires a simultaneous understanding of both the visual content of images and the textual content of questions. The approaches used to represent the images and questions in a…

Computer Vision and Pattern Recognition · Computer Science 2017-08-07 Zhou Yu , Jun Yu , Jianping Fan , Dacheng Tao