English
Related papers

Related papers: Multimodal Fusion And Sparse Attention-based Align…

200 papers

The main idea of multimodal recommendation is the rational utilization of the item's multimodal information to improve the recommendation performance. Previous works directly integrate item multimodal features with item ID embeddings,…

Information Retrieval · Computer Science 2023-04-25 Yan Zhou , Jie Guo , Hao Sun , Bin Song , Fei Richard Yu

Multimodal learning mimics the reasoning process of the human multi-sensory system, which is used to perceive the surrounding world. While making a prediction, the human brain tends to relate crucial cues from multiple sources of…

Computer Vision and Pattern Recognition · Computer Science 2021-06-29 Lang Su , Chuqing Hu , Guofa Li , Dongpu Cao

Unsupervised object-centric learning (OCL) decomposes visual scenes into distinct entities. Slot attention is a popular approach that represents individual objects as latent vectors, called slots. Current methods obtain these slot…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Sebastian Bock , Leonie Schüßler , Krishnakant Singh , Simone Schaub-Meyer , Stefan Roth

Feature selection is essential for high-dimensional biomedical data, enabling stronger predictive performance, reduced computational cost, and improved interpretability in precision medicine applications. Existing approaches face notable…

Machine Learning · Computer Science 2026-01-07 Xiaoyan Sun , Qingyu Meng , Yalu Wen

Multimodal Aspect-based Sentiment Analysis (MABSA) enhances sentiment detection by integrating textual data with complementary modalities, such as images, to provide a more refined and comprehensive understanding of sentiment. However,…

Computation and Language · Computer Science 2025-04-22 Adamu Lawan , Juhua Pu , Haruna Yunusa , Muhammad Lawan , Aliyu Umar , Adamu Sani Yahya , Mahmoud Basi

In applications such as e-commerce, online education, and streaming services, sequential recommendation systems play a critical role. Despite the excellent performance of self-attention-based sequential recommendation models in capturing…

Information Retrieval · Computer Science 2026-02-06 Jinzhao Su , Zhenhua Huang

One important challenge of applying deep learning to electronic health records (EHR) is the complexity of their multimodal structure. EHR usually contains a mixture of structured (codes) and unstructured (free-text) data with sparse and…

Machine Learning · Computer Science 2021-10-07 Zhen Xu , David R. So , Andrew M. Dai

Sequential recommendations have drawn significant attention in modeling the user's historical behaviors to predict the next item. With the booming development of multimodal data (e.g., image, text) on internet platforms, sequential…

Information Retrieval · Computer Science 2024-12-12 Changhong Li , Zhiqiang Guo

Multimodal learning has gained much success in recent years. However, current multimodal fusion methods adopt the attention mechanism of Transformers to implicitly learn the underlying correlation of multimodal features. As a result, the…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Thanh-Dat Truong , Christophe Bobda , Nitin Agarwal , Khoa Luu

The lifelong user behavior sequence provides abundant information of user preference and gains impressive improvement in the recommendation task, however increases computational consumption significantly. To meet the severe latency…

Information Retrieval · Computer Science 2024-06-17 Wenhui Yu , Chao Feng , Yanze Zhang , Lantao Hu , Peng Jiang , Han Li

Multimodal fusion learning has shown significant promise in classifying various diseases such as skin cancer and brain tumors. However, existing methods face three key limitations. First, they often lack generalizability to other diagnosis…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Joy Dhar , Nayyar Zaidi , Maryam Haghighat , Puneet Goyal , Sudipta Roy , Azadeh Alavi , Vikas Kumar

We consider the problem of referring image segmentation. Given an input image and a natural language expression, the goal is to segment the object referred by the language expression in the image. Existing works in this area treat the…

Computer Vision and Pattern Recognition · Computer Science 2019-04-10 Linwei Ye , Mrigank Rochan , Zhi Liu , Yang Wang

This paper challenges the cross-domain semantic segmentation task, aiming to improve the segmentation accuracy on the unlabeled target domain without incurring additional annotation. Using the pseudo-label-based unsupervised domain…

Computer Vision and Pattern Recognition · Computer Science 2021-12-02 Kai Zhang , Yifan Sun , Rui Wang , Haichang Li , Xiaohui Hu

Recently, deep neural networks are widely applied in recommender systems for their effectiveness in capturing/modeling users' preferences. Especially, the attention mechanism in deep learning enables recommender systems to incorporate…

Information Retrieval · Computer Science 2021-03-17 Jianqing Zhang , Dongjing Wang , Dongjin Yu

Multimodal Fusion Learning (MFL), leveraging disparate data from various imaging modalities (e.g., MRI, CT, SPECT), has shown great potential for addressing medical problems such as skin cancer and brain tumor prediction. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2026-02-18 Joy Dhar , Nayyar Zaidi , Maryam Haghighat

Multi-view multi-label data offers richer perspectives for artificial intelligence, but simultaneously presents significant challenges for feature selection due to the inherent complexity of interrelations among features, views and labels.…

Machine Learning · Computer Science 2025-11-18 Yuzhou Liu , Jiarui Liu , Wanfu Gao

The aim of session-based recommendation is to predict the users' next clicked item, which is a challenging task due to the inherent uncertainty in user behaviors and anonymous implicit feedback information. A powerful session-based…

Information Retrieval · Computer Science 2020-07-27 Jing Zhu , Yanan Xu , Yanmin Zhu

Sequential Recommender Systems (SRS) aim to predict users' next interaction based on their historical behaviors, while still facing the challenge of data sparsity. With the rapid advancement of Multimodal Large Language Models (MLLMs),…

Information Retrieval · Computer Science 2026-02-17 Mingyao Huang , Qidong Liu , Wenxuan Yang , Moranxin Wang , Yuqi Sun , Haiping Zhu , Feng Tian , Yan Chen

Side information fusion for sequential recommendation (SR) aims to effectively leverage various side information to enhance the performance of next-item prediction. Most state-of-the-art methods build on self-attention networks and focus on…

Information Retrieval · Computer Science 2022-04-26 Yueqi Xie , Peilin Zhou , Sunghun Kim

Recent years have witnessed growing interests in multimedia recommendation, which aims to predict whether a user will interact with an item with multimodal contents. Previous studies focus on modeling user-item interactions with multimodal…

Information Retrieval · Computer Science 2022-03-18 Jinghao Zhang , Yanqiao Zhu , Qiang Liu , Mengqi Zhang , Shu Wu , Liang Wang
‹ Prev 1 2 3 10 Next ›