English
Related papers

Related papers: Combating the Bucket Effect:Multi-Knowledge Alignm…

200 papers

Multimodal information retrieval (MIR) faces inherent challenges due to the heterogeneity of data sources and the complexity of cross-modal alignment. While previous studies have identified modal gaps in feature spaces, a systematic…

Computer Vision and Pattern Recognition · Computer Science 2025-05-28 Fanheng Kong , Jingyuan Zhang , Yahui Liu , Hongzhi Zhang , Shi Feng , Xiaocui Yang , Daling Wang , Yu Tian , Victoria W. , Fuzheng Zhang , Guorui Zhou

Multi-modal Knowledge Graph Completion (MMKGC) aims to uncover hidden world knowledge in multimodal knowledge graphs by leveraging both multimodal and structural entity information. However, the inherent imbalance in multimodal knowledge…

Artificial Intelligence · Computer Science 2025-07-29 Lijian Li

With the increasing availability of multimodal data, many fields urgently require advanced architectures capable of effectively integrating these diverse data sources to address specific problems. This study proposes a hybrid recommendation…

Information Retrieval · Computer Science 2024-12-17 Jingyu Xu , Yang Wang

Clinical texts, such as admission notes, discharge summaries, and progress notes, contain rich and valuable information that can be used for clinical decision making. However, a severe bottleneck in using transformer encoders for processing…

Computation and Language · Computer Science 2025-01-03 Mohammad Junayed Hasan , Suhra Noor , Mohammad Ashrafuzzaman Khan

As real-world knowledge continues to evolve, the parametric knowledge acquired by multimodal models during pretraining becomes increasingly difficult to remain consistent with real-world knowledge. Existing research on multimodal knowledge…

Computation and Language · Computer Science 2026-03-17 Baochen Fu , Yuntao Du , Cheng Chang , Baihao Jin , Wenzhi Deng , Muhao Xu , Hongmei Yan , Weiye Song , Yi Wan

Recent progress in deep learning is revolutionizing the healthcare domain including providing solutions to medication recommendations, especially recommending medication combination for patients with complex health conditions. Existing…

Artificial Intelligence · Computer Science 2019-03-08 Junyuan Shang , Cao Xiao , Tengfei Ma , Hongyan Li , Jimeng Sun

Multi-modal recommendation systems, which integrate diverse types of information, have gained widespread attention in recent years. However, compared to traditional collaborative filtering-based multi-modal recommendation systems, research…

Information Retrieval · Computer Science 2023-08-15 Wei Ji , Xiangyan Liu , An Zhang , Yinwei Wei , Yongxin Ni , Xiang Wang

Learning high-quality multi-modal entity representations is an important goal of multi-modal knowledge graph (MMKG) representation learning, which can enhance reasoning tasks within the MMKGs, such as MMKG completion (MMKGC). The main…

Artificial Intelligence · Computer Science 2025-04-08 Yichi Zhang , Zhuo Chen , Lingbing Guo , Yajing Xu , Binbin Hu , Ziqi Liu , Wen Zhang , Huajun Chen

Medication recommendation aims to integrate patients' long-term health records to provide accurate and safe medication combinations for specific health states. Existing methods often fail to deeply explore the true causal relationships…

Information Retrieval · Computer Science 2024-10-31 Shunpan Liang , Xiang Li , Shi Mu , Chen Li , Yu Lei , Yulei Hou , Tengfei Ma

The clinical trial is a pivotal and costly process, often spanning multiple years and requiring substantial financial resources. Therefore, the development of clinical trial outcome prediction models aims to exclude drugs likely to fail and…

Machine Learning · Computer Science 2025-01-29 Wenhao Zheng , Liaoyaqi Wang , Dongshen Peng , Hongxia Xu , Yun Li , Hongtu Zhu , Tianfan Fu , Huaxiu Yao

A comprehensive pharmaceutical recommendation system was designed based on the patients and drugs features extracted from Drugs.com and Druglib.com. First, data from these databases were combined, and a dataset of patients and drug…

While the ICD code assignment problem has been widely studied, most works have focused on post-discharge document classification. Models for early forecasting of this information could be used for identifying health risks, suggesting…

Machine Learning · Computer Science 2025-08-18 Cindy Shih-Ting Huang , Clarence Boon Liang Ng , Marek Rei

Effectively medication recommendation with complex multimorbidity conditions is a critical task in healthcare. Most existing works predicted medications based on longitudinal records, which assumed the information transmitted patterns of…

Machine Learning · Computer Science 2023-09-13 Sicen Liu , Xiaolong Wang , JIngcheng Du , Yongshuai Hou , Xianbing Zhao , Hui Xu , Hui Wang , Yang Xiang , Buzhou Tang

Recommendation systems have lately been popularized globally, with primary use cases in online interaction systems, with significant focus on e-commerce platforms. We have developed a machine learning-based recommendation platform, which…

In multi-modal learning, some modalities are more influential than others, and their absence can have a significant impact on classification/segmentation accuracy. Addressing this challenge, we propose a novel approach called Meta-learned…

Computer Vision and Pattern Recognition · Computer Science 2025-08-27 Hu Wang , Salma Hassan , Yuyuan Liu , Congbo Ma , Yuanhong Chen , Qing Li , Jiahui Geng , Bingjie Wang , Yu Tian , Yutong Xie , Jodie Avery , Louise Hull , Ian Reid , Mohammad Yaqub , Gustavo Carneiro

The broad adoption of Electronic Health Records (EHR) has led to vast amounts of data being accumulated on a patient's history, diagnosis, prescriptions, and lab tests. Advances in recommender technologies have the potential to utilize this…

Information Retrieval · Computer Science 2020-09-01 Suman Bhoi , Lee Mong Li , Wynne Hsu

Cross-domain sequential recommendation is the task of predict the next item that the user is most likely to interact with based on past sequential behavior from multiple domains. One of the key challenges in cross-domain sequential…

Information Retrieval · Computer Science 2020-12-08 Muyang Ma , Pengjie Ren , Zhumin Chen , Zhaochun Ren , Lifan Zhao , Jun Ma , Maarten de Rijke

Multimodal retrieval, which seeks to retrieve relevant content across modalities such as text or image, supports applications from AI search to contents production. Despite the success of separate-encoder approaches like CLIP align…

Computation and Language · Computer Science 2025-10-20 Qiyu Wu , Shuyang Cui , Satoshi Hayakawa , Wei-Yao Wang , Hiromi Wakaki , Yuki Mitsufuji

Background and Objective High medicine diversity has always been a significant challenge for prescription, causing confusion or doubt in physicians' decision-making process. This paper aims to develop a medicine recommender system called…

Information Retrieval · Computer Science 2022-06-10 Maryam Sajde , Hamed Malek , Mehran Mohsenzadeh

Multimodal Recommender Systems aim to improve recommendation accuracy by integrating heterogeneous content, such as images and textual metadata. While effective, it remains unclear whether their gains stem from true multimodal understanding…

Information Retrieval · Computer Science 2025-08-07 Claudio Pomo , Matteo Attimonelli , Danilo Danese , Fedelucio Narducci , Tommaso Di Noia