English
Related papers

Related papers: Multimodal Learning on Graphs for Disease Relation…

200 papers

In the field of multimodal medical data analysis, leveraging diverse types of data and understanding their hidden relationships continues to be a research focus. The main challenges lie in effectively modeling the complex interactions…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Xuhao Shan , Ruiquan Ge , Jikui Liu , Linglong Wu , Chi Zhang , Siqi Liu , Wenjian Qin , Wenwen Min , Ahmed Elazab , Changmiao Wang

Large language models record impressive performance on many natural language processing tasks. However, their knowledge capacity is limited to the pretraining corpus. Retrieval augmentation offers an effective solution by retrieving context…

Computation and Language · Computer Science 2023-11-22 Sai Munikoti , Anurag Acharya , Sridevi Wagle , Sameera Horawalavithana

Graph neural networks are increasingly applied to multimodal medical diagnosis for their inherent relational modeling capabilities. However, their efficacy is often compromised by the prevailing reliance on a single, static graph built from…

Computer Vision and Pattern Recognition · Computer Science 2025-12-24 Ziwei Qin , Xuhui Song , Deqing Huang , Na Qin , Jun Li

A large-scale knowledge graph enhances reproducibility in biomedical data discovery by providing a standardized, integrated framework that ensures consistent interpretation across diverse datasets. It improves generalizability by connecting…

Methodology · Statistics 2024-10-11 Suqi Liu , Tianxi Cai , Xiaoou Li

Question answering is a natural language understanding task that involves reasoning over both explicit context, and unstated relevant domain knowledge. Despite the high cost of training, large language models (LLMs) -- the backbone of most…

Computation and Language · Computer Science 2025-04-24 Laura Cabello , Carmen Martin-Turrero , Uchenna Akujuobi , Anders Søgaard , Carlos Bobed

Epistemic AI accelerates biomedical discovery by finding hidden connections in the network of biomedical knowledge. The Epistemic AI web-based software platform embodies the concept of knowledge mapping, an interactive process that relies…

Artificial Intelligence · Computer Science 2022-04-04 Da Chen Emily Koo , Heather Bowling , Kenneth Ashworth , David J. Heeger , Stefano Pacifico

Large Language Models (LLMs) have significantly advanced medical question-answering by leveraging extensive clinical data and medical literature. However, the rapid evolution of medical knowledge and the labor-intensive process of manually…

Computation and Language · Computer Science 2025-07-01 Mohammad Reza Rezaei , Reza Saadati Fard , Jayson L. Parker , Rahul G. Krishnan , Milad Lankarany

Increasingly large electronic health records (EHRs) provide an opportunity to algorithmically learn medical knowledge. In one prominent example, a causal health knowledge graph could learn relationships between diseases and symptoms and…

Applications · Statistics 2019-10-04 Irene Y. Chen , Monica Agrawal , Steven Horng , David Sontag

In this paper, an innovative multi-modal deep learning model is proposed to deeply integrate heterogeneous information from medical images and clinical reports. First, for medical images, convolutional neural networks were used to extract…

Machine Learning · Computer Science 2024-05-29 Ziyan Yao , Fei Lin , Sheng Chai , Weijie He , Lu Dai , Xinghui Fei

This paper describes an ongoing multi-scale visual analytics approach for exploring and analyzing biomedical knowledge at scale.We utilize global and local views, hierarchical and flow-based graph layouts, multi-faceted search, neighborhood…

Human-Computer Interaction · Computer Science 2021-10-22 Fahd Husain , Rosa Romero-Gomez , Emily Kuang , Dario Segura , Adamo Carolli , Lai Chung Liu , Manfred Cheung , Yohann Paris

A key assumption in multi-task learning is that at the inference time the multi-task model only has access to a given data point but not to the data point's labels from other tasks. This presents an opportunity to extend multi-task learning…

Machine Learning · Computer Science 2023-03-15 Kaidi Cao , Jiaxuan You , Jure Leskovec

AI tools in pathology have improved screening throughput, standardized quantification, and revealed prognostic patterns that inform treatment. However, adoption remains limited because most systems still lack the human-readable reasoning…

Artificial Intelligence · Computer Science 2025-11-18 Yunqi Hong , Johnson Kao , Liam Edwards , Nein-Tzu Liu , Chung-Yen Huang , Alex Oliveira-Kowaleski , Cho-Jui Hsieh , Neil Y. C. Lin

This work deals with the challenge of learning and reasoning over multi-modal multi-hop question answering (QA). We propose a graph reasoning network based on the semantic structure of the sentences to learn multi-source reasoning paths and…

Computation and Language · Computer Science 2025-01-09 Navya Yarrabelly , Saloni Mittal

Alzheimer's disease (AD) is a progressive neurodegenerative condition necessitating early and precise diagnosis to provide prompt clinical management. Given the paramount importance of early diagnosis, recent studies have increasingly…

Machine Learning · Computer Science 2026-02-18 Fatemeh Khalvandi , Saadat Izadi , Abdolah Chalechale

Relation extraction task is a crucial and challenging aspect of Natural Language Processing. Several methods have surfaced as of late, exhibiting notable performance in addressing the task; however, most of these approaches rely on vast…

Computation and Language · Computer Science 2023-08-25 Fréjus A. A. Laleye , Loïc Rakotoson , Sylvain Massip

Medication recommendations aim to generate safe and effective medication sets from health records. However, accurately recommending medications hinges on inferring a patient's latent clinical condition from sparse and noisy observations,…

Information Retrieval · Computer Science 2026-03-20 Xiangxu Zhang , Xiao Zhou , Hongteng Xu , Jianxun Lian

Understanding disease-gene associations is essential for unravelling disease mechanisms and advancing diagnostics and therapeutics. Traditional approaches based on manual curation and literature review are labour-intensive and not scalable,…

Machine Learning · Computer Science 2026-02-24 Osman Onur Kuzucu , Tunca Doğan

Machine learning in healthcare requires effective representation of structured medical codes, but current methods face a trade off: knowledge graph based approaches capture formal relationships but miss real world patterns, while data…

Machine Learning · Computer Science 2025-10-07 Ahmed Elhussein , Paul Meddeb , Abigail Newbury , Jeanne Mirone , Martin Stoll , Gamze Gursoy

Plant disease recognition is a critical task that ensures crop health and mitigates the damage caused by diseases. A handy tool that enables farmers to receive a diagnosis based on query pictures or the text description of suspicious plants…

Computer Vision and Pattern Recognition · Computer Science 2024-08-28 Tianqi Wei , Zhi Chen , Xin Yu

Retrieving targeted pathways in biological knowledge bases, particularly when incorporating wet-lab experimental data, remains a challenging task and often requires downstream analyses and specialized expertise. In this paper, we frame this…

Machine Learning · Computer Science 2026-04-14 Rikuto Kotoge , Ziwei Yang , Zheng Chen , Yushun Dong , Yasuko Matsubara , Jimeng Sun , Yasushi Sakurai