English
Related papers

Related papers: A Graph Framework for Multimodal Medical Informati…

200 papers

We present a new unified graph-based representation of medical data, combining genetic information and medical records of patients with medical knowledge via a unique knowledge graph. This approach allows us to infer meaningful information…

Artificial Intelligence · Computer Science 2024-10-22 Davide Belluomo , Tiziana Calamoneri , Giacomo Paesani , Ivano Salvo

Multimodal medical imaging plays a pivotal role in clinical diagnosis and research, as it combines information from various imaging modalities to provide a more comprehensive understanding of the underlying pathology. Recently, deep…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Yihao Li , Mostafa El Habib Daho , Pierre-Henri Conze , Rachid Zeghlache , Hugo Le Boité , Ramin Tadayoni , Béatrice Cochener , Mathieu Lamard , Gwenolé Quellec

As machine learning and artificial intelligence are more frequently being leveraged to tackle problems in the health sector, there has been increased interest in utilizing them in clinical decision-support. This has historically been the…

Machine Learning · Computer Science 2022-04-12 Adrienne Kline , Hanyin Wang , Yikuan Li , Saya Dennis , Meghan Hutch , Zhenxing Xu , Fei Wang , Feixiong Cheng , Yuan Luo

This paper describes an ongoing multi-scale visual analytics approach for exploring and analyzing biomedical knowledge at scale.We utilize global and local views, hierarchical and flow-based graph layouts, multi-faceted search, neighborhood…

Human-Computer Interaction · Computer Science 2021-10-22 Fahd Husain , Rosa Romero-Gomez , Emily Kuang , Dario Segura , Adamo Carolli , Lai Chung Liu , Manfred Cheung , Yohann Paris

Currently, there are many difficulties regarding the interoperability of medical data and related population data sources. These complications get in the way of the generation of high-quality data sets at city, region and national levels.…

Computers and Society · Computer Science 2023-10-13 Anna Andreychenko , Viktoriia Korzhuk , Stanislav Kondratenko , Polina Cheraneva

Accurate forecasting and analysis of emerging pandemics play a crucial role in effective public health management and decision-making. Traditional approaches primarily rely on epidemiological data, overlooking other valuable sources of…

Machine Learning · Computer Science 2023-10-24 Khanh-Tung Tran , Truong Son Hy , Lili Jiang , Xuan-Son Vu

Electronic medical records contain multi-format electronic medical data that consist of an abundance of medical knowledge. Facing with patient's symptoms, experienced caregivers make right medical decisions based on their professional…

Databases · Computer Science 2017-07-25 Meng Wang , Jiaheng Zhang , Jun Liu , Wei Hu , Sen Wang , Xue Li , Wenqiang Liu

Social media is accompanied by an increasing proportion of content that provides fake information or misleading content, known as information disorder. In this paper, we study the problem of multimodal fake news detection on a largescale…

Information Retrieval · Computer Science 2021-06-01 Armin Kirchknopf , Djordje Slijepcevic , Matthias Zeppelzauer

Multi-modal data comprising imaging (MRI, fMRI, PET, etc.) and non-imaging (clinical test, demographics, etc.) data can be collected together and used for disease prediction. Such diverse data gives complementary information about the…

Machine Learning · Computer Science 2018-12-27 Anees Kazi , S. Arvind krishna , Shayan Shekarforoush , Karsten Kortuem , Shadi Albarqouni , Nassir Navab

Multi-modality cardiac imaging plays a key role in the management of patients with cardiovascular diseases. It allows a combination of complementary anatomical, morphological and functional information, increases diagnosis accuracy, and…

Image and Video Processing · Electrical Eng. & Systems 2022-08-30 Lei Li , Wangbin Ding , Liqun Huang , Xiahai Zhuang , Vicente Grau

We present a pipeline for unbiased and robust multimodal registration of neuroimaging modalities with minimal pre-processing. While typical multimodal studies need to use multiple independent processing pipelines, with diverse options and…

Computer Vision and Pattern Recognition · Computer Science 2024-01-26 Adria Casamitjana , Juan Eugenio Iglesias , Raul Tudela , Aida Ninerola-Baizan , Roser Sala-Llonch

Deep learning has brought significant progress to medical image classification, yet most existing methods still rely on isolated visual evidence and cannot effectively leverage similar cases or external knowledge. In clinical practice,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Yiming Xu , Yixuan Liu , Yuhang Zhang , Ling Zheng , Yihan Wang , Qi Song

Medical data collected for diagnostic decisions are typically multimodal, providing comprehensive information on a subject. While computer-aided diagnosis systems can benefit from multimodal inputs, effectively fusing such data remains a…

Computer Vision and Pattern Recognition · Computer Science 2025-02-03 Qiuhui Chen , Yi Hong

Multi-modality is widely used in medical imaging, because it can provide multiinformation about a target (tumor, organ or tissue). Segmentation using multimodality consists of fusing multi-information to improve the segmentation. Recently,…

Image and Video Processing · Electrical Eng. & Systems 2020-07-17 Tongxue Zhou , Su Ruan , Stéphane Canu

The effectiveness of artificial intelligence (AI) in healthcare is significantly hindered by unstructured clinical documentation, which results in noisy, inconsistent, and logically fragmented training data. To address this challenge, we…

Machine Learning · Computer Science 2025-10-21 Dun Liu , Qin Pang , Guangai Liu , Hongyu Mou , Jipeng Fan , Yiming Miao , Pin-Han Ho , Limei Peng

Clinicians are increasingly looking towards machine learning to gain insights about patient evolutions. We propose a novel approach named Multi-Modal UMLS Graph Learning (MMUGL) for learning meaningful representations of medical concepts…

Machine Learning · Computer Science 2024-02-07 Manuel Burger , Gunnar Rätsch , Rita Kuznetsova

Machine learning methods in healthcare have traditionally focused on using data from a single modality, limiting their ability to effectively replicate the clinical practice of integrating multiple sources of information for improved…

Machine Learning · Computer Science 2024-02-13 Felix Krones , Umar Marikkar , Guy Parsons , Adam Szmul , Adam Mahdi

The storage and manipulation of digital images and the analysis of the information held in those images are essential requirements for next-generation medical information systems. The medical community has been exploring collaborative…

Databases · Computer Science 2007-05-23 D Rogulin , F Estrella , T Hauer , R McClatchey , T Solomonides

This paper presents a Tri-branch Neural Fusion (TNF) approach designed for classifying multimodal medical images and tabular data. It also introduces two solutions to address the challenge of label inconsistency in multimodal…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Tong Zheng , Shusaku Sone , Yoshitaka Ushiku , Yuki Oba , Jiaxin Ma

Humans make accurate decisions by interpreting complex data from multiple sources. Medical diagnostics, in particular, often hinge on human interpretation of multi-modal information. In order for artificial intelligence to make progress in…

Computer Vision and Pattern Recognition · Computer Science 2018-11-20 Faisal Mahmood , Ziyun Yang , Thomas Ashley , Nicholas J. Durr