English
Related papers

Related papers: Fusing Modalities by Multiplexed Graph Neural Netw…

200 papers

Accurate prediction of molecular properties is essential in drug discovery and related fields. However, existing graph neural networks (GNNs) often struggle to simultaneously capture both local and global molecular structures. In this work,…

Machine Learning · Computer Science 2025-08-26 XiaYu Liu , Chao Fan , Yang Liu , Hou-biao Li

Cancer prognosis and survival outcome predictions are crucial for therapeutic response estimation and for stratifying patients into various treatment groups. Medical domains concerned with cancer prognosis are abundant with multiple…

Image and Video Processing · Electrical Eng. & Systems 2024-02-29 Ruining Deng , Nazim Shaikh , Gareth Shannon , Yao Nie

Deep learning (DL) has drawn tremendous attention in object localization and recognition for both natural and medical images. U-Net segmentation models have demonstrated superior performance compared to conventional handcrafted…

Computer Vision and Pattern Recognition · Computer Science 2021-03-29 Sivaramakrishnan Rajaraman , Les Folio , Jane Dimperio , Philip Alderson , Sameer Antani

In anti-cancer drug development, a major scientific challenge is disentangling the complex relationships between high-dimensional genomics data from patient tumor samples, the corresponding tumor's organ of origin, the drug targets…

Machine Learning · Computer Science 2024-03-29 Omid Bazgir , Zichen Wang , Ji Won Park , Marc Hafner , James Lu

The task of data integration for multi-omics data has emerged as a powerful strategy to unravel the complex biological underpinnings of cancer. Recent advancements in graph neural networks (GNNs) offer an effective framework to model…

Machine Learning · Computer Science 2025-06-24 Payam Zohari , Mostafa Haghir Chehreghani

The abundance of intestinal flora is closely related to human diseases, but diseases are not caused by a single gut microbe. Instead, they result from the complex interplay of numerous microbial entities. This intricate and implicit…

Artificial Intelligence · Computer Science 2024-08-01 Dingkun Liu , Hongjie Zhou , Yilu Qu , Huimei Zhang , Yongdong Xu

Most prognostic methods require a decent amount of data for model training. In reality, however, the amount of historical data owned by a single organization might be small or not large enough to train a reliable prognostic model. To…

Machine Learning · Statistics 2024-04-11 Madi Arabi , Xiaolei Fang

The analysis of multi-modality positron emission tomography and computed tomography (PET-CT) images for computer aided diagnosis applications requires combining the sensitivity of PET to detect abnormal regions with anatomical localization…

Computer Vision and Pattern Recognition · Computer Science 2019-10-29 Ashnil Kumar , Michael Fulham , Dagan Feng , Jinman Kim

The diagnosis and prognosis of cancer are typically based on multi-modal clinical data, including histology images and genomic data, due to the complex pathogenesis and high heterogeneity. Despite the advancements in digital pathology and…

Quantitative Methods · Quantitative Biology 2024-04-15 Zeyu Zhang , Yuanshen Zhao , Jingxian Duan , Yaou Liu , Hairong Zheng , Dong Liang , Zhenyu Zhang , Zhi-Cheng Li

Cancer clinics capture disease data at various scales, from genetic to organ level. Current bioinformatic methods struggle to handle the heterogeneous nature of this data, especially with missing modalities. We propose PARADIGM, a Graph…

Cell Behavior · Quantitative Biology 2024-11-22 Asim Waqas , Aakash Tripathi , Paul Stewart , Mia Naeini , Matthew B. Schabath , Ghulam Rasool

Missing data is a common problem in machine learning and in retrospective imaging research it is often encountered in the form of missing imaging modalities. We propose to take into account missing modalities in the design and training of…

Computer Vision and Pattern Recognition · Computer Science 2019-09-26 Karin van Garderen , Marion Smits , Stefan Klein

We introduce a visual analysis method for multiple causal graphs with different outcome variables, namely, multi-outcome causal graphs. Multi-outcome causal graphs are important in healthcare for understanding multimorbidity and…

Machine Learning · Computer Science 2026-05-01 Mengjie Fan , Jinlu Yu , Daniel Weiskopf , Nan Cao , Huai-Yu Wang , Liang Zhou

Learning an effective global model on private and decentralized datasets has become an increasingly important challenge of machine learning when applied in practice. Existing distributed learning paradigms, such as Federated Learning,…

Machine Learning · Computer Science 2023-06-05 Tengfei Ma , Trong Nghia Hoang , Jie Chen

Medical multimodal representation learning aims to integrate heterogeneous data into unified patient representations to support clinical outcome prediction. However, real-world medical datasets commonly contain systematic biases from…

Machine Learning · Computer Science 2026-05-19 Xiaoguang Zhu , Linxiao Gong , Lianlong Sun , Yang Liu , Haoyu Wang , Jing Liu

Accurate cancer survival prediction is crucial for assisting clinical doctors in formulating treatment plans. Multimodal data, including histopathological images and genomic data, offer complementary and comprehensive information that can…

Computer Vision and Pattern Recognition · Computer Science 2024-08-09 Hui Luo , Jiashuang Huang , Hengrong Ju , Tianyi Zhou , Weiping Ding

Molecular graph neural networks (GNNs) often focus exclusively on XYZ-based geometric representations and thus overlook valuable chemical context available in public databases like PubChem. This work introduces a multimodal framework that…

Machine Learning · Computer Science 2025-05-20 Can Polat , Hasan Kurban , Erchin Serpedin , Mustafa Kurban

As information sources are usually imperfect, it is necessary to take into account their reliability in multi-source information fusion tasks. In this paper, we propose a new deep framework allowing us to merge multi-MR image segmentation…

Computer Vision and Pattern Recognition · Computer Science 2022-11-23 Ling Huang , Thierry Denoeux , Pierre Vera , Su Ruan

Visual Tracking is a complex problem due to unconstrained appearance variations and dynamic environment. Extraction of complementary information from the object environment via multiple features and adaption to the target's appearance…

Computer Vision and Pattern Recognition · Computer Science 2019-05-27 Kapil Sharma , Himanshu Ahuja , Ashish Kumar , Nipun Bansal , Gurjit Singh Walia

Gigapixel medical images provide massive data, both morphological textures and spatial information, to be mined. Due to the large data scale in histology, deep learning methods play an increasingly significant role as feature extractors.…

Image and Video Processing · Electrical Eng. & Systems 2022-06-16 Yiqing Shen , Bingxin Zhou , Xinye Xiong , Ruitian Gao , Yu Guang Wang

Multi-modal medical images provide complementary soft-tissue characteristics that aid in the screening and diagnosis of diseases. However, limited scanning time, image corruption and various imaging protocols often result in incomplete…

Computer Vision and Pattern Recognition · Computer Science 2024-07-10 Yue Zhang , Chengtao Peng , Qiuli Wang , Dan Song , Kaiyan Li , S. Kevin Zhou