English
Related papers

Related papers: MoXGATE: Modality-aware cross-attention for multi-…

200 papers

Cancer is a highly heterogeneous condition that can occur almost anywhere in the human body. 18F-fluorodeoxyglucose is an imaging modality commonly used to detect cancer due to its high sensitivity and clear visualisation of the pattern of…

Image and Video Processing · Electrical Eng. & Systems 2023-04-17 Ashay Patel , Petru-Danial Tudiosu , Walter H. L. Pinaya , Gary Cook , Vicky Goh , Sebastien Ourselin , M. Jorge Cardoso

Breast cancer screening, primarily conducted through mammography, is often supplemented with ultrasound for women with dense breast tissue. However, existing deep learning models analyze each modality independently, missing opportunities to…

Image and Video Processing · Electrical Eng. & Systems 2023-11-16 Yiqiu Shen , Jungkyu Park , Frank Yeung , Eliana Goldberg , Laura Heacock , Farah Shamout , Krzysztof J. Geras

Recent advances in biological research have seen the emergence of high-throughput technologies with numerous applications that allow the study of biological mechanisms at an unprecedented depth and scale. A large amount of genomic data is…

Machine Learning · Statistics 2020-05-11 Nanwei Wang , Laurent Briollais , Helene Massam

Cancer is a highly heterogeneous disease with significant variability in molecular features and clinical outcomes, making diagnosis and treatment challenging. In recent years, high-throughput omic technologies have facilitated the discovery…

Quantitative Methods · Quantitative Biology 2024-08-19 Saiful Islam , Md. Nahid Hasan

The increase in high-dimensional multiomics data demands advanced integration models to capture the complexity of human diseases. Graph-based deep learning integration models, despite their promise, struggle with small patient cohorts and…

Machine Learning · Computer Science 2024-08-07 Sina Tabakhi , Charlotte Vandermeulen , Ian Sudbery , Haiping Lu

Fusing multiple modalities has proven effective for multimodal information processing. However, the incongruity between modalities poses a challenge for multimodal fusion, especially in affect recognition. In this study, we first analyze…

Computation and Language · Computer Science 2023-11-14 Yaoting Wang , Yuanchao Li , Paul Pu Liang , Louis-Philippe Morency , Peter Bell , Catherine Lai

Multi-modal learning has shown exceptional performance in various tasks, especially in medical applications, where it integrates diverse medical information for comprehensive diagnostic evidence. However, there still are several challenges…

Machine Learning · Computer Science 2024-11-19 Lin Fan , Yafei Ou , Cenyang Zheng , Pengyu Dai , Tamotsu Kamishima , Masayuki Ikebe , Kenji Suzuki , Xun Gong

Accurate survival prediction from multimodal medical data is essential for precision oncology, yet clinical deployment faces a persistent challenge: modalities are frequently incomplete due to cost constraints, technical limitations, or…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Kyungwon Kim , Dosik Hwang

The use of diverse modalities, such as omics, medical images, and clinical data can not only improve the performance of prognostic models but also deepen an understanding of disease mechanisms and facilitate the development of novel…

Image and Video Processing · Electrical Eng. & Systems 2025-08-14 Maria Boyko , Aleksandra Beliaeva , Dmitriy Kornilov , Alexander Bernstein , Maxim Sharaev

Cancer prognosis is a critical task that involves predicting patient outcomes and survival rates. To enhance prediction accuracy, previous studies have integrated diverse data modalities, such as clinical notes, medical images, and genomic…

Machine Learning · Computer Science 2025-02-04 Jie Peng , Shuang Zhou , Longwei Yang , Yiran Song , Mohan Zhang , Kaixiong Zhou , Feng Xie , Mingquan Lin , Rui Zhang , Tianlong Chen

Prognostic task is of great importance as it closely related to the survival analysis of patients, the optimization of treatment plans and the allocation of resources. The existing prognostic models have shown promising results on specific…

Image and Video Processing · Electrical Eng. & Systems 2025-01-14 Binyu Zhang , Shichao Li , Junpeng Jian , Zhu Meng , Limei Guo , Zhicheng Zhao

Multimodal learning has gained much success in recent years. However, current multimodal fusion methods adopt the attention mechanism of Transformers to implicitly learn the underlying correlation of multimodal features. As a result, the…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Thanh-Dat Truong , Christophe Bobda , Nitin Agarwal , Khoa Luu

Abnormalities in the gastrointestinal tract significantly influence the patient's health and require a timely diagnosis for effective treatment. With such consideration, an effective automatic classification of these abnormalities from a…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Lakshmi Srinivas Panchananam , Praveen Kumar Chandaliya , Kishor Upla , Kiran Raja

Aims Late diagnosis of Oral Squamous Cell Carcinoma (OSCC) contributes significantly to its high global mortality rate, with over 50\% of cases detected at advanced stages and a 5-year survival rate below 50\% according to WHO statistics.…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Ajo Babu George , Sreehari J R Ajo Babu George , Sreehari J R Ajo Babu George , Sreehari J R

With the rapid advances in high-throughput sequencing technologies, the focus of survival analysis has shifted from examining clinical indicators to incorporating genomic profiles with pathological images. However, existing methods either…

Image and Video Processing · Electrical Eng. & Systems 2023-09-25 Fengtao Zhou , Hao Chen

Cancer has relational information residing at varying scales, modalities, and resolutions of the acquired data, such as radiology, pathology, genomics, proteomics, and clinical records. Integrating diverse data types can improve the…

Machine Learning · Computer Science 2024-07-29 Asim Waqas , Aakash Tripathi , Ravi P. Ramachandran , Paul Stewart , Ghulam Rasool

Fusion of multimodal healthcare data holds great promise to provide a holistic view of a patient's health, taking advantage of the complementarity of different modalities while leveraging their correlation. This paper proposes a simple and…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Omnia Alwazzan , Ioannis Patras , Gregory Slabaugh

The integration of heterogeneous multi-omics datasets at a systems level remains a central challenge for developing analytical and computational models in precision cancer diagnostics. This paper introduces Multi-Omics Graph…

An important objective in computational biology is the efficient integration of multi-omics data. The task of integration comes with challenges: multi-omics data are most often unpaired (requiring diagonal integration), partially labeled…

Machine Learning · Computer Science 2025-09-16 Daniel Lepe-Soltero , Thierry Artières , Anaïs Baudot , Paul Villoutreix

The essence of precision oncology lies in its commitment to tailor targeted treatments and care measures to each patient based on the individual characteristics of the tumor. The inherent heterogeneity of tumors necessitates gathering…

Quantitative Methods · Quantitative Biology 2024-07-01 Huajun Zhou , Fengtao Zhou , Chenyu Zhao , Yingxue Xu , Luyang Luo , Hao Chen