English
Related papers

Related papers: MMFusion: Multi-modality Diffusion Model for Lymph…

200 papers

Accurately predicting the survival rate of cancer patients is crucial for aiding clinicians in planning appropriate treatment, reducing cancer-related medical expenses, and significantly enhancing patients' quality of life. Multimodal…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Liangrui Pan , Yijun Peng , Yan Li , Xiang Wang , Wenjuan Liu , Liwen Xu , Qingchun Liang , Shaoliang Peng

While spatial transcriptomics (ST) has advanced our understanding of gene expression in tissue context, its high experimental cost limits its large-scale application. Predicting ST from pathology images is a promising, cost-effective…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Zhiceng Shi , Changmiao Wang , Jun Wan , Wenwen Min

Although diffusion models have achieved remarkable progress in multi-modal magnetic resonance imaging (MRI) translation tasks, existing methods still tend to suffer from anatomical inconsistencies or degraded texture details when handling…

Image and Video Processing · Electrical Eng. & Systems 2026-03-16 Jianqiang Lin , Zhiqiang Shen , Peng Cao , Jinzhu Yang , Osmar R. Zaiane , Xiaoli Liu

This study proposes a novel approach combining Multimodal Deep Learning with intrinsic eXplainable Artificial Intelligence techniques to predict pathological response in non-small cell lung cancer patients undergoing neoadjuvant therapy.…

Computer Vision and Pattern Recognition · Computer Science 2026-02-16 Alice Natalina Caragliano , Claudia Tacconi , Carlo Greco , Lorenzo Nibid , Edy Ippolito , Michele Fiore , Giuseppe Perrone , Sara Ramella , Paolo Soda , Valerio Guarrasi

In this study, we introduce a multi-modal approach that efficiently integrates multi-scale clinical and dermoscopy features within a single network, thereby substantially reducing model parameters. The proposed method includes three novel…

Image and Video Processing · Electrical Eng. & Systems 2024-03-31 Peng Tang , Tobias Lasser

In the present article the diffusion equation is used to model the spatio-temporal dynamics of a tumor, taking into account the heterogeneous of the medium. This approach makes it possible to take into account the complex geometric shape of…

Biological Physics · Physics 2023-02-07 Maxim V. Polyakov , Valeria V. Ten

With the emergence of multimodal electronic health records, the evidence for an outcome may be captured across multiple modalities ranging from clinical to imaging and genomic data. Predicting outcomes effectively requires fusion frameworks…

Melanoma is a type of skin cancer developed from melanocytes. It is one of the most lethal types of cancer, accounting for approximately 75% of skin cancer deaths. Late stage melanoma is very difficult to treat, since the cancer cells are…

Quantitative Methods · Quantitative Biology 2018-11-28 Xue Teng , Fuad Gwadry , Haley McConkey , Scott Ernst , Femida Gwadry-Sridhar

Cervical cancer presents a significant global health challenge, necessitating advanced diagnostic and prognostic approaches for effective treatment. This paper investigates the potential of employing multi-modal medical imaging at various…

Medical Physics · Physics 2024-08-27 Haotian Feng , Emi Yoshida , Ke Sheng

Early diagnosis of lung cancer is challenging due to biological uncertainty and the limited understanding of the biological mechanisms driving nodule progression. To address this, we propose Nodule-Aligned Multimodal (Latent) Diffusion…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 James Song , Yifan Wang , Chuan Zhou , Liyue Shen

Clinical decision-making relies on the integration of information across various data modalities, such as clinical time-series, medical images and textual reports. Compared to other domains, real-world medical data is heterogeneous in…

Image and Video Processing · Electrical Eng. & Systems 2025-08-14 Baraa Al Jorf , Farah Shamout

Benefiting from the powerful expressive capability of graphs, graph-based approaches have been popularly applied to handle multi-modal medical data and achieved impressive performance in various biomedical applications. For disease…

Machine Learning · Computer Science 2022-03-14 Shuai Zheng , Zhenfeng Zhu , Zhizhe Liu , Zhenyu Guo , Yang Liu , Yuchen Yang , Yao Zhao

The Latent Diffusion Model (LDM) has demonstrated strong capabilities in high-resolution image generation and has been widely employed for Pose-Guided Person Image Synthesis (PGPIS), yielding promising results. However, the compression…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Jiaqi Liu , Jichao Zhang , Paolo Rota , Nicu Sebe

In sequential recommendation, multi-modal information (e.g., text or image) can provide a more comprehensive view of an item's profile. The optimal stage (early or late) to fuse modality features into item representations is still debated.…

Information Retrieval · Computer Science 2023-08-31 Hengchang Hu , Wei Guo , Yong Liu , Min-Yen Kan

The long-term progression of neurodegenerative diseases is commonly conceptualized as a spatiotemporal diffusion process that consists of a graph diffusion process across the structural brain connectome and a localized reaction process…

Machine Learning · Computer Science 2025-08-12 Tiantian He , Keyue Jiang , An Zhao , Anna Schroder , Elinor Thompson , Sonja Soskic , Frederik Barkhof , Daniel C. Alexander

Most convolutional neural network (CNN) based methods for skin cancer classification obtain their results using only dermatological images. Although good classification results have been shown, more accurate results can be achieved by…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Peng Tang , Xintong Yan , Yang Nan , Xiaobin Hu , Xiaobin Hu , Bjoern H Menzee. Sebastian Krammer , Tobias Lasser

Survival analysis stands as a pivotal process in cancer treatment research, crucial for predicting patient survival rates accurately. Recent advancements in data collection techniques have paved the way for enhancing survival predictions by…

Machine Learning · Computer Science 2024-07-26 Linhao Qu , Dan Huang , Shaoting Zhang , Xiaosong Wang

The development of computational pathology lies in the consensus that pathological characteristics of tumors are significant guidance for cancer diagnostics. Most existing research focuses on the inner-contextual information within each WSI…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Jun Shi , Tong Shu , Zhiguo Jiang , Wei Wang , Haibo Wu , Yushan Zheng

Cancers are characterized by remarkable heterogeneity and diverse prognosis. Accurate cancer classification is essential for patient stratification and clinical decision-making. Although digital pathology has been advancing cancer diagnosis…

Computer Vision and Pattern Recognition · Computer Science 2025-02-13 Xiaofei Wang , Hanyu Liu , Yupei Zhang , Boyang Zhao , Hao Duan , Wanming Hu , Yonggao Mou , Stephen Price , Chao Li

Survival outcome assessment is challenging and inherently associated with multiple clinical factors (e.g., imaging and genomics biomarkers) in cancer. Enabling multimodal analytics promises to reveal novel predictive patterns of patient…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Kexin Ding , Mu Zhou , Dimitris N. Metaxas , Shaoting Zhang