English
Related papers

Related papers: MIRROR: Multi-Modal Pathological Self-Supervised R…

200 papers

Understanding how chemical perturbations propagate through biological systems is essential for robust molecular property prediction. While most existing methods focus on chemical structures alone, recent advances highlight the crucial role…

Machine Learning · Computer Science 2025-11-27 Mengran Li , Zelin Zang , Wenbin Xing , Junzhou Chen , Ronghui Zhang , Jiebo Luo , Stan Z. Li

Multimodal MR-US registration is critical for prostate cancer diagnosis. However, this task remains challenging due to significant modality discrepancies. Existing methods often fail to align critical boundaries while being overly sensitive…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Xudong Ma , Nantheera Anantrasirichai , Stefanos Bolomytis , Alin Achim

Whole Slide Images (WSI), obtained by high-resolution digital scanning of microscope slides at multiple scales, are the cornerstone of modern Digital Pathology. However, they represent a particular challenge to AI-based/AI-mediated analysis…

Computer Vision and Pattern Recognition · Computer Science 2024-04-12 Martim Afonso , Praphulla M. S. Bhawsar , Monjoy Saha , Jonas S. Almeida , Arlindo L. Oliveira

Magnetic resonance (MR) protocols rely on several sequences to assess pathology and organ status properly. Despite advances in image analysis, we tend to treat each sequence, here termed modality, in isolation. Taking advantage of the…

Computer Vision and Pattern Recognition · Computer Science 2020-11-11 Agisilaos Chartsias , Giorgos Papanastasiou , Chengjia Wang , Scott Semple , David E. Newby , Rohan Dharmakumar , Sotirios A. Tsaftaris

Multimodal Magnetic Resonance Imaging (MRI) provides essential complementary information for analyzing brain tumor subregions. While methods using four common MRI modalities for automatic segmentation have shown success, they often face…

Image and Video Processing · Electrical Eng. & Systems 2024-11-14 Runze Cheng , Zhongao Sun , Ye Zhang , Chun Li

Multimodal survival prediction, a crucial yet challenging task, demands the integration of multimodal medical data (\eg Whole Slide Images (WSIs) and Genomic Profiles) to achieve accurate prognostic modeling. Given the inherent…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Huayi Wang , Haochao Ying , Yuyang Xu , Qiyao Zheng , jun wang , Cheng Zhang , Ying Sun , Jian Wu

Multiple instance learning (MIL) has shown significant promise in histopathology whole slide image (WSI) analysis for cancer diagnosis and prognosis. However, the inherent spatial heterogeneity of WSIs presents critical challenges, as…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Junjian Li , Jin Liu , Hulin Kuang , Hailin Yue , Mengshen He , Jianxin Wang

In medical vision, different imaging modalities provide complementary information. However, in practice, not all modalities may be available during inference or even training. Previous approaches, e.g., knowledge distillation or image…

Computer Vision and Pattern Recognition · Computer Science 2023-08-23 Aishik Konwer , Xiaoling Hu , Joseph Bae , Xuan Xu , Chao Chen , Prateek Prasanna

The acquisition of different data modalities can enhance our knowledge and understanding of various diseases, paving the way for a more personalized healthcare. Thus, medicine is progressively moving towards the generation of massive…

Image and Video Processing · Electrical Eng. & Systems 2024-05-06 Tiago Mota , M. Rita Verdelho , Alceu Bissoto , Carlos Santiago , Catarina Barata

Feature matching is a cornerstone task in computer vision, essential for applications such as image retrieval, stereo matching, 3D reconstruction, and SLAM. This survey comprehensively reviews modality-based feature matching, exploring…

Computer Vision and Pattern Recognition · Computer Science 2025-07-31 Weide Liu , Wei Zhou , Jun Liu , Ping Hu , Jun Cheng , Jungong Han , Weisi Lin

Due to its superior efficiency in utilizing annotations and addressing gigapixel-sized images, multiple instance learning (MIL) has shown great promise as a framework for whole slide image (WSI) classification in digital pathology…

Quantitative Methods · Quantitative Biology 2023-07-14 Qiehe Sun , Jiawen Li , Jin Xu , Junru Cheng , Tian Guan , Yonghong He

This work is motivated by multimodality breast cancer imaging data, which is quite challenging in that the signals of discrete tumor-associated microvesicles (TMVs) are randomly distributed with heterogeneous patterns. This imposes a…

Machine Learning · Statistics 2019-03-22 Xiwei Tang , Xuan Bi , Annie Qu

Forensic pathology is critical in analyzing death manner and time from the microscopic aspect to assist in the establishment of reliable factual bases for criminal investigation. In practice, even the manual differentiation between…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Chen Shen , Jun Zhang , Xinggong Liang , Zeyi Hao , Kehan Li , Fan Wang , Zhenyuan Wang , Chunfeng Lian

Artificial Intelligence (AI) has great potential to improve health outcomes by training systems on vast digitized clinical datasets. Computational Pathology, with its massive amounts of microscopy image data and impact on diagnostics and…

Image and Video Processing · Electrical Eng. & Systems 2024-05-24 Gabriele Campanella , Eugene Fluder , Jennifer Zeng , Chad Vanderbilt , Thomas J. Fuchs

In recent years, artificial intelligence has played an important role on accelerating the whole process of drug discovery. Various of molecular representation schemes of different modals (e.g. textual sequence or graph) are developed. By…

Machine Learning · Computer Science 2022-11-28 Tianyu Wu , Yang Tang , Qiyu Sun , Luolin Xiong

Prediction tasks in digital pathology are challenging due to the massive size of whole-slide images (WSIs) and the weak nature of training signals. Advances in computing, data availability, and self-supervised learning (SSL) have paved the…

Image and Video Processing · Electrical Eng. & Systems 2026-02-02 Vishwesh Ramanathan , Tony Xu , Pushpak Pati , Faruk Ahmed , Maged Goubran , Anne L. Martel

Histopathological imaging is vital for cancer research and clinical practice, with multiplexed Immunofluorescence (MxIF) and Hematoxylin and Eosin (H&E) providing complementary insights. However, aligning different stains at the cell level…

Image and Video Processing · Electrical Eng. & Systems 2024-10-02 Jun Jiang , Raymond Moore , Brenna Novotny , Leo Liu , Zachary Fogarty , Ray Guo , Markovic Svetomir , Chen Wang

Accurate prediction of cardiovascular diseases remains imperative for early diagnosis and intervention, necessitating robust and precise predictive models. Recently, there has been a growing interest in multi-modal learning for uncovering…

Computer Vision and Pattern Recognition · Computer Science 2024-11-12 Francesco Girlanda , Olga Demler , Bjoern Menze , Neda Davoudi

Computational pathology models that use digitized histopathology whole-slide images have the potential to become a cost-effective and scalable alternative to molecular assays for the prediction of genomic biomarkers, a key task in precision…

Quantitative Methods · Quantitative Biology 2026-03-03 Ekaterina Redekop , Eric Zimmermann , Ava P Amini , Alex X Lu , Neil Tenenholtz , James Brian Hall , Lorin Crawford , Kristen A Severson

Background: The integration of multi-stain histopathology images through deep learning poses a significant challenge in digital histopathology. Current multi-modal approaches struggle with data heterogeneity and missing data. This study…

Computer Vision and Pattern Recognition · Computer Science 2024-09-27 Valentin Koch , Sabine Bauer , Valerio Luppberger , Michael Joner , Heribert Schunkert , Julia A. Schnabel , Moritz von Scheidt , Carsten Marr