English
Related papers

Related papers: Gene-induced Multimodal Pre-training for Image-omi…

200 papers

Multimodal multilabel classification (MMC) is a challenging task that aims to design a learning algorithm to handle two data sources, the image and text, and learn a comprehensive semantic feature presentation across the modalities. In this…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Yanming Guo

Pathology foundation models (PFMs) have emerged as powerful tools for analyzing whole slide images (WSIs). However, adapting these pretrained PFMs for specific clinical tasks presents considerable challenges, primarily due to the…

Computer Vision and Pattern Recognition · Computer Science 2025-06-06 Neeraj Kumar , Swaraj Nanda , Siddharth Singi , Jamal Benhamida , David Kim , Jie-Fu Chen , Amir Momeni-Boroujeni , Gregory M. Goldgof , Gabriele Campanella , Chad Vanderbilt

Foundation models (FMs) are transforming computational pathology by offering new ways to analyze histopathology images. However, FMs typically require weeks of training on large databases, making their creation a resource-intensive process.…

Image and Video Processing · Electrical Eng. & Systems 2026-01-27 Till Nicke , Daniela Schacherer , Jan Raphael Schäfer , Natalia Artysh , Antje Prasse , André Homeyer , Andrea Schenk , Henning Höfener , Johannes Lotz

Whole Slide Image (WSI) analysis is a powerful method to facilitate the diagnosis of cancer in tissue samples. Automating this diagnosis poses various issues, most notably caused by the immense image resolution and limited annotations. WSIs…

Computer Vision and Pattern Recognition · Computer Science 2023-04-19 Ahmet Gokberk Gul , Oezdemir Cetin , Christoph Reich , Tim Prangemeier , Nadine Flinner , Heinz Koeppl

Multiple Instance Learning (MIL) and transformers are increasingly popular in histopathology Whole Slide Image (WSI) classification. However, unlike human pathologists who selectively observe specific regions of histopathology tissues under…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Conghao Xiong , Hao Chen , Joseph J. Y. Sung , Irwin King

The integration of DNA methylation data with a Whole Slide Image (WSI) offers significant potential for enhancing the diagnostic precision of central nervous system (CNS) tumor classification in neuropathology. While existing approaches…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 Omnia Alwazzan , Amaya Gallagher-Syed , Thomas O. Millner , Sebastian Brandner , Ioannis Patras , Silvia Marino , Gregory Slabaugh

Representation learning from Gigapixel Whole Slide Images (WSI) poses a significant challenge in computational pathology due to the complicated nature of tissue structures and the scarcity of labeled data. Multi-instance learning methods…

Image and Video Processing · Electrical Eng. & Systems 2024-05-28 Ali Nasiri-Sarvi , Vincent Quoc-Huy Trinh , Hassan Rivaz , Mahdi S. Hosseini

Whole slide images (WSIs) are gigapixel-scale digital images of H\&E-stained tissue samples widely used in pathology. The substantial size and complexity of WSIs pose unique analytical challenges. Multiple Instance Learning (MIL) has…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Jun Wang , Yu Mao , Nan Guan , Chun Jason Xue

Tumor segmentation stands as a pivotal task in cancer diagnosis. Given the immense dimensions of whole slide images (WSI) in histology, deep learning approaches for WSI classification mainly operate at patch-wise or superpixel-wise level.…

Computer Vision and Pattern Recognition · Computer Science 2024-02-22 Huaqian Wu , Clara Brémond-Martin , Kévin Bouaou , Cédric Clouchoux

Masked Autoencoders (MAEs) have emerged as a dominant strategy for self-supervised representation learning in natural images, where models are pre-trained to reconstruct masked patches with a pixel-wise mean squared error (MSE) between…

Image and Video Processing · Electrical Eng. & Systems 2025-07-16 Chetan Madan , Aarjav Satia , Soumen Basu , Pankaj Gupta , Usha Dutta , Chetan Arora

Multimodal pathology-genomic analysis is critical for cancer survival prediction. However, existing approaches predominantly integrate formalin-fixed paraffin-embedded (FFPE) slides with genomic data, while neglecting the availability of…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Mingcheng Qu , Guang Yang , Donglin Di , Yue Gao , Tonghua Su , Yang Song , Lei Fan

Images and structured tables are essential parts of real-world databases. Though tabular-image representation learning is promising to create new insights, it remains a challenging task, as tabular data is typically heterogeneous and…

Computer Vision and Pattern Recognition · Computer Science 2024-07-11 Siyi Du , Shaoming Zheng , Yinsong Wang , Wenjia Bai , Declan P. O'Regan , Chen Qin

Healthcare applications are inherently multimodal, benefiting greatly from the integration of diverse data sources. However, the modalities available in clinical settings can vary across different locations and patients. A key area that…

Computer Vision and Pattern Recognition · Computer Science 2025-09-04 Mohammed Amer , Mohamed A. Suliman , Tu Bui , Nuria Garcia , Serban Georgescu

Convolutional Neural Networks (CNN) are state-of-the-art models for many image classification tasks. However, to recognize cancer subtypes automatically, training a CNN on gigapixel resolution Whole Slide Tissue Images (WSI) is currently…

Computer Vision and Pattern Recognition · Computer Science 2016-03-10 Le Hou , Dimitris Samaras , Tahsin M. Kurc , Yi Gao , James E. Davis , Joel H. Saltz

Tissue phenotyping is a fundamental task in learning objective characterizations of histopathologic biomarkers within the tumor-immune microenvironment in cancer pathology. However, whole-slide imaging (WSI) is a complex computer vision in…

Computer Vision and Pattern Recognition · Computer Science 2022-03-02 Richard J. Chen , Rahul G. Krishnan

Medical imaging is an essential tool for diagnosing and treating diseases. However, lacking medical images can lead to inaccurate diagnoses and ineffective treatments. Generative models offer a promising solution for addressing medical…

Image and Video Processing · Electrical Eng. & Systems 2024-01-02 M. AbdulRazek , G. Khoriba , M. Belal

Gliomas are brain tumours with a high mortality rate. There are various grades and sub-types of this tumour, and the treatment procedure varies accordingly. Clinicians and oncologists diagnose and categorise these tumours based on visual…

Image and Video Processing · Electrical Eng. & Systems 2020-11-12 Azam Hamidinekoo , Tomasz Pieciak , Maryam Afzali , Otar Akanyeti , Yinyin Yuan

We developed a deep ensemble learning model with a radiomics spatial encoding execution for improved glioma segmentation accuracy using multi-parametric MRI (mp-MRI). This model was developed using 369 glioma patients with a 4-modality…

Quantitative Methods · Quantitative Biology 2023-03-21 Yang Chen , Zhenyu Yang , Jingtong Zhao , Justus Adamson , Yang Sheng , Fang-Fang Yin , Chunhao Wang

Semi-supervised learning enhances medical image segmentation by leveraging unlabeled data, reducing reliance on extensive labeled datasets. On the one hand, the distribution discrepancy between limited labeled data and abundant unlabeled…

Computer Vision and Pattern Recognition · Computer Science 2025-03-13 Lianyuan Yu , Xiuzhen Guo , Ji Shi , Hongxiao Wang , Hongwei Li

The opaque nature of deep learning models remains a significant barrier to their clinical adoption in medical imaging. This paper presents a multimodal explainability framework that bridges the gap between convolutional neural network (CNN)…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Paul Valery Nguezet , Elie Tagne Fute , Yusuf Brima , Benoit Martin Azanguezet , Marcellin Atemkeng