English
Related papers

Related papers: PathMR: Multimodal Visual Reasoning for Interpreta…

200 papers

The computer-aided detection (CADe) systems are developed to assist pathologists in slide assessment, increasing diagnosis efficiency and reducing missing inspections. Many studies have shown such a CADe system with deep learning approaches…

Computer Vision and Pattern Recognition · Computer Science 2019-03-05 Wei-Wen Hsu , Chung-Hao Chen , Chang Hoa , Yu-Ling Hou , Xiang Gao , Yun Shao , Xueli Zhang , Jingjing Wang , Tao He , Yanghong Tai

Dermatological conditions affect 1.9 billion people globally, yet accurate diagnosis remains challenging due to limited specialist availability and complex clinical presentations. Family history significantly influences skin disease…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Satya Narayana Panda , Vaishnavi Kukkala , Spandana Iyer

Despite remarkable advancements in pixel-level medical image perception, existing methods are either limited to specific tasks or heavily rely on accurate bounding boxes or text labels as input prompts. However, the medical knowledge…

Computer Vision and Pattern Recognition · Computer Science 2025-04-24 Qinyue Tong , Ziqian Lu , Jun Liu , Yangming Zheng , Zheming Lu

Interpretation and diagnosis of machine learning models have gained renewed interest in recent years with breakthroughs in new approaches. We present Manifold, a framework that utilizes visual analysis techniques to support interpretation,…

Machine Learning · Computer Science 2019-01-18 Jiawei Zhang , Yang Wang , Piero Molino , Lezhi Li , David S. Ebert

Tumor segmentation plays a critical role in histopathology, but it requires costly, fine-grained image-mask pairs annotated by pathologists. Thus, synthesizing histopathology data to expand the dataset is highly desirable. Previous works…

Computer Vision and Pattern Recognition · Computer Science 2025-03-07 Hong Liu , Haosen Yang , Evi M. C. Huijben , Mark Schuiveling , Ruisheng Su , Josien P. W. Pluim , Mitko Veta

Traditional whole slide image (WSI) analysis methods typically rely on the multiple instance learning (MIL) paradigm, which extracts patch-level features at high magnification and aggregates them for slide-level prediction. However, such…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Jiusong Ge , Yingkang Zhan , Wenjie Zhao , Di Zhang , Ke Wang , Jiashuai Liu , Chunze Yang , Chengzu Li , Jian Zhang , Yuxin Dong , Ni Zhang , Qidong Liu , Mireia Crispin-Ortuzar , Huazhu Fu , Chen Li , Zeyu Gao

Radiologists rely on anatomical understanding to accurately delineate pathologies, yet most current deep learning approaches use pure pattern recognition and ignore the anatomical context in which pathologies develop. To narrow this gap, we…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Keyi Li , Alexander Jaus , Jens Kleesiek , Rainer Stiefelhagen

Non-invasive brain imaging techniques allow understanding the behavior and macro changes in the brain to determine the progress of a disease. However, computational pathology provides a deeper understanding of brain disorders at cellular…

Image and Video Processing · Electrical Eng. & Systems 2023-01-18 Gabriel Jimenez , Daniel Racoceanu

The rapid adoption of transformer-based models in computational pathology has enabled prediction of molecular and clinical biomarkers from H&E whole-slide images, yet interpretability has not kept pace with model complexity. While…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Marco Gustav , Fabian Wolf , Christina Glasner , Nic G. Reitsam , Stefan Schulz , Kira Aschenbroich , Bruno Märkl , Sebastian Foersch , Jakob Nikolas Kather

Chest X-rays (CXRs) are the most frequently performed imaging examinations in clinical settings. Recent advancements in Large Multimodal Models (LMMs) have enabled automated CXR interpretation, enhancing diagnostic accuracy and efficiency.…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Qingqiu Li , Zihang Cui , Seongsu Bae , Jilan Xu , Runtian Yuan , Yuejie Zhang , Rui Feng , Quanli Shen , Xiaobo Zhang , Junjun He , Shujun Wang

Computational Pathology (CPath) is an emerging field concerned with the study of tissue pathology via computational algorithms for the processing and analysis of digitized high-resolution images of tissue slides. Recent deep learning based…

Image and Video Processing · Electrical Eng. & Systems 2021-12-20 Amina Asif , Kashif Rajpoot , David Snead , Fayyaz Minhas , Nasir Rajpoot

It is imperative that breast cancer is detected precisely and timely to improve patient outcomes. Diagnostic methodologies have traditionally relied on unimodal approaches; however, medical data analytics is integrating diverse data sources…

Machine Learning · Computer Science 2024-06-21 Faseela Abdullakutty , Younes Akbari , Somaya Al-Maadeed , Ahmed Bouridane , Rifat Hamoudi

Advancements in artificial intelligence (AI) are transforming pathology by integrat-ing large language models (LLMs) with retrieval-augmented generation (RAG) and domain-specific foundation models. This study explores the application of…

Computation and Language · Computer Science 2025-05-14 Hussien Al-Asi , Jordan P Reynolds , Shweta Agarwal , Bryan J Dangott , Aziza Nassar , Zeynettin Akkus

Interpretability of deep learning is widely used to evaluate the reliability of medical imaging models and reduce the risks of inaccurate patient recommendations. For models exceeding human performance, e.g. predicting RNA structure from…

Quantitative Methods · Quantitative Biology 2022-08-31 Mara Graziani , Niccolò Marini , Nicolas Deutschmann , Nikita Janakarajan , Henning Müller , María Rodríguez Martínez

Proactive analysis of patient pathways helps healthcare providers anticipate treatment-related risks, identify outcomes, and allocate resources. Machine learning (ML) can leverage a patient's complete health history to make informed…

Machine Learning · Computer Science 2024-05-24 Sandra Zilker , Sven Weinzierl , Mathias Kraus , Patrick Zschech , Martin Matzner

Magnetic Resonance Imaging (MRI) plays an important role in diagnosing the parotid tumor, where accurate segmentation of tumors is highly desired for determining appropriate treatment plans and avoiding unnecessary surgery. However, the…

Image and Video Processing · Electrical Eng. & Systems 2022-10-05 Yifan Gao , Yin Dai , Fayu Liu , Weibing Chen , Lifu Shi

The problem of recognizing various types of tissues present in multi-gigapixel histology images is an important fundamental pre-requisite for downstream analysis of the tumor microenvironment in a bottom-up analysis paradigm for…

Image and Video Processing · Electrical Eng. & Systems 2021-04-02 Nima Hatami , Mohsin Bilal , Nasir Rajpoot

Accurate diagnosis of skin diseases remains a significant challenge due to the complex and diverse visual features present in dermatoscopic images, often compounded by a lack of interpretability in existing purely visual diagnostic models.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Kexin Yu , Zihan Xu , Jialei Xie , Carter Adams

Recent years have witnessed remarkable progress in multimodal learning within computational pathology. Existing models primarily rely on vision and language modalities; however, language alone lacks molecular specificity and offers limited…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Minghao Han , Dingkang Yang , Linhao Qu , Zizhi Chen , Gang Li , Han Wang , Jiacong Wang , Lihua Zhang

Medical imaging plays a vital role in modern diagnostics; however, interpreting high-resolution radiological data remains time-consuming and susceptible to variability among clinicians. Traditional image processing techniques often lack the…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Melika Filvantorkaman , Maral Filvan Torkaman