中文
相关论文

相关论文: PathMR: Multimodal Visual Reasoning for Interpreta…

200 篇论文

With the development of generative artificial intelligence and instruction tuning techniques, multimodal large language models (MLLMs) have made impressive progress on general reasoning tasks. Benefiting from the chain-of-thought (CoT)…

机器学习 · 计算机科学 2025-07-03 Junjie Zhou , Yingli Zuo , Shichang Feng , Peng Wan , Qi Zhu , Daoqiang Zhang , Wei Shao

Artificial intelligence (AI)-enabled diagnostics in maxillofacial pathology require structured, high-quality multimodal datasets. However, existing resources provide limited ameloblastoma coverage and lack the format consistency needed for…

人工智能 · 计算机科学 2026-02-06 Ajo Babu George , Anna Mariam John , Athul Anoop , Balu Bhasuran

Pathology images are crucial for diagnosing and managing various diseases by visualizing cellular and tissue-level abnormalities. Recent advancements in artificial intelligence (AI), particularly multimodal models like ChatGPT, have shown…

人机交互 · 计算机科学 2024-09-25 Mianxin Liu , Jianfeng Wu , Fang Yan , Hongjun Li , Wei Wang , Shaoting Zhang , Zhe Wang

Interpretable deep learning models have received widespread attention in the field of image recognition. Due to the unique multi-instance learning of medical images and the difficulty in identifying decision-making regions, many…

计算机视觉与模式识别 · 计算机科学 2023-12-05 Yitao Peng , Lianghua He , Die Hu , Yihang Liu , Longzhen Yang , Shaohua Shang

Pathology image analysis plays a pivotal role in medical diagnosis, with deep learning techniques significantly advancing diagnostic accuracy and research. While numerous studies have been conducted to address specific pathological tasks,…

图像与视频处理 · 电气工程与系统科学 2025-03-31 Dankai Liao , Sicheng Chen , Nuwa Xi , Qiaochu Xue , Jieyu Li , Lingxuan Hou , Zeyu Liu , Chang Han Low , Yufeng Wu , Yiling Liu , Yanqin Jiang , Dandan Li , Shangqing Lyu

In Recent Years, Digital Technologies Have Made Significant Strides In Augmenting-Human-Health, Cognition, And Perception, Particularly Within The Field Of Computational-Pathology. This Paper Presents A Novel Approach To Enhancing The…

计算机视觉与模式识别 · 计算机科学 2025-07-24 Xiaoqian Hu

Interpretability is crucial to enhance trust in machine learning models for medical diagnostics. However, most state-of-the-art image classifiers based on neural networks are not interpretable. As a result, clinicians often resort to known…

While Vision-Language Models (VLMs) have achieved notable progress in computational pathology (CPath), the gigapixel scale and spatial heterogeneity of Whole Slide Images (WSIs) continue to pose challenges for multimodal understanding.…

计算机视觉与模式识别 · 计算机科学 2025-12-22 Fengchun Liu , Songhan Jiang , Linghan Cai , Ziyue Wang , Yongbing Zhang

The development of robust artificial intelligence models for histopathology diagnosis is severely constrained by the scarcity of expert-annotated lesion data, particularly for rare pathologies and underrepresented disease subtypes. While…

计算机视觉与模式识别 · 计算机科学 2026-01-14 Mohamad Koohi-Moghadam , Mohammad-Ali Nikouei Mahani , Kyongtae Tyler Bae

Though deep learning has shown successful performance in classifying the label and severity stage of certain diseases, most of them give few explanations on how to make predictions. Inspired by Koch's Postulates, the foundation in…

图像与视频处理 · 电气工程与系统科学 2022-05-02 Yuhao Niu , Lin Gu , Yitian Zhao , Feng Lu

Pathological diagnosis remains the definitive standard for identifying tumors. The rise of multimodal large models has simplified the process of integrating image analysis with textual descriptions. Despite this advancement, the substantial…

计算机视觉与模式识别 · 计算机科学 2024-08-14 Xiaomin Wu , Rui Xu , Pengchen Wei , Wenkang Qin , Peixiang Huang , Ziheng Li , Lin Luo

Explainable Artificial Intelligence (AI) in the form of an interpretable and semiautomatic approach to stage grading ocular pathologies such as Diabetic retinopathy, Hypertensive retinopathy, and other retinopathies on the backdrop of major…

图像与视频处理 · 电气工程与系统科学 2022-12-15 Ayushi Raj Bhatt , Rajkumar Vaghashiya , Meghna Kulkarni , Dr Prakash Kamaraj

Remarkable success of modern image-based AI methods and the resulting interest in their applications in critical decision-making processes has led to a surge in efforts to make such intelligent systems transparent and explainable. The need…

人工智能 · 计算机科学 2020-11-30 Adriano Lucieri , Muhammad Naseer Bajwa , Andreas Dengel , Sheraz Ahmed

Integrating heterogeneous biomedical data including imaging, omics, and clinical records supports accurate diagnosis and personalised care. Graph-based models fuse such non-Euclidean data by capturing spatial and relational structure, yet…

基因组学 · 定量生物学 2025-05-06 Alireza Sadeghi , Farshid Hajati , Ahmadreza Argha , Nigel H Lovell , Min Yang , Hamid Alinejad-Rokny

We introduce MATEX (Multi-scale Attention and Text-guided Explainability), a novel framework that advances interpretability in medical vision-language models by incorporating anatomically informed spatial reasoning. MATEX synergistically…

计算机视觉与模式识别 · 计算机科学 2026-01-21 Muhammad Imran , Chi Lee , Yugyung Lee

Foundation models have emerged as a powerful paradigm in computational pathology (CPath), enabling scalable and generalizable analysis of histopathological images. While early developments centered on uni-modal models trained solely on…

计算机视觉与模式识别 · 计算机科学 2025-03-21 Dong Li , Guihong Wan , Xintao Wu , Xinyu Wu , Xiaohui Chen , Yi He , Christine G. Lian , Peter K. Sorger , Yevgeniy R. Semenov , Chen Zhao

We present ViDRiP-LLaVA, the first large multimodal model (LMM) in computational pathology that integrates three distinct image scenarios, including single patch images, automatically segmented pathology video clips, and manually segmented…

计算机视觉与模式识别 · 计算机科学 2025-10-14 Trinh T. L. Vuong , Jin Tae Kwak

Healthcare models are transitioning from unimodal prediction toward multimodal reasoning over heterogeneous diagnostic inputs. In computational pathology, for complex tumor subtypes where morphology alone can be challenging to distinguish,…

As interpretability has been pointed out as the obstacle to the adoption of Deep Neural Networks (DNNs), there is an increasing interest in solving a transparency issue to guarantee the impressive performance. In this paper, we demonstrate…

图像与视频处理 · 电气工程与系统科学 2021-07-20 Woo-Jeoung Nam , Seong-Whan Lee

With the development of digital imaging in medical microscopy, artificial intelligent-based analysis of pathological whole slide images (WSIs) provides a powerful tool for cancer diagnosis. Limited by the expensive cost of pixel-level…

计算机视觉与模式识别 · 计算机科学 2024-11-19 Jiawen Li , Qiehe Sun , Renao Yan , Yizhi Wang , Yuqiu Fu , Yani Wei , Tian Guan , Huijuan Shi , Yonghonghe He , Anjia Han