中文
相关论文

相关论文: PathMoE: Interpretable Multimodal Interaction Expe…

200 篇论文

The development of computational pathology lies in the consensus that pathological characteristics of tumors are significant guidance for cancer diagnostics. Most existing research focuses on the inner-contextual information within each WSI…

计算机视觉与模式识别 · 计算机科学 2024-10-15 Jun Shi , Tong Shu , Zhiguo Jiang , Wei Wang , Haibo Wu , Yushan Zheng

Cancer survival prediction from multi-omics data remains challenging because prognostic signals are high-dimensional, heterogeneous, and distributed across interacting genes and pathways. We propose PathMoG, a pathway-centric modular graph…

机器学习 · 计算机科学 2026-04-28 Di Wang , Chupei Tang , Junxiao Kong , Jixiu Zhai , Moyu Tang , Tianchi Lu

Multimodal data provides heterogeneous information for a holistic understanding of the tumor microenvironment. However, existing AI models often struggle to harness the rich information within multimodal data and extract poorly…

机器学习 · 计算机科学 2025-09-17 Huajun Zhou , Fengtao Zhou , Jiabo Ma , Yingxue Xu , Xi Wang , Xiuming Zhang , Li Liang , Zhenhui Li , Hao Chen

Robust and generalizable segmentation of brain tumors on multi-parametric magnetic resonance imaging (MRI) remains difficult because tumor types differ widely. The BraTS 2025 Lighthouse Challenge benchmarks segmentation methods on diverse…

Histopathology remains the gold standard for cancer diagnosis because it provides detailed cellular-level assessment of tissue morphology. However, manual histopathological examination is time-consuming, labour-intensive, and subject to…

计算机视觉与模式识别 · 计算机科学 2026-03-13 Ravi Mosalpuri , Mohammed Abdelsamea , Ahmed Karam Eldaly

Whole-slide images (WSIs) from cancer patients contain rich information that can be used for medical diagnosis or to follow treatment progress. To automate their analysis, numerous deep learning methods based on convolutional neural…

计算机视觉与模式识别 · 计算机科学 2026-02-18 Lucas Sancéré , Noémie Moreau , Katarzyna Bozek

To develop intelligent speech assistants and integrate them seamlessly with intra-operative decision-support frameworks, accurate and efficient surgical phase recognition is a prerequisite. In this study, we propose a multimodal framework…

音频与语音处理 · 电气工程与系统科学 2024-06-24 Kubilay Can Demir , Belen Lojo Rodriguez , Tobias Weise , Andreas Maier , Seung Hee Yang

Whole Slide Image (WSI) classification is often formulated as a Multiple Instance Learning (MIL) problem. Recently, Vision-Language Models (VLMs) have demonstrated remarkable performance in WSI classification. However, existing methods…

计算机视觉与模式识别 · 计算机科学 2024-04-08 Hao Li , Ying Chen , Yifei Chen , Wenxian Yang , Bowen Ding , Yuchen Han , Liansheng Wang , Rongshan Yu

Motivation: Despite advances in the computational analysis of high-throughput molecular profiling assays (e.g. transcriptomics), a dichotomy exists between methods that are simple and interpretable, and ones that are complex but with lower…

机器学习 · 计算机科学 2023-06-12 Pedro Henrique da Costa Avelar , Min Wu , Sophia Tsoka

The emergence of large multimodal models (LMMs) has brought significant advancements to pathology. Previous research has primarily focused on separately training patch-level and whole-slide image (WSI)-level models, limiting the integration…

计算机视觉与模式识别 · 计算机科学 2024-12-17 Yuxuan Sun , Yixuan Si , Chenglu Zhu , Xuan Gong , Kai Zhang , Pingyi Chen , Ye Zhang , Zhongyi Shui , Tao Lin , Lin Yang

Algorithmic decision support is rapidly becoming a staple of personalized medicine, especially for high-stakes recommendations in which access to certain information can drastically alter the course of treatment, and thus, patient outcome;…

计算机视觉与模式识别 · 计算机科学 2021-08-16 Haomin Chen , T. Y. Alvin Liu , Catalina Gomez , Zelia Correa , Mathias Unberath

Multimodal survival methods combining gigapixel histology whole-slide images (WSIs) and transcriptomic profiles are particularly promising for patient prognostication and stratification. Current approaches involve tokenizing the WSIs into…

计算机视觉与模式识别 · 计算机科学 2024-07-02 Andrew H. Song , Richard J. Chen , Guillaume Jaume , Anurag J. Vaidya , Alexander S. Baras , Faisal Mahmood

Multimodal molecular representation learning, which jointly models molecular graphs and their textual descriptions, enhances predictive accuracy and interpretability by enabling more robust and reliable predictions of drug toxicity,…

机器学习 · 计算机科学 2025-10-21 Yingxu Wang , Kunyu Zhang , Jiaxin Huang , Nan Yin , Siwei Liu , Eran Segal

Interpretability is crucial to enhance trust in machine learning models for medical diagnostics. However, most state-of-the-art image classifiers based on neural networks are not interpretable. As a result, clinicians often resort to known…

Deep learning methods are widely used for medical applications to assist medical doctors in their daily routines. While performances reach expert's level, interpretability (highlight how and what a trained model learned and why it makes a…

计算机视觉与模式识别 · 计算机科学 2020-09-30 Antoine Pirovano , Hippolyte Heuberger , Sylvain Berlemont , Saïd Ladjal , Isabelle Bloch

Diagnosing rare diseases presents a common challenge in clinical practice, necessitating the expertise of specialists for accurate identification. The advent of machine learning offers a promising solution, while the development of such…

Histopathological image analysis is an essential process for the discovery of diseases such as cancer. However, it is challenging to train CNN on whole slide images (WSIs) of gigapixel resolution considering the available memory capacity.…

图像与视频处理 · 电气工程与系统科学 2019-10-11 Shusuke Takahama , Yusuke Kurose , Yusuke Mukuta , Hiroyuki Abe , Masashi Fukayama , Akihiko Yoshizawa , Masanobu Kitagawa , Tatsuya Harada

Survival analysis plays a vital role in making clinical decisions. However, the models currently in use are often difficult to interpret, which reduces their usefulness in clinical settings. Prototype learning presents a potential solution,…

计算机视觉与模式识别 · 计算机科学 2025-10-08 Shuo Jiang , Zhuwen Chen , Liaoman Xu , Yanming Zhu , Changmiao Wang , Jiong Zhang , Feiwei Qin , Yifei Chen , Zhu Zhu

Multimodal pathological image understanding has garnered widespread interest due to its potential to improve diagnostic accuracy and enable personalized treatment through integrated visual and textual data. However, existing methods exhibit…

计算机视觉与模式识别 · 计算机科学 2025-05-22 Zhe Xu , Cheng Jin , Yihui Wang , Ziyi Liu , Hao Chen

Due to its superior efficiency in utilizing annotations and addressing gigapixel-sized images, multiple instance learning (MIL) has shown great promise as a framework for whole slide image (WSI) classification in digital pathology…

定量方法 · 定量生物学 2023-07-14 Qiehe Sun , Jiawen Li , Jin Xu , Junru Cheng , Tian Guan , Yonghong He