English
Related papers

Related papers: PathInsight: Instruction Tuning of Multimodal Data…

200 papers

Large language models (LLMs) have demonstrated immense capabilities in understanding textual data and are increasingly being adopted to help researchers accelerate scientific discovery through knowledge extraction (information retrieval),…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Robinson Umeike , Neil Getty , Fangfang Xia , Rick Stevens

The emergence of large multimodal models has unlocked remarkable potential in AI, particularly in pathology. However, the lack of specialized, high-quality benchmark impeded their development and precise evaluation. To address this, we…

Computer Vision and Pattern Recognition · Computer Science 2024-03-21 Yuxuan Sun , Hao Wu , Chenglu Zhu , Sunyi Zheng , Qizi Chen , Kai Zhang , Yunlong Zhang , Dan Wan , Xiaoxiao Lan , Mengyue Zheng , Jingxiong Li , Xinheng Lyu , Tao Lin , Lin Yang

Artificial intelligence (AI)-enabled diagnostics in maxillofacial pathology require structured, high-quality multimodal datasets. However, existing resources provide limited ameloblastoma coverage and lack the format consistency needed for…

Artificial Intelligence · Computer Science 2026-02-06 Ajo Babu George , Anna Mariam John , Athul Anoop , Balu Bhasuran

The rapid development of diagnostic technologies in healthcare is leading to higher requirements for physicians to handle and integrate the heterogeneous, yet complementary data that are produced during routine practice. For instance, the…

Machine Learning · Computer Science 2023-01-30 Can Cui , Haichun Yang , Yaohong Wang , Shilin Zhao , Zuhayr Asad , Lori A. Coburn , Keith T. Wilson , Bennett A. Landman , Yuankai Huo

Vision-threatening eye diseases pose a major global health burden, with timely diagnosis limited by workforce shortages and restricted access to specialized care. While multimodal large language models (MLLMs) show promise for medical image…

Interpretability is significant in computational pathology, leading to the development of multimodal information integration from histopathological image and corresponding text data.However, existing multimodal methods have limited…

Computer Vision and Pattern Recognition · Computer Science 2026-01-22 Kangcheng Zhou , Jun Jiang , Qing Zhang , Shuang Zheng , Qingli Li , Shugong Xu

Large language models (LLMs) constitute a breakthrough state-of-the-art Artificial Intelligence technology which is rapidly evolving and promises to aid in medical diagnosis. However, the correctness and the accuracy of their returns has…

Computation and Language · Computer Science 2024-02-07 Dimitrios P. Panagoulias , Maria Virvou , George A. Tsihrintzis

Foundation models have emerged as a powerful paradigm in computational pathology (CPath), enabling scalable and generalizable analysis of histopathological images. While early developments centered on uni-modal models trained solely on…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Dong Li , Guihong Wan , Xintao Wu , Xinyu Wu , Xiaohui Chen , Yi He , Christine G. Lian , Peter K. Sorger , Yevgeniy R. Semenov , Chen Zhao

The rapidly emerging field of deep learning-based computational pathology has demonstrated promise in developing objective prognostic models from histology whole slide images. However, most prognostic models are either based on histology or…

Computer Vision and Pattern Recognition · Computer Science 2021-08-06 Richard J. Chen , Ming Y. Lu , Drew F. K. Williamson , Tiffany Y. Chen , Jana Lipkova , Muhammad Shaban , Maha Shady , Mane Williams , Bumjin Joo , Zahra Noor , Faisal Mahmood

Recent studies have made significant progress in developing large language models (LLMs) in the medical domain, which can answer expert-level questions and demonstrate the potential to assist clinicians in real-world clinical scenarios.…

Computation and Language · Computer Science 2025-04-18 Sangwook Kim , Soonyoung Lee , Jongseong Jang

Pathological diagnosis is vital for determining disease characteristics, guiding treatment, and assessing prognosis, relying heavily on detailed, multi-scale analysis of high-resolution whole slide images (WSI). However, existing large…

Computer Vision and Pattern Recognition · Computer Science 2025-05-19 Shengxuming Zhang , Weihan Li , Tianhong Gao , Jiacong Hu , Haoming Luo , Xiuming Zhang , Jing Zhang , Mingli Song , Zunlei Feng

Data is one of the essential ingredients to power deep learning research. Small datasets, especially specific to medical institutes, bring challenges to deep learning training stage. This work aims to develop a practical deep multimodal…

Machine Learning · Computer Science 2019-02-26 Faik Aydin , Maggie Zhang , Michelle Ananda-Rajah , Gholamreza Haffari

Deep learning has recently gained popularity in digital pathology due to its high prediction quality. However, the medical domain requires explanation and insight for a better understanding beyond standard quantitative performance…

Image and Video Processing · Electrical Eng. & Systems 2020-04-28 Miriam Hägele , Philipp Seegerer , Sebastian Lapuschkin , Michael Bockmayr , Wojciech Samek , Frederick Klauschen , Klaus-Robert Müller , Alexander Binder

Recent advances in medical multi-modal models focus on specialized image analysis like dermatology, pathology, or radiology. However, they do not fully capture the complexity of real-world clinical diagnostics, which involve heterogeneous…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Jiao Xu , Junwei Liu , Jiangwei Lao , Qi Zhu , Yunpeng Zhao , Congyun Jin , Shinan Liu , Zhihong Lu , Lihe Zhang , Xin Chen , Jian Wang , Ping Wang

Accurate classification of pediatric central nervous system tumors remains challenging due to histological complexity and limited training data. While pathology foundation models have advanced whole-slide image (WSI) analysis, they often…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Jian Yu , Joakim Nguyen , Jinrui Fang , Awais Naeem , Zeyuan Cao , Sanjay Krishnan , Nicholas Konz , Tianlong Chen , Chandra Krishnan , Hairong Wang , Edward Castillo , Ying Ding , Ankita Shukla

Recent advancements in computational pathology have produced patch-level Multi-modal Large Language Models (MLLMs), but these models are limited by their inability to analyze whole slide images (WSIs) comprehensively and their tendency to…

Computer Vision and Pattern Recognition · Computer Science 2025-08-13 Yuci Liang , Xinheng Lyu , Wenting Chen , Meidan Ding , Jipeng Zhang , Xiangjian He , Song Wu , Xiaohan Xing , Sen Yang , Xiyue Wang , Linlin Shen

Recent breakthroughs in self-supervised learning have enabled the use of large unlabeled datasets to train visual foundation models that can generalize to a variety of downstream tasks. While this training paradigm is well suited for the…

It is imperative that breast cancer is detected precisely and timely to improve patient outcomes. Diagnostic methodologies have traditionally relied on unimodal approaches; however, medical data analytics is integrating diverse data sources…

Machine Learning · Computer Science 2024-06-21 Faseela Abdullakutty , Younes Akbari , Somaya Al-Maadeed , Ahmed Bouridane , Rifat Hamoudi

Computational pathology demands both visual pattern recognition and dynamic integration of structured domain knowledge, including taxonomy, grading criteria, and clinical evidence. In practice, diagnostic reasoning requires linking…

Artificial Intelligence · Computer Science 2026-05-26 Jinyue Li , Yuci Liang , Qiankun Li , Xinheng Lyu , Jiayu Qian , Huabao Chen , Kun Wang , Zhigang Zeng , Anil Anthony Bharath , Yang Liu

In Computational Pathology (CPath), the introduction of Vision-Language Models (VLMs) has opened new avenues for research, focusing primarily on aligning image-text pairs at a single magnification level. However, this approach might not be…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Shahad Albastaki , Anabia Sohail , Iyyakutti Iyappan Ganapathi , Basit Alawode , Asim Khan , Sajid Javed , Naoufel Werghi , Mohammed Bennamoun , Arif Mahmood
‹ Prev 1 2 3 10 Next ›