中文
相关论文

相关论文: Towards a Visual-Language Foundation Model for Com…

200 篇论文

Detectingandsegmentingobjectswithinwholeslideimagesis essential in computational pathology workflow. Self-supervised learning (SSL) is appealing to such annotation-heavy tasks. Despite the extensive benchmarks in natural images for dense…

计算机视觉与模式识别 · 计算机科学 2022-07-15 Jiawei Yang , Hanbo Chen , Yuan Liang , Junzhou Huang , Lei He , Jianhua Yao

The recent surge of foundation models in computer vision and natural language processing opens up perspectives in utilizing multi-modal clinical data to train large models with strong generalizability. Yet pathological image datasets often…

计算机视觉与模式识别 · 计算机科学 2023-07-28 Yunkun Zhang , Jin Gao , Mu Zhou , Xiaosong Wang , Yu Qiao , Shaoting Zhang , Dequan Wang

We present ARCH, a computational pathology (CP) multiple instance captioning dataset to facilitate dense supervision of CP tasks. Existing CP datasets focus on narrow tasks; ARCH on the other hand contains dense diagnostic and morphological…

计算机视觉与模式识别 · 计算机科学 2021-03-10 Jevgenij Gamper , Nasir Rajpoot

AI tools in pathology have improved screening throughput, standardized quantification, and revealed prognostic patterns that inform treatment. However, adoption remains limited because most systems still lack the human-readable reasoning…

Medical image classification requires labeled, task-specific datasets which are used to train deep learning networks de novo, or to fine-tune foundation models. However, this process is computationally and technically demanding. In language…

Multimodal learning has shown promise in medical imaging, combining complementary modalities like images and text. Vision-language models (VLMs) capture rich diagnostic cues but often require large paired datasets and prompt- or text-based…

计算机视觉与模式识别 · 计算机科学 2025-11-26 Banafsheh Karimian , Giulia Avanzato , Soufian Belharbi , Alexis Guichemerre , Luke McCaffrey , Mohammadhadi Shateri , Eric Granger

Foundation models for computational pathology are expected to facilitate the development of high-performing, generalisable deep learning systems. However, in addition to biologically relevant features, current foundation models also capture…

A heterogeneous information network (HIN) has as vertices objects of different types and as edges the relations between objects, which are also of various types. We study the problem of classifying objects in HINs. Most existing methods…

机器学习 · 计算机科学 2021-02-23 Xiang Li , Danhao Ding , Ben Kao , Yizhou Sun , Nikos Mamoulis

Recently, histopathology vision-language foundation models (VLMs) have gained popularity due to their enhanced performance and generalizability across different downstream tasks. However, most existing histopathology benchmarks are either…

图像与视频处理 · 电气工程与系统科学 2025-03-18 Roba Al Majzoub , Hashmat Malik , Muzammal Naseer , Zaigham Zaheer , Tariq Mahmood , Salman Khan , Fahad Khan

Interpretability is significant in computational pathology, leading to the development of multimodal information integration from histopathological image and corresponding text data.However, existing multimodal methods have limited…

计算机视觉与模式识别 · 计算机科学 2026-01-22 Kangcheng Zhou , Jun Jiang , Qing Zhang , Shuang Zheng , Qingli Li , Shugong Xu

Few-shot learning is a standard practice in most deep learning based histopathology image segmentation, given the relatively low number of digitized slides that are generally available. While many models have been developed for domain…

图像与视频处理 · 电气工程与系统科学 2021-10-01 Zheng Yuan , Andre Esteva , Ran Xu

Artificial intelligence has started to transform histopathology impacting clinical diagnostics and biomedical research. However, while many computational pathology approaches have been proposed, most current AI models are limited with…

We explore the problem of classification within a medical image data-set based on a feature vector extracted from the deepest layer of pre-trained Convolution Neural Networks. We have used feature vectors from several pre-trained…

计算机视觉与模式识别 · 计算机科学 2017-10-17 Brady Kieffer , Morteza Babaie , Shivam Kalra , H. R. Tizhoosh

Forensic pathology is critical in analyzing death manner and time from the microscopic aspect to assist in the establishment of reliable factual bases for criminal investigation. In practice, even the manual differentiation between…

计算机视觉与模式识别 · 计算机科学 2023-08-29 Chen Shen , Jun Zhang , Xinggong Liang , Zeyi Hao , Kehan Li , Fan Wang , Zhenyuan Wang , Chunfeng Lian

Recent advances in Vision-Language Models (VLMs) in histopathology, such as CONCH and QuiltNet, have demonstrated impressive zero-shot classification capabilities across various tasks. However, their general-purpose design may lead to…

计算机视觉与模式识别 · 计算机科学 2025-08-12 Jingna Qiu , Nishanth Jain , Jonas Ammeling , Marc Aubreville , Katharina Breininger

Leaf disease identification plays a pivotal role in smart agriculture. However, many existing studies still struggle to integrate image and textual modalities to compensate for each other's limitations. Furthermore, many of these approaches…

计算机视觉与模式识别 · 计算机科学 2025-10-28 Khang Nguyen Quoc , Lan Le Thi Thu , Luyl-Da Quach

Vision-language models (VLMs) have gained significant attention in computational pathology due to their multimodal learning capabilities that enhance big-data analytics of giga-pixel whole slide image (WSI). However, their sensitivity to…

计算机视觉与模式识别 · 计算机科学 2025-05-02 Vasudev Sharma , Ahmed Alagha , Abdelhakim Khellaf , Vincent Quoc-Huy Trinh , Mahdi S. Hosseini

Contrastive visual language pretraining has emerged as a powerful method for either training new language-aware image encoders or augmenting existing pretrained models with zero-shot visual recognition capabilities. However, existing works…

计算机视觉与模式识别 · 计算机科学 2023-06-14 Ming Y. Lu , Bowen Chen , Andrew Zhang , Drew F. K. Williamson , Richard J. Chen , Tong Ding , Long Phi Le , Yung-Sung Chuang , Faisal Mahmood

Self-supervised representation learning has been highly promising for histopathology image analysis with numerous approaches leveraging their patient-slide-patch hierarchy to learn better representations. In this paper, we explore how the…

计算机视觉与模式识别 · 计算机科学 2024-03-22 Hasindri Watawana , Kanchana Ranasinghe , Tariq Mahmood , Muzammal Naseer , Salman Khan , Fahad Shahbaz Khan

Unsupervised learning has been a long-standing goal of machine learning and is especially important for medical image analysis, where the learning can compensate for the scarcity of labeled datasets. A promising subclass of unsupervised…

图像与视频处理 · 电气工程与系统科学 2021-09-09 Ozan Ciga , Tony Xu , Anne L. Martel