中文
相关论文

相关论文: A Foundational Multimodal Vision Language AI Assis…

200 篇论文

Artificial intelligence (AI) is vital in ophthalmology, tackling tasks like diagnosis, classification, and visual question answering (VQA). However, existing AI models in this domain often require extensive annotation and are task-specific,…

计算机视觉与模式识别 · 计算机科学 2024-05-24 Danli Shi , Weiyi Zhang , Xiaolan Chen , Yexin Liu , Jiancheng Yang , Siyu Huang , Yih Chung Tham , Yingfeng Zheng , Mingguang He

Recent advancements in artificial intelligence (AI) have precipitated significant breakthroughs in healthcare, particularly in refining diagnostic procedures. However, previous studies have often been constrained to limited functionalities.…

The emergence of large multimodal models has unlocked remarkable potential in AI, particularly in pathology. However, the lack of specialized, high-quality benchmark impeded their development and precise evaluation. To address this, we…

计算机视觉与模式识别 · 计算机科学 2024-03-21 Yuxuan Sun , Hao Wu , Chenglu Zhu , Sunyi Zheng , Qizi Chen , Kai Zhang , Yunlong Zhang , Dan Wan , Xiaoxiao Lan , Mengyue Zheng , Jingxiong Li , Xinheng Lyu , Tao Lin , Lin Yang

Recent advances in agentic artificial intelligence, i.e. systems capable of autonomous perception, reasoning, and tool use, offer new opportunities for digital pathology. In this pilot study, we evaluate whether two agentic multimodal AI…

人机交互 · 计算机科学 2026-01-21 Marc Aubreville , Taryn A. Donovan , Christof A. Bertram

From self-supervised, vision-only models to contrastive visual-language frameworks, computational pathology has rapidly evolved in recent years. Generative AI "co-pilots" now demonstrate the ability to mine subtle, sub-visual tissue cues…

计算机视觉与模式识别 · 计算机科学 2025-02-13 Mohsin Bilal , Aadam , Manahil Raza , Youssef Altherwy , Anas Alsuhaibani , Abdulrahman Abduljabbar , Fahdah Almarshad , Paul Golding , Nasir Rajpoot

The rapid digitization of histopathology slides has opened up new possibilities for computational tools in clinical and research workflows. Among these, content-based slide retrieval stands out, enabling pathologists to identify…

计算机视觉与模式识别 · 计算机科学 2025-10-28 Hongyi Wang , Zhengjie Zhu , Jiabo Ma , Fang Wang , Yue Shi , Bo Luo , Jili Wang , Qiuyu Cai , Xiuming Zhang , Yen-Wei Chen , Lanfen Lin , Hao Chen

Analyzing whole-slide images (WSIs) requires an iterative, evidence-driven reasoning process that parallels how pathologists dynamically zoom, refocus, and self-correct while collecting the evidence. However, existing computational…

计算机视觉与模式识别 · 计算机科学 2025-11-24 Jingyun Chen , Linghan Cai , Zhikang Wang , Yi Huang , Songhan Jiang , Shenjin Huang , Hongpeng Wang , Yongbing Zhang

Recent advances in deep learning have completely transformed the domain of computational pathology (CPath). More specifically, it has altered the diagnostic workflow of pathologists by integrating foundation models (FMs) and vision-language…

机器学习 · 计算机科学 2024-09-19 Dibaloke Chanda , Milan Aryal , Nasim Yahya Soltani , Masoud Ganji

Digital pathology is not only one of the most promising fields of diagnostic medicine, but at the same time a hot topic for fundamental research. Digital pathology is not just the transfer of histopathological slides into digital…

In this paper, we consider the problem of visual representation learning for computational pathology, by exploiting large-scale image-text pairs gathered from public resources, along with the domain-specific knowledge in pathology.…

计算机视觉与模式识别 · 计算机科学 2024-09-17 Xiao Zhou , Xiaoman Zhang , Chaoyi Wu , Ya Zhang , Weidi Xie , Yanfeng Wang

Diagnosing diseases through histopathology whole slide images (WSIs) is fundamental in modern pathology but is challenged by the gigapixel scale and complexity of WSIs. Trained histopathologists overcome this challenge by navigating the…

Conversational generative AI has demonstrated remarkable promise for empowering biomedical practitioners, but current investigations focus on unimodal text. Multimodal conversational AI has seen rapid progress by leveraging billions of…

计算机视觉与模式识别 · 计算机科学 2023-06-02 Chunyuan Li , Cliff Wong , Sheng Zhang , Naoto Usuyama , Haotian Liu , Jianwei Yang , Tristan Naumann , Hoifung Poon , Jianfeng Gao

Foundation models have revolutionized the paradigm of digital pathology, as they leverage general-purpose features to emulate real-world pathological practices, enabling the quantitative analysis of critical histological patterns and the…

Despite being widely used to support clinical care, general-purpose large multimodal models (LMMs) have generally shown poor or inconclusive performance in medical image interpretation, particularly in pathology, where gigapixel images are…

计算机视觉与模式识别 · 计算机科学 2025-11-26 Thomas A. Buckley , Kian R. Weihrauch , Katherine Latham , Andrew Z. Zhou , Padmini A. Manrai , Arjun K. Manrai

In this paper, we critically evaluate the capabilities of the state-of-the-art multimodal large language model, i.e., GPT-4 with Vision (GPT-4V), on Visual Question Answering (VQA) task. Our experiments thoroughly assess GPT-4V's…

计算机视觉与模式识别 · 计算机科学 2023-10-31 Zhiling Yan , Kai Zhang , Rong Zhou , Lifang He , Xiang Li , Lichao Sun

Computational Pathology (CPath) is an emerging field concerned with the study of tissue pathology via computational algorithms for the processing and analysis of digitized high-resolution images of tissue slides. Recent deep learning based…

图像与视频处理 · 电气工程与系统科学 2021-12-20 Amina Asif , Kashif Rajpoot , David Snead , Fayyaz Minhas , Nasir Rajpoot

The accelerated adoption of digital pathology and advances in deep learning have enabled the development of powerful models for various pathology tasks across a diverse array of diseases and patient cohorts. However, model training is often…

Artificial intelligence (AI) that can effectively learn ultrasound representations by integrating multi-source data holds significant promise for advancing clinical care. However, the scarcity of large labeled datasets in real-world…

Gastric endoscopic screening is an effective way to decide appropriate gastric cancer (GC) treatment at an early stage, reducing GC-associated mortality rate. Although artificial intelligence (AI) has brought a great promise to assist…

图像与视频处理 · 电气工程与系统科学 2023-08-16 Yujin Oh , Go Eun Bae , Kyung-Hee Kim , Min-Kyung Yeo , Jong Chul Ye

In Computational Pathology (CPath), the introduction of Vision-Language Models (VLMs) has opened new avenues for research, focusing primarily on aligning image-text pairs at a single magnification level. However, this approach might not be…