English
Related papers

Related papers: PathFound: An Agentic Multimodal Model Activating …

200 papers

The rapid digitization of histopathology slides has opened up new possibilities for computational tools in clinical and research workflows. Among these, content-based slide retrieval stands out, enabling pathologists to identify…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Hongyi Wang , Zhengjie Zhu , Jiabo Ma , Fang Wang , Yue Shi , Bo Luo , Jili Wang , Qiuyu Cai , Xiuming Zhang , Yen-Wei Chen , Lanfen Lin , Hao Chen

While Large Multimodal Models (LMMs) demonstrate impressive visual perception, they remain epistemically constrained by their static parametric knowledge. To transcend these boundaries, multimodal search models have been adopted to actively…

Computer Vision and Pattern Recognition · Computer Science 2026-04-16 Yikun Liu , Yuan Liu , Le Tian , Xiao Zhou , Jiangchao Yao , Yanfeng Wang , Weidi Xie

The diagnosis of pathological images is often limited by expert availability and regional disparities, highlighting the importance of automated diagnosis using Vision-Language Models (VLMs). Traditional multimodal models typically emphasize…

Computer Vision and Pattern Recognition · Computer Science 2025-04-21 Jianyu Wu , Hao Yang , Xinhua Zeng , Guibing He , Zhiyu Chen , Zihui Li , Xiaochuan Zhang , Yangyang Ma , Run Fang , Yang Liu

Radiology is a vital and complex component of modern clinical workflow and covers many tasks. Recently, vision-language (VL) foundation models in medicine have shown potential in processing multimodal information, offering a unified…

Computer Vision and Pattern Recognition · Computer Science 2024-09-25 Xiaohong Liu , Guoxing Yang , Yulin Luo , Jiaji Mao , Xiang Zhang , Ming Gao , Shanghang Zhang , Jun Shen , Guangyu Wang

Pathology has played a crucial role in the diagnosis and evaluation of patient tissue samples obtained from surgeries and biopsies for many years. The advent of Whole Slide Scanners and the development of deep learning technologies have…

Computer Vision and Pattern Recognition · Computer Science 2024-08-07 Mieko Ochi , Daisuke Komura , Shumpei Ishikawa

Automated pathology image analysis is central to clinical diagnosis, but clinicians still ask which slide features drive a model's decision and why. Vision-language models can produce natural language explanations, but these are often…

Artificial Intelligence · Computer Science 2026-01-06 Kewen Cao , Jianxu Chen , Yongbing Zhang , Ye Zhang , Hongxiao Wang

Lithology classification in well logs is a fundamental geoscience data mining task that aims to infer rock types from multi dimensional geophysical sequences. Despite recent progress, existing approaches typically formulate the problem as a…

Artificial Intelligence · Computer Science 2026-04-28 Yitong Zhou , Mingyue Cheng , Jiahao Wang , Qingyang Mao , Qi Liu

With the rapid development of computational pathology, many AI-assisted diagnostic tasks have emerged. Cellular nuclei segmentation can segment various types of cells for downstream analysis, but it relies on predefined categories and lacks…

Computer Vision and Pattern Recognition · Computer Science 2025-03-03 Chunlin Zhong , Shuang Hao , Junhua Wu , Xiaona Chang , Jiwei Jiang , Xiu Nie , He Tang , Xiang Bai

The deep neural network is a research hotspot for histopathological image analysis, which can improve the efficiency and accuracy of diagnosis for pathologists or be used for disease screening. The whole slide pathological image can reach…

Image and Video Processing · Electrical Eng. & Systems 2022-05-09 Tingting Zheng , Weixing chen , Shuqin Li , Hao Quan , Qun Bai , Tianhang Nan , Song Zheng , Xinghua Gao , Yue Zhao , Xiaoyu Cui

Multimodal large models have shown great potential in automating pathology image analysis. However, current multimodal models for gastrointestinal pathology are constrained by both data quality and reasoning transparency: pervasive noise…

Image and Video Processing · Electrical Eng. & Systems 2025-07-25 Minxi Ouyang , Lianghui Zhu , Yaqing Bao , Qiang Huang , Jingli Ouyang , Tian Guan , Xitong Ling , Jiawen Li , Song Duan , Wenbin Dai , Li Zheng , Xuemei Zhang , Yonghong He

Though deep learning has shown successful performance in classifying the label and severity stage of certain disease, most of them give few evidence on how to make prediction. Here, we propose to exploit the interpretability of deep…

Computer Vision and Pattern Recognition · Computer Science 2020-03-16 Yuhao Niu , Lin Gu , Feng Lu , Feifan Lv , Zongji Wang , Imari Sato , Zijian Zhang , Yangyan Xiao , Xunzhang Dai , Tingting Cheng

Traditional AI-based healthcare systems often rely on single-modal data, limiting diagnostic accuracy due to incomplete information. However, recent advancements in foundation models show promising potential for enhancing diagnosis…

Artificial Intelligence · Computer Science 2025-03-24 Sihan Wang , Suiyang Jiang , Yibo Gao , Boming Wang , Shangqi Gao , Xiahai Zhuang

The automation of the medical evidence acquisition and diagnosis process has recently attracted increasing attention in order to reduce the workload of doctors and democratize access to medical care. However, most works proposed in the…

Computation and Language · Computer Science 2022-10-14 Arsene Fansi Tchango , Rishab Goel , Julien Martel , Zhi Wen , Gaetan Marceau Caron , Joumana Ghosn

Visual impairment represents a major global health challenge, with multimodal imaging providing complementary information that is essential for accurate ophthalmic diagnosis. This comprehensive survey systematically reviews the latest…

Image and Video Processing · Electrical Eng. & Systems 2025-08-07 Xiaoling Luo , Ruli Zheng , Qiaojian Zheng , Zibo Du , Shuo Yang , Meidan Ding , Qihao Xu , Chengliang Liu , Linlin Shen

The rapid development of diagnostic technologies in healthcare is leading to higher requirements for physicians to handle and integrate the heterogeneous, yet complementary data that are produced during routine practice. For instance, the…

Machine Learning · Computer Science 2023-01-30 Can Cui , Haichun Yang , Yaohong Wang , Shilin Zhao , Zuhayr Asad , Lori A. Coburn , Keith T. Wilson , Bennett A. Landman , Yuankai Huo

Large language models perform well on static medical examinations, yet clinical diagnosis often requires iterative evidence gathering under uncertainty. Building on prior interactive evaluation efforts, we introduce an OSCE-inspired…

Artificial Intelligence · Computer Science 2026-05-22 Chen Zhan , Xihe Qiu , Xiaoyu Tan , Xibing Zhuang , Gengchen Ma , Yue Zhang , Shuo Li , Peifeng Liu , Xiaoxiao Ge , Liang Liu , Lu Gan

Interpretability is significant in computational pathology, leading to the development of multimodal information integration from histopathological image and corresponding text data.However, existing multimodal methods have limited…

Computer Vision and Pattern Recognition · Computer Science 2026-01-22 Kangcheng Zhou , Jun Jiang , Qing Zhang , Shuang Zheng , Qingli Li , Shugong Xu

Advances in AI have introduced several strong models in computational pathology to usher it into the era of multi-modal diagnosis, analysis, and interpretation. However, the current pathology-specific visual language models still lack…

Scientific research follows multi-turn, multi-step workflows that require proactively searching the literature, consulting figures and tables, and integrating evidence across papers to align experimental settings and support reproducible…

Computation and Language · Computer Science 2026-04-08 Xuan Dong , Huanyang Zheng , Tianhao Niu , Zhe Han , Pengzhan Li , Bofei Liu , Zhengyang Liu , Guancheng Li , Qingfu Zhu , Wanxiang Che

Whole-slide image visual question answering (WSI-VQA) frames pathology as an extreme-context search problem: to answer a free-form clinical query, a system must first navigate a gigapixel slide under a strict inspection budget to locate…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Chunze Yang , Qidong Liu , Wenjie Zhao , Yue Tang , Jiusong Ge , Di Zhang , Jiashuai Liu , Lei Wu , Junbo Lu , Ni Zhang , Xian Wu , Zeyu Gao , Chen Li