English
Related papers

Related papers: PathFound: An Agentic Multimodal Model Activating …

200 papers

Remarkable strides in computational pathology have been made in the task-agnostic foundation model that advances the performance of a wide array of downstream clinical tasks. Despite the promising performance, there are still several…

Agentic systems offer a potential path to solve complex clinical tasks through collaboration among specialized agents, augmented by tool use and external knowledge bases. Nevertheless, for chest X-ray (CXR) interpretation, prevailing…

Multiagent Systems · Computer Science 2026-04-16 Kai Zhang , Corey D Barrett , Jangwon Kim , Lichao Sun , Tara Taghavi , Krishnaram Kenthapadi

As advances in large language models (LLMs) and multimodal techniques continue to mature, the development of general-purpose multimodal large language models (MLLMs) has surged, offering significant applications in interpreting natural…

Computer Vision and Pattern Recognition · Computer Science 2024-02-20 Yuxuan Sun , Chenglu Zhu , Sunyi Zheng , Kai Zhang , Lin Sun , Zhongyi Shui , Yunlong Zhang , Honglin Li , Lin Yang

Pathological diagnosis remains the definitive standard for identifying tumors. The rise of multimodal large models has simplified the process of integrating image analysis with textual descriptions. Despite this advancement, the substantial…

Computer Vision and Pattern Recognition · Computer Science 2024-08-14 Xiaomin Wu , Rui Xu , Pengchen Wei , Wenkang Qin , Peixiang Huang , Ziheng Li , Lin Luo

AI tools in pathology have improved screening throughput, standardized quantification, and revealed prognostic patterns that inform treatment. However, adoption remains limited because most systems still lack the human-readable reasoning…

Artificial Intelligence · Computer Science 2025-11-18 Yunqi Hong , Johnson Kao , Liam Edwards , Nein-Tzu Liu , Chung-Yen Huang , Alex Oliveira-Kowaleski , Cho-Jui Hsieh , Neil Y. C. Lin

Pathology foundation models (PFMs) have demonstrated strong representational capabilities through self-supervised pre-training on large-scale, unannotated histopathology image datasets. However, their diverse yet opaque pretraining…

Computer Vision and Pattern Recognition · Computer Science 2025-09-15 Yuxiang Xiao , Yang Hu , Bin Li , Tianyang Zhang , Zexi Li , Huazhu Fu , Jens Rittscher , Kaixiang Yang

Pain is a manifold condition that impacts a significant percentage of the population. Accurate and reliable pain evaluation for the people suffering is crucial to developing effective and advanced pain management protocols. Automatic pain…

Computer Vision and Pattern Recognition · Computer Science 2025-10-10 Stefanos Gkikas , Raul Fernandez Rojas , Manolis Tsiknakis

Molecular property prediction and generative design via deep learning models has been the subject of intense research given its potential to accelerate development of new, high-performance materials. More recently, these workflows have been…

Artificial Intelligence · Computer Science 2024-12-16 Nathaniel H. Park , Tiffany J. Callahan , James L. Hedrick , Tim Erdmann , Sara Capponi

Recent advances in vision language models (VLMs) have enabled broad progress in the general medical field. However, pathology still remains a more challenging subdomain, with current pathology specific VLMs exhibiting limitations in both…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Wenchuan Zhang , Penghao Zhang , Jingru Guo , Tao Cheng , Jie Chen , Shuwan Zhang , Zhang Zhang , Yuhao Yi , Hong Bu

Evaluating the clinical correctness and reasoning fidelity of automatically generated medical imaging reports remains a critical yet unresolved challenge. Existing evaluation methods often fail to capture the structured diagnostic logic…

Artificial Intelligence · Computer Science 2026-01-26 Suzhong Fu , Jingqi Dong , Xuan Ding , Rui Sun , Yiming Yang , Shuguang Cui , Zhen Li

As natural image understanding moves towards the pretrain-finetune era, research in pathology imaging is concurrently evolving. Despite the predominant focus on pretraining pathological foundation models, how to adapt foundation models to…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Jiaxuan Lu , Fang Yan , Xiaofan Zhang , Yue Gao , Shaoting Zhang

Diagnosing and treating skin diseases require advanced visual skills across domains and the ability to synthesize information from multiple imaging modalities. While current deep learning models excel at specific tasks like skin cancer…

Recent agentic search frameworks enable deep research via iterative planning and retrieval, reducing hallucinations and enhancing factual grounding. However, they remain text-centric, overlooking the multimodal evidence that characterizes…

Computation and Language · Computer Science 2026-04-21 Fangda Ye , Zhifei Xie , Yuxin Hu , Yihang Yin , Shurui Huang , Shikai Dong , Jianzhu Bao , Shuicheng Yan

Large Language Model (LLM)-based multi-agent systems (MAS) demonstrate remarkable potential for scientific discovery. Existing approaches, however, often automate scientific discovery using predefined workflows that lack rationality…

Machine Learning · Computer Science 2026-02-10 Yingming Pu , Tao Lin , Hongyu Chen

The emergence of tool-calling-based agent systems introduces a more evidence-driven paradigm for pathology image analysis in contrast to the coarse-grained text-image diagnostic approaches. With the recent large-scale experimental adoption…

Artificial Intelligence · Computer Science 2026-02-24 Haoyang Su , Shaoting Zhang , Xiaosong Wang

Agentic multimodal models should not only comprehend text and images, but also actively invoke external tools, such as code execution environments and web search, and integrate these operations into reasoning. In this work, we introduce…

Computer Vision and Pattern Recognition · Computer Science 2026-03-12 Jack Hong , Chenxiao Zhao , ChengLin Zhu , Weiheng Lu , Guohai Xu , Xing Yu

Modern medicine requires generalised approaches to the synthesis and integration of multimodal data, often at different biological scales, that can be applied to a variety of evidence structures, such as complex disease analyses and…

Quantitative Methods · Quantitative Biology 2019-11-11 Devin Taylor , Simeon Spasov , Pietro Liò

Explanations for AI models in high-stakes domains like medicine often lack verifiability, which can hinder trust. To address this, we propose an interactive agent that produces explanations through an auditable sequence of actions. The…

Artificial Intelligence · Computer Science 2025-11-04 Yuhang Huang , Zekai Lin , Fan Zhong , Lei Liu

The integration of multi-modal data, such as pathological images and genomic data, is essential for understanding cancer heterogeneity and complexity for personalized treatments, as well as for enhancing survival predictions. Despite the…

Quantitative Methods · Quantitative Biology 2023-01-09 Lin Qiu , Aminollah Khormali , Kai Liu

Pathology image segmentation across multiple centers encounters significant challenges due to diverse sources of heterogeneity including imaging modalities, organs, and scanning equipment, whose variability brings representation bias and…

Computer Vision and Pattern Recognition · Computer Science 2025-05-29 Yuan Zhang , Feng Chen , Yaolei Qi , Guanyu Yang , Huazhu Fu