English
Related papers

Related papers: PathFound: An Agentic Multimodal Model Activating …

200 papers

Engineered image-based biomarkers offer a clinically interpretable alternative to black-box AI in computational pathology, yet their discovery remains largely intuition-driven, guided by fragmented literature rather than rigorous biological…

Vision-Language Models (VLMs) are advancing computational pathology with superior visual understanding capabilities. However, current systems often reduce diagnosis to directly output conclusions without verifiable evidence-linked…

Computer Vision and Pattern Recognition · Computer Science 2026-01-30 Songhan Jiang , Fengchun Liu , Ziyue Wang , Linghan Cai , Yongbing Zhang

Clinical diagnosis is a complex reasoning process in which clinicians gather evidence, form hypotheses, and test them against alternative explanations. In medical training, this reasoning is explicitly developed through counterfactual…

Computation and Language · Computer Science 2026-04-24 Zhiwen You , Xi Chen , Aniket Vashishtha , Simo Du , Gabriel Erion-Barner , Hongyuan Mei , Hao Peng , Yue Guo

Analytical information needs, such as trend analysis and causal impact assessment, are prevalent across various domains including law, finance, science, and much more. However, existing information retrieval paradigms, whether based on…

Information Retrieval · Computer Science 2026-02-13 Yiteng Tu , Shuo Miao , Weihang Su , Yiqun Liu , Qingyao Ai

Whole slide images (WSIs) enable weakly supervised prognostic modeling via multiple instance learning (MIL). Spatial transcriptomics (ST) preserves in situ gene expression, providing a spatial molecular context that complements morphology.…

Computer Vision and Pattern Recognition · Computer Science 2026-02-16 Lihe Liu , Xiaoxi Pan , Yinyin Yuan , Lulu Shang

In computational pathology, several foundation models have recently emerged and demonstrated enhanced learning capability for analyzing pathology images. However, adapting these models to various downstream tasks remains challenging,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Jeaung Lee , Jeewoo Lim , Keunho Byeon , Jin Tae Kwak

The increasing realism of AI-Generated Images (AIGI) has created an urgent need for forensic tools capable of reliably distinguishing synthetic content from authentic imagery. Existing detectors are typically tailored to specific forgery…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Yangxin Yu , Yue Zhou , Bin Li , Kaiqing Lin , Haodong Li , Jiangqun Ni , Bo Cao

Pre-trained multimodal models have achieved significant success in retrieval-based question answering. However, current multimodal retrieval question-answering models face two main challenges. Firstly, utilizing compressed evidence features…

Artificial Intelligence · Computer Science 2023-10-17 Shuwen Yang , Anran Wu , Xingjiao Wu , Luwei Xiao , Tianlong Ma , Cheng Jin , Liang He

Model-based approaches for image reconstruction, analysis and interpretation have made significant progress over the last decades. Many of these approaches are based on either mathematical, physical or biological models. A challenge for…

Computer Vision and Pattern Recognition · Computer Science 2019-10-01 Daniel Rueckert , Julia A. Schnabel

To evaluate the translational capabilities of foundation models, we develop a pathological concept learning approach focused on kidney cancer. By leveraging TNM staging guidelines and pathology reports, we build comprehensive pathological…

Artificial Intelligence · Computer Science 2025-10-01 Shangqi Gao , Sihan Wang , Yibo Gao , Boming Wang , Xiahai Zhuang , Anne Warren , Grant Stewart , James Jones , Mireia Crispin-Ortuzar

Research agents have recently achieved significant progress in information seeking and synthesis across heterogeneous textual and visual sources. In this paper, we introduce MuSEAgent, a multimodal reasoning agent that enhances…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Shijian Wang , Jiarui Jin , Runhao Fu , Zexuan Yan , Xingjian Wang , Mengkang Hu , Eric Wang , Xiaoxi Li , Kangning Zhang , Li Yao , Wenxiang Jiao , Xuelian Cheng , Yuan Lu , Zongyuan Ge

Current multi-instance learning algorithms for pathology image analysis often require a substantial number of Whole Slide Images for effective training but exhibit suboptimal performance in scenarios with limited learning data. In clinical…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Linhao Qu , Dingkang Yang , Dan Huang , Qinhao Guo , Rongkui Luo , Shaoting Zhang , Xiaosong Wang

Multimodal neuroimaging provides complementary insights for Alzheimer's disease diagnosis, yet clinical datasets frequently suffer from missing modalities. We propose ACADiff, a framework that synthesizes missing brain imaging modalities…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Rong Zhou , Houliang Zhou , Yao Su , Brian Y. Chen , Yu Zhang , Lifang He , Alzheimer's Disease Neuroimaging Initiative

Foundation models have indeed made a profound impact on various fields, emerging as pivotal components that significantly shape the capabilities of intelligent systems. In the context of intelligent vehicles, leveraging the power of…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Sheng Luo , Wei Chen , Wanxin Tian , Rui Liu , Luanxuan Hou , Xiubao Zhang , Haifeng Shen , Ruiqi Wu , Shuyi Geng , Yi Zhou , Ling Shao , Yi Yang , Bojun Gao , Qun Li , Guobin Wu

Multimodal AI models are increasingly used in fields like healthcare, finance, and autonomous driving, where information is drawn from multiple sources or modalities such as images, texts, audios, videos. However, effectively managing…

Machine Learning · Computer Science 2025-05-16 Grigor Bezirganyan , Sana Sellami , Laure Berti-Équille , Sébastien Fournier

Ultrasound interpretation requires both precise lesion localization and holistic clinical reasoning, yet existing methods typically excel at only one of these capabilities: specialized detectors offer strong localization but limited…

Computer Vision and Pattern Recognition · Computer Science 2026-05-01 Jing Zhang , Wentao Jiang , Tao Huang , Zhiwei Wang , Jianxin Liu , Jian Chen , Ping Ye , Gang Wang , Zengmao Wang , Bo Du , Dacheng Tao

With recent advancements in large language models, methods like chain-of-thought prompting to elicit reasoning chains have been shown to improve results on reasoning tasks. However, tasks that require multiple steps of reasoning still pose…

Computation and Language · Computer Science 2023-12-13 Olga Golovneva , Sean O'Brien , Ramakanth Pasunuru , Tianlu Wang , Luke Zettlemoyer , Maryam Fazel-Zarandi , Asli Celikyilmaz

Medical imaging research is increasingly shifting from controlled benchmark evaluation toward real-world clinical deployment. In such settings, applying analytical methods extends beyond model design to require dataset-aware workflow…

Foundation models, large-scale, pre-trained deep-learning models adapted to a wide range of downstream tasks have gained significant interest lately in various deep-learning problems undergoing a paradigm shift with the rise of these…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Bobby Azad , Reza Azad , Sania Eskandari , Afshin Bozorgpour , Amirhossein Kazerouni , Islem Rekik , Dorit Merhof

Trustworthy clinical AI requires that performance gains reflect genuine evidence integration rather than surface-level artifacts. We evaluate 12 open-weight vision-language models (VLMs) on binary classification across two clinical…

Artificial Intelligence · Computer Science 2026-03-31 Doan Nam Long Vu , Simone Balloccu