English
Related papers

Related papers: PBSBench: A Multi-Level Vision-Language Framework …

200 papers

With the development of medical imaging technology and machine learning, computer-assisted diagnosis which can provide impressive reference to pathologists, attracts extensive research interests. The exponential growth of medical images and…

Computer Vision and Pattern Recognition · Computer Science 2020-10-08 Xiao Kang , Xingbo Liu , Xiushan Nie , Yilong Yin

We investigate a critical yet under-explored question in Large Vision-Language Models (LVLMs): Do LVLMs genuinely comprehend interleaved image-text in the document? Existing document understanding benchmarks often assess LVLMs using…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Haolong Yan , Kaijun Tan , Yeqing Shen , Xin Huang , Zheng Ge , Xiangyu Zhang , Si Li , Daxin Jiang

Multiple Sclerosis (MS) is a chronic autoimmune disease of the central nervous system whose molecular mechanisms remain incompletely understood. In this study, we developed an end-to-end machine learning pipeline to analyze transcriptomic…

The Vision Foundation Model has recently gained attention in medical image analysis. Its zero-shot learning capabilities accelerate AI deployment and enhance the generalizability of clinical applications. However, segmenting pathological…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Can Cui , Ruining Deng , Junlin Guo , Quan Liu , Tianyuan Yao , Haichun Yang , Yuankai Huo

Medical vision-language models (VLMs) have shown promise as clinical assistants across various medical fields. However, specialized dermatology VLM capable of delivering professional and detailed diagnostic analysis remains underdeveloped,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-12 Wenqi Zeng , Yuqi Sun , Chenxi Ma , Weimin Tan , Bo Yan

Radiologists interpret mammography exams by jointly analyzing all four views, as correlations among them are crucial for accurate diagnosis. Recent methods employ dedicated fusion blocks to capture such dependencies, but these are often…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Eleonora Lopez , Eleonora Grassucci , Danilo Comminiello

In the era of modern healthcare, swiftly generating medical question summaries is crucial for informed and timely patient care. Despite the increasing complexity and volume of medical data, existing studies have focused solely on text-based…

Artificial Intelligence · Computer Science 2023-12-20 Akash Ghosh , Arkadeep Acharya , Raghav Jain , Sriparna Saha , Aman Chadha , Setu Sinha

Representation learning of pathology whole-slide images (WSIs) has primarily relied on weak supervision with Multiple Instance Learning (MIL). This approach leads to slide representations highly tailored to a specific clinical task.…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Tim Lenz , Peter Neidlinger , Marta Ligero , Georg Wölflein , Marko van Treeck , Jakob Nikolas Kather

Explainability is a key requirement for computer-aided diagnosis systems in clinical decision-making. Multiple instance learning with attention pooling provides instance-level explainability, however for many clinical applications a deeper,…

Image and Video Processing · Electrical Eng. & Systems 2023-03-16 Ario Sadafi , Oleksandra Adonkina , Ashkan Khakzar , Peter Lienemann , Rudolf Matthias Hehr , Daniel Rueckert , Nassir Navab , Carsten Marr

Computational pathology and whole-slide image (WSI) analysis are pivotal in cancer diagnosis and prognosis. However, the ultra-high resolution of WSIs presents significant modeling challenges. Recent advancements in pathology foundation…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Honglin Li , Zhongyi Shui , Yunlong Zhang , Chenglu Zhu , Lin Yang

Deep learning has been widely applied in neuroimaging, including predicting brain-phenotype relationships from magnetic resonance imaging (MRI) volumes. MRI data usually requires extensive preprocessing prior to modeling, but variation…

Machine Learning · Computer Science 2023-10-17 Xinhui Li , Alex Fedorov , Mrinal Mathur , Anees Abrol , Gregory Kiar , Sergey Plis , Vince Calhoun

The complexity and variability inherent in high-resolution pathological images present significant challenges in computational pathology. While pathology foundation models leveraging AI have catalyzed transformative advancements, their…

Spine disorders affect 619 million people globally and are a leading cause of disability, yet AI-assisted diagnosis remains limited by the lack of level-aware, multimodal datasets. Clinical decision-making for spine disorders requires…

As vision-language models (VLMs) are deployed globally, their ability to understand culturally situated knowledge becomes essential. Yet, existing evaluations largely assess static recall or isolated visual grounding, leaving unanswered…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Bryan Chen Zhengyu Tan , Zheng Weihua , Zhengyuan Liu , Nancy F. Chen , Hwaran Lee , Kenny Tsu Wei Choo , Roy Ka-Wei Lee

The emergence of large multimodal models (LMMs) has brought significant advancements to pathology. Previous research has primarily focused on separately training patch-level and whole-slide image (WSI)-level models, limiting the integration…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Yuxuan Sun , Yixuan Si , Chenglu Zhu , Xuan Gong , Kai Zhang , Pingyi Chen , Ye Zhang , Zhongyi Shui , Tao Lin , Lin Yang

Most organizational data in this world are stored as documents, and visual retrieval plays a crucial role in unlocking the collective intelligence from all these documents. However, existing benchmarks focus on English-only document…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Jian Chen , Ming Li , Jihyung Kil , Chenguang Wang , Tong Yu , Ryan Rossi , Tianyi Zhou , Changyou Chen , Ruiyi Zhang

The integration of AI-assisted biomedical image analysis into clinical practice demands AI-generated findings that are not only accurate but also interpretable to clinicians. However, existing biomedical AI models generally lack the ability…

The previous advancements in pathology image understanding primarily involved developing models tailored to specific tasks. Recent studies has demonstrated that the large vision-language model can enhance the performance of various…

Artificial Intelligence · Computer Science 2024-08-20 Dawei Dai , Yuanhui Zhang , Long Xu , Qianlan Yang , Xiaojing Shen , Shuyin Xia , Guoyin Wang

Pathology image analysis plays a pivotal role in medical diagnosis, with deep learning techniques significantly advancing diagnostic accuracy and research. While numerous studies have been conducted to address specific pathological tasks,…

Image and Video Processing · Electrical Eng. & Systems 2025-03-31 Dankai Liao , Sicheng Chen , Nuwa Xi , Qiaochu Xue , Jieyu Li , Lingxuan Hou , Zeyu Liu , Chang Han Low , Yufeng Wu , Yiling Liu , Yanqin Jiang , Dandan Li , Shangqing Lyu

The ability to use, understand, and create tools is a hallmark of human intelligence, enabling sophisticated interaction with the physical world. For any general-purpose intelligent agent to achieve true versatility, it must also master…

Computer Vision and Pattern Recognition · Computer Science 2025-10-13 Zixin Zhang , Kanghao Chen , Xingwang Lin , Lutao Jiang , Xu Zheng , Yuanhuiyi Lyu , Litao Guo , Yinchuan Li , Ying-Cong Chen