English
Related papers

Related papers: WSI-LLaVA: A Multimodal Large Language Model for W…

200 papers

Computational methods on analyzing Whole Slide Images (WSIs) enable early diagnosis and treatments by supporting pathologists in detection and classification of tumors. However, the extremely high resolution of WSIs makes end-to-end…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Umar Marikkar , Muhammad Awais , Sara Atito

Forensic pathology is critical in determining the cause and manner of death through post-mortem examinations, both macroscopic and microscopic. The field, however, grapples with issues such as outcome variability, laborious processes, and a…

Image and Video Processing · Electrical Eng. & Systems 2025-08-12 Chen Shen , Chunfeng Lian , Wanqing Zhang , Fan Wang , Jianhua Zhang , Shuanliang Fan , Xin Wei , Gongji Wang , Kehan Li , Hongshu Mu , Hao Wu , Xinggong Liang , Jianhua Ma , Zhenyuan Wang

Ultrasound is a widely-used imaging modality critical to global healthcare, yet its interpretation remains challenging due to its varying image quality on operators, noises, and anatomical structures. Although large vision-language models…

The prevalence of vision-threatening eye diseases is a significant global burden, with many cases remaining undiagnosed or diagnosed too late for effective treatment. Large vision-language models (LVLMs) have the potential to assist in…

Computer Vision and Pattern Recognition · Computer Science 2025-02-06 Zhenyue Qin , Yu Yin , Dylan Campbell , Xuansheng Wu , Ke Zou , Yih-Chung Tham , Ninghao Liu , Xiuzhen Zhang , Qingyu Chen

Recent advancements in Large Vision-Language Models (LVLMs) have demonstrated remarkable capabilities across diverse tasks, garnering significant attention in AI communities. However, their performance and reliability in specialized domains…

Computer Vision and Pattern Recognition · Computer Science 2025-06-30 Yang Nan , Huichi Zhou , Xiaodan Xing , Guang Yang

Whole Slide Images (WSIs) are critical for various clinical applications, including histopathological analysis. However, current deep learning approaches in this field predominantly focus on individual tumor types, limiting model…

Image and Video Processing · Electrical Eng. & Systems 2024-09-18 Sharon Peled , Yosef E. Maruvka , Moti Freiman

Brain imaging analysis is crucial for diagnosing and treating brain disorders, and multimodal large language models (MLLMs) are increasingly supporting it. However, current brain imaging visual question-answering (VQA) benchmarks either…

Computer Vision and Pattern Recognition · Computer Science 2025-12-29 Zhihao Peng , Cheng Wang , Shengyuan Liu , Zhiying Liang , Zanting Ye , Minjie Ju , PeterYM Woo , Yixuan Yuan

Geometry mathematics problems pose significant challenges for large language models (LLMs) because they involve visual elements and spatial reasoning. Current methods primarily rely on symbolic character awareness to address these problems.…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Shihao Xu , Yiyang Luo , Wei Shi

The rapidly emerging field of deep learning-based computational pathology has demonstrated promise in developing objective prognostic models from histology whole slide images. However, most prognostic models are either based on histology or…

Computer Vision and Pattern Recognition · Computer Science 2021-08-06 Richard J. Chen , Ming Y. Lu , Drew F. K. Williamson , Tiffany Y. Chen , Jana Lipkova , Muhammad Shaban , Maha Shady , Mane Williams , Bumjin Joo , Zahra Noor , Faisal Mahmood

Large Vision-Language Models (LVLMs) have demonstrated remarkable capabilities in processing both visual and textual information. However, the critical challenge of alignment between visual and textual representations is not fully…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Dong Shu , Haiyan Zhao , Jingyu Hu , Weiru Liu , Ali Payani , Lu Cheng , Mengnan Du

While Multimodal Large Language Models (MLLMs) have experienced significant advancement in visual understanding and reasoning, their potential to serve as powerful, flexible, interpretable, and text-driven models for Image Quality…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Tianhe Wu , Kede Ma , Jie Liang , Yujiu Yang , Lei Zhang

Large Language Models (LLMs) have shown promise in various domains, including healthcare, with significant potential to transform mental health applications by enabling scalable and accessible solutions. This study aims to provide a…

Artificial Intelligence · Computer Science 2025-11-25 Abdelrahman Hanafi , Mohammed Saad , Noureldin Zahran , Radwa J. Hanafy , Mohammed E. Fouda

As an alternative to expensive expert evaluation, Image Aesthetic Assessment (IAA) stands out as a crucial task in computer vision. However, traditional IAA methods are typically constrained to a single data source or task, restricting the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Zhaokun Zhou , Qiulin Wang , Bin Lin , Yiwei Su , Rui Chen , Xin Tao , Amin Zheng , Li Yuan , Pengfei Wan , Di Zhang

Large Language Models (LLMs) have shown strong performance in text-based healthcare tasks. However, their utility in image-based applications remains unexplored. We investigate the effectiveness of LLMs for medical imaging tasks,…

Computer Vision and Pattern Recognition · Computer Science 2025-09-16 Felicia Liu , Jay J. Yoo , Farzad Khalvati

Bag-based Multiple Instance Learning (MIL) approaches have emerged as the mainstream methodology for Whole Slide Image (WSI) classification. However, most existing methods adopt a segmented training strategy, which first extracts features…

Computer Vision and Pattern Recognition · Computer Science 2025-03-13 Jiangping Wen , Jinyu Wen , Meie Fang

Vision-Language Models (VLMs) trained on web-scale corpora excel at natural image tasks and are increasingly repurposed for healthcare; however, their competence in medical tasks remains underexplored. We present a comprehensive evaluation…

Computer Vision and Pattern Recognition · Computer Science 2025-07-21 Che Liu , Jiazhen Pan , Weixiang Shen , Wenjia Bai , Daniel Rueckert , Rossella Arcucci

Visual spatial intelligence is critical for medical image interpretation, yet remains largely unexplored in Multimodal Large Language Models (MLLMs) for 3D imaging. This gap persists due to a systemic lack of datasets featuring structured…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Quoc-Huy Trinh , Xi Ding , Yang Liu , Zhenyue Qin , Xingjian Li , Gorkem Durak , Halil Ertugrul Aktas , Elif Keles , Ulas Bagci , Min Xu

Researchers working on computational analysis of Whole Slide Images (WSIs) in histopathology have primarily resorted to patch-based modelling due to large resolution of each WSI. The large resolution makes WSIs infeasible to be fed directly…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 Suvidha Tripathi , Satish Kumar Singh , Hwee Kuan Lee

Supervised deep learning methods have achieved considerable success in medical image analysis, owing to the availability of large-scale and well-annotated datasets. However, creating such datasets for whole slide images (WSIs) in…

Computer Vision and Pattern Recognition · Computer Science 2024-06-10 Hao Wang , Euijoon Ahn , Jinman Kim

Recent breakthroughs in object detection and image classification using Convolutional Neural Networks (CNNs) are revolutionizing the state of the art in medical imaging, and microscopy in particular presents abundant opportunities for…

Image and Video Processing · Electrical Eng. & Systems 2020-07-07 Rui Aguiar , Jon Braatz