English
Related papers

Related papers: WSI-LLaVA: A Multimodal Large Language Model for W…

200 papers

Spatial intelligence is essential for multimodal large language models (MLLMs) operating in the complex physical world. Existing benchmarks, however, probe only single-image relations and thus fail to assess the multi-image spatial…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Sihan Yang , Runsen Xu , Yiman Xie , Sizhe Yang , Mo Li , Jingli Lin , Chenming Zhu , Xiaochen Chen , Haodong Duan , Xiangyu Yue , Dahua Lin , Tai Wang , Jiangmiao Pang

The machine learning community has witnessed impressive advancements since large language models (LLMs) first appeared. Yet, their massive memory consumption has become a significant roadblock to large-scale training. For instance, a 7B…

Machine Learning · Computer Science 2024-12-30 Rui Pan , Xiang Liu , Shizhe Diao , Renjie Pi , Jipeng Zhang , Chi Han , Tong Zhang

Objective: We develop a computer-aided diagnosis (CAD) system using deep learning approaches for lesion detection and classification on whole-slide images (WSIs) with breast cancer. The deep features being distinguishing in classification…

Image and Video Processing · Electrical Eng. & Systems 2021-08-29 Wei-Wen Hsu , Yongfang Wu , Chang Hao , Yu-Ling Hou , Xiang Gao , Yun Shao , Xueli Zhang , Tao He , Yanhong Tai

Autoregressive models (ARMs) have long dominated the landscape of biomedical vision-language models (VLMs). Recently, masked diffusion models such as LLaDA have emerged as promising alternatives, yet their application in the biomedical…

Computer Vision and Pattern Recognition · Computer Science 2026-02-26 Xuanzhao Dong , Wenhui Zhu , Xiwen Chen , Zhipeng Wang , Peijie Qiu , Shao Tang , Xin Li , Yalin Wang

A Whole Slide Image (WSI) is a high-resolution digital image created by scanning an entire glass slide containing a biological specimen, such as tissue sections or cell samples, at multiple magnifications. These images are digitally…

Prompt learning has emerged as a promising paradigm for adapting pre-trained vision-language models (VLMs) to few-shot whole slide image (WSI) classification by aligning visual features with textual representations, thereby reducing…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Junjie Zhou , Wei Shao , Yagao Yue , Wei Mu , Peng Wan , Qi Zhu , Daoqiang Zhang

Recent advancements in multi-modal large language models (MLLMs) have led to substantial improvements in visual understanding, primarily driven by sophisticated modality alignment strategies. However, predominant approaches prioritize…

Computer Vision and Pattern Recognition · Computer Science 2024-08-29 Jinjin Xu , Liwu Xu , Yuzhe Yang , Xiang Li , Fanyi Wang , Yanchun Xie , Yi-Jie Huang , Yaqian Li

The deployment of computer-aided diagnosis systems for cervical cancer screening using whole slide images (WSIs) faces critical challenges due to domain shifts caused by staining variations across different scanners and imaging…

Image and Video Processing · Electrical Eng. & Systems 2025-03-11 Jiangdong Cai , Haotian Jiang , Zhenrong Shen , Yonghao Li , Honglin Xiong , Lichi Zhang , Qian Wang

Multimodal Large Language Models (MLLMs) have demonstrated robust capabilities in recognizing everyday human activities, yet their potential for analyzing clinically significant involuntary movements in neurological disorders remains…

Computer Vision and Pattern Recognition · Computer Science 2026-05-06 Lina Zhang , Tonmoy Monsoor , Mehmet Efe Lorasdagi , Prateik Sinha , Chong Han , Peizheng Li , Yuan Wang , Jessica Pasqua , Colin McCrimmon , Rajarshi Mazumder , Vwani Roychowdhury

Whole Slide Image (WSI) analysis, with its ability to reveal detailed tissue structures in magnified views, plays a crucial role in cancer diagnosis and prognosis. Due to their giga-sized nature, WSIs require substantial storage and…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Doanh Cao Bui , Jin Tae Kwak

Representation learning for Whole Slide Images (WSIs) is pivotal in developing image-based systems to achieve higher precision in diagnostic pathology. We propose a two-stage framework for WSI representation learning. We sample relevant…

Image and Video Processing · Electrical Eng. & Systems 2020-04-20 Mohammed Adnan , Shivam Kalra , Hamid R. Tizhoosh

Whole Slide Images (WSI), obtained by high-resolution digital scanning of microscope slides at multiple scales, are the cornerstone of modern Digital Pathology. However, they represent a particular challenge to AI-based/AI-mediated analysis…

Computer Vision and Pattern Recognition · Computer Science 2024-04-12 Martim Afonso , Praphulla M. S. Bhawsar , Monjoy Saha , Jonas S. Almeida , Arlindo L. Oliveira

Whole Slide Imaging (WSI) has become a gold standard in cancer diagnosis, inspecting multi-scale information from cellular to tissue levels. Processing an entire WSI directly is infeasible due to GPU memory constraints; thus, Multiple…

Image and Video Processing · Electrical Eng. & Systems 2026-05-08 Tianyi Zhang , Sicheng Chen , Borui Kang , Dankai Liao , Qiaochu Xue , Bochong Zhang , Fei Xia , Zeyu Liu , Yueming Jin

Digital pathology based on whole slide images (WSIs) plays a key role in cancer diagnosis and clinical practice. Due to the high resolution of the WSI and the unavailability of patch-level annotations, WSI classification is usually…

Computer Vision and Pattern Recognition · Computer Science 2023-05-02 Litao Yang , Deval Mehta , Sidong Liu , Dwarikanath Mahapatra , Antonio Di Ieva , Zongyuan Ge

Recent advances in multimodal large language models enable new possibilities for image-based decision support. However, their reliability and operational trade-offs in neuroimaging remain insufficiently understood. We present a…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Katarina Trojachanec Dineva , Stefan Andonov , Ilinka Ivanoska , Ivan Kitanovski , Sasho Gramatikov , Tamara Kostova , Monika Simjanoska Misheva , Kostadin Mishev

Conversation agents powered by large language models are revolutionizing the way we interact with visual data. Recently, large vision-language models (LVLMs) have been extensively studied for both images and videos. However, these studies…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Juseong Jin , Chang Wook Jeong

The emergence of foundation models in computational pathology has transformed histopathological image analysis, with whole slide imaging (WSI) diagnosis being a core application. Traditionally, weakly supervised fine-tuning via multiple…

Computer Vision and Pattern Recognition · Computer Science 2025-03-03 Jiawen Li , Jiali Hu , Qiehe Sun , Renao Yan , Minxi Ouyang , Tian Guan , Anjia Han , Chao He , Yonghong He

Whole Slide Images (WSIs) play a crucial role in accurate cancer diagnosis and prognosis, as they provide tissue details at the cellular level. However, the rapid growth of computational tasks involving WSIs poses significant challenges.…

Computer Vision and Pattern Recognition · Computer Science 2025-10-30 Doanh C. Bui , Hoai Luan Pham , Vu Trung Duong Le , Tuan Hai Vu , Van Duy Tran , Khang Nguyen , Yasuhiko Nakashima

Whole slide image (WSI) classification is a crucial problem for cancer diagnostics in clinics and hospitals. A WSI, acquired at gigapixel size, is commonly tiled into patches and processed by multiple-instance learning (MIL) models.…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Doanh C. Bui , Jin Tae Kwak

We developed a software pipeline for quality control (QC) of histopathology whole slide images (WSIs) that segments various regions, such as blurs of different levels, tissue regions, tissue folds, and pen marks. Given the necessity and…

Image and Video Processing · Electrical Eng. & Systems 2025-06-17 Abhijeet Patil , Garima Jain , Harsh Diwakar , Jay Sawant , Tripti Bameta , Swapnil Rane , Amit Sethi