中文
相关论文

相关论文: WSI-LLaVA: A Multimodal Large Language Model for W…

200 篇论文

Whole-slide image (WSI) classification in computational pathology is commonly formulated as slide-level Multiple Instance Learning (MIL) with a single global bag representation. However, slide-level MIL is fundamentally underconstrained:…

Large language models (LLMs) have shown remarkable proficiency in human-level reasoning and generation capabilities, which encourages extensive research on their application in mathematical problem solving. However, current work has been…

计算与语言 · 计算机科学 2025-08-21 Jiahui Gao , Renjie Pi , Jipeng Zhang , Jiacheng Ye , Wanjun Zhong , Yufei Wang , Lanqing Hong , Jianhua Han , Hang Xu , Zhenguo Li , Lingpeng Kong

Large language models (LLMs) have demonstrated impressive reasoning capabilities, particularly in textual mathematical problem-solving. However, existing open-source image instruction fine-tuning datasets, containing limited question-answer…

计算与语言 · 计算机科学 2024-10-10 Wenhao Shi , Zhiqiang Hu , Yi Bin , Junhua Liu , Yang Yang , See-Kiong Ng , Lidong Bing , Roy Ka-Wei Lee

Nucleus detection in histopathology whole slide images (WSIs) is crucial for a broad spectrum of clinical applications. The gigapixel size of WSIs necessitates the use of sliding window methodology for nucleus detection. However, mainstream…

图像与视频处理 · 电气工程与系统科学 2026-02-10 Zhongyi Shui , Honglin Li , Yunlong Zhang , Yuxuan Sun , Yiwen Ye , Pingyi Chen , Ruizhe Guo , Lei Cui , Chenglu Zhu , Lin Yang

Whole slide images (WSIs) pose unique challenges when training deep learning models. They are very large which makes it necessary to break each image down into smaller patches for analysis, image features have to be extracted at multiple…

图像与视频处理 · 电气工程与系统科学 2020-12-02 Ozan Ciga , Tony Xu , Sharon Nofech-Mozes , Shawna Noy , Fang-I Lu , Anne L. Martel

Histopathological image analysis is an essential process for the discovery of diseases such as cancer. However, it is challenging to train CNN on whole slide images (WSIs) of gigapixel resolution considering the available memory capacity.…

图像与视频处理 · 电气工程与系统科学 2019-10-11 Shusuke Takahama , Yusuke Kurose , Yusuke Mukuta , Hiroyuki Abe , Masashi Fukayama , Akihiko Yoshizawa , Masanobu Kitagawa , Tatsuya Harada

In computational pathology, multiple instance learning (MIL) is widely used to circumvent the computational impasse in giga-pixel whole slide image (WSI) analysis. It usually consists of two stages: patch-level feature extraction and…

图像与视频处理 · 电气工程与系统科学 2023-09-21 Beidi Zhao , Wenlong Deng , Zi Han , Li , Chen Zhou , Zuhua Gao , Gang Wang , Xiaoxiao Li

With the increasing integration of Multimodal Large Language Models (MLLMs) into the medical field, comprehensive evaluation of their performance in various medical domains becomes critical. However, existing benchmarks primarily assess…

计算机视觉与模式识别 · 计算机科学 2025-10-15 Chenghanyu Zhang , Zekun Li , Peipei Li , Xing Cui , Shuhan Xia , Weixiang Yan , Yiqiao Zhang , Qianyu Zhuang

Multimodal Aspect-Based Sentiment Analysis (MABSA) aims to extract aspect terms and their corresponding sentiment polarities from multimodal information, including text and images. While traditional supervised learning methods have shown…

计算与语言 · 计算机科学 2024-11-26 Shezheng Song

Accurate analysis of histopathological images is critical for disease diagnosis and treatment planning. Whole-slide images (WSIs), which digitize tissue specimens at gigapixel resolution, are fundamental to this process but require…

计算机视觉与模式识别 · 计算机科学 2026-05-07 Enhui Chai , Sicheng Chen , Tianyi Zhang , Chad Wong , Kecheng Huang , Zeyu Liu , Fei Xia

Recent rapid progress in the field of computational pathology has been enabled by foundation models. These models are beginning to move beyond encoding image patches towards whole-slide understanding but their clinical utility remains…

Vision-threatening eye diseases pose a major global health burden, with timely diagnosis limited by workforce shortages and restricted access to specialized care. While multimodal large language models (MLLMs) show promise for medical image…

While multimodal large language models (MLLMs) have made significant strides in natural image understanding, their ability to perceive and reason over hyperspectral image (HSI) remains underexplored, which is a vital modality in remote…

Purpose: This study aimed to develop an open-source multimodal large language model (CXR-LLAVA) for interpreting chest X-ray images (CXRs), leveraging recent advances in large language models (LLMs) to potentially replicate the image…

计算与语言 · 计算机科学 2024-01-17 Seowoo Lee , Jiwon Youn , Hyungjin Kim , Mansu Kim , Soon Ho Yoon

Peripheral Blood Smear (PBS) is a critical microscopic examination in hematopathology that yields whole-slide imaging (WSI). Unlike solid tissue pathology, PBS interpretation focuses on individual cell morphologies rather than tissue…

计算机视觉与模式识别 · 计算机科学 2026-04-21 Yuanlong Wang , Weichi Chen , Adrian Rajab , Wenfang Liu , Yulan Jin , Andrew Srisuwananukorn , Ping Zhang

Accurate prediction of placental diseases via whole slide images (WSIs) is critical for preventing severe maternal and fetal complications. However, WSI analysis presents significant computational challenges due to the massive data volume.…

计算机视觉与模式识别 · 计算机科学 2025-08-06 Hang Guo , Qing Zhang , Zixuan Gao , Siyuan Yang , Shulin Peng , Xiang Tao , Ting Yu , Yan Wang , Qingli Li

While Large Language Models (LLMs) are emerging as a promising direction in computational pathology, the substantial computational cost of giga-pixel Whole Slide Images (WSIs) necessitates the use of Multi-Instance Learning (MIL) to enable…

计算机视觉与模式识别 · 计算机科学 2025-11-12 Zhenfeng Zhuang , Fangyu Zhou , Liansheng Wang

Pathology images are considered the ``gold standard" for cancer diagnosis and treatment, with gigapixel images providing extensive tissue and cellular information. Existing methods fail to simultaneously extract global structural and local…

计算机视觉与模式识别 · 计算机科学 2025-02-17 Haoming Luo , Xiaotian Yu , Shengxuming Zhang , Jiabin Xia , Yang Jian , Yuning Sun , Liang Xue , Mingli Song , Jing Zhang , Xiuming Zhang , Zunlei Feng

Large Vision-Language Models (LVLMs) show significant strides in general-purpose multimodal applications such as visual dialogue and embodied navigation. However, existing multimodal evaluation benchmarks cover a limited number of…

Histopathology Whole-Slide Images (WSIs) provide an important tool to assess cancer prognosis in computational pathology (CPATH). While existing survival analysis (SA) approaches have made exciting progress, they are generally limited to…

计算机视觉与模式识别 · 计算机科学 2025-02-12 Pei Liu , Luping Ji , Jiaxiang Gou , Bo Fu , Mao Ye