中文
相关论文

相关论文: ViLa-MIL: Dual-scale Vision-Language Multiple Inst…

200 篇论文

Multiple Instance Learning (MIL) gains popularity in many real-life machine learning applications due to its weakly supervised nature. However, the corresponding effort on explaining MIL lags behind, and it is usually limited to presenting…

Modular vision-language models (Vision-LLMs) align pretrained image encoders with (frozen) large language models (LLMs) and post-hoc condition LLMs to `understand' the image input. With the abundance of readily available high-quality…

计算机视觉与模式识别 · 计算机科学 2024-06-21 Gregor Geigle , Abhay Jain , Radu Timofte , Goran Glavaš

Weakly supervised whole slide image classification is usually formulated as a multiple instance learning (MIL) problem, where each slide is treated as a bag, and the patches cut out of it are treated as instances. Existing methods either…

计算机视觉与模式识别 · 计算机科学 2024-05-14 Linhao Qu , Yingfan Ma , Xiaoyuan Luo , Manning Wang , Zhijian Song

In Large Visual Language Models (LVLMs), the efficacy of In-Context Learning (ICL) remains limited by challenges in cross-modal interactions and representation disparities. To overcome these challenges, we introduce a novel Visual…

计算机视觉与模式识别 · 计算机科学 2024-02-20 Yucheng Zhou , Xiang Li , Qianning Wang , Jianbing Shen

Whole Slide Image (WSI) classification is often formulated as a Multiple Instance Learning (MIL) problem. Recently, Vision-Language Models (VLMs) have demonstrated remarkable performance in WSI classification. However, existing methods…

计算机视觉与模式识别 · 计算机科学 2024-04-08 Hao Li , Ying Chen , Yifei Chen , Wenxian Yang , Bowen Ding , Yuchen Han , Liansheng Wang , Rongshan Yu

Multiple instance learning (MIL) has become the leading approach for extracting discriminative features from whole slide images (WSIs) in computational pathology. Attention-based MIL methods can identify key patches but tend to overlook…

计算机视觉与模式识别 · 计算机科学 2025-09-30 Lubin Gan , Xiaoman Wu , Jing Zhang , Zhifeng Wang , Linhao Qu , Siying Wu , Xiaoyan Sun

Survival prediction using whole-slide images (WSIs) is crucial in cancer re-search. Despite notable success, existing approaches are limited by their reliance on sparse slide-level labels, which hinders the learning of discriminative…

计算机视觉与模式识别 · 计算机科学 2025-07-08 Jiaqi Cui , Lu Wen , Yuchen Fei , Bo Liu , Luping Zhou , Dinggang Shen , Yan Wang

Whole slide image (WSI) classification is a critical task in computational pathology, requiring the processing of gigapixel-sized images, which is challenging for current deep-learning methods. Current state of the art methods are based on…

计算机视觉与模式识别 · 计算机科学 2023-10-06 Jingwei Zhang , Saarthak Kapse , Ke Ma , Prateek Prasanna , Joel Saltz , Maria Vakalopoulou , Dimitris Samaras

Multiple Instance Learning (MIL) has been widely used in weakly supervised whole slide image (WSI) classification. Typical MIL methods include a feature embedding part, which embeds the instances into features via a pre-trained feature…

计算机视觉与模式识别 · 计算机科学 2024-08-02 Peijie Qiu , Pan Xiao , Wenhui Zhu , Yalin Wang , Aristeidis Sotiras

Many image restoration (IR) tasks require both pixel-level fidelity and high-level semantic understanding to recover realistic photos with fine-grained details. However, previous approaches often struggle to effectively leverage both the…

计算机视觉与模式识别 · 计算机科学 2025-12-22 Cuixin Yang , Rongkang Dong , Kin-Man Lam

Multiple instance learning (MIL) has become a standard paradigm for the weakly supervised classification of whole slide images (WSIs). However, this paradigm relies on using a large number of labeled WSIs for training. The lack of training…

计算机视觉与模式识别 · 计算机科学 2025-09-10 Minghao Han , Linhao Qu , Dingkang Yang , Xukun Zhang , Xiaoying Wang , Lihua Zhang

Multiple instance learning (MIL) is a robust paradigm for whole-slide pathological image (WSI) analysis, processing gigapixel-resolution images with slide-level labels. As pioneering efforts, attention-based MIL (ABMIL) and its variants are…

计算机视觉与模式识别 · 计算机科学 2024-04-02 Linghan Cai , Shenjin Huang , Ye Zhang , Jinpeng Lu , Yongbing Zhang

Multiple instance learning (MIL) significantly reduced annotation costs via bag-level weak labels for large-scale images, such as histopathological whole slide images (WSIs). However, its adaptability to continual tasks with minimal…

计算机视觉与模式识别 · 计算机科学 2025-07-09 Byung Hyun Lee , Wongi Jeong , Woojae Han , Kyoungbun Lee , Se Young Chun

Vision-Language Models (VLMs) leverage aligned visual encoders to transform images into visual tokens, allowing them to be processed similarly to text by the backbone large language model (LLM). This unified input paradigm enables VLMs to…

计算机视觉与模式识别 · 计算机科学 2025-03-18 Bangzheng Li , Fei Wang , Wenxuan Zhou , Nan Xu , Ben Zhou , Sheng Zhang , Hoifung Poon , Muhao Chen

Recent advances in vision-language models (VLMs) have shown remarkable potential in bridging visual and textual modalities. In computational pathology, domain-specific VLMs, which are pre-trained on extensive histopathology image-text…

计算机视觉与模式识别 · 计算机科学 2025-03-03 Anh Tien Nguyen , Keunho Byeon , Kyungeun Kim , Jin Tae Kwak

In vision-language pre-training (VLP), masked image modeling (MIM) has recently been introduced for fine-grained cross-modal alignment. However, in most existing methods, the reconstruction targets for MIM lack high-level semantics, and…

计算机视觉与模式识别 · 计算机科学 2024-03-04 Haowei Liu , Yaya Shi , Haiyang Xu , Chunfeng Yuan , Qinghao Ye , Chenliang Li , Ming Yan , Ji Zhang , Fei Huang , Bing Li , Weiming Hu

Fine-grained classification of whole slide images (WSIs) is essential in precision oncology, enabling precise cancer diagnosis and personalized treatment strategies. The core of this task involves distinguishing subtle morphological…

计算机视觉与模式识别 · 计算机科学 2025-04-07 Cheng Jin , Luyang Luo , Huangjing Lin , Jun Hou , Hao Chen

Whole slide images (WSIs) are gigapixel-scale digital images of H\&E-stained tissue samples widely used in pathology. The substantial size and complexity of WSIs pose unique analytical challenges. Multiple Instance Learning (MIL) has…

计算机视觉与模式识别 · 计算机科学 2024-08-20 Jun Wang , Yu Mao , Nan Guan , Chun Jason Xue

Multiple instance learning (MIL) is the preferred approach for whole slide image classification. However, most MIL approaches do not exploit the interdependencies of tiles extracted from a whole slide image, which could provide valuable…

计算机视觉与模式识别 · 计算机科学 2021-08-26 Marvin Lerousseau , Maria Vakalopoulou , Eric Deutsch , Nikos Paragios

Whole slide pathology image classification presents challenges due to gigapixel image sizes and limited annotation labels, hindering model generalization. This paper introduces a prompt learning method to adapt large vision-language models…