English
Related papers

Related papers: Local Attention Graph-based Transformer for Multi-…

200 papers

Multiple instance learning (MIL) is the standard approach for whole-slide image (WSI) classification and survival prediction, where attention-based models ag gregate patch features into slide-level predictions. These models treat attention…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Xiangyu Li , Ran Su

Recently, Transformers have shown promising performance in various vision tasks. A challenging issue in Transformer design is that global self-attention is very expensive to compute, especially for the high-resolution vision tasks. Local…

Computer Vision and Pattern Recognition · Computer Science 2022-11-15 Zhemin Zhang , Xun Gong

A new multi-attention based method for solving the MIL problem (MAMIL), which takes into account the neighboring patches or instances of each analyzed patch in a bag, is proposed. In the method, one of the attention modules takes into…

Machine Learning · Computer Science 2021-12-14 Andrei V. Konstantinov , Lev V. Utkin

Over the past decade, Deep Convolutional Neural Networks have been widely adopted for medical image segmentation and shown to achieve adequate performance. However, due to the inherent inductive biases present in the convolutional…

Computer Vision and Pattern Recognition · Computer Science 2021-07-08 Jeya Maria Jose Valanarasu , Poojan Oza , Ilker Hacihaliloglu , Vishal M. Patel

Whole Slide Image (WSI) classification relies on Multiple Instance Learning (MIL) with spatial patch features, yet existing methods struggle to capture global dependencies due to the immense size of WSIs and the local nature of patch…

Computer Vision and Pattern Recognition · Computer Science 2025-10-22 Anthony Bilic , Guangyu Sun , Ming Li , Md Sanzid Bin Hossain , Yu Tian , Wei Zhang , Laura Brattain , Dexter Hadley , Chen Chen

Transformers have demonstrated great potential in computer vision tasks. To avoid dense computations of self-attentions in high-resolution visual data, some recent Transformer models adopt a hierarchical design, where self-attentions are…

Computer Vision and Pattern Recognition · Computer Science 2021-07-13 Jinpeng Li , Yichao Yan , Shengcai Liao , Xiaokang Yang , Ling Shao

Whole slide images (WSIs) are gigapixel-scale digital images of H\&E-stained tissue samples widely used in pathology. The substantial size and complexity of WSIs pose unique analytical challenges. Multiple Instance Learning (MIL) has…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Jun Wang , Yu Mao , Nan Guan , Chun Jason Xue

Previous works on multi-label image recognition (MLIR) usually use CNNs as a starting point for research. In this paper, we take pure Vision Transformer (ViT) as the research base and make full use of the advantages of Transformer with…

Computer Vision and Pattern Recognition · Computer Science 2022-04-25 Yunqing Hu , Xuan Jin , Yin Zhang , Haiwen Hong , Jingfeng Zhang , Feihu Yan , Yuan He , Hui Xue

Whole Slide Image (WSI) analysis is a powerful method to facilitate the diagnosis of cancer in tissue samples. Automating this diagnosis poses various issues, most notably caused by the immense image resolution and limited annotations. WSIs…

Computer Vision and Pattern Recognition · Computer Science 2023-04-19 Ahmet Gokberk Gul , Oezdemir Cetin , Christoph Reich , Tim Prangemeier , Nadine Flinner , Heinz Koeppl

Advances in medical imaging and deep learning have propelled progress in whole slide image (WSI) analysis, with multiple instance learning (MIL) showing promise for efficient and accurate diagnostics. However, conventional MIL models often…

Computer Vision and Pattern Recognition · Computer Science 2025-05-19 Xianrui Li , Yufei Cui , Jun Li , Antoni B. Chan

The self-attention module is a key component of Transformer-based models, wherein each token pays attention to every other token. Recent studies have shown that these heads exhibit syntactic, semantic, or local behaviour. Some studies have…

Computation and Language · Computer Science 2020-08-14 Madhura Pande , Aakriti Budhraja , Preksha Nema , Pratyush Kumar , Mitesh M. Khapra

Multiple instance learning (MIL) has become the leading approach for extracting discriminative features from whole slide images (WSIs) in computational pathology. Attention-based MIL methods can identify key patches but tend to overlook…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Lubin Gan , Xiaoman Wu , Jing Zhang , Zhifeng Wang , Linhao Qu , Siying Wu , Xiaoyan Sun

Medical imaging is a key component in clinical diagnosis, treatment planning and clinical trial design, accounting for almost 90% of all healthcare data. CNNs achieved performance gains in medical image analysis (MIA) over the last years.…

Computer Vision and Pattern Recognition · Computer Science 2024-02-13 Giorgos Papanastasiou , Nikolaos Dikaios , Jiahao Huang , Chengjia Wang , Guang Yang

Attention-based multiple instance learning (MIL) has emerged as a powerful framework for whole slide image (WSI) diagnosis, leveraging attention to aggregate instance-level features into bag-level predictions. Despite this success, we find…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Linfeng Ye , Shayan Mohajer Hamidi , Zhixiang Chi , Guang Li , Mert Pilanci , Takahiro Ogawa , Miki Haseyama , Konstantinos N. Plataniotis

Multiple Instance Learning (MIL) offers a natural solution for settings where only coarse, bag-level labels are available, without having access to instance-level annotations. This is usually the case in digital pathology, which consists of…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Andreas Lolos , Stergios Christodoulidis , Aris L. Moustakas , Jose Dolz , Maria Vakalopoulou

Recently Transformer-based hyperspectral image (HSI) change detection methods have shown remarkable performance. Nevertheless, existing attention mechanisms in Transformers have limitations in local feature representation. To address this…

Image and Video Processing · Electrical Eng. & Systems 2024-11-22 Ziyi Wang , Feng Gao , Junyu Dong , Qian Du

Multi-modal data comprising imaging (MRI, fMRI, PET, etc.) and non-imaging (clinical test, demographics, etc.) data can be collected together and used for disease prediction. Such diverse data gives complementary information about the…

Machine Learning · Computer Science 2018-12-27 Anees Kazi , S. Arvind krishna , Shayan Shekarforoush , Karsten Kortuem , Shadi Albarqouni , Nassir Navab

The paradigm of Transformers using the self-attention mechanism has manifested its advantage in learning graph-structured data. Yet, Graph Transformers are capable of modeling full range dependencies but are often deficient in extracting…

Machine Learning · Computer Science 2024-09-11 Minhong Zhu , Zhenhao Zhao , Weiran Cai

We propose an extension to the transformer neural network architecture for general-purpose graph learning by adding a dedicated pathway for pairwise structural information, called edge channels. The resultant framework - which we call…

Machine Learning · Computer Science 2022-06-06 Md Shamim Hussain , Mohammed J. Zaki , Dharmashankar Subramanian

We consider training classifiers for 3D medical images using only one binary label for the entire volume rather than a label for each 2D slice. In such weakly supervised settings, can we learn accurate classifiers for slice-level…

Machine Learning · Computer Science 2026-05-27 Ethan Harvey , Dennis Johan Loevlie , Michael C. Hughes