English
Related papers

Related papers: Local Attention Graph-based Transformer for Multi-…

200 papers

Digital pathology based on whole slide images (WSIs) plays a key role in cancer diagnosis and clinical practice. Due to the high resolution of the WSI and the unavailability of patch-level annotations, WSI classification is usually…

Computer Vision and Pattern Recognition · Computer Science 2023-05-02 Litao Yang , Deval Mehta , Sidong Liu , Dwarikanath Mahapatra , Antonio Di Ieva , Zongyuan Ge

Weakly supervised instance labeling using only image-level labels, in lieu of expensive fine-grained pixel annotations, is crucial in several applications including medical image analysis. In contrast to conventional instance segmentation…

Computer Vision and Pattern Recognition · Computer Science 2019-07-31 Jayaraman J. Thiagarajan , Satyananda Kashyap , Alexandros Karagyris

Strongly supervised learning requires detailed knowledge of truth labels at instance levels, and in many machine learning applications this is a major drawback. Multiple instance learning (MIL) is a popular weakly supervised learning method…

Machine Learning · Computer Science 2022-02-18 Saul Fuster , Trygve Eftestøl , Kjersti Engan

Early detection of cancers has been much explored due to its paramount importance in biomedical fields. Among different types of data used to answer this biological question, studies based on T cell receptors (TCRs) are under recent…

Machine Learning · Statistics 2022-08-10 Younghoon Kim , Tao Wang , Danyi Xiong , Xinlei Wang , Seongoh Park

Fine-grained classification of whole slide images (WSIs) is essential in precision oncology, enabling precise cancer diagnosis and personalized treatment strategies. The core of this task involves distinguishing subtle morphological…

Computer Vision and Pattern Recognition · Computer Science 2025-04-07 Cheng Jin , Luyang Luo , Huangjing Lin , Jun Hou , Hao Chen

Whole slide image (WSI) classification is a critical task in computational pathology, requiring the processing of gigapixel-sized images, which is challenging for current deep-learning methods. Current state of the art methods are based on…

Computer Vision and Pattern Recognition · Computer Science 2023-10-06 Jingwei Zhang , Saarthak Kapse , Ke Ma , Prateek Prasanna , Joel Saltz , Maria Vakalopoulou , Dimitris Samaras

Transformer-based models are popularly used in natural language processing (NLP). Its core component, self-attention, has aroused widespread interest. To understand the self-attention mechanism, a direct method is to visualize the attention…

Machine Learning · Computer Science 2021-07-02 Han Shi , Jiahui Gao , Xiaozhe Ren , Hang Xu , Xiaodan Liang , Zhenguo Li , James T. Kwok

\textit{Attention} computes the dependency between representations, and it encourages the model to focus on the important selective features. Attention-based models, such as Transformer and graph attention network (GAT), are widely utilized…

Machine Learning · Computer Science 2021-03-02 Kyungwoo Song , Yohan Jung , Dongjun Kim , Il-Chul Moon

In this paper, we introduce the prior knowledge, multi-scale structure, into self-attention modules. We propose a Multi-Scale Transformer which uses multi-scale multi-head self-attention to capture features from different scales. Based on…

Computation and Language · Computer Science 2019-12-03 Qipeng Guo , Xipeng Qiu , Pengfei Liu , Xiangyang Xue , Zheng Zhang

Multi-Instance Learning (MIL) has shown impressive performance for histopathology whole slide image (WSI) analysis using bags or pseudo-bags. It involves instance sampling, feature representation, and decision-making. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2024-03-14 Tingting Zheng , Kui Jiang , Hongxun Yao

Whole slide image (WSI) classification has emerged as a powerful tool in computational pathology, but remains constrained by domain shifts, e.g., due to different organs, diseases, or institution-specific variations. To address this…

Computer Vision and Pattern Recognition · Computer Science 2025-05-14 Pratibha Kumari , Daniel Reisenbüchler , Afshin Bozorgpour , Nadine S. Schaadt , Friedrich Feuerhake , Dorit Merhof

Multiple Instance learning (MIL) models have been extensively used in pathology to predict biomarkers and risk-stratify patients from gigapixel-sized images. Machine learning problems in medical imaging often deal with rare diseases, making…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Dinkar Juyal , Siddhant Shingi , Syed Ashar Javed , Harshith Padigela , Chintan Shah , Anand Sampat , Archit Khosla , John Abel , Amaro Taylor-Weiner

In this work, we propose a novel methodology for self-supervised learning for generating global and local attention-aware visual features. Our approach is based on training a model to differentiate between specific image transformations of…

Computer Vision and Pattern Recognition · Computer Science 2021-08-03 Trung X. Pham , Rusty John Lloyd Mina , Dias Issa , Chang D. Yoo

Multiple instance learning (MIL) can reduce the need for costly annotation in tasks such as semantic segmentation by weakening the required degree of supervision. We propose a novel MIL formulation of multi-class semantic segmentation…

Computer Vision and Pattern Recognition · Computer Science 2015-04-16 Deepak Pathak , Evan Shelhamer , Jonathan Long , Trevor Darrell

Initially developed for natural language processing (NLP), Transformer model is now widely used for speech processing tasks such as speaker recognition, due to its powerful sequence modeling capabilities. However, conventional…

Audio and Speech Processing · Electrical Eng. & Systems 2022-01-28 Rui Wang , Junyi Ao , Long Zhou , Shujie Liu , Zhihua Wei , Tom Ko , Qing Li , Yu Zhang

Discrete undirected graphical models, also known as Markov Random Fields (MRFs), can flexibly encode probabilistic interactions of multiple variables, and have enjoyed successful applications to a wide range of problems. However, a…

Machine Learning · Computer Science 2021-12-08 Guangyao Zhou , Wolfgang Lehrach , Antoine Dedieu , Miguel Lázaro-Gredilla , Dileep George

Multiple Instance Learning (MIL) represents the predominant framework in Whole Slide Image (WSI) classification, covering aspects such as sub-typing, diagnosis, and beyond. Current MIL models predominantly rely on instance-level features…

Computer Vision and Pattern Recognition · Computer Science 2024-07-26 Heng Fang , Sheng Huang , Wenhao Tang , Luwen Huangfu , Bo Liu

Transformers have become one of the dominant architectures in deep learning, particularly as a powerful alternative to convolutional neural networks (CNNs) in computer vision. However, Transformer training and inference in previous works…

Computer Vision and Pattern Recognition · Computer Science 2021-12-24 Zizheng Pan , Bohan Zhuang , Haoyu He , Jing Liu , Jianfei Cai

Expression of human epidermal growth factor receptor 2 (HER2) is an important biomarker in breast cancer patients who can benefit from cost-effective automatic Hematoxylin and Eosin (H\&E) HER2 scoring. However, developing such scoring…

Computer Vision and Pattern Recognition · Computer Science 2024-11-11 Rawan S. Abdulsadig , Bryan M. Williams , Nikolay Burlutskiy

The great success of Transformer-based models benefits from the powerful multi-head self-attention mechanism, which learns token dependencies and encodes contextual information from the input. Prior work strives to attribute model decisions…

Computation and Language · Computer Science 2021-02-26 Yaru Hao , Li Dong , Furu Wei , Ke Xu