English
Related papers

Related papers: Multiple Instance Neuroimage Transformer

200 papers

Vision Transformers (ViT)s have shown great performance in self-supervised learning of global and local representations that can be transferred to downstream applications. Inspired by these results, we introduce a novel self-supervised…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Yucheng Tang , Dong Yang , Wenqi Li , Holger Roth , Bennett Landman , Daguang Xu , Vishwesh Nath , Ali Hatamizadeh

Although vision Transformers have achieved excellent performance as backbone models in many vision tasks, most of them intend to capture global relations of all tokens in an image or a window, which disrupts the inherent spatial and local…

Computer Vision and Pattern Recognition · Computer Science 2021-12-28 Gang Li , Di Xu , Xing Cheng , Lingyu Si , Changwen Zheng

Vision Transformer (ViT) self-attention mechanism is characterized by feature collapse in deeper layers, resulting in the vanishing of low-level visual features. However, such features can be helpful to accurately represent and identify…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Anxhelo Diko , Danilo Avola , Marco Cascio , Luigi Cinque

Transformers have become one of the dominant architectures in deep learning, particularly as a powerful alternative to convolutional neural networks (CNNs) in computer vision. However, Transformer training and inference in previous works…

Computer Vision and Pattern Recognition · Computer Science 2021-12-24 Zizheng Pan , Bohan Zhuang , Haoyu He , Jing Liu , Jianfei Cai

Magnetic resonance imaging (MRI) is critically important for brain mapping in both scientific research and clinical studies. Precise segmentation of brain tumors facilitates clinical diagnosis, evaluations, and surgical planning. Deep…

Image and Video Processing · Electrical Eng. & Systems 2023-05-01 Rui Nian , Guoyao Zhang , Yao Sui , Yuqi Qian , Qiuying Li , Mingzhang Zhao , Jianhui Li , Ali Gholipour , Simon K. Warfield

Traditional deep learning approaches for breast cancer classification has predominantly concentrated on single-view analysis. In clinical practice, however, radiologists concurrently examine all views within a mammography exam, leveraging…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 Sushmita Sarker , Prithul Sarker , George Bebis , Alireza Tavakkoli

Attention-based models such as transformers have shown outstanding performance on dense prediction tasks, such as semantic segmentation, owing to their capability of capturing long-range dependency in an image. However, the benefit of…

Computer Vision and Pattern Recognition · Computer Science 2022-07-13 Ashutosh Agarwal , Chetan Arora

Whole Slide Image (WSI) analysis is a powerful method to facilitate the diagnosis of cancer in tissue samples. Automating this diagnosis poses various issues, most notably caused by the immense image resolution and limited annotations. WSIs…

Computer Vision and Pattern Recognition · Computer Science 2023-04-19 Ahmet Gokberk Gul , Oezdemir Cetin , Christoph Reich , Tim Prangemeier , Nadine Flinner , Heinz Koeppl

Recent Vision Transformer (ViT)-based methods for Image Super-Resolution have demonstrated impressive performance. However, they suffer from significant complexity, resulting in high inference times and memory usage. Additionally, ViT…

Computer Vision and Pattern Recognition · Computer Science 2024-09-06 Jeongsoo Kim , Jongho Nang , Junsuk Choe

We introduce Iwin Transformer, a novel position-embedding-free hierarchical vision transformer, which can be fine-tuned directly from low to high resolution, through the collaboration of innovative interleaved window attention and depthwise…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Simin Huo , Ning Li

We present Multiscale Multiview Vision Transformers (MMViT), which introduces multiscale feature maps and multiview encodings to transformer models. Our model encodes different views of the input signal and builds several channel-resolution…

Computer Vision and Pattern Recognition · Computer Science 2023-05-02 Yuchen Liu , Natasha Ong , Kaiyan Peng , Bo Xiong , Qifan Wang , Rui Hou , Madian Khabsa , Kaiyue Yang , David Liu , Donald S. Williamson , Hanchao Yu

Unpaired Image-to-image Translation is a new rising and challenging vision problem that aims to learn a mapping between unaligned image pairs in diverse domains. Recent advances in this field like MUNIT and DRIT mainly focus on…

Computer Vision and Pattern Recognition · Computer Science 2019-05-07 Zhiqiang Shen , Mingyang Huang , Jianping Shi , Xiangyang Xue , Thomas Huang

We address the challenging problem of whole slide image (WSI) classification. WSIs have very high resolutions and usually lack localized annotations. WSI classification can be cast as a multiple instance learning (MIL) problem when only…

Computer Vision and Pattern Recognition · Computer Science 2021-04-05 Bin Li , Yin Li , Kevin W. Eliceiri

Whole-slide image (WSI) classification is a challenging task because 1) patches from WSI lack annotation, and 2) WSI possesses unnecessary variability, e.g., stain protocol. Recently, Multiple-Instance Learning (MIL) has made significant…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Joohyung Lee , Heejeong Nam , Kwanhyung Lee , Sangchul Hahn

Whole Slide Images (WSIs) are critical for various clinical applications, including histopathological analysis. However, current deep learning approaches in this field predominantly focus on individual tumor types, limiting model…

Image and Video Processing · Electrical Eng. & Systems 2024-09-18 Sharon Peled , Yosef E. Maruvka , Moti Freiman

The scarcity of annotated medical images is a major bottleneck in developing learning models for medical image analysis. Hence, recent studies have focused on pretrained models with fewer annotation requirements that can be fine-tuned for…

Image and Video Processing · Electrical Eng. & Systems 2024-10-02 Jonghun Kim , Mansu Kim , Hyunjin Park

Since their emergence, Convolutional Neural Networks (CNNs) have made significant strides in medical image analysis. However, the local nature of the convolution operator may pose a limitation for capturing global and long-range…

Image and Video Processing · Electrical Eng. & Systems 2024-04-01 Abdul Rehman Khan , Asifullah Khan

Attention-based models, exemplified by the Transformer, can effectively model long range dependency, but suffer from the quadratic complexity of self-attention operation, making them difficult to be adopted for high-resolution image…

Computer Vision and Pattern Recognition · Computer Science 2021-12-28 Long Zhao , Zizhao Zhang , Ting Chen , Dimitris N. Metaxas , Han Zhang

The current methods for diagnosing Alzheimer Disease using Magnetic Resonance Imaging (MRI) have significant limitations. Many previous studies used 2D Transformers to analyze individual brain slices independently, potentially losing…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Juan A. Castro-Silva , Maria N. Moreno Garcia , Diego H. Peluffo-Ordoñez

We propose a deep network that can be trained to tackle image reconstruction and classification problems that involve detection of multiple object instances, without any supervision regarding their whereabouts. The network learns to extract…

Computer Vision and Pattern Recognition · Computer Science 2020-12-08 Baptiste Angles , Yuhe Jin , Simon Kornblith , Andrea Tagliasacchi , Kwang Moo Yi