English
Related papers

Related papers: Multiple Instance Neuroimage Transformer

200 papers

The Transformer structures have been widely used in computer vision and have recently made an impact in the area of medical image registration. However, the use of Transformer in most registration networks is straightforward. These networks…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Haiqiao Wang , Dong Ni , Yi Wang

Multimodal medical imaging integrates diverse data types, such as structural and functional neuroimaging, to provide complementary insights that enhance deep learning predictions and improve outcomes. This study focuses on a neuroimaging…

Image and Video Processing · Electrical Eng. & Systems 2025-06-17 Bi Yuda , Jia Sihan , Gao Yutong , Abrol Anees , Fu Zening , Calhoun Vince

Transformers have recently gained significant attention in the computer vision community. However, the lack of scalability of self-attention mechanisms with respect to image size has limited their wide adoption in state-of-the-art vision…

Computer Vision and Pattern Recognition · Computer Science 2022-09-12 Zhengzhong Tu , Hossein Talebi , Han Zhang , Feng Yang , Peyman Milanfar , Alan Bovik , Yinxiao Li

Whole body magnetic resonance imaging (WB-MRI) is the recommended modality for diagnosis of multiple myeloma (MM). WB-MRI is used to detect sites of disease across the entire skeletal system, but it requires significant expertise and is…

Deep learning has proven very promising for interpreting MRI in brain tumor diagnosis. However, deep learning models suffer from a scarcity of brain MRI datasets for effective training. Self-supervised learning (SSL) models provide…

Image and Video Processing · Electrical Eng. & Systems 2024-11-21 Meryem Altin Karagoz , O. Ufuk Nalbantoglu , Geoffrey C. Fox

Transformer has been applied in the field of computer vision due to its excellent performance in natural language processing, surpassing traditional convolutional neural networks and achieving new state-of-the-art. ViT divides an image into…

Computer Vision and Pattern Recognition · Computer Science 2024-04-23 Yuang Liu , Zhiheng Qiu , Xiaokai Qin

Although multiple instance learning (MIL) methods are widely used for automatic tumor detection on whole slide images (WSI), they suffer from the extreme class imbalance within the small tumor WSIs. This occurs when the tumor comprises only…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Ziyu Su , Mostafa Rezapour , Usama Sajjad , Shuo Niu , Metin Nafi Gurcan , Muhammad Khalid Khan Niazi

Text-to-image (T2I) generation models often struggle with multi-instance synthesis (MIS), where they must accurately depict multiple distinct instances in a single image based on complex prompts detailing individual features. Traditional…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Chunyang Zhang , Zhenhong Sun , Zhicheng Zhang , Junyan Wang , Yu Zhang , Dong Gong , Huadong Mo , Daoyi Dong

The Transformer is a sequence model that forgoes traditional recurrent architectures in favor of a fully attention-based approach. Besides improving performance, an advantage of using attention is that it can also help to interpret a model…

Human-Computer Interaction · Computer Science 2019-06-14 Jesse Vig

Although many recent works have made advancements in the image restoration (IR) field, they often suffer from an excessive number of parameters. Another issue is that most Transformer-based IR methods focus only on either local or global…

Computer Vision and Pattern Recognition · Computer Science 2024-04-19 Haram Choi , Cheolwoong Na , Jihyeon Oh , Seungjae Lee , Jinseop Kim , Subeen Choe , Jeongmin Lee , Taehoon Kim , Jihoon Yang

In digital pathology, the multiple instance learning (MIL) strategy is widely used in the weakly supervised histopathology whole slide image (WSI) classification task where giga-pixel WSIs are only labeled at the slide level. However,…

Image and Video Processing · Electrical Eng. & Systems 2024-03-28 Zhan Shi , Jingwei Zhang , Jun Kong , Fusheng Wang

Although convolutional neural networks (CNNs) showed remarkable results in many vision tasks, they are still strained by simple yet challenging visual reasoning problems. Inspired by the recent success of the Transformer network in computer…

Computer Vision and Pattern Recognition · Computer Science 2021-11-30 Nicola Messina , Giuseppe Amato , Fabio Carrara , Claudio Gennaro , Fabrizio Falchi

Multi-modal brain magnetic resonance imaging (MRI) plays a crucial role in clinical diagnostics by providing complementary information across different imaging modalities. However, a common challenge in clinical practice is missing MRI…

Image and Video Processing · Electrical Eng. & Systems 2025-06-04 Haowen Pang , Weiyan Guo , Chuyang Ye

Multi-modal image registration plays a critical role in precision medicine but faces challenges from non-linear intensity relationships and local optima. While deep learning models enable rapid inference, they often suffer from…

Image and Video Processing · Electrical Eng. & Systems 2026-04-14 Boya Wang , Ruizhe Li , Chao Chen , Xin Chen

Advances in the motor imagery (MI)-based brain-computer interfaces (BCIs) allow control of several applications by decoding neurophysiological phenomena, which are usually recorded by electroencephalography (EEG) using a non-invasive…

Multiple instance learning (MIL) has been successfully applied for whole slide images (WSIs) analysis in computational pathology, enabling a wide range of prediction tasks from tumor subtyping to inferring genetic mutations and multi-omics…

Computer Vision and Pattern Recognition · Computer Science 2024-07-25 Junyu Li , Ye Zhang , Wen Shu , Xiaobing Feng , Yingchun Wang , Pengju Yan , Xiaolin Li , Chulin Sha , Min He

Though multiple instance learning (MIL) has been a foundational strategy in computational pathology for processing whole slide images (WSIs), current approaches are designed for traditional hematoxylin and eosin (H&E) slides rather than…

Image and Video Processing · Electrical Eng. & Systems 2024-11-15 Marc Harary , Eliezer M. Van Allen , William Lotter

Whole Slide Images (WSIs) present a challenging computer vision task due to their gigapixel size and presence of numerous artefacts. Yet they are a valuable resource for patient diagnosis and stratification, often representing the gold…

Computer Vision and Pattern Recognition · Computer Science 2023-10-05 Amaya Gallagher-Syed , Luca Rossi , Felice Rivellese , Costantino Pitzalis , Myles Lewis , Michael Barnes , Gregory Slabaugh

Recent deep learning models have attracted substantial attention in infant brain analysis. These models have performed state-of-the-art performance, such as semi-supervised techniques (e.g., Temporal Ensembling, mean teacher). However,…

Image and Video Processing · Electrical Eng. & Systems 2023-12-25 Afifa Khaled , Ahmed A. Mubarak , Kun He

Standard decoding approaches rely on model-based channel estimation methods to compensate for varying channel effects, which degrade in performance whenever there is a model mismatch. Recently proposed Deep learning based neural decoders…

Signal Processing · Electrical Eng. & Systems 2019-03-07 Yihan Jiang , Hyeji Kim , Himanshu Asnani , Sreeram Kannan