English
Related papers

Related papers: Learning Brain Tumor Representation in 3D High-Res…

200 papers

High-dimensional time series are common in many domains. Since human cognition is not optimized to work well in high-dimensional spaces, these areas could benefit from interpretable low-dimensional representations. However, most…

Machine Learning · Computer Science 2019-01-07 Vincent Fortuin , Matthias Hüser , Francesco Locatello , Heiko Strathmann , Gunnar Rätsch

Vision transformers (ViTs) have rapidly gained prominence in medical imaging tasks such as disease classification, segmentation, and detection due to their superior accuracy compared to conventional deep learning models. However, due to…

Computer Vision and Pattern Recognition · Computer Science 2025-07-11 Montasir Shams , Chashi Mahiul Islam , Shaeke Salman , Phat Tran , Xiuwen Liu

Structural magnetic resonance imaging (sMRI) provides accurate estimates of the brain's structural organization and learning invariant brain representations from sMRI is an enduring issue in neuroscience. Previous deep representation…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Ning Jiang , Gongshu Wang , Tianyi Yan

Semantic segmentation of brain tumors is a fundamental medical image analysis task involving multiple MRI imaging modalities that can assist clinicians in diagnosing the patient and successively studying the progression of the malignant…

Image and Video Processing · Electrical Eng. & Systems 2022-01-05 Ali Hatamizadeh , Vishwesh Nath , Yucheng Tang , Dong Yang , Holger Roth , Daguang Xu

The integration of machine learning in magnetic resonance imaging (MRI), specifically in neuroimaging, is proving to be incredibly effective, leading to better diagnostic accuracy, accelerated image analysis, and data-driven insights, which…

The brain is a highly complex organ that manages many important tasks, including movement, memory and thinking. Brain-related conditions, like tumors and degenerative disorders, can be hard to diagnose and treat. Magnetic Resonance Imaging…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Shuvashis Sarker , Shamim Rahim Refat , Faika Fairuj Preotee , Shifat Islam , Tashreef Muhammad , Mohammad Ashraful Hoque

Automation of brain tumors in 3D magnetic resonance images (MRIs) is key to assess the diagnostic and treatment of the disease. In recent years, convolutional neural networks (CNNs) have shown improved results in the task. However, high…

Image and Video Processing · Electrical Eng. & Systems 2020-09-28 Laura Mora Ballestar , Veronica Vilaplana

Interpretability is a critical factor in applying complex deep learning models to advance the understanding of brain disorders in neuroimaging studies. To interpret the decision process of a trained classifier, existing techniques typically…

Image and Video Processing · Electrical Eng. & Systems 2021-06-29 Zixuan Liu , Ehsan Adeli , Kilian M. Pohl , Qingyu Zhao

Capturing long-range dependencies while preserving high-resolution visual representations is crucial for dense prediction tasks such as human pose estimation. Vision Transformers (ViTs) have advanced global modeling through self-attention…

Computer Vision and Pattern Recognition · Computer Science 2025-08-18 Hao Zhang , Yongqiang Ma , Wenqi Shao , Ping Luo , Nanning Zheng , Kaipeng Zhang

Interpretable models are crucial for supporting clinical decision-making, driving advances in their development and application for medical images. However, the nature of 3D volumetric data makes it inherently challenging to visualize and…

Graphics · Computer Science 2025-06-26 Fabian Bongratz , Tom Nuno Wolf , Jaume Gual Ramon , Christian Wachinger

Vision foundation models (FMs) achieve state-of-the-art performance in medical imaging. However, they encode information in abstract latent representations that clinicians cannot interrogate or verify. The goal of this study is to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Philipp Wesp , Robbie Holland , Vasiliki Sideri-Lampretsa , Sergios Gatidis

The rich chemical information from tissue metabolomics provides a powerful means to elaborate tissue physiology or tumor characteristics at cellular and tumor microenvironment levels. However, the process of obtaining such information…

Masked image modelling (MIM) is a powerful self-supervised representation learning paradigm, whose potential has not been widely demonstrated in medical image analysis. In this work, we show the capacity of MIM to capture rich semantic…

Computer Vision and Pattern Recognition · Computer Science 2023-06-30 Piotr Wójcik , Hussein Naji , Adrian Simon , Reinhard Büttner , Katarzyna Bożek

Understanding how the brain encodes visual information is a central challenge in neuroscience and machine learning. A promising approach is to reconstruct visual stimuli, essentially images, from functional Magnetic Resonance Imaging (fMRI)…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Zheng Huang , Enpei Zhang , Weikang Qiu , Yinghao Cai , Carl Yang , Elynn Chen , Xiang Zhang , Rex Ying , Dawei Zhou , Yujun Yan

Breast-Conserving Surgery (BCS) requires precise intraoperative margin assessment to preserve healthy tissue. Deep Ultraviolet Fluorescence Scanning Microscopy (DUV-FSM) offers rapid, high-resolution surface imaging for this purpose;…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Pouya Afshin , David Helminiak , Tianling Niu , Julie M. Jorns , Tina Yen , Bing Yu , Dong Hye Ye

Self-supervised learning has attracted increasing attention as it learns data-driven representation from data without annotations. Vision transformer-based autoencoder (ViT-AE) by He et al. (2021) is a recent self-supervised learning…

Computer Vision and Pattern Recognition · Computer Science 2023-05-17 Chinmay Prabhakar , Hongwei Bran Li , Jiancheng Yang , Suprosana Shit , Benedikt Wiestler , Bjoern Menze

Transformer, which can benefit from global (long-range) information modeling using self-attention mechanisms, has been successful in natural language processing and 2D image classification recently. However, both local and global features…

Computer Vision and Pattern Recognition · Computer Science 2021-06-29 Wenxuan Wang , Chen Chen , Meng Ding , Jiangyun Li , Hong Yu , Sen Zha

Brain tumor diagnosis is largely dependent on Magnetic Resonance Imaging (MRI) evaluation, which requires radiologists to synthesize thousands of images across multiple 3D sequences and longitudinal studies. This process requires advanced…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Shiv Ghosh , Junayd Lateef , Chih-Hua Liu , Yannan Yu , Andreas M. Rauschecker , Madhumita Sushil

For deep reinforcement learning (RL) from pixels, learning effective state representations is crucial for achieving high performance. However, in practice, limited experience and high-dimensional inputs prevent effective representation…

Machine Learning · Computer Science 2022-10-11 Tao Yu , Zhizheng Zhang , Cuiling Lan , Yan Lu , Zhibo Chen

Magnetic resonance imaging (MRI) is an important non-invasive clinical tool that can produce high-resolution and reproducible images. However, a long scanning time is required for high-quality MR images, which leads to exhaustion and…

Image and Video Processing · Electrical Eng. & Systems 2022-04-12 Jiahao Huang , Yingying Fang , Yinzhe Wu , Huanjun Wu , Zhifan Gao , Yang Li , Javier Del Ser , Jun Xia , Guang Yang