English
Related papers

Related papers: Medical Transformer: Universal Brain Encoder for 3…

200 papers

Purpose: Conventional automated segmentation of the head anatomy in MRI distinguishes different brain and non-brain tissues based on image intensities and prior tissue probability maps (TPM). This works well for normal head anatomies, but…

Image and Video Processing · Electrical Eng. & Systems 2021-05-20 Lukas Hirsch , Yu Huang , Lucas C Parra

In this work we introduce a novel medical image style transfer method, StyleMapper, that can transfer medical scans to an unseen style with access to limited training data. This is made possible by training our model on unlimited…

Image and Video Processing · Electrical Eng. & Systems 2024-02-08 Shixing Cao , Nicholas Konz , James Duncan , Maciej A. Mazurowski

In the past few years, convolutional neural networks (CNNs), particularly U-Net, have been the prevailing technique in the medical image processing era. Specifically, the seminal U-Net, as well as its alternatives, have successfully managed…

Computer Vision and Pattern Recognition · Computer Science 2022-07-28 Reza Azad , Mohammad T. AL-Antary , Moein Heidari , Dorit Merhof

Image-to-fMRI encoding is important for both neuroscience research and practical applications. However, such "Brain-Encoders" have been typically trained per-subject and per fMRI-dataset, thus restricted to very limited training data. In…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Roman Beliy , Navve Wasserman , Amit Zalcher , Michal Irani

Deep neural networks have been a prevailing technique in the field of medical image processing. However, the most popular convolutional neural networks (CNNs) based methods for medical image segmentation are imperfect because they model…

Computer Vision and Pattern Recognition · Computer Science 2022-05-02 Zhuangzhuang Zhang , Weixiong Zhang

The Segment Anything Model (SAM), originally built on a 2D Vision Transformer (ViT), excels at capturing global patterns in 2D natural images but struggles with 3D medical imaging modalities like CT and MRI. These modalities require…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Xiang Gao , Kai Lu

In volume-to-volume translations in medical images, existing models often struggle to capture the inherent volumetric distribution using 3D voxelspace representations, due to high computational dataset demands. We present Score-Fusion, a…

Computer Vision and Pattern Recognition · Computer Science 2025-02-10 Xiyue Zhu , Dou Hoon Kwark , Ruike Zhu , Kaiwen Hong , Yiqi Tao , Shirui Luo , Yudu Li , Zhi-Pei Liang , Volodymyr Kindratenko

Vision transformers are effective deep learning models for vision tasks, including medical image segmentation. However, they lack efficiency and translational invariance, unlike convolutional neural networks (CNNs). To model long-range…

Image and Video Processing · Electrical Eng. & Systems 2023-08-15 Liam Chalcroft , Ruben Lourenço Pereira , Mikael Brudfors , Andrew S. Kayser , Mark D'Esposito , Cathy J. Price , Ioannis Pappas , John Ashburner

We propose a registration algorithm for 2D CT/MRI medical images with a new unsupervised end-to-end strategy using convolutional neural networks. The contributions of our algorithm are threefold: (1) We transplant traditional image…

Computer Vision and Pattern Recognition · Computer Science 2018-01-23 Siyuan Shan , Wen Yan , Xiaoqing Guo , Eric I-Chao Chang , Yubo Fan , Yan Xu

One of the most common tasks in medical imaging is semantic segmentation. Achieving this segmentation automatically has been an active area of research, but the task has been proven very challenging due to the large variation of anatomy…

Computer Vision and Pattern Recognition · Computer Science 2018-04-10 Holger R. Roth , Chen Shen , Hirohisa Oda , Masahiro Oda , Yuichiro Hayashi , Kazunari Misawa , Kensaku Mori

Transformers have become a common foundation across deep learning, yet 3D scene understanding still relies on specialized backbones with strong domain priors. This keeps the field isolated from the broader Transformer ecosystem, limiting…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Kadir Yilmaz , Adrian Kruse , Tristan Höfer , Daan de Geus , Bastian Leibe

As a classic statistical model of 3D facial shape and texture, 3D Morphable Model (3DMM) is widely used in facial analysis, e.g., model fitting, image synthesis. Conventional 3DMM is learned from a set of well-controlled 2D face images with…

Computer Vision and Pattern Recognition · Computer Science 2018-08-28 Luan Tran , Xiaoming Liu

Machine learning using transformers has shown great potential in medical imaging, but its real-world applicability remains limited due to the scarcity of annotated data. In this study, we propose a practical framework for the few-shot…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Mengyu Li , Guoyao Shen , Chad W. Farris , Xin Zhang

Objective: Transformers, born to remedy the inadequate receptive fields of CNNs, have drawn explosive attention recently. However, the daunting computational complexity of global representation learning, together with rigid window…

Computer Vision and Pattern Recognition · Computer Science 2023-04-20 Xian Lin , Li Yu , Kwang-Ting Cheng , Zengqiang Yan

In medical image analysis, transfer learning is a powerful method for deep neural networks (DNNs) to generalize well on limited medical data. Prior efforts have focused on developing pre-training algorithms on domains such as lung…

Computer Vision and Pattern Recognition · Computer Science 2023-05-30 Yixiong Chen , Li Liu , Jingxian Li , Hua Jiang , Chris Ding , Zongwei Zhou

Tumor segmentation from multi-modal brain MRI images is a challenging task due to the limited samples, high variance in shapes and uneven distribution of tumor morphology. The performance of automated medical image segmentation has been…

Image and Video Processing · Electrical Eng. & Systems 2024-02-13 Tianyi Ren , Ethan Honey , Harshitha Rebala , Abhishek Sharma , Agamdeep Chopra , Mehmet Kurt

Deep learning affords enormous opportunities to augment the armamentarium of biomedical imaging, albeit its design and implementation have potential flaws. Fundamentally, most deep learning models are driven entirely by data without…

Computer Vision and Pattern Recognition · Computer Science 2021-05-26 Liyue Shen , Wei Zhao , Dante Capaldi , John Pauly , Lei Xing

The growing use of Machine Learning has produced significant advances in many fields. For image-based tasks, however, the use of deep learning remains challenging in small datasets. In this article, we review, evaluate and compare the…

Machine Learning · Computer Science 2021-06-09 Miguel Romero , Yannet Interian , Timothy Solberg , Gilmer Valdes

Astounding results from Transformer models on natural language tasks have intrigued the vision community to study their application to computer vision problems. Among their salient benefits, Transformers enable modeling long dependencies…

Computer Vision and Pattern Recognition · Computer Science 2022-01-20 Salman Khan , Muzammal Naseer , Munawar Hayat , Syed Waqas Zamir , Fahad Shahbaz Khan , Mubarak Shah

The success of the transformer architecture in natural language processing has recently triggered attention in the computer vision field. The transformer has been used as a replacement for the widely used convolution operators, due to its…

Computer Vision and Pattern Recognition · Computer Science 2022-08-09 Jean Lahoud , Jiale Cao , Fahad Shahbaz Khan , Hisham Cholakkal , Rao Muhammad Anwer , Salman Khan , Ming-Hsuan Yang