English
Related papers

Related papers: Anatomically-guided masked autoencoder pre-trainin…

200 papers

Videos captured from multiple viewpoints can help in perceiving the 3D structure of the world and benefit computer vision tasks such as action recognition, tracking, etc. In this paper, we present a method for self-supervised learning from…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 Ketul Shah , Robert Crandall , Jie Xu , Peng Zhou , Marian George , Mayank Bansal , Rama Chellappa

Human social behaviors are inherently multimodal necessitating the development of powerful audiovisual models for their perception. In this paper, we present Social-MAE, our pre-trained audiovisual Masked Autoencoder based on an extended…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Hugo Bohy , Minh Tran , Kevin El Haddad , Thierry Dutoit , Mohammad Soleymani

Interpretability is essential for user trust in real-world anomaly detection applications. However, deep learning models, despite their strong performance, often lack transparency. In this work, we study the interpretability of…

We are concerned with the challenge of reliably classifying and assessing intracranial aneurysms using deep learning without compromising clinical transparency. While traditional black-box models achieve high predictive accuracy, their lack…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Toqa Khaled , Ahmad Al-Kabbany

Self-supervised pre-training of image encoders is omnipresent in the literature, particularly following the introduction of Masked autoencoders (MAE). Current efforts attempt to learn object-centric representations from motion in videos. In…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Alexandre Eymaël , Renaud Vandeghen , Anthony Cioppa , Silvio Giancola , Bernard Ghanem , Marc Van Droogenbroeck

Vision Transformers (ViTs) have gained significant popularity in the natural image domain but have been less successful in 3D medical image segmentation. Nevertheless, 3D ViTs are particularly interesting for large medical imaging volumes…

Computer Vision and Pattern Recognition · Computer Science 2025-10-30 Benjamin Jin , Grant Mair , Joanna M. Wardlaw , Maria del C. Valdés Hernández

With the increasing incidence of neurodegenerative diseases such as Alzheimer's Disease (AD), there is a need for further research that enhances detection and monitoring of the diseases. We present MORPHADE (Morphological Autoencoders for…

Image and Video Processing · Electrical Eng. & Systems 2024-07-08 Mehmet Yigit Avci , Emily Chan , Veronika Zimmer , Daniel Rueckert , Benedikt Wiestler , Julia A. Schnabel , Cosmin I. Bercea

Active infrared thermography (AIRT) became a crucial tool in aerospace non-destructive testing (NDT), enabling the detection of hidden defects and anomalies in materials by capturing thermal responses over time. In AIRT, autoencoders are…

Signal Processing · Electrical Eng. & Systems 2025-12-30 Mohammed Salah , Eman Ouda , Stefano Sfarra , Davor Svetinovic , Yusra Abdulrahman

Accurate identification and quantification of unruptured intracranial aneurysms (UIAs) is crucial for the risk assessment and treatment of this cerebrovascular disorder. Current 2D manual assessment on 3D magnetic resonance angiography…

Image and Video Processing · Electrical Eng. & Systems 2024-03-21 Amirhossein Rasoulian , Arash Harirpoush , Soorena Salari , Yiming Xiao

This paper introduces the Efficient Decoupled Masked Autoencoder (EDMAE), a novel self-supervised method for recognizing standard views in pediatric echocardiography. EDMAE introduces a new proxy task based on the encoder-decoder structure.…

Image and Video Processing · Electrical Eng. & Systems 2023-08-04 Yiman Liu , Xiaoxiang Han , Tongtong Liang , Bin Dong , Jiajun Yuan , Menghan Hu , Qiaohong Liu , Jiangang Chen , Qingli Li , Yuqi Zhang

The hematology analytics used for detection and classification of small blood components is a significant challenge. In particular, when objects exists as small pixel-sized entities in a large context of similar objects. Deep learning…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 H. Martin Gillis , Ming Hill , Paul Hollensen , Alan Fine , Thomas Trappenberg

Autoencoders have been widely used for dimensional reduction and feature extraction. Various types of autoencoders have been proposed by introducing regularization terms. Most of these regularizations improve representation learning by…

Machine Learning · Computer Science 2020-06-26 Yuzhu Guo , Kang Pan , Simeng Li , Zongchang Han , Kexin Wang , Li Li

Medical anomaly detection aims to identify abnormal findings using only normal training data, playing a crucial role in health screening and recognizing rare diseases. Reconstruction-based methods, particularly those utilizing autoencoders…

Machine Learning · Computer Science 2024-07-10 Yu Cai , Hao Chen , Kwang-Ting Cheng

Deep neural networks are powerful tools for biomedical image segmentation. These models are often trained with heavy supervision, relying on pairs of images and corresponding voxel-level labels. However, obtaining segmentations of…

Image and Video Processing · Electrical Eng. & Systems 2020-04-30 Evan M. Yu , Juan Eugenio Iglesias , Adrian V. Dalca , Mert R. Sabuncu

Pathological anomalies exhibit diverse appearances in medical imaging, making it difficult to collect and annotate a representative amount of data required to train deep learning models in a supervised setting. Therefore, in this work, we…

Image and Video Processing · Electrical Eng. & Systems 2023-07-18 Mariana-Iuliana Georgescu

In recent years, deep learning methods such as convolutional neural network (CNN) and transformers have made significant progress in CT multi-organ segmentation. However, CT multi-organ segmentation methods based on masked image modeling…

Computer Vision and Pattern Recognition · Computer Science 2025-04-04 Yunhao Lv , Lingyu Chen , Jian Wang , Yangxi Li , Fang Chen

Featurizing microscopy images for use in biological research remains a significant challenge, especially for large-scale experiments spanning millions of images. This work explores the scaling properties of weakly supervised classifiers and…

Introduction: Deep learning (DL) models can help detect intracranial aneurysms on CTA, but high false positive (FP) rates remain a barrier to clinical translation, despite improvement in model architectures and strategies like detection…

Image and Video Processing · Electrical Eng. & Systems 2025-07-02 Jisoo Kim , Chu-Hsuan Lin , Alberto Ceballos-Arroyo , Ping Liu , Huaizu Jiang , Shrikanth Yadav , Qi Wan , Lei Qin , Geoffrey S Young

Harnessing the power of pre-training on large-scale datasets like ImageNet forms a fundamental building block for the progress of representation learning-driven solutions in computer vision. Medical images are inherently different from…

Computer Vision and Pattern Recognition · Computer Science 2023-08-01 Jeya Maria Jose Valanarasu , Yucheng Tang , Dong Yang , Ziyue Xu , Can Zhao , Wenqi Li , Vishal M. Patel , Bennett Landman , Daguang Xu , Yufan He , Vishwesh Nath

The use of deep learning to undertake shape analysis of the complexities of the human head holds great promise. However, there have traditionally been a number of barriers to accurate modelling, especially when operating on both a global…