English
Related papers

Related papers: Anatomically-guided masked autoencoder pre-trainin…

200 papers

Masked AutoEncoder (MAE) has recently led the trends of visual self-supervision area by an elegant asymmetric encoder-decoder design, which significantly optimizes both the pre-training efficiency and fine-tuning accuracy. Notably, the…

Computer Vision and Pattern Recognition · Computer Science 2022-05-23 Xiang Li , Wenhai Wang , Lingfeng Yang , Jian Yang

Masked Autoencoders (MAEs) have emerged as a powerful pretraining technique for vision foundation models. Despite their effectiveness, they require extensive hyperparameter tuning (masking ratio, patch size, encoder/decoder layers) when…

Computer Vision and Pattern Recognition · Computer Science 2025-08-25 Anthony Bisulco , Rahul Ramesh , Randall Balestriero , Pratik Chaudhari

Deep learning in medical imaging has the potential to minimize the risk of diagnostic errors, reduce radiologist workload, and accelerate diagnosis. Training such deep learning models requires large and accurate datasets, with annotations…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Daniel Wolf , Tristan Payer , Catharina Silvia Lisson , Christoph Gerhard Lisson , Meinrad Beer , Michael Götz , Timo Ropinski

Vast amounts of remote sensing (RS) data provide Earth observations across multiple dimensions, encompassing critical spatial, temporal, and spectral information which is essential for addressing global-scale challenges such as land use…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Lixian Zhang , Yi Zhao , Runmin Dong , Jinxiao Zhang , Shuai Yuan , Shilei Cao , Mengxuan Chen , Juepeng Zheng , Weijia Li , Wei Liu , Wayne Zhang , Litong Feng , Haohuan Fu

In self-supervised learning, it is challenging to reduce the gap between the enhancement performance on the estimated and target speech signals with existed pre-tasks. In this paper, we propose a multi-task pre-training method to improve…

Sound · Computer Science 2022-01-02 Yi Li , Yang Sun , Syed Mohsen Naqvi

This paper studies a simple extension of image-based Masked Autoencoders (MAE) to self-supervised representation learning from audio spectrograms. Following the Transformer encoder-decoder design in MAE, our Audio-MAE first encodes audio…

Vision Transformer (ViT) has become one of the most popular neural architectures due to its great scalability, computational efficiency, and compelling performance in many vision tasks. However, ViT has shown inferior performance to…

Computer Vision and Pattern Recognition · Computer Science 2022-10-25 Junfei Xiao , Yutong Bai , Alan Yuille , Zongwei Zhou

We introduce a novel masked graph autoencoder (MGAE) framework to perform effective learning on graph structure data. Taking insights from self-supervised learning, we randomly mask a large proportion of edges and try to reconstruct these…

Machine Learning · Computer Science 2022-01-10 Qiaoyu Tan , Ninghao Liu , Xiao Huang , Rui Chen , Soo-Hyun Choi , Xia Hu

Building robust medical machine learning systems requires pretraining strategies that exploit the intrinsic structure present in clinical data. We introduce Multiview Masked Autoencoder (MVMAE), a self-supervised framework that leverages…

Vehicle re-identification is a cross-view search task by matching the same target vehicle from different perspectives. It serves an important role in road-vehicle collaboration and intelligent road control. With the large-scale and dynamic…

Computer Vision and Pattern Recognition · Computer Science 2023-02-14 Jing Yang , Jianwu Fang , Hongke Xu

Detecting anomalies for multivariate time-series without manual supervision continues a challenging problem due to the increased scale of dimensions and complexity of today's IT monitoring systems. Recent progress of unsupervised…

Machine Learning · Computer Science 2021-10-19 Qinfeng Xiao , Shikuan Shao , Jing Wang

Masked Autoencoders (MAE) play a pivotal role in learning potent representations, delivering outstanding results across various 3D perception tasks essential for autonomous driving. In real-world driving scenarios, it's commonplace to…

Computer Vision and Pattern Recognition · Computer Science 2024-08-26 Jian Zou , Tianyu Huang , Guanglei Yang , Zhenhua Guo , Tao Luo , Chun-Mei Feng , Wangmeng Zuo

Recent trends in self-supervised representation learning have focused on removing inductive biases from training pipelines. However, inductive biases can be useful in settings when limited data are available or provide additional insight…

Computer Vision and Pattern Recognition · Computer Science 2022-09-09 Kevin Miao , Akash Gokul , Raghav Singh , Suzanne Petryk , Joseph Gonzalez , Kurt Keutzer , Trevor Darrell , Colorado Reed

Purpose: To develop CADIA, a supervised deep learning model based on a region proposal network coupled with a false-positive reduction module for the detection and localization of intracranial aneurysms (IA) from computed tomography…

Image and Video Processing · Electrical Eng. & Systems 2021-12-16 Dufan Wu , Daniel Montes , Ziheng Duan , Yangsibo Huang , Javier M. Romero , Ramon Gilberto Gonzalez , Quanzheng Li

This paper studies masked autoencoder (MAE) video pre-training for various temporal matching-based downstream tasks, i.e., object-level tracking tasks including video object tracking (VOT) and video object segmentation (VOS),…

Computer Vision and Pattern Recognition · Computer Science 2025-04-07 Qiangqiang Wu , Tianyu Yang , Ziquan Liu , Wei Lin , Baoyuan Wu , Antoni B. Chan

Unsupervised Anomaly Detection has become a popular method to detect pathologies in medical images as it does not require supervision or labels for training. Most commonly, the anomaly detection model generates a "normal" version of an…

Image and Video Processing · Electrical Eng. & Systems 2023-09-26 Felix Meissen , Johannes Paetzold , Georgios Kaissis , Daniel Rueckert

The proposed study aimed to develop a deep learning model capable of detecting ventriculomegaly on prenatal ultrasound images. Ventriculomegaly is a prenatal condition characterized by dilated cerebral ventricles of the fetal brain and is…

Image and Video Processing · Electrical Eng. & Systems 2025-11-24 Youssef Megahed , Inok Lee , Robin Ducharme , Aylin Erman , Olivier X. Miguel , Kevin Dick , Adrian D. C. Chan , Steven Hawken , Mark Walker , Felipe Moretti

Recently, self-supervised Masked Autoencoders (MAE) have attracted unprecedented attention for their impressive representation learning ability. However, the pretext task, Masked Image Modeling (MIM), reconstructs the missing local patches,…

Computer Vision and Pattern Recognition · Computer Science 2024-01-23 Feng Liang , Yangguang Li , Diana Marculescu

Self-supervised frameworks for representation learning have recently stirred up interest among the remote sensing community, given their potential to mitigate the high labeling costs associated with curating large satellite image datasets.…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Hugo Chan-To-Hing , Bharadwaj Veeravalli

Human emotion recognition holds a pivotal role in facilitating seamless human-computer interaction. This paper delineates our methodology in tackling the Valence-Arousal (VA) Estimation Challenge, Expression (Expr) Classification Challenge,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Weiwei Zhou , Jiada Lu , Chenkun Ling , Weifeng Wang , Shaowei Liu