English
Related papers

Related papers: A multifractal-based masked auto-encoder: an appli…

200 papers

Wearable devices enable continuous multi-modal physiological and behavioral monitoring, yet analysis of these data streams faces fundamental challenges including the lack of gold-standard labels and incomplete sensor data. While…

Machine Learning · Statistics 2025-09-22 Howon Ryu , Yuliang Chen , Yacun Wang , Andrea Z. LaCroix , Chongzhi Di , Loki Natarajan , Yu Wang , Jingjing Zou

Ultrasound imaging is one of the most widely used diagnostic modalities, offering real-time, radiation-free assessment across diverse clinical domains. However, interpretation of ultrasound images remains challenging due to high noise…

Image and Video Processing · Electrical Eng. & Systems 2025-11-10 Youssef Megahed , Robin Ducharme , Aylin Erman , Mark Walker , Steven Hawken , Adrian D. C. Chan

Masked image modeling (MIM) is a highly popular and effective self-supervised learning method for image understanding. Existing MIM-based methods mostly focus on spatial feature modeling, neglecting spectral feature modeling. Meanwhile,…

Image and Video Processing · Electrical Eng. & Systems 2023-11-09 Junyan Lin , Feng Gao , Xiaocheng Shi , Junyu Dong , Qian Du

Electrocardiogram (ECG) analysis is a fundamental tool for diagnosing cardiovascular conditions, yet anomaly detection in ECG signals remains challenging due to their inherent complexity and variability. We propose Multi-scale Masked…

Machine Learning · Computer Science 2025-02-11 Ya Zhou , Yujie Yang , Jianhuang Gan , Xiangjie Li , Jing Yuan , Wei Zhao

Artificial Intelligence (AI) has the potential to revolutionize diagnosis and segmentation in medical imaging. However, development and clinical implementation face multiple challenges including limited data availability, lack of…

Image and Video Processing · Electrical Eng. & Systems 2025-01-22 Zelong Liu , Andrew Tieu , Nikhil Patel , Georgios Soultanidis , Louisa Deyer , Ying Wang , Sean Huver , Alexander Zhou , Yunhao Mei , Zahi A. Fayad , Timothy Deyer , Xueyan Mei

Masked autoencoder (MAE) has attracted unprecedented attention and achieves remarkable performance in many vision tasks. It reconstructs random masked image patches (known as proxy task) during pretraining and learns meaningful semantic…

Computer Vision and Pattern Recognition · Computer Science 2023-07-14 Qingbo Kang , Jun Gao , Kang Li , Qicheng Lao

Masked autoencoder (MAE), a simple and effective self-supervised learning framework based on the reconstruction of masked image regions, has recently achieved prominent success in a variety of vision tasks. Despite the emergence of…

Machine Learning · Computer Science 2023-06-09 Lingjing Kong , Martin Q. Ma , Guangyi Chen , Eric P. Xing , Yuejie Chi , Louis-Philippe Morency , Kun Zhang

Accurate and robust medical image classification is paramount for early disease diagnosis and treatment planning. However, challenges such as limited annotated data, high intra-class variability, and subtle inter-class differences often…

Image and Video Processing · Electrical Eng. & Systems 2026-05-22 Joao Florindo , Viviane Moura

There has been a growing interest in using deep learning models for processing long surgical videos, in order to automatically detect clinical/operational activities and extract metrics that can enable workflow efficiency tools and…

Computer Vision and Pattern Recognition · Computer Science 2023-05-22 Muhammad Abdullah Jamal , Omid Mohareri

The computer vision domain has greatly benefited from an abundance of data across many modalities to improve on various visual tasks. Recently, there has been a lot of focus on self-supervised pre-training methods through Masked…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Pîrvu Mihai-Cristian , Marius Leordeanu

Masked Autoencoding (MAE) has emerged as an effective approach for pre-training representations across multiple domains. In contrast to discrete tokens in natural languages, the input for image MAE is continuous and subject to additional…

Computer Vision and Pattern Recognition · Computer Science 2022-10-14 Ronghang Hu , Shoubhik Debnath , Saining Xie , Xinlei Chen

Accurate atmospheric profiles from remote sensing instruments such as Doppler Lidar, Radar, and radiometers are frequently corrupted by low-SNR (Signal to Noise Ratio) gates, range folding, and spurious discontinuities. Traditional gap…

Machine Learning · Computer Science 2026-01-15 Anurup Naskar , Nathanael Zhixin Wong , Sara Shamekh

Masked autoencoders (MAEs) represent a prominent self-supervised learning paradigm in computer vision. Despite their empirical success, the underlying mechanisms of MAEs remain insufficiently understood. Recent studies have attempted to…

Computer Vision and Pattern Recognition · Computer Science 2025-02-28 Tao Huang , Yanxiang Ma , Shan You , Chang Xu

In this work, we explore regions as a potential visual analogue of words for self-supervised image representation learning. Inspired by Masked Autoencoding (MAE), a generative pre-training baseline, we propose masked region autoencoding to…

Computer Vision and Pattern Recognition · Computer Science 2024-01-08 Duy-Kien Nguyen , Vaibhav Aggarwal , Yanghao Li , Martin R. Oswald , Alexander Kirillov , Cees G. M. Snoek , Xinlei Chen

Remote sensing images present unique challenges to image analysis due to the extensive geographic coverage, hardware limitations, and misaligned multi-scale images. This paper revisits the classical multi-scale representation learning…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Maofeng Tang , Andrei Cozma , Konstantinos Georgiou , Hairong Qi

Unsupervised anomaly detection has gained significant attention in the field of medical imaging due to its capability of relieving the costly pixel-level annotation. To achieve this, modern approaches usually utilize generative models to…

Image and Video Processing · Electrical Eng. & Systems 2024-01-22 Rui Xu , Yunke Wang , Bo Du

The Masked Autoencoder (MAE) has recently demonstrated effectiveness in pre-training Vision Transformers (ViT) for analyzing natural images. By reconstructing complete images from partially masked inputs, the ViT encoder gathers contextual…

Image and Video Processing · Electrical Eng. & Systems 2025-06-03 Badhan Kumar Das , Gengyan Zhao , Han Liu , Thomas J. Re , Dorin Comaniciu , Eli Gibson , Andreas Maier

The integration of multi-modal Magnetic Resonance Imaging (MRI) and clinical data holds great promise for enhancing the diagnosis of neurological disorders (NDs) in real-world clinical settings. Deep Learning (DL) has recently emerged as a…

Image and Video Processing · Electrical Eng. & Systems 2025-06-19 Wajih Hassan Raza , Aamir Bader Shah , Yu Wen , Yidan Shen , Juan Diego Martinez Lemus , Mya Caryn Schiess , Timothy Michael Ellmore , Renjie Hu , Xin Fu

Masked image modeling (MIM) has been recognized as a strong self-supervised pre-training approach in the vision domain. However, the mechanism and properties of the learned representations by such a scheme, as well as how to further enhance…

Computer Vision and Pattern Recognition · Computer Science 2024-04-10 Kevin Zhang , Zhiqiang Shen

Masked Autoencoders (MAE) based on a reconstruction task have risen to be a promising paradigm for self-supervised learning (SSL) and achieve state-of-the-art performance across different benchmark datasets. However, despite its impressive…

Machine Learning · Computer Science 2023-03-28 Qi Zhang , Yifei Wang , Yisen Wang