English
Related papers

Related papers: VIS-MAE: An Efficient Self-supervised Learning App…

200 papers

An important challenge in emotion recognition is to develop methods that can leverage unlabeled training data. In this paper, we propose the VQ-MAE-AV model, a self-supervised multimodal model that leverages masked autoencoders to learn…

Sound · Computer Science 2025-05-12 Samir Sadok , Simon Leglaive , Renaud Séguier

We propose MAE-SAM2, a novel foundation model for retinal vascular leakage segmentation on fluorescein angiography images. Due to the small size and dense distribution of the leakage areas, along with the limited availability of labeled…

Tissues and Organs · Quantitative Biology 2026-04-09 Xin Xing , Irmak Karaca , Amir Akhavanrezayat , Samira Badrloo , Quan Dong Nguyen , Mahadevan Subramaniam

Segmentation is a fundamental problem in surgical scene analysis using artificial intelligence. However, the inherent data scarcity in this domain makes it challenging to adapt traditional segmentation techniques for this task. To tackle…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Jay N. Paranjape , Nithin Gopalakrishnan Nair , Shameema Sikder , S. Swaroop Vedula , Vishal M. Patel

Understanding whether self-supervised learning methods can scale with unlimited data is crucial for training large-scale models. In this work, we conduct an empirical study on the scaling capability of masked image modeling (MIM) methods…

Computer Vision and Pattern Recognition · Computer Science 2023-05-25 Cheng-Ze Lu , Xiaojie Jin , Qibin Hou , Jun Hao Liew , Ming-Ming Cheng , Jiashi Feng

Self-supervised pretraining followed by supervised fine-tuning has seen success in image recognition, especially when labeled examples are scarce, but has received limited attention in medical image analysis. This paper studies the…

Recent medical vision-language models have shown promise on tasks such as VQA, report generation, and anomaly detection. However, most are adapted to structured adult imaging and underperform in fetal ultrasound, which poses challenges of…

Computer Vision and Pattern Recognition · Computer Science 2026-01-28 Xiao He , Huangxuan Zhao , Guojia Wan , Wei Zhou , Yanxing Liu , Juhua Liu , Yongchao Xu , Yong Luo , Dacheng Tao , Bo Du

Video Capsule Endoscopy (VCE) has become an indispensable diagnostic tool for gastrointestinal (GI) disorders due to its non-invasive nature and ability to capture high-resolution images of the small intestine. However, the enormous volume…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Vamshi Krishna Kancharla , Pavan Kumar Kaveti , Dasari Naga Raju

Latest federated learning (FL) methods started to focus on how to use unlabeled data in clients for training due to users' privacy concerns, high labeling costs, or lack of expertise. However, current Federated…

Machine Learning · Computer Science 2023-03-22 Nan Yang , Xuanyu Chen , Charles Z. Liu , Dong Yuan , Wei Bao , Lizhen Cui

Foundation models for medical image segmentation have achieved remarkable performance. Adaptive fine-tuning of natural image segmentation foundation models is crucial for medical image segmentation tasks. However, some limitations exist in…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Xinwei Zhang , Hu Chen , Zhe Yuan , Sukun Tian , Peng Feng

Whole-slide images are central to digital pathology, yet their extreme size and scarce annotations make self-supervised learning essential. Masked Autoencoders (MAEs) with Vision Transformer backbones have recently shown strong potential…

Computer Vision and Pattern Recognition · Computer Science 2025-11-20 Raneen Younis , Louay Hamdi , Lukas Chavez , Zahra Ahmadi

Recently, self-supervised pre-training has advanced Vision Transformers on various tasks w.r.t. different data modalities, e.g., image and 3D point cloud data. In this paper, we explore this learning paradigm for 3D mesh data analysis based…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Yaqian Liang , Shanshan Zhao , Baosheng Yu , Jing Zhang , Fazhi He

Large-scale pre-trained models, such as Vision Foundation Models (VFMs), have demonstrated impressive performance across various downstream tasks by transferring generalized knowledge, especially when target data is limited. However, their…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Pengchen Liang , Haishan Huang , Bin Pu , Jianguo Chen , Xiang Hua , Jing Zhang , Weibo Ma , Zhuangzhuang Chen , Yiwei Li , Qing Chang

Image segmentation is an important task in many medical applications. Methods based on convolutional neural networks attain state-of-the-art accuracy; however, they typically rely on supervised training with large labeled datasets. Labeling…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Amy Zhao , Guha Balakrishnan , Frédo Durand , John V. Guttag , Adrian V. Dalca

Scalp disorders are highly prevalent worldwide, yet remain underdiagnosed due to limited access to expert evaluation and the high cost of annotation. Although AI-based approaches hold great promise, their practical deployment is hindered by…

Computer Vision and Pattern Recognition · Computer Science 2025-09-16 Youngmin Kim , Saejin Kim , Hoyeon Moon , Youngjae Yu , Junhyug Noh

Masked Autoencoder (MAE) has demonstrated superior performance on various vision tasks via randomly masking image patches and reconstruction. However, effective data augmentation strategies for MAE still remain open questions, different…

Computer Vision and Pattern Recognition · Computer Science 2024-02-08 Kai Chen , Zhili Liu , Lanqing Hong , Hang Xu , Zhenguo Li , Dit-Yan Yeung

Segmentation of images is a long-standing challenge in medical AI. This is mainly due to the fact that training a neural network to perform image segmentation requires a significant number of pixel-level annotated data, which is often…

Computer Vision and Pattern Recognition · Computer Science 2021-08-26 Himashi Peiris , Zhaolin Chen , Gary Egan , Mehrtash Harandi

Remote sensing images present unique challenges to image analysis due to the extensive geographic coverage, hardware limitations, and misaligned multi-scale images. This paper revisits the classical multi-scale representation learning…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Maofeng Tang , Andrei Cozma , Konstantinos Georgiou , Hairong Qi

Unsupervised learning can leverage large-scale data sources without the need for annotations. In this context, deep learning-based autoencoders have shown great potential in detecting anomalies in medical images. However, especially…

Image and Video Processing · Electrical Eng. & Systems 2020-01-03 David Zimmerer , Simon Kohl , Jens Petersen , Fabian Isensee , Klaus Maier-Hein

Pretraining and fine-tuning have emerged as a new paradigm in remote sensing image interpretation. Among them, Masked Autoencoder (MAE)-based pretraining stands out for its strong capability to learn general feature representations via…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Xiaokang Zhang , Bo Li , Chufeng Zhou , Weikang Yu , Lefei Zhang

Semi-supervised learning is attracting increasing attention due to the fact that datasets of many domains lack enough labeled data. Variational Auto-Encoder (VAE), in particular, has demonstrated the benefits of semi-supervised learning.…

Machine Learning · Computer Science 2018-12-04 Yang Li , Quan Pan , Suhang Wang , Haiyun Peng , Tao Yang , Erik Cambria