English
Related papers

Related papers: USF-MAE: Ultrasound Self-Supervised Foundation Mod…

200 papers

Masked image modeling (MIM) is a highly popular and effective self-supervised learning method for image understanding. Existing MIM-based methods mostly focus on spatial feature modeling, neglecting spectral feature modeling. Meanwhile,…

Image and Video Processing · Electrical Eng. & Systems 2023-11-09 Junyan Lin , Feng Gao , Xiaocheng Shi , Junyu Dong , Qian Du

This paper shows that masked autoencoders (MAE) are scalable self-supervised learners for computer vision. Our MAE approach is simple: we mask random patches of the input image and reconstruct the missing pixels. It is based on two core…

Computer Vision and Pattern Recognition · Computer Science 2021-12-21 Kaiming He , Xinlei Chen , Saining Xie , Yanghao Li , Piotr Dollár , Ross Girshick

Ultrasound is widely used in obstetric care due to its safety, accessibility, and real-time imaging. However, interpretation remains operator-dependent and susceptible to noise and artifacts. Deep learning models have shown strong…

Image and Video Processing · Electrical Eng. & Systems 2026-05-28 Leya Barrientos , Yuexi Du , Nicha C. Dvornek

Large, pretrained models are commonly finetuned with imagery that is heavily augmented to mimic different conditions and scales, with the resulting models used for various tasks with imagery from a range of spatial scales. Such models…

Computer Vision and Pattern Recognition · Computer Science 2023-09-25 Colorado J. Reed , Ritwik Gupta , Shufan Li , Sarah Brockman , Christopher Funk , Brian Clipp , Kurt Keutzer , Salvatore Candido , Matt Uyttendaele , Trevor Darrell

Accurate tumor segmentation and classification in breast ultrasound (BUS) imaging remain challenging due to low contrast, speckle noise, and diverse lesion morphology. This study presents a multi-task deep learning framework that jointly…

Computer Vision and Pattern Recognition · Computer Science 2026-01-12 Samuel E. Johnny , Bernes L. Atabonfack , Israel Alagbe , Assane Gueye

Robust segmentation is critical for deriving quantitative measures from large-scale, multi-center, and longitudinal medical scans. Manually annotating medical scans, however, is expensive and labor-intensive and may not always be available…

Constructing large-scale labeled datasets for multi-modal perception model training in autonomous driving presents significant challenges. This has motivated the development of self-supervised pretraining strategies. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Xiaohao Xu , Ye Li , Tianyi Zhang , Jinrong Yang , Matthew Johnson-Roberson , Xiaonan Huang

The accurate segmentation of lesions in whole-body PET/CT imaging is es-sential for tumor characterization, treatment planning, and response assess-ment, yet current manual workflows are labor-intensive and prone to inter-observer…

Image and Video Processing · Electrical Eng. & Systems 2025-09-04 Moona Mazher , Steven A Niederer , Abdul Qayyum

Ultrasound (US) imaging exhibits substantial heterogeneity across anatomical structures and acquisition protocols, posing significant challenges to the development of generalizable analysis models. Most existing methods are task-specific,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Bo Deng , Yitong Tang , Jiake Li , Yuxin Huang , Li Wang , Yu Zhang , Yufei Zhan , Hua Lu , Xiaoshen Zhang , Jieyun Bai

Accurate and robust medical image classification is paramount for early disease diagnosis and treatment planning. However, challenges such as limited annotated data, high intra-class variability, and subtle inter-class differences often…

Image and Video Processing · Electrical Eng. & Systems 2026-05-22 Joao Florindo , Viviane Moura

Recent general-purpose audio representations show state-of-the-art performance on various audio tasks. These representations are pre-trained by self-supervised learning methods that create training signals from the input. For example,…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-09 Daisuke Niizumi , Daiki Takeuchi , Yasunori Ohishi , Noboru Harada , Kunio Kashino

Bioacoustic recognition requires fine-grained acoustic understanding to distinguish similar-sounding species. However, many large-scale data repositories such as iNaturalist are weakly annotated, often with only a single positive species…

Sound · Computer Science 2026-05-15 Wuao Liu , Mustafa Chasmai , Subhransu Maji , Grant Van Horn

Deep learning-based analysis of high-frequency, high-resolution micro-ultrasound data shows great promise for prostate cancer detection. Previous approaches to analysis of ultrasound data largely follow a supervised learning paradigm.…

Image and Video Processing · Electrical Eng. & Systems 2022-11-02 Paul F. R. Wilson , Mahdi Gilany , Amoon Jamzad , Fahimeh Fooladgar , Minh Nguyen Nhat To , Brian Wodlinger , Purang Abolmaesumi , Parvin Mousavi

Affective video facial analysis (AVFA) has emerged as a key research field for building emotion-aware intelligent systems, yet this field continues to suffer from limited data availability. In recent years, the self-supervised learning…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Xuecheng Wu , Junxiao Xue , Xinyi Yin , Yunyun Shi , Liangyu Fu , Danlei Huang , Yifan Wang , Jia Zhang , Jiayu Nie , Jun Wang

Masked autoencoders (MAE) have shown great promise in medical image classification. However, the random masking strategy employed by traditional MAEs may overlook critical areas in medical images, where even subtle changes can indicate…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Joao Batista Florindo , Viviane de Moura

Generating semantic segmentation datasets has consistently been laborious and time-consuming, particularly in the context of large models or specialized domains(i.e. Medical Imaging or Remote Sensing). Specifically, large models necessitate…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Jiaru Jia , Mingzhe Liu , Jiake Xie , Xin Chen , Hong Zhang , Feixiang Zhao , Aiqing Yang

The Vision Transformer (ViT) has demonstrated remarkable performance in Self-Supervised Learning (SSL) for 3D medical image analysis. Masked AutoEncoder (MAE) for feature pre-training can further unleash the potential of ViT on various…

Computer Vision and Pattern Recognition · Computer Science 2025-01-13 Jiaxin Zhuang , Linshan Wu , Qiong Wang , Peng Fei , Varut Vardhanabhuti , Lin Luo , Hao Chen

Masked Autoencoders (MAE) based on a reconstruction task have risen to be a promising paradigm for self-supervised learning (SSL) and achieve state-of-the-art performance across different benchmark datasets. However, despite its impressive…

Machine Learning · Computer Science 2023-03-28 Qi Zhang , Yifei Wang , Yisen Wang

Pre-training strategies based on self-supervised learning (SSL) have proven to be effective pretext tasks for many downstream tasks in computer vision. Due to the significant disparity between medical and natural images, the application of…

Accurate imputation of missing laboratory values in electronic health records (EHRs) is critical to enable robust clinical predictions and reduce biases in AI systems in healthcare. Existing methods, such as XGBoost, softimpute, GAIN,…

Machine Learning · Computer Science 2025-06-27 David Restrepo , Chenwei Wu , Yueran Jia , Jaden K. Sun , Jack Gallifant , Catherine G. Bielick , Yugang Jia , Leo A. Celi