English
Related papers

Related papers: USF-MAE: Ultrasound Self-Supervised Foundation Mod…

200 papers

Echocardiography is widely used to clinical practice for diagnosis and treatment, e.g., on the common congenital heart defects. The traditional manual manipulation is error-prone due to the staff shortage, excess workload, and less…

Computer Vision and Pattern Recognition · Computer Science 2022-03-15 Fuhai Chen , Rongrong Ji , Chengpeng Dai , Xuri Ge , Shengchuang Zhang , Xiaojing Ma , Yue Gao

Recent advancements in foundation models have significantly impacted various fields, including natural language processing, computer vision, and multi-modal tasks. One area that stands to benefit greatly is Earth observation, where these…

Computer Vision and Pattern Recognition · Computer Science 2024-10-21 Yohei Nakayama , Jiawei Su , Luis M. Pazos-Outón

Downhole drilling telemetry presents a fundamental labeling asymmetry: surface sensor data are generated continuously at 1~Hz, while labeled downhole measurements are costly, intermittent, and scarce. Current machine learning approaches for…

Machine Learning · Computer Science 2026-04-24 Aleksander Berezowski , Hassan Hassanzadeh , Gouri Ginde

Ultrasound is widely used in clinical practice due to its affordability, portability, and safety. However, current AI research often overlooks combined disease prediction and tissue segmentation. We propose UniUSNet, a universal framework…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Zehui Lin , Zhuoneng Zhang , Xindi Hu , Zhifan Gao , Xin Yang , Yue Sun , Dong Ni , Tao Tan

Semi-supervised learning (SSL) has emerged as a promising paradigm for breast ultrasound (BUS) image segmentation, but it often suffers from unstable pseudo labels under extremely limited annotations, leading to inaccurate supervision and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Ruili Li , Jiayi Ding , Ruiyu Li , Yilun Jin , Shiwen Ge , Yuwen Zeng , Xiaoyong Zhang , Eichi Takaya , Jan Vrba , Noriyasu Homma

Accurate lesion segmentation in ultrasound images is essential for preventive screening and clinical diagnosis, yet remains challenging due to low contrast, blurry boundaries, and significant scale variations. Although existing deep…

Computer Vision and Pattern Recognition · Computer Science 2026-04-16 Chen Wang , Yixin Zhu , Yongbin Zhu , Fengyuan Shi , Qi Li , Jun Wang , Zuozhu Liu , Keli Hu

Shape information is a strong and valuable prior in segmenting organs in medical images. However, most current deep learning based segmentation algorithms have not taken shape information into consideration, which can lead to bias towards…

Computer Vision and Pattern Recognition · Computer Science 2022-07-07 Yuan Yao , Fengze Liu , Zongwei Zhou , Yan Wang , Wei Shen , Alan Yuille , Yongyi Lu

Masked autoencoder (MAE), a simple and effective self-supervised learning framework based on the reconstruction of masked image regions, has recently achieved prominent success in a variety of vision tasks. Despite the emergence of…

Machine Learning · Computer Science 2023-06-09 Lingjing Kong , Martin Q. Ma , Guangyi Chen , Eric P. Xing , Yuejie Chi , Louis-Philippe Morency , Kun Zhang

Masked Autoencoders (MAE) have shown great potentials in self-supervised pre-training for language and 2D image transformers. However, it still remains an open question on how to exploit masked autoencoding for learning 3D representations…

Computer Vision and Pattern Recognition · Computer Science 2022-10-17 Renrui Zhang , Ziyu Guo , Rongyao Fang , Bin Zhao , Dong Wang , Yu Qiao , Hongsheng Li , Peng Gao

Masked Autoencoders (MAEs) achieve impressive performance in image classification tasks, yet the internal representations they learn remain less understood. This work started as an attempt to understand the strong downstream classification…

Machine Learning · Computer Science 2026-02-04 Anika Shrivastava , Renu Rameshan , Samar Agnihotri

Electroencephalography (EEG) serves as an essential diagnostic tool in neurology; however, its accurate manual interpretation is a time-intensive process that demands highly specialized expertise, which remains relatively scarce and not…

Quantitative Methods · Quantitative Biology 2025-03-14 Ruggero G. Bettinardi , Mohamed Rahmouni , Ulysse Gimenez

Unsupervised learning can leverage large-scale data sources without the need for annotations. In this context, deep learning-based autoencoders have shown great potential in detecting anomalies in medical images. However, especially…

Image and Video Processing · Electrical Eng. & Systems 2020-01-03 David Zimmerer , Simon Kohl , Jens Petersen , Fabian Isensee , Klaus Maier-Hein

IMPORTANCE: Modern ultrasound systems are universal diagnostic tools capable of imaging the entire body. However, current AI solutions remain fragmented into single-task tools. This critical gap between hardware versatility and software…

Infrared imaging plays a critical role in low-light and adverse weather conditions. However, due to the distinct characteristics of infrared images, existing foundation models such as Masked Autoencoder (MAE) trained on visible data perform…

Computer Vision and Pattern Recognition · Computer Science 2026-02-05 Yinghui Xing , Xiaoting Su , Shizhou Zhang , Donghao Chu , Di Xu

Compared to 2D data, the scale of point cloud data in different domains available for training, is quite limited. Researchers have been trying to combine these data of different domains for masked autoencoder (MAE) pre-training to leverage…

Computer Vision and Pattern Recognition · Computer Science 2025-10-27 Ziqi Gao , Qiufu Li , Linlin Shen

Self-supervised learning (SSL) has demonstrated remarkable success in 3D point cloud analysis, particularly through masked autoencoders (MAEs). However, existing MAE-based methods lack rotation invariance, leading to significant performance…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Xuanhua Yin , Dingxin Zhang , Jianhui Yu , Weidong Cai

Echocardiography is a widely used modality for cardiac assessment due to its non-invasive and cost-effective nature, but the sparse and heterogeneous spatiotemporal views of the heart pose distinct challenges. Existing masked autoencoder…

We propose MAE-SAM2, a novel foundation model for retinal vascular leakage segmentation on fluorescein angiography images. Due to the small size and dense distribution of the leakage areas, along with the limited availability of labeled…

Tissues and Organs · Quantitative Biology 2026-04-09 Xin Xing , Irmak Karaca , Amir Akhavanrezayat , Samira Badrloo , Quan Dong Nguyen , Mahadevan Subramaniam

Robotic ultrasound has advanced local image-driven control, contact regulation, and view optimization, yet current systems lack the anatomical understanding needed to determine what to scan, where to begin, and how to adapt to individual…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Jing Zhang , Duojie Chen , Wentao Jiang , Zihan Lou , Jianxin Liu , Xinwu Cui , Qinghong Zhao , Bo Du , Christoph F. Dietrich , Dacheng Tao

The advent of foundation models has heralded a new era in medical artificial intelligence (AI), enabling the extraction of generalizable representations from large-scale unlabeled datasets. However, current ophthalmic AI paradigms are…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Tienyu Chang , Zhen Chen , Renjie Liang , Jinyu Ding , Jie Xu , Sunu Mathew , Amir Reza Hajrasouliha , Andrew J. Saykin , Ruogu Fang , Yu Huang , Jiang Bian , Qingyu Chen