English
Related papers

Related papers: A Study on Self-Supervised Pretraining for Vision …

200 papers

Gastrointestinal diseases impose a growing global health burden, and endoscopy is a primary tool for early diagnosis. However, routine endoscopic image interpretation still suffers from missed lesions and limited efficiency. Although…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Peixi Peng , Housheng Xie , Yanling Wei , Guangcong Ruan , Xiaoyang Zou , Qian Cao , Yongjian Nian , Guoyan Zheng

Supervised machine learning provides state-of-the-art solutions to a wide range of computer vision problems. However, the need for copious labelled training data limits the capabilities of these algorithms in scenarios where such input is…

Computer Vision and Pattern Recognition · Computer Science 2022-09-02 András Kalapos , Bálint Gyires-Tóth

Esophageal cancer is among the most common types of cancer worldwide. It is traditionally treated using open esophagectomy, but in recent years, robot-assisted minimally invasive esophagectomy (RAMIE) has emerged as a promising alternative.…

This paper revisits the standard pretrain-then-finetune paradigm used in computer vision for visual recognition tasks. Typically, state-of-the-art foundation models are pretrained using large scale (weakly) supervised datasets with billions…

Training visual embeddings with labeled data supervision has been the de facto setup for representation learning in computer vision. Inspired by recent success of adopting masked image modeling (MIM) in self-supervised representation…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Kaifeng Chen , Daniel Salz , Huiwen Chang , Kihyuk Sohn , Dilip Krishnan , Mojtaba Seyedhosseini

Ultrasound imaging is one of the most widely used diagnostic modalities, offering real-time, radiation-free assessment across diverse clinical domains. However, interpretation of ultrasound images remains challenging due to high noise…

Image and Video Processing · Electrical Eng. & Systems 2025-11-10 Youssef Megahed , Robin Ducharme , Aylin Erman , Mark Walker , Steven Hawken , Adrian D. C. Chan

Deep learning has proven very promising for interpreting MRI in brain tumor diagnosis. However, deep learning models suffer from a scarcity of brain MRI datasets for effective training. Self-supervised learning (SSL) models provide…

Image and Video Processing · Electrical Eng. & Systems 2024-11-21 Meryem Altin Karagoz , O. Ufuk Nalbantoglu , Geoffrey C. Fox

The development of deep learning models in medical image analysis is majorly limited by the lack of large-sized and well-annotated datasets. Unsupervised learning does not require labels and is more suitable for solving medical image…

Computer Vision and Pattern Recognition · Computer Science 2023-01-06 Zi'an Xu , Yin Dai , Fayu Liu , Weibing Chen , Yue Liu , Lifu Shi , Sheng Liu , Yuhang Zhou

A unified self-supervised and supervised deep learning framework for PET image reconstruction is presented, including deep-learned filtered backprojection (DL-FBP) for sinograms, deep-learned backproject then filter (DL-BPF) for…

Image and Video Processing · Electrical Eng. & Systems 2023-02-28 Andrew J. Reader

Most deep neural networks (DNNs) based ultrasound (US) medical image analysis models use pretrained backbones (e.g., ImageNet) for better model generalization. However, the domain gap between natural and medical images causes an inevitable…

Computer Vision and Pattern Recognition · Computer Science 2021-09-03 Yixiong Chen , Chunhui Zhang , Li Liu , Cheng Feng , Changfeng Dong , Yongfang Luo , Xiang Wan

During image-guided procedures, real-time image segmentation is often required. This demands lightweight AI models that can operate on resource-constrained devices. One important use case is endoscopy-guided colonoscopy, where polyps must…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 M Iffat Hossain , Laura Brattain

X-ray Computed Tomography (CT) is widely used in clinical applications such as diagnosis and image-guided interventions. In this paper, we propose a new deep learning based model for CT image reconstruction with the backbone network…

Image and Video Processing · Electrical Eng. & Systems 2020-09-21 Haimiao Zhang , Baodong Liu , Hengyong Yu , Bin Dong

Many real-world applications require recognition models that are robust to different operational conditions and modalities, but at the same time run on small embedded devices, with limited hardware. While for normal size models,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Srikanth Muralidharan , Heitor R. Medeiros , Masih Aminbeidokhti , Eric Granger , Marco Pedersoli

Despite the revolutionary impact of AI and the development of locally trained algorithms, achieving widespread generalized learning from multi-modal data in medical AI remains a significant challenge. This gap hinders the practical…

Computer Vision and Pattern Recognition · Computer Science 2024-01-24 Fatema-E Jannat , Sina Gholami , Minhaj Nur Alam , Hamed Tabkhi

Recent breakthroughs in self-supervised learning have enabled the use of large unlabeled datasets to train visual foundation models that can generalize to a variety of downstream tasks. While this training paradigm is well suited for the…

In recent years, the diagnosis of gastrointestinal (GI) diseases has advanced greatly with the advent of high-tech video capsule endoscopy (VCE) technology, which allows for non-invasive observation of the digestive system. The MisaHub…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Vaneeta Ahlawat , Rohit Sharma , Urush

Self-supervised learning (SSL) has attracted much interest in remote sensing and earth observation due to its ability to learn task-agnostic representations without human annotation. While most of the existing SSL works in remote sensing…

Computer Vision and Pattern Recognition · Computer Science 2022-06-15 Yi Wang , Conrad M Albrecht , Xiao Xiang Zhu

Recently, a massive number of deep learning based approaches have been successfully applied to various remote sensing image (RSI) recognition tasks. However, most existing advances of deep learning methods in the RSI field heavily rely on…

Image and Video Processing · Electrical Eng. & Systems 2021-12-08 Cheng Peng , Yangyang Li , Ronghua Shang , Licheng Jiao

Vision Transformer (ViT) suffers from data scarcity in semi-supervised learning (SSL). To alleviate this issue, inspired by masked autoencoder (MAE), which is a data-efficient self-supervised learner, we propose Semi-MAE, a pure ViT-based…

Computer Vision and Pattern Recognition · Computer Science 2023-01-05 Haojie Yu , Kang Zhao , Xiaoming Xu

Automated seizure detection and classification from electroencephalography (EEG) can greatly improve seizure diagnosis and treatment. However, several modeling challenges remain unaddressed in prior automated seizure detection and…

Signal Processing · Electrical Eng. & Systems 2022-03-15 Siyi Tang , Jared A. Dunnmon , Khaled Saab , Xuan Zhang , Qianying Huang , Florian Dubost , Daniel L. Rubin , Christopher Lee-Messer