中文
相关论文

相关论文: Self-Supervised Pre-Training with Contrastive and …

200 篇论文

Self-supervised learning (SSL) methods such as masked language modeling have shown massive performance gains by pretraining transformer models for a variety of natural language processing tasks. The follow-up research adapted similar…

计算机视觉与模式识别 · 计算机科学 2022-05-12 Gokul Karthik Kumar , Sahal Shaji Mullappilly , Abhishek Singh Gehlot

Self-supervised learning has gained popularity because of its ability to avoid the cost of annotating large-scale datasets. It is capable of adopting self-defined pseudo labels as supervision and use the learned representations for several…

计算机视觉与模式识别 · 计算机科学 2021-02-09 Ashish Jaiswal , Ashwin Ramesh Babu , Mohammad Zaki Zadeh , Debapriya Banerjee , Fillia Makedon

Self-supervision has demonstrated to be an effective learning strategy when training target tasks on small annotated data-sets. While current research focuses on creating novel pretext tasks to learn meaningful and reusable representations…

计算机视觉与模式识别 · 计算机科学 2021-05-17 Fernando Navarro , Christopher Watanabe , Suprosanna Shit , Anjany Sekuboyina , Jan C. Peeken , Stephanie E. Combs , Bjoern H. Menze

In recent years, deep neural networks (DNNs) have been found very successful for multi-label classification (MLC) of remote sensing (RS) images. Self-supervised pre-training combined with fine-tuning on a randomly selected small training…

计算机视觉与模式识别 · 计算机科学 2023-06-22 Lars Möllenbrok , Begüm Demir

Pre-trained vision-language models learn massive data to model unified representations of images and natural languages, which can be widely applied to downstream machine learning tasks. In addition to zero-shot inference, in order to better…

计算机视觉与模式识别 · 计算机科学 2024-06-28 Qian-Wei Wang , Yuqiu Xie , Letian Zhang , Zimo Liu , Shu-Tao Xia

Supervised learning-based segmentation methods typically require a large number of annotated training data to generalize well at test time. In medical applications, curating such datasets is not a favourable option because acquiring a large…

图像与视频处理 · 电气工程与系统科学 2020-11-20 Krishna Chaitanya , Neerav Karani , Christian F. Baumgartner , Ertunc Erdil , Anton Becker , Olivio Donati , Ender Konukoglu

Feature matching and finding correspondences between endoscopic images is a key step in many clinical applications such as patient follow-up and generation of panoramic image from clinical sequences for fast anomalies localization.…

计算机视觉与模式识别 · 计算机科学 2022-08-25 Manel Farhat , Houda Chaabouni-Chouayakh , Achraf Ben-Hamadou

The implementation of deep learning based computer aided diagnosis systems for the classification of mammogram images can help in improving the accuracy, reliability, and cost of diagnosing patients. However, training a deep learning model…

图像与视频处理 · 电气工程与系统科学 2021-07-27 Saul Calderon-Ramirez , Diego Murillo-Hernandez , Kevin Rojas-Salazar , David Elizondo , Shengxiang Yang , Miguel Molina-Cabello

Deep learning technologies have already demonstrated a high potential to build diagnosis support systems from medical imaging data, such as Chest X-Ray images. However, the shortage of labeled data in the medical field represents one key…

图像与视频处理 · 电气工程与系统科学 2023-01-26 Iván de Andrés Tamé , Kirill Sirotkin , Pablo Carballeira , Marcos Escudero-Viñolo

Self-supervised learning methods have witnessed a recent surge of interest after proving successful in multiple application fields. In this work, we leverage these techniques, and we propose 3D versions for five different self-supervised…

计算机视觉与模式识别 · 计算机科学 2020-11-03 Aiham Taleb , Winfried Loetzsch , Noel Danz , Julius Severin , Thomas Gaertner , Benjamin Bergner , Christoph Lippert

Contrastive language-image Pre-training (CLIP) [13] can leverage large datasets of unlabeled Image-Text pairs, which have demonstrated impressive performance in various downstream tasks. Given that annotating medical data is time-consuming…

图像与视频处理 · 电气工程与系统科学 2023-07-13 Yuhao Wang

Self-supervised pre-training has become the priory choice to establish reliable neural networks for automated recognition of massive biomedical microscopy images, which are routinely annotation-free, without semantics, and without guarantee…

计算机视觉与模式识别 · 计算机科学 2023-01-13 Wei Chen , Chen Li , Dan Chen , Xin Luo

Deep image prior (DIP) has been successfully applied to positron emission tomography (PET) image restoration, enabling represent implicit prior using only convolutional neural network architecture without training dataset, whereas the…

医学物理 · 物理学 2024-04-23 Yuya Onishi , Fumio Hashimoto , Kibo Ote , Keisuke Matsubara , Masanobu Ibaraki

Strong gravitational lensing can reveal the influence of dark-matter substructure in galaxies, but analyzing these effects from noisy, low-resolution images poses a significant challenge. In this work, we propose a masked autoencoder (MAE)…

Automated endoscopy video analysis is a challenging task in medical computer vision, with the primary objective of assisting surgeons during procedures. The difficulty arises from the complexity of surgical scenes and the lack of a…

计算机视觉与模式识别 · 计算机科学 2023-04-03 Dominik Batić , Felix Holm , Ege Özsoy , Tobias Czempiel , Nassir Navab

Recent advancements in self-supervised learning have demonstrated that effective visual representations can be learned from unlabeled images. This has led to increased interest in applying self-supervised learning to the medical domain,…

计算机视觉与模式识别 · 计算机科学 2023-04-10 Xiangyi Yan , Junayed Naushad , Chenyu You , Hao Tang , Shanlin Sun , Kun Han , Haoyu Ma , James Duncan , Xiaohui Xie

Computational pathology can lead to saving human lives, but models are annotation hungry and pathology images are notoriously expensive to annotate. Self-supervised learning has shown to be an effective method for utilizing unlabeled data,…

计算机视觉与模式识别 · 计算机科学 2023-04-19 Mingu Kang , Heon Song , Seonwook Park , Donggeun Yoo , Sérgio Pereira

Deep learning associated with neurological signals is poised to drive major advancements in diverse fields such as medical diagnostics, neurorehabilitation, and brain-computer interfaces. The challenge in harnessing the full potential of…

信号处理 · 电气工程与系统科学 2024-07-08 Di Wu , Siyuan Li , Jie Yang , Mohamad Sawan

In this paper, we aim to improve the performance of semantic image segmentation in a semi-supervised setting in which training is effectuated with a reduced set of annotated images and additional non-annotated images. We present a method…

计算机视觉与模式识别 · 计算机科学 2019-10-31 Jizong Peng , Guillermo Estrada , Marco Pedersoli , Christian Desrosiers

In this paper, we investigate self-supervised pre-training methods for document text recognition. Nowadays, large unlabeled datasets can be collected for many research tasks, including text recognition, but it is costly to annotate them.…

计算机视觉与模式识别 · 计算机科学 2024-05-02 Martin Kišš , Michal Hradiš