中文
相关论文

相关论文: Using Deep Learning Models Pretrained by Self-Supe…

200 篇论文

Self-supervised representation learning (SSL) methods provide an effective label-free initial condition for fine-tuning downstream tasks. However, in numerous realistic scenarios, the downstream task might be biased with respect to the…

机器学习 · 计算机科学 2022-11-01 Andrius Ovsianas , Jason Ramapuram , Dan Busbridge , Eeshan Gunesh Dhekane , Russ Webb

Dataset distillation methods have achieved remarkable success in distilling a large dataset into a small set of representative samples. However, they are not designed to produce a distilled dataset that can be effectively used for…

机器学习 · 计算机科学 2024-04-15 Dong Bok Lee , Seanie Lee , Joonho Ko , Kenji Kawaguchi , Juho Lee , Sung Ju Hwang

Self-supervised pretraining (SSP) has been recognized as a method to enhance prediction accuracy in various downstream tasks. However, its efficacy for DNA sequences remains somewhat constrained. This limitation stems primarily from the…

机器学习 · 计算机科学 2024-05-15 Tong Yu , Lei Cheng , Ruslan Khalitov , Erland Brandser Olsson , Zhirong Yang

Domain adaptation (DA) mitigates the domain shift problem when transferring knowledge from one annotated domain to another similar but different unlabeled domain. However, existing models often utilize one of the ImageNet models as the…

计算机视觉与模式识别 · 计算机科学 2021-05-04 Youshan Zhang , Brian D. Davison

Recent advances in self-supervised learning (SSL) have largely closed the gap with supervised ImageNet pretraining. Despite their success these methods have been primarily applied to unlabeled ImageNet images, and show marginal gains when…

计算机视觉与模式识别 · 计算机科学 2020-12-09 Ramprasaath R. Selvaraju , Karan Desai , Justin Johnson , Nikhil Naik

Acquiring and annotating large datasets in ultrasound imaging is challenging due to low contrast, high noise, and susceptibility to artefacts. This process requires significant time and clinical expertise. Self-supervised learning (SSL)…

计算机视觉与模式识别 · 计算机科学 2025-07-25 Edward Ellis , Robert Mendel , Andrew Bulpitt , Nasim Parsa , Michael F Byrne , Sharib Ali

Recent research at CHU Sainte Justine's Pediatric Critical Care Unit (PICU) has revealed that traditional machine learning methods, such as semi-supervised label propagation and K-nearest neighbors, outperform Transformer-based models in…

机器学习 · 计算机科学 2025-05-27 Thanh-Dung Le , Clara Macabiau , Kévin Albert , Philippe Jouvet , Rita Noumeir

The emerging field of action prediction plays a vital role in various computer vision applications such as autonomous driving, activity analysis and human-computer interaction. Despite significant advancements, accurately predicting future…

计算机视觉与模式识别 · 计算机科学 2023-08-22 Izzeddin Teeti , Rongali Sai Bhargav , Vivek Singh , Andrew Bradley , Biplab Banerjee , Fabio Cuzzolin

Self-supervised learning (SSL) is a technique for learning useful representations from unlabeled data. It has been applied effectively to domain adaptation (DA) on images and videos. It is still unknown if and how it can be leveraged for…

计算机视觉与模式识别 · 计算机科学 2022-05-16 Idan Achituve , Haggai Maron , Gal Chechik

Training deep networks with noisy labels leads to poor generalization and degraded accuracy due to overfitting to label noise. Existing approaches for learning with noisy labels often rely on the availability of a clean subset of data. By…

机器学习 · 计算机科学 2025-11-27 David Szczecina , Nicholas Pellegrino , Paul Fieguth

Deep learning has made revolutionary advances to diverse applications in the presence of large-scale labeled datasets. However, it is prohibitively time-costly and labor-expensive to collect sufficient labeled data in most realistic…

机器学习 · 计算机科学 2021-07-22 Ximei Wang , Jinghan Gao , Mingsheng Long , Jianmin Wang

Self-Supervised Learning (SSL) has emerged as a promising approach in computer vision, enabling networks to learn meaningful representations from large unlabeled datasets. SSL methods fall into two main categories: instance discrimination…

计算机视觉与模式识别 · 计算机科学 2026-05-01 Alina Ciocarlan , Sidonie Lefebvre , Sylvie Le Hégarat-Mascle , Arnaud Woiselle

Dataset distillation (DD) generates small synthetic datasets that can efficiently train deep networks with a limited amount of memory and compute. Despite the success of DD methods for supervised learning, DD for self-supervised…

机器学习 · 计算机科学 2025-04-02 Siddharth Joshi , Jiayi Ni , Baharan Mirzasoleiman

Self-supervised learning (SSL) has shown impressive results in downstream classification tasks. However, there is limited work in understanding their failure modes and interpreting their learned representations. In this paper, we study the…

机器学习 · 计算机科学 2023-12-14 Neha Kalibhat , Kanika Narang , Hamed Firooz , Maziar Sanjabi , Soheil Feizi

Influenza A viruses (IAVs) evolve antigenically at a pace that requires frequent vaccine updates, yet the haemagglutination inhibition (HI) assays used to quantify antigenicity are labor-intensive and unscalable. As a result, genomic data…

机器学习 · 计算机科学 2025-12-08 Yanhua Xu

In network representation learning we learn how to represent heterogeneous information networks in a low-dimensional space so as to facilitate effective search, classification, and prediction solutions. Previous network representation…

人工智能 · 计算机科学 2021-05-19 Yang Fang , Xiang Zhao , Yifan Chen , Weidong Xiao , Maarten de Rijke

Accurate prediction of material properties facilitates the discovery of novel materials with tailored functionalities. Deep learning models have recently shown superior accuracy and flexibility in capturing structure-property relationships.…

机器学习 · 计算机科学 2025-04-30 Chowdhury Mohammad Abid Rahman , Aldo H. Romero , Prashnna K. Gyawali

Computational pathology can lead to saving human lives, but models are annotation hungry and pathology images are notoriously expensive to annotate. Self-supervised learning has shown to be an effective method for utilizing unlabeled data,…

计算机视觉与模式识别 · 计算机科学 2023-04-19 Mingu Kang , Heon Song , Seonwook Park , Donggeun Yoo , Sérgio Pereira

Training a neural network with a large labeled dataset is still a dominant paradigm in computational histopathology. However, obtaining such exhaustive manual annotations is often expensive, laborious, and prone to inter and Intra-observer…

计算机视觉与模式识别 · 计算机科学 2021-11-03 Chetan L. Srinidhi , Seung Wook Kim , Fu-Der Chen , Anne L. Martel

Deep Learning has led to a dramatic leap in Super-Resolution (SR) performance in the past few years. However, being supervised, these SR methods are restricted to specific training data, where the acquisition of the low-resolution (LR)…

计算机视觉与模式识别 · 计算机科学 2017-12-19 Assaf Shocher , Nadav Cohen , Michal Irani