中文
相关论文

相关论文: Improving Self-supervised Learning with Hardness-a…

200 篇论文

This paper introduces a novel approach to improving the training stability of self-supervised learning (SSL) methods by leveraging a non-parametric memory of seen concepts. The proposed method involves augmenting a neural network with a…

计算机视觉与模式识别 · 计算机科学 2024-07-26 Thalles Silva , Helio Pedrini , Adín Ramírez Rivera

Supervised learning for semantic segmentation requires a large number of labeled samples, which is difficult to obtain in the field of remote sensing. Self-supervised learning (SSL), can be used to solve such problems by pre-training a…

计算机视觉与模式识别 · 计算机科学 2022-02-01 Haifeng Li , Yi Li , Guo Zhang , Ruoyun Liu , Haozhe Huang , Qing Zhu , Chao Tao

Self-paced curriculum learning (SCL) has demonstrated its great potential in computer vision, natural language processing, etc. During training, it implements easy-to-hard sampling based on online estimation of data difficulty. Most SCL…

计算机视觉与模式识别 · 计算机科学 2023-02-10 Han Li , Hu Han , S. Kevin Zhou

Self-supervised learning (SSL) has recently achieved tremendous empirical advancements in learning image representation. However, our understanding of the principle behind learning such a representation is still limited. This work shows…

计算机视觉与模式识别 · 计算机科学 2023-06-14 Yubei Chen , Adrien Bardes , Zengyi Li , Yann LeCun

Self-supervised learning (SSL) as an effective paradigm of representation learning has achieved tremendous success on various curated datasets in diverse scenarios. Nevertheless, when facing the long-tailed distribution in real-world…

机器学习 · 计算机科学 2023-10-27 Zhihan Zhou , Jiangchao Yao , Feng Hong , Ya Zhang , Bo Han , Yanfeng Wang

Task-specific deep learning models in histopathology offer promising opportunities for improving diagnosis, clinical research, and precision medicine. However, development of such models is often limited by availability of high-quality…

Pretraining has become a standard technique in computer vision and natural language processing, which usually helps to improve performance substantially. Previously, the most dominant pretraining method is transfer learning (TL), which uses…

计算机视觉与模式识别 · 计算机科学 2020-07-09 Xingyi Yang , Xuehai He , Yuxiao Liang , Yue Yang , Shanghang Zhang , Pengtao Xie

Learning self-supervised image representations has been broadly studied to boost various visual understanding tasks. Existing methods typically learn a single level of image semantics like pairwise semantic similarity or image clustering…

计算机视觉与模式识别 · 计算机科学 2022-05-27 Minghao Xu , Yuanfan Guo , Xuanyu Zhu , Jiawen Li , Zhenbang Sun , Jian Tang , Yi Xu , Bingbing Ni

Self-supervised learning (SSL), especially contrastive methods, has raised attraction recently as it learns effective transferable representations without semantic annotations. A common practice for self-supervised pre-training is to use as…

计算机视觉与模式识别 · 计算机科学 2022-05-27 Zhili Liu , Jianhua Han , Lanqing Hong , Hang Xu , Kai Chen , Chunjing Xu , Zhenguo Li

Self-supervised learning (SSL) enables label efficient training for machine learning models. This is essential for domains such as medical imaging, where labels are costly and time-consuming to curate. However, the most effective supervised…

计算机视觉与模式识别 · 计算机科学 2023-05-16 Cara Van Uden , Jeremy Irvin , Mars Huang , Nathan Dean , Jason Carr , Andrew Ng , Curtis Langlotz

Localizing keypoints of an object is a basic visual problem. However, supervised learning of a keypoint localization network often requires a large amount of data, which is expensive and time-consuming to obtain. To remedy this, there is an…

计算机视觉与模式识别 · 计算机科学 2022-01-25 Can Wang , Sheng Jin , Yingda Guan , Wentao Liu , Chen Qian , Ping Luo , Wanli Ouyang

Recommender systems are widely deployed in various web environments, and self-supervised learning (SSL) has recently attracted significant attention in this field. Contrastive learning (CL) stands out as a major SSL paradigm due to its…

信息检索 · 计算机科学 2025-01-17 Yu Zhang , Lei Sang , Yi Zhang , Yiwen Zhang , Yun Yang

Self-supervised learning techniques have shown their abilities to learn meaningful feature representation. This is made possible by training a model on pretext tasks that only requires to find correlations between inputs or parts of inputs.…

计算机视觉与模式识别 · 计算机科学 2020-01-17 Vishal Keshav , Fabien Delattre

Recently, self-supervised learning has attracted attention due to its remarkable ability to acquire meaningful representations for classification tasks without using semantic labels. This paper introduces a self-supervised learning…

计算机视觉与模式识别 · 计算机科学 2022-02-09 Hyungtae Lee , Heesung Kwon

Despite the rapid progress in self-supervised learning (SSL), end-to-end fine-tuning still remains the dominant fine-tuning strategy for medical imaging analysis. However, it remains unclear whether this approach is truly optimal for…

计算机视觉与模式识别 · 计算机科学 2023-11-17 Muhammad Osama Khan , Yi Fang

3D deep learning is a growing field of interest due to the vast amount of information stored in 3D formats. Triangular meshes are an efficient representation for irregular, non-uniform 3D objects. However, meshes are often challenging to…

计算机视觉与模式识别 · 计算机科学 2022-12-23 Ayaan Haque , Hankyu Moon , Heng Hao , Sima Didari , Jae Oh Woo , Patrick Bangert

Deep learning has become a valuable tool for the automation of certain medical image segmentation tasks, significantly relieving the workload of medical specialists. Some of these tasks require segmentation to be performed on a subset of…

图像与视频处理 · 电气工程与系统科学 2024-02-06 José Morano , Guilherme Aresta , Dmitrii Lachinov , Julia Mai , Ursula Schmidt-Erfurth , Hrvoje Bogunović

Self-supervised contrastive learning is a powerful tool to learn visual representation without labels. Prior work has primarily focused on evaluating the recognition accuracy of various pre-training algorithms, but has overlooked other…

计算机视觉与模式识别 · 计算机科学 2022-06-13 Yuanyi Zhong , Haoran Tang , Junkun Chen , Jian Peng , Yu-Xiong Wang

Continual learning is a process that involves training learning agents to sequentially master a stream of tasks or classes without revisiting past data. The challenge lies in leveraging previously acquired knowledge to learn new tasks…

机器学习 · 计算机科学 2024-02-21 Marcus de Carvalho , Mahardhika Pratama , Jie Zhang , Chua Haoyan , Edward Yapp

Text Recognition (TR) refers to the research area that focuses on retrieving textual information from images, a topic that has seen significant advancements in the last decade due to the use of Deep Neural Networks (DNN). However, these…

计算机视觉与模式识别 · 计算机科学 2025-06-06 Carlos Penarrubia , Jose J. Valero-Mas , Jorge Calvo-Zaragoza