中文
相关论文

相关论文: A Survey on Self-Supervised Learning for Non-Seque…

200 篇论文

Fine-grained image classification involves identifying different subcategories of a class which possess very subtle discriminatory features. Fine-grained datasets usually provide bounding box annotations along with class labels to aid the…

计算机视觉与模式识别 · 计算机科学 2021-07-30 Farha Al Breiki , Muhammad Ridzuan , Rushali Grandhe

Simplicity Bias (SB) is a phenomenon that deep neural networks tend to rely favorably on simpler predictive patterns but ignore some complex features when applied to supervised discriminative tasks. In this work, we investigate SB in…

计算机视觉与模式识别 · 计算机科学 2023-02-08 Xiu-Shen Wei , Xuhao Sun , Yang Shen , Anqi Xu , Peng Wang , Faen Zhang

Electroencephalogram (EEG) is a non-invasive technique to record bioelectrical signals. Integrating supervised deep learning techniques with EEG signals has recently facilitated automatic analysis across diverse EEG-based tasks. However,…

信号处理 · 电气工程与系统科学 2024-01-12 Weining Weng , Yang Gu , Shuai Guo , Yuan Ma , Zhaohua Yang , Yuchen Liu , Yiqiang Chen

Deep neural networks have been widely used in communication signal recognition and achieved remarkable performance, but this superiority typically depends on using massive examples for supervised learning, whereas training a deep neural…

信号处理 · 电气工程与系统科学 2023-11-15 Weidong Wang , Hongshu Liao , Lu Gan

Self-supervised learning (SSL) aims to learn intrinsic features without labels. Despite the diverse architectures of SSL methods, the projection head always plays an important role in improving the performance of the downstream task. In…

机器学习 · 计算机科学 2023-01-31 Jiajun Ma , Tianyang Hu , Wenjia Wang

Inspired by the humans' cognitive ability to generalise knowledge and skills, Self-Supervised Learning (SSL) targets at discovering general representations from large-scale data without requiring human annotations, which is an expensive and…

Machine learning for differential equations paves the way for computationally efficient alternatives to numerical solvers, with potentially broad impacts in science and engineering. Though current algorithms typically require simulated…

机器学习 · 计算机科学 2024-02-15 Grégoire Mialon , Quentin Garrido , Hannah Lawrence , Danyal Rehman , Yann LeCun , Bobak T. Kiani

Semi-supervised learning (SSL) aims to improve performance by exploiting unlabeled data when labels are scarce. Conventional SSL studies typically assume close environments where important factors (e.g., label, feature, distribution)…

机器学习 · 计算机科学 2024-12-25 Lan-Zhe Guo , Lin-Han Jia , Jie-Jing Shao , Yu-Feng Li

Early cancer detection is crucial for prognosis, but many cancer types lack large labelled datasets required for developing deep learning models. This paper investigates self-supervised learning (SSL) as an alternative to the standard…

图像与视频处理 · 电气工程与系统科学 2024-11-27 Hamish Haggerty , Rohitash Chandra

We consider the task of self-supervised representation learning (SSL) for tabular data: tabular-SSL. Typical contrastive learning based SSL methods require instance-wise data augmentations which are difficult to design for unstructured…

机器学习 · 计算机科学 2022-06-20 Kushal Majmundar , Sachin Goyal , Praneeth Netrapalli , Prateek Jain

Machine learning, satellites or local sensors are key factors for a sustainable and resource-saving optimisation of agriculture and proved its values for the management of agricultural land. Up to now, the main focus was on the enlargement…

Semi-supervised learning (SSL) has been widely explored in recent years, and it is an effective way of leveraging unlabeled data to reduce the reliance on labeled data. In this work, we adjust neural processes (NPs) to the semi-supervised…

计算机视觉与模式识别 · 计算机科学 2023-06-27 Jianfeng Wang , Xiaolin Hu , Thomas Lukasiewicz

Self-supervised learning has recently emerged as a strong alternative in document analysis. These approaches are now capable of learning high-quality image representations and overcoming the limitations of supervised methods, which require…

计算机视觉与模式识别 · 计算机科学 2024-04-30 Marwa Dhiaf , Mohamed Ali Souibgui , Kai Wang , Yuyang Liu , Yousri Kessentini , Alicia Fornés , Ahmed Cheikh Rouhou

With the development of deep learning, supervised learning methods perform well in remote sensing images (RSIs) scene classification. However, supervised learning requires a huge number of annotated data for training. When labeled samples…

计算机视觉与模式识别 · 计算机科学 2020-10-05 Chao Tao , Ji Qi , Weipeng Lu , Hao Wang , Haifeng Li

Deep learning has attained remarkable success in many 3D visual recognition tasks, including shape classification, object detection, and semantic segmentation. However, many of these results rely on manually collecting densely annotated…

计算机视觉与模式识别 · 计算机科学 2022-12-19 Fernando Julio Cendra , Lan Ma , Jiajun Shen , Xiaojuan Qi

Semi-supervised learning (SSL) is a promising approach for training deep classification models using labeled and unlabeled datasets. However, existing SSL methods rely on a large unlabeled dataset, which may not always be available in many…

机器学习 · 计算机科学 2023-09-29 Shin'ya Yamaguchi

Self-supervised learning (SSL) has emerged as a powerful framework to learn representations from raw data without supervision. Yet in practice, engineers face issues such as instability in tuning optimizers and collapse of representations…

机器学习 · 统计学 2023-06-02 Vivien Cabannes , Bobak T. Kiani , Randall Balestriero , Yann LeCun , Alberto Bietti

Writer independent offline signature verification is one of the most challenging tasks in pattern recognition as there is often a scarcity of training data. To handle such data scarcity problem, in this paper, we propose a novel…

计算机视觉与模式识别 · 计算机科学 2022-07-13 Siladittya Manna , Soumitri Chattopadhyay , Saumik Bhattacharya , Umapada Pal

Deep learning has proven effective for various application tasks, but its applicability is limited by the reliance on annotated examples. Self-supervised learning has emerged as a promising direction to alleviate the supervision bottleneck,…

机器学习 · 计算机科学 2021-07-28 Hoifung Poon , Hai Wang , Hunter Lang

Self-supervised learning (SSL) can be used to solve complex visual tasks without human labels. Self-supervised representations encode useful semantic information about images, and as a result, they have already been used for tasks such as…

计算机视觉与模式识别 · 计算机科学 2023-11-27 Paul Engstler , Luke Melas-Kyriazi , Christian Rupprecht , Iro Laina