English
Related papers

Related papers: Self-supervised Deep Learning for Reading Activity…

200 papers

Depth estimation (DE) provides spatial information about a scene and enables tasks such as 3D reconstruction, object detection, and scene understanding. Recently, there has been an increasing interest in using deep learning (DL)-based…

Computer Vision and Pattern Recognition · Computer Science 2025-01-10 Ali Rohan , Md Junayed Hasan , Andrei Petrovski

We investigate the utility of in-domain self-supervised pre-training of vision models in the analysis of remote sensing imagery. Self-supervised learning (SSL) has emerged as a promising approach for remote sensing image classification due…

Computer Vision and Pattern Recognition · Computer Science 2024-02-06 Ivica Dimitrovski , Ivan Kitanovski , Nikola Simidjievski , Dragi Kocev

This paper looks at semi-supervised learning (SSL) for image-based text recognition. One of the most popular SSL approaches is pseudo-labeling (PL). PL approaches assign labels to unlabeled data before re-training the model with a…

Computer Vision and Pattern Recognition · Computer Science 2022-10-10 Gaurav Patel , Jan Allebach , Qiang Qiu

Self-supervised pretraining has been observed to be effective at improving feature representations for transfer learning, leveraging large amounts of unlabelled data. This review summarizes recent research into its usage in X-ray, computed…

Machine Learning · Computer Science 2023-09-07 Blake VanBerlo , Jesse Hoey , Alexander Wong

As a newly emerging unsupervised learning paradigm, self-supervised learning (SSL) recently gained widespread attention, which usually introduces a pretext task without manual annotation of data. With its help, SSL effectively learns the…

Computer Vision and Pattern Recognition · Computer Science 2020-05-18 Chuanxing Geng , Zhenghao Tan , Songcan Chen

In this work, we observe a counterintuitive phenomenon in self-supervised learning (SSL): longer training may impair the performance of dense prediction tasks (e.g., semantic segmentation). We refer to this phenomenon as Self-supervised…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Siran Dai , Qianqian Xu , Peisong Wen , Yang Liu , Qingming Huang

Recent research has shown the potential of deep learning in multi-parametric MRI-based visual pathway (VP) segmentation. However, obtaining labeled data for training is laborious and time-consuming. Therefore, it is crucial to develop…

Image and Video Processing · Electrical Eng. & Systems 2024-01-04 Alou Diakite , Cheng Li , Lei Xie , Yuanjing Feng , Hua Han , Shanshan Wang

The supervised learning paradigm is limited by the cost - and sometimes the impracticality - of data collection and labeling in multiple domains. Self-supervised learning, a paradigm which exploits the structure of unlabeled data to create…

Self-supervised learning (SSL) can be used to solve complex visual tasks without human labels. Self-supervised representations encode useful semantic information about images, and as a result, they have already been used for tasks such as…

Computer Vision and Pattern Recognition · Computer Science 2023-11-27 Paul Engstler , Luke Melas-Kyriazi , Christian Rupprecht , Iro Laina

Compared with single-label image classification, multi-label image classification is more practical and challenging. Some recent studies attempted to leverage the semantic information of categories for improving multi-label image…

Computer Vision and Pattern Recognition · Computer Science 2021-04-05 Fengtao Zhou , Sheng Huang , Yun Xing

Supervised deep learning algorithms have enabled significant performance gains in medical image classification tasks. But these methods rely on large labeled datasets that require resource-intensive expert annotation. Semi-supervised…

Semi-supervised multi-label learning (SSMLL) is a powerful framework for leveraging unlabeled data to reduce the expensive cost of collecting precise multi-label annotations. Unlike semi-supervised learning, one cannot select the most…

Machine Learning · Computer Science 2024-12-30 Jia-Hao Xiao , Ming-Kun Xie , Heng-Bo Fan , Gang Niu , Masashi Sugiyama , Sheng-Jun Huang

Data labeling in supervised learning is considered an expensive and infeasible tool in some conditions. The self-supervised learning method is proposed to tackle the learning effectiveness with fewer labeled data, however, there is a lack…

Machine Learning · Computer Science 2021-08-18 Hilal AlQuabeh , Ameera Bawazeer , Abdulateef Alhashmi

Human fall is one of the very critical health issues, especially for elders and disabled people living alone. The number of elder populations is increasing steadily worldwide. Therefore, human fall detection is becoming an effective…

Computer Vision and Pattern Recognition · Computer Science 2022-07-25 Ekram Alam , Abu Sufian , Paramartha Dutta , Marco Leo

Document screening is a central task within Evidenced Based Medicine, which is a clinical discipline that supplements scientific proof to back medical decisions. Given the recent advances in DL (Deep Learning) methods applied to Information…

Information Retrieval · Computer Science 2021-04-20 Alexandros Ioannidis

While semi-supervised learning (SSL) has received tremendous attentions in many machine learning tasks due to its successful use of unlabeled data, existing SSL algorithms use either all unlabeled examples or the unlabeled examples with a…

Machine Learning · Computer Science 2021-09-03 Yi Xu , Lei Shang , Jinxing Ye , Qi Qian , Yu-Feng Li , Baigui Sun , Hao Li , Rong Jin

For preventing youth suicide, social media platforms have received much attention from researchers. A few researches apply machine learning, or deep learning-based text classification approaches to classify social media posts containing…

Computation and Language · Computer Science 2022-06-20 Siqu Long , Rina Cabral , Josiah Poon , Soyeon Caren Han

Deep learning is very data hungry, and supervised learning especially requires massive labeled data to work well. Machine listening research often suffers from limited labeled data problem, as human annotations are costly to acquire, and…

Sound · Computer Science 2021-02-08 Ho-Hsiang Wu , Chieh-Chi Kao , Qingming Tang , Ming Sun , Brian McFee , Juan Pablo Bello , Chao Wang

Vision transformers combined with self-supervised learning have enabled the development of models which scale across large datasets for several downstream tasks like classification, segmentation and detection. The low-shot learning…

Computer Vision and Pattern Recognition · Computer Science 2024-06-26 Srinivasa Rao Nandam , Sara Atito , Zhenhua Feng , Josef Kittler , Muhammad Awais

Data annotation is an essential stage in supervised learning. However, the annotation process is exhaustive and time consuming, specially for large datasets. Activities of Daily Living (ADL) recognition is an example of systems that exploit…

Machine Learning · Computer Science 2020-02-18 Alaa E. Abdel-Hakim , Wael Deabes