English
Related papers

Related papers: Spatial Context-based Self-Supervised Learning for…

200 papers

Recent research in self-supervised learning (SSL) has shown its capability in learning useful semantic representations from images for classification tasks. Through our work, we study the usefulness of SSL for Fine-Grained Visual…

Computer Vision and Pattern Recognition · Computer Science 2021-05-20 Muhammad Maaz , Hanoona Abdul Rasheed , Dhanalaxmi Gaddam

Computer-aided diagnosis via deep learning relies on large-scale annotated data sets, which can be costly when involving expert knowledge. Semi-supervised learning (SSL) mitigates this challenge by leveraging unlabeled data. One effective…

Machine Learning · Computer Science 2020-05-25 Prashnna Kumar Gyawali , Sandesh Ghimire , Pradeep Bajracharya , Zhiyuan Li , Linwei Wang

Incorporating heterogeneous representations from different architectures has facilitated various vision tasks, e.g., some hybrid networks combine transformers and convolutions. However, complementarity between such heterogeneous…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Zhong-Yu Li , Bo-Wen Yin , Yongxiang Liu , Li Liu , Ming-Ming Cheng

As a new paradigm in machine learning, self-supervised learning (SSL) is capable of learning high-quality representations of complex data without relying on labels. In addition to eliminating the need for labeled data, research has found…

Cryptography and Security · Computer Science 2023-08-15 Changjiang Li , Ren Pang , Zhaohan Xi , Tianyu Du , Shouling Ji , Yuan Yao , Ting Wang

Self-supervised learning (SSL) can be used to solve complex visual tasks without human labels. Self-supervised representations encode useful semantic information about images, and as a result, they have already been used for tasks such as…

Computer Vision and Pattern Recognition · Computer Science 2023-11-27 Paul Engstler , Luke Melas-Kyriazi , Christian Rupprecht , Iro Laina

The immense success of deep learning based methods in computer vision heavily relies on large scale training datasets. These richly annotated datasets help the network learn discriminative visual features. Collecting and annotating such…

Computer Vision and Pattern Recognition · Computer Science 2018-07-09 Yash Patel , Lluis Gomez , Raul Gomez , Marçal Rusiñol , Dimosthenis Karatzas , C. V. Jawahar

A self-supervised multi-task learning (SSMTL) framework for video anomaly detection was recently introduced in literature. Due to its highly accurate results, the method attracted the attention of many researchers. In this work, we revisit…

Handwritten Numeral recognition plays a vital role in postal automation services especially in countries like India where multiple languages and scripts are used Discrete Hidden Markov Model (HMM) and hybrid of Neural Network (NN) and HMM…

Neural and Evolutionary Computing · Computer Science 2012-03-20 Anshuman Sharma

Deep learning on graphs has recently achieved remarkable success on a variety of tasks, while such success relies heavily on the massive and carefully labeled data. However, precise annotations are generally very expensive and…

Machine Learning · Computer Science 2021-09-30 Lirong Wu , Haitao Lin , Zhangyang Gao , Cheng Tan , Stan. Z. Li

Unsupervised representation learning has significantly advanced various machine learning tasks. In the computer vision domain, state-of-the-art approaches utilize transformations like random crop and color jitter to achieve invariant…

Computer Vision and Pattern Recognition · Computer Science 2025-01-16 Jaemyung Yu , Jaehyun Choi , Dong-Jae Lee , HyeongGwon Hong , Junmo Kim

Self-supervised learning (SSL) has demonstrated its effectiveness in learning representations through comparison methods that align with human intuition. However, mainstream SSL methods heavily rely on high body datasets with single label,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Jiale Chen

Text recognition remains a fundamental and extensively researched topic in computer vision, largely owing to its wide array of commercial applications. The challenging nature of the very problem however dictated a fragmentation of research…

Computer Vision and Pattern Recognition · Computer Science 2021-07-29 Ayan Kumar Bhunia , Aneeshan Sain , Pinaki Nath Chowdhury , Yi-Zhe Song

We introduce S$^2$VS, a video similarity learning approach with self-supervision. Self-Supervised Learning (SSL) is typically used to train deep models on a proxy task so as to have strong transferability on target tasks after fine-tuning.…

Computer Vision and Pattern Recognition · Computer Science 2023-06-19 Giorgos Kordopatis-Zilos , Giorgos Tolias , Christos Tzelepis , Ioannis Kompatsiaris , Ioannis Patras , Symeon Papadopoulos

In recent years, deep learning-based methods have shown promising results in computer vision area. However, a common deep learning model requires a large amount of labeled data, which is labor-intensive to collect and label. What's more,…

Computer Vision and Pattern Recognition · Computer Science 2021-08-25 Shuhao Qiu , Chuang Zhu , Wenli Zhou

While state-of-the-art Handwritten Text Recognition (HTR) models perform well on standard benchmarks, they frequently struggle with writers exhibiting highly specific styles that are underrepresented in the training data. To handle unseen…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Tom Simon , Stephane Nicolas , Pierrick Tranouez , Clement Chatelain , Thierry Paquet

In text recognition, self-supervised pre-training emerges as a good solution to reduce dependence on expansive annotated real data. Previous studies primarily focus on local visual representation by leveraging mask image modeling or…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Zuan Gao , Yuxin Wang , Yadong Qu , Boqiang Zhang , Zixiao Wang , Jianjun Xu , Hongtao Xie

In this paper, we investigate self-supervised pre-training methods for document text recognition. Nowadays, large unlabeled datasets can be collected for many research tasks, including text recognition, but it is costly to annotate them.…

Computer Vision and Pattern Recognition · Computer Science 2024-05-02 Martin Kišš , Michal Hradiš

Existing Scene Text Recognition (STR) methods typically use a language model to optimize the joint probability of the 1D character sequence predicted by a visual recognition (VR) model, which ignore the 2D spatial context of visual…

Computer Vision and Pattern Recognition · Computer Science 2021-12-28 Yue He , Chen Chen , Jing Zhang , Juhua Liu , Fengxiang He , Chaoyue Wang , Bo Du

The primary challenge for handwriting recognition systems lies in managing long-range contextual dependencies, an issue that traditional models often struggle with. To mitigate it, attention mechanisms have recently been employed to enhance…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Sara Ferro , Alessandro Torcinovich , Arianna Traviglia , Marcello Pelillo

Self-supervised learning offers an efficient way of extracting rich representations from various types of unlabeled data while avoiding the cost of annotating large-scale datasets. This is achievable by designing a pretext task to form…

Machine Learning · Computer Science 2023-10-11 Pouya Mehralian , Bagher BabaAli , Ashena Gorgan Mohammadi