English
Related papers

Related papers: Self-Supervised Learning Based Handwriting Verific…

200 papers

Self-supervised Learning (SSL) including the mainstream contrastive learning has achieved great success in learning visual representations without data annotations. However, most of methods mainly focus on the instance level information…

Computer Vision and Pattern Recognition · Computer Science 2021-07-26 Mingkai Zheng , Shan You , Fei Wang , Chen Qian , Changshui Zhang , Xiaogang Wang , Chang Xu

Modern astronomical surveys are producing progressively larger and more complex datasets, making traditional supervised approaches that rely on extensive labelled catalogues increasingly difficult. Consequently, pre-training using…

Instrumentation and Methods for Astrophysics · Physics 2026-05-21 Johnny Joseph Alphonse , Anna M. M. Scaife

This paper describes our system developed for SemEval-2024 Task 8, ``Multigenerator, Multidomain, and Multilingual Black-Box Machine-Generated Text Detection'' Machine-generated texts have been one of the main concerns due to the use of…

Computation and Language · Computer Science 2024-03-29 Shubhashis Roy Dipta , Sadat Shahriar

The current literature on self-supervised learning (SSL) focuses on developing learning objectives to train neural networks more effectively on unlabeled data. The typical development process involves taking well-established architectures,…

Computer Vision and Pattern Recognition · Computer Science 2022-03-16 Sharath Girish , Debadeepta Dey , Neel Joshi , Vibhav Vineet , Shital Shah , Caio Cesar Teodoro Mendes , Abhinav Shrivastava , Yale Song

Incorporating heterogeneous representations from different architectures has facilitated various vision tasks, e.g., some hybrid networks combine transformers and convolutions. However, complementarity between such heterogeneous…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Zhong-Yu Li , Bo-Wen Yin , Yongxiang Liu , Li Liu , Ming-Ming Cheng

Self-supervised learning (SSL) has recently advanced through non-contrastive methods that couple an invariance term with variance, covariance, or redundancy-reduction penalties. While such objectives shape first- and second-order statistics…

Machine Learning · Computer Science 2026-05-18 Benyamin Ghojogh , M. Hadi Sepanj , Paul Fieguth

Neural networks have demonstrated exceptional performance in supervised learning, benefiting from abundant high-quality annotated data. However, obtaining such data in real-world scenarios is costly and labor-intensive. Semi-supervised…

Machine Learning · Computer Science 2025-06-03 Shuai Zhao , Heyan Huang , Xinge Li , Xiaokang Chen , Rui Wang

Deep learning on graphs has recently achieved remarkable success on a variety of tasks, while such success relies heavily on the massive and carefully labeled data. However, precise annotations are generally very expensive and…

Machine Learning · Computer Science 2021-09-30 Lirong Wu , Haitao Lin , Zhangyang Gao , Cheng Tan , Stan. Z. Li

In this work, we propose a novel methodology for self-supervised learning for generating global and local attention-aware visual features. Our approach is based on training a model to differentiate between specific image transformations of…

Computer Vision and Pattern Recognition · Computer Science 2021-08-03 Trung X. Pham , Rusty John Lloyd Mina , Dias Issa , Chang D. Yoo

Variance-Invariance-Covariance Regularization (VICReg) is a self-supervised learning (SSL) method that has shown promising results on a variety of tasks. However, the fundamental mechanisms underlying VICReg remain unexplored. In this…

Information Theory · Computer Science 2024-05-03 Ravid Shwartz-Ziv , Randall Balestriero , Kenji Kawaguchi , Tim G. J. Rudner , Yann LeCun

Recent advancements in Self-Supervised Learning (SSL) have shown promising results in Speaker Verification (SV). However, narrowing the performance gap with supervised systems remains an ongoing challenge. Several studies have observed that…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-25 Victor Miara , Theo Lepage , Reda Dehak

Handwritten signature verification poses a formidable challenge in biometrics and document authenticity. The objective is to ascertain the authenticity of a provided handwritten signature, distinguishing between genuine and forged ones.…

Computer Vision and Pattern Recognition · Computer Science 2024-01-19 Fatih Ozyurt , Jafar Majidpour , Tarik A. Rashid , Canan Koc

Self-supervision has shown outstanding results for natural language processing, and more recently, for image recognition. Simultaneously, vision transformers and its variants have emerged as a promising and scalable alternative to…

Computer Vision and Pattern Recognition · Computer Science 2022-02-01 Prarthana Bhattacharyya , Chenge Li , Xiaonan Zhao , István Fehérvári , Jason Sun

Self-supervised representation learning (SSL) methods provide an effective label-free initial condition for fine-tuning downstream tasks. However, in numerous realistic scenarios, the downstream task might be biased with respect to the…

Machine Learning · Computer Science 2022-11-01 Andrius Ovsianas , Jason Ramapuram , Dan Busbridge , Eeshan Gunesh Dhekane , Russ Webb

Perceptual quality assessment of user generated content (UGC) videos is challenging due to the requirement of large scale human annotated videos for training. In this work, we address this challenge by first designing a self-supervised…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Shankhanil Mitra , Rajiv Soundararajan

Deep supervised learning has achieved great success in the last decade. However, its deficiencies of dependence on manual labels and vulnerability to attacks have driven people to explore a better solution. As an alternative,…

Machine Learning · Computer Science 2021-06-28 Xiao Liu , Fanjin Zhang , Zhenyu Hou , Zhaoyu Wang , Li Mian , Jing Zhang , Jie Tang

Optical character recognition (OCR) systems performance have improved significantly in the deep learning era. This is especially true for handwritten text recognition (HTR), where each author has a unique style, unlike printed text, where…

Computer Vision and Pattern Recognition · Computer Science 2020-03-25 Sharon Fogel , Hadar Averbuch-Elor , Sarel Cohen , Shai Mazor , Roee Litman

This paper introduces SAGHOG, a self-supervised pretraining strategy for writer retrieval using HOG features of the binarized input image. Our preprocessing involves the application of the Segment Anything technique to extract handwriting…

Computer Vision and Pattern Recognition · Computer Science 2024-04-29 Marco Peer , Florian Kleber , Robert Sablatnig

Self-supervised learning algorithms (SSL) based on instance discrimination have shown promising results, performing competitively or even outperforming supervised learning counterparts in some downstream tasks. Such approaches employ data…

Computer Vision and Pattern Recognition · Computer Science 2025-05-01 Mohammad Alkhalefi , Georgios Leontidis , Mingjun Zhong

Generative Adversarial Networks (GANs) based semi-supervised learning (SSL) approaches are shown to improve classification performance by utilizing a large number of unlabeled samples in conjunction with limited labeled samples. However,…

Machine Learning · Computer Science 2020-09-16 Zexi Chen , Bharathkumar Ramachandra , Ranga Raju Vatsavai