English
Related papers

Related papers: Hyperspherically Regularized Networks for Self-Sup…

200 papers

Contact-rich robotic manipulation requires representations that encode local geometry. Vision provides global context but lacks direct measurements of properties such as texture and hardness, whereas touch supplies these cues. Modern…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Gurmeher Khurana , Lan Wei , Dandan Zhang

Anomaly detection on the attributed network has recently received increasing attention in many research fields, such as cybernetic anomaly detection and financial fraud detection. With the wide application of deep learning on graph…

Social and Information Networks · Computer Science 2022-09-13 Yuanjun Shi

A key challenge in lifelong imitation learning (LIL) is enabling agents to acquire new skills from expert demonstrations while retaining prior knowledge. This requires preserving the low-dimensional manifolds and geometric structures that…

Machine Learning · Computer Science 2026-03-11 Kaushik Roy , Giovanni D'urso , Nicholas Lawrance , Brendan Tidd , Peyman Moghadam

The self-supervised learning (SSL) paradigm is an essential exploration area, which tries to eliminate the need for expensive data labeling. Despite the great success of SSL methods in computer vision and natural language processing, most…

Machine Learning · Computer Science 2023-09-13 Piotr Bielak , Tomasz Kajdanowicz , Nitesh V. Chawla

We propose DiRL, a Diversity-inducing Representation Learning technique for histopathology imaging. Self-supervised learning techniques, such as contrastive and non-contrastive approaches, have been shown to learn rich and effective…

Computer Vision and Pattern Recognition · Computer Science 2023-09-13 Saarthak Kapse , Srijan Das , Jingwei Zhang , Rajarsi R. Gupta , Joel Saltz , Dimitris Samaras , Prateek Prasanna

Most self-supervised methods for representation learning leverage a cross-view consistency objective i.e., they maximize the representation similarity of a given image's augmented views. Recent work NNCLR goes beyond the cross-view paradigm…

Computer Vision and Pattern Recognition · Computer Science 2023-09-08 Tim Lebailly , Thomas Stegmüller , Behzad Bozorgtabar , Jean-Philippe Thiran , Tinne Tuytelaars

Learned image compression sits at the intersection of machine learning and image processing. With advances in deep learning, neural network-based compression methods have emerged. In this process, an encoder maps the image to a…

Computer Vision and Pattern Recognition · Computer Science 2025-09-15 Fabien Allemand , Attilio Fiandrotti , Sumanta Chaudhuri , Alaa Eddine Mazouz

Recent self-supervised models have demonstrated equal or better performance than supervised methods, opening for AI systems to learn visual representations from practically unlimited data. However, these methods are typically…

Computer Vision and Pattern Recognition · Computer Science 2022-10-10 Robin Karlsson , Tomoki Hayashi , Keisuke Fujii , Alexander Carballo , Kento Ohtani , Kazuya Takeda

Learning discriminative image representations plays a vital role in long-tailed image classification because it can ease the classifier learning in imbalanced cases. Given the promising performance contrastive learning has shown recently in…

Computer Vision and Pattern Recognition · Computer Science 2021-03-29 Peng Wang , Kai Han , Xiu-Shen Wei , Lei Zhang , Lei Wang

In self-supervised representation learning, Siamese networks are a natural architecture for learning transformation-invariance by bringing representations of positive pairs closer together. But it is prone to collapse into a degenerate…

Machine Learning · Computer Science 2025-03-13 Byeongchan Lee , Sehyun Lee

Unsupervised disentanglement is a long-standing challenge in representation learning. Recently, self-supervised techniques achieved impressive results in the sequential setting, where data is time-dependent. However, the latter methods…

Machine Learning · Computer Science 2023-05-26 Ilan Naiman , Nimrod Berman , Omri Azencot

Siamese-network-based self-supervised learning (SSL) suffers from slow convergence and instability in training. To alleviate this, we propose a framework to exploit intermediate self-supervisions in each stage of deep nets, called the…

Computer Vision and Pattern Recognition · Computer Science 2022-11-28 Ryota Yoshihashi , Shuhei Nishimura , Dai Yonebayashi , Yuya Otsuka , Tomohiro Tanaka , Takashi Miyazaki

Vision-based reinforcement learning (RL) is a promising approach to solve control tasks involving images as the main observation. State-of-the-art RL algorithms still struggle in terms of sample efficiency, especially when using image…

Machine Learning · Computer Science 2021-10-05 Elie Aljalbout , Maximilian Ulmer , Rudolph Triebel

Self-supervised learning (SSL) is a popular paradigm for representation learning. Recent multiview methods can be classified as sample-contrastive, dimension-contrastive, or asymmetric network-based, with each family having its own approach…

Machine Learning · Computer Science 2024-08-06 Oscar Skean , Aayush Dhakal , Nathan Jacobs , Luis Gonzalo Sanchez Giraldo

In self-supervised learning, self-distilled methods have shown impressive performance, learning representations useful for downstream tasks and even displaying emergent properties. However, state-of-the-art methods usually rely on ensembles…

Machine Learning · Computer Science 2026-05-01 Esteban Rodríguez-Betancourt , Edgar Casasola-Murillo

Regularization is an effective way to promote the generalization performance of machine learning models. In this paper, we focus on label smoothing, a form of output distribution regularization that prevents overfitting of a neural network…

Machine Learning · Computer Science 2020-07-07 Weizhi Li , Gautam Dasarathy , Visar Berisha

Few-shot class incremental learning implies the model to learn new classes while retaining knowledge of previously learned classes with a small number of training instances. Existing frameworks typically freeze the parameters of the…

Computer Vision and Pattern Recognition · Computer Science 2025-01-17 Parinita Nema , Vinod K Kurmi

This work presents a novel label-efficient selfsupervised representation learning-based approach for classifying diabetic retinopathy (DR) images in cross-domain settings. Most of the existing DR image classification methods are based on…

Image and Video Processing · Electrical Eng. & Systems 2023-04-25 Ekta Gupta , Varun Gupta , Muskaan Chopra , Prakash Chandra Chhipa , Marcus Liwicki

A prominent technique for self-supervised representation learning has been to contrast semantically similar and dissimilar pairs of samples. Without access to labels, dissimilar (negative) points are typically taken to be randomly sampled…

Machine Learning · Computer Science 2020-10-22 Ching-Yao Chuang , Joshua Robinson , Lin Yen-Chen , Antonio Torralba , Stefanie Jegelka

Learning quickly from very few labeled samples is a fundamental attribute that separates machines and humans in the era of deep representation learning. Unsupervised few-shot learning (U-FSL) aspires to bridge this gap by discarding the…

Computer Vision and Pattern Recognition · Computer Science 2024-02-06 Stylianos Poulakakis-Daktylidis , Hadi Jamali-Rad