English
Related papers

Related papers: StateSpace-SSL: Linear-Time Self-supervised Learni…

200 papers

Self-supervised learning (SSL) is able to build latent representations that generalize well to unseen data. However, only a few SSL techniques exist for the online CL setting, where data arrives in small minibatches, the model must comply…

Machine Learning · Computer Science 2025-07-16 Giacomo Cignoni , Andrea Cossu , Alexandra Gomez-Villa , Joost van de Weijer , Antonio Carta

Linear probing (LP) (and $k$-NN) on the upstream dataset with labels (e.g., ImageNet) and transfer learning (TL) to various downstream datasets are commonly employed to evaluate the quality of visual representations learned via…

Computer Vision and Pattern Recognition · Computer Science 2023-04-10 Jae-Hun Lee , Doyoung Yoon , ByeongMoon Ji , Kyungyul Kim , Sangheum Hwang

In many real world medical image classification settings we do not have access to samples of all possible disease classes, while a robust system is expected to give high performance in recognizing novel test data. We propose a generalized…

Image and Video Processing · Electrical Eng. & Systems 2022-08-30 Dwarikanath Mahapatra

Plants, crops and their yields are essential to our very existence, but diseases and pests cause large losses every year. As such it is vital to ensure that diseases can be spotted early and treated accordingly and stopping the spread while…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 David J. Richter

3D medical image self-supervised learning (mSSL) holds great promise for medical analysis. Effectively supporting broader applications requires considering anatomical structure variations in location, scale, and morphology, which are…

Computer Vision and Pattern Recognition · Computer Science 2025-07-04 Tan Pan , Zhaorui Tan , Kaiyu Guo , Dongli Xu , Weidi Xu , Chen Jiang , Xin Guo , Yuan Qi , Yuan Cheng

Objectives: Lung cancer poses a significant global health challenge, necessitating improved prognostic methods for personalized treatment. This study introduces a censor-aware semi-supervised learning (SSL) framework that integrates…

Medical Physics · Physics 2025-06-16 Arman Gorji , Ali Fathi Jouzdani , Nima Sanati , Ren Yuan , Arman Rahmim , Mohammad R. Salmanpour

Self-supervised learning (SSL) methods aim to exploit the abundance of unlabelled data for machine learning (ML), however the underlying principles are often method-specific. An SSL framework derived from biological first principles of…

Machine Learning · Computer Science 2023-08-03 Franz Scherr , Qinghai Guo , Timoleon Moraitis

Self-supervised learning (SSL) has emerged as a powerful paradigm for Chest X-ray (CXR) analysis under limited annotations. Yet, existing SSL strategies remain suboptimal for medical imaging. Masked image modeling allocates substantial…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Wangyu Feng , Shawn Young , Lijian Xu

Leaf disease identification plays a pivotal role in smart agriculture. However, many existing studies still struggle to integrate image and textual modalities to compensate for each other's limitations. Furthermore, many of these approaches…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Khang Nguyen Quoc , Lan Le Thi Thu , Luyl-Da Quach

Time series analysis by state-space models is widely used in forecasting and extracting unobservable components like level, slope, and seasonality, along with explanatory variables. However, their reliance on traditional Kalman filtering…

Machine Learning · Statistics 2024-08-20 André Ramos , Davi Valladão , Alexandre Street

Recent advances in self-supervised learning (SSL) have largely closed the gap with supervised ImageNet pretraining. Despite their success these methods have been primarily applied to unlabeled ImageNet images, and show marginal gains when…

Computer Vision and Pattern Recognition · Computer Science 2020-12-09 Ramprasaath R. Selvaraju , Karan Desai , Justin Johnson , Nikhil Naik

Reliable molecular property prediction is essential for various scientific endeavors and industrial applications, such as drug discovery. However, the data scarcity, combined with the highly non-linear causal relationships between…

Machine Learning · Computer Science 2025-01-14 Yue Wan , Jialu Wu , Tingjun Hou , Chang-Yu Hsieh , Xiaowei Jia

Self-Supervised Learning (SSL) is crucial for real-world applications, especially in data-hungry domains such as healthcare and self-driving cars. In addition to a lack of labeled data, these applications also suffer from distributional…

Computer Vision and Pattern Recognition · Computer Science 2022-12-26 Ha Manh Bui , Iliana Maifeld-Carucci

Deep learning can promote the mammography-based computer-aided diagnosis (CAD) for breast cancers, but it generally suffers from the small sample size problem. Self-supervised learning (SSL) has shown its effectiveness in medical image…

Image and Video Processing · Electrical Eng. & Systems 2021-08-31 Ronglin Gong , Jun Wang , Jun Shi

Cell recognition is a fundamental task in digital histopathology image analysis. Point-based cell recognition (PCR) methods normally require a vast number of annotations, which is extremely costly, time-consuming and labor-intensive.…

Computer Vision and Pattern Recognition · Computer Science 2023-06-16 Zhongyi Shui , Yizhi Zhao , Sunyi Zheng , Yunlong Zhang , Honglin Li , Shichuan Zhang , Xiaoxuan Yu , Chenglu Zhu , Lin Yang

Semi-Supervised Learning (SSL) is important for reducing the annotation cost for medical image segmentation models. State-of-the-art SSL methods such as Mean Teacher, FixMatch and Cross Pseudo Supervision (CPS) are mainly based on…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Weiren Zhao , Lanfeng Zhong , Xin Liao , Wenjun Liao , Sichuan Zhang , Shaoting Zhang , Guotai Wang

As a new paradigm in machine learning, self-supervised learning (SSL) is capable of learning high-quality representations of complex data without relying on labels. In addition to eliminating the need for labeled data, research has found…

Cryptography and Security · Computer Science 2023-08-15 Changjiang Li , Ren Pang , Zhaohan Xi , Tianyu Du , Shouling Ji , Yuan Yao , Ting Wang

Many self-supervised learning (SSL) methods have been successful in learning semantically meaningful visual representations by solving pretext tasks. However, prior work in SSL focuses on tasks like object recognition or detection, which…

Computer Vision and Pattern Recognition · Computer Science 2021-08-13 Donghyun Kim , Kuniaki Saito , Samarth Mishra , Stan Sclaroff , Kate Saenko , Bryan A Plummer

Radiography imaging protocols target on specific anatomical regions, resulting in highly consistent images with recurrent structural patterns across patients. Recent advances in medical anomaly detection have demonstrated the effectiveness…

Computer Vision and Pattern Recognition · Computer Science 2025-07-28 Rui Pan , Ruiying Lu

Detecting medical conditions from speech acoustics is fundamentally a weakly-supervised learning problem: a single, often noisy, session-level label must be linked to nuanced patterns within a long, complex audio recording. This task is…

Sound · Computer Science 2026-04-21 Xingyuan Li , Mengyue Wu