English
Related papers

Related papers: Branch-Tuning: Balancing Stability and Plasticity …

200 papers

Scene-level point cloud self-supervised learning (PC-SSL) has demonstrated potential in enhancing the generalization capability of 3D vision models. Despite the advances in the field through existing methods, the sample-independent modeling…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Xinxing Yu , Ajian Liu , Sunyuan Qiang , Hui Ma , Liying Yang , Yuzhong Wang , Zhi Rao , Yanyan Liang

Class imbalance remains a critical challenge in semi-supervised learning (SSL), especially when distributional mismatches between labeled and unlabeled data lead to biased classification. Although existing methods address this issue by…

Machine Learning · Computer Science 2025-11-25 Senmao Tian , Xiang Wei , Shunli Zhang

Self-supervised learning (SSL) has shown great promise in graph representation learning. However, most existing graph SSL methods are developed and evaluated under a single-dataset setting, leaving their cross-dataset transferability…

Machine Learning · Computer Science 2025-09-10 Yu Song , Zhigang Hua , Yan Xie , Jingzhe Liu , Bo Long , Hui Liu

Self-supervised learning (SSL) has empirically shown its data representation learnability in many downstream tasks. There are only a few theoretical works on data representation learnability, and many of those focus on final data…

Machine Learning · Computer Science 2024-01-09 Ruofeng Yang , Xiangyuan Li , Bo Jiang , Shuai Li

Spectral clustering (SC) and graph-based semi-supervised learning (SSL) algorithms are sensitive to how graphs are constructed from data. In particular if the data has proximal and unbalanced clusters these algorithms can lead to poor…

Machine Learning · Statistics 2013-02-22 Jing Qian , Venkatesh Saligrama

State-of-the-art (SOTA) semi-supervised learning (SSL) methods have been highly successful in leveraging a mix of labeled and unlabeled data by combining techniques of consistency regularization and pseudo-labeling. During pseudo-labeling,…

Semi-supervised learning (SSL) uses unlabeled data to improve the performance of machine learning models when labeled data is scarce. However, its real-world applications often face the label distribution mismatch problem, in which the…

Machine Learning · Computer Science 2025-08-05 Jinsoo Bae , Seoung Bum Kim , Hyungrok Do

We focus on developing a novel scalable graph-based semi-supervised learning (SSL) method for a small number of labeled data and a large amount of unlabeled data. Due to the lack of labeled data and the availability of large-scale unlabeled…

Machine Learning · Computer Science 2019-12-06 Zitong Wang , Li Wang , Raymond Chan , Tieyong Zeng

Low latency speech human-machine communication is becoming increasingly necessary as speech technology advances quickly in the last decade. One of the primary factors behind the advancement of speech technology is self-supervised learning.…

Computation and Language · Computer Science 2026-01-01 Yun Tang , Cindy Tseng

Stripe-like space target detection (SSTD) is crucial for space situational awareness. Traditional unsupervised methods often fail in low signal-to-noise ratio and variable stripe-like space targets scenarios, leading to weak generalization.…

Computer Vision and Pattern Recognition · Computer Science 2024-08-12 Zijian Zhu , Ali Zia , Xuesong Li , Bingbing Dan , Yuebo Ma , Hongfeng Long , Kaili Lu , Enhai Liu , Rujin Zhao

The goal of Continual Learning (CL) task is to continuously learn multiple new tasks sequentially while achieving a balance between the plasticity and stability of new and old knowledge. This paper analyzes that this insufficiency arises…

Machine Learning · Computer Science 2024-05-28 Hanxi Xiao , Fan Lyu

Continual learning has emerged as an increasingly important challenge across various tasks, including Spoken Language Understanding (SLU). In SLU, its objective is to effectively handle the emergence of new concepts and evolving…

Computation and Language · Computer Science 2024-02-19 Muqiao Yang , Xiang Li , Umberto Cappellazzo , Shinji Watanabe , Bhiksha Raj

Recent advances in image-level self-supervised learning (SSL) have made significant progress, yet learning dense representations for patches remains challenging. Mainstream methods encounter an over-dispersion phenomenon that patches from…

Computer Vision and Pattern Recognition · Computer Science 2025-09-12 Peisong Wen , Qianqian Xu , Siran Dai , Runmin Cong , Qingming Huang

Machine learning, satellites or local sensors are key factors for a sustainable and resource-saving optimisation of agriculture and proved its values for the management of agricultural land. Up to now, the main focus was on the enlargement…

Machine Learning · Computer Science 2022-04-06 Michael L. Marszalek , Bertrand Le Saux , Pierre-Philippe Mathieu , Artur Nowakowski , Daniel Springer

Semi-supervised learning (SSL) has emerged as a promising paradigm for breast ultrasound (BUS) image segmentation, but it often suffers from unstable pseudo labels under extremely limited annotations, leading to inaccurate supervision and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Ruili Li , Jiayi Ding , Ruiyu Li , Yilun Jin , Shiwen Ge , Yuwen Zeng , Xiaoyong Zhang , Eichi Takaya , Jan Vrba , Noriyasu Homma

Self-supervised learning (SSL) has become a popular method for generating invariant representations without the need for human annotations. Nonetheless, the desired invariant representation is achieved by utilising prior online…

Machine Learning · Computer Science 2024-09-30 Foivos Ntelemis , Yaochu Jin , Spencer A. Thomas

Deep learning on graphs has attracted significant interests recently. However, most of the works have focused on (semi-) supervised learning, resulting in shortcomings including heavy label reliance, poor generalization, and weak…

Machine Learning · Computer Science 2022-05-05 Yixin Liu , Ming Jin , Shirui Pan , Chuan Zhou , Yu Zheng , Feng Xia , Philip S. Yu

Self-Supervised Learning (SSL) has shown great promise in learning representations from unlabeled data. The power of learning representations without the need for human annotations has made SSL a widely used technique in real-world…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Aryan Satpathy , Nilaksh Singh , Dhruva Rajwade , Somesh Kumar

Self-supervised learning (SSL) is rapidly closing the gap with supervised methods on large computer vision benchmarks. A successful approach to SSL is to learn embeddings which are invariant to distortions of the input sample. However, a…

Computer Vision and Pattern Recognition · Computer Science 2021-06-15 Jure Zbontar , Li Jing , Ishan Misra , Yann LeCun , Stéphane Deny

Self-supervised learning (SSL) enables label efficient training for machine learning models. This is essential for domains such as medical imaging, where labels are costly and time-consuming to curate. However, the most effective supervised…

Computer Vision and Pattern Recognition · Computer Science 2023-05-16 Cara Van Uden , Jeremy Irvin , Mars Huang , Nathan Dean , Jason Carr , Andrew Ng , Curtis Langlotz