English
Related papers

Related papers: Do Neural Scaling Laws Exist on Graph Self-Supervi…

200 papers

While semi-supervised learning (SSL) has received tremendous attentions in many machine learning tasks due to its successful use of unlabeled data, existing SSL algorithms use either all unlabeled examples or the unlabeled examples with a…

Machine Learning · Computer Science 2021-09-03 Yi Xu , Lei Shang , Jinxing Ye , Qi Qian , Yu-Feng Li , Baigui Sun , Hao Li , Rong Jin

Graph neural networks (GNNs) work remarkably well in semi-supervised node regression, yet a rigorous theory explaining when and why they succeed remains lacking. To address this gap, we study an aggregate-and-readout model that encompasses…

Machine Learning · Statistics 2026-02-20 Juntong Chen , Claire Donnat , Olga Klopp , Johannes Schmidt-Hieber

Self-supervised learning (SSL) has emerged as a central paradigm for training foundation models by leveraging large-scale unlabeled datasets, often producing representations with strong generalization capabilities. These models are…

Computer Vision and Pattern Recognition · Computer Science 2026-01-30 Brown Ebouky , Ajad Chhatkuli , Cristiano Malossi , Christoph Studer , Roy Assaf , Andrea Bartezzaghi

Extracting information from the electrocardiography (ECG) signal is an essential step in the design of digital health technologies in cardiology. In recent years, several machine learning (ML) algorithms for automatic extraction of…

Signal Processing · Electrical Eng. & Systems 2023-05-18 Adrian Atienza , Jakob Bardram , Sadasivan Puthusserypady

We present a graph-based semi-supervised learning (SSL) method for learning edge flows defined on a graph. Specifically, given flow measurements on a subset of edges, we want to predict the flows on the remaining edges. To this end, we…

Machine Learning · Computer Science 2019-05-21 Junteng Jia , Michael T. Schaub , Santiago Segarra , Austin R. Benson

We investigate the generalization of semi-supervised learning (SSL) to diverse pixel-wise tasks. Although SSL methods have achieved impressive results in image classification, the performances of applying them to pixel-wise tasks are…

Computer Vision and Pattern Recognition · Computer Science 2020-08-13 Zhanghan Ke , Di Qiu , Kaican Li , Qiong Yan , Rynson W. H. Lau

Semi-supervised learning (SSL) is an important theme in machine learning, in which we have a few labeled samples and many unlabeled samples. In this paper, for SSL in a regression problem, we consider a method of incorporating information…

Machine Learning · Computer Science 2024-11-20 Katsuyuki Hagiwara

Deep learning (DL) models have now been widely used for high-performance material property prediction for properties such as formation energy and band gap. However, training such DL models usually requires a large amount of labeled data,…

Materials Science · Physics 2024-01-11 Nihang Fu , Lai Wei , Jianjun Hu

Self-supervised learning (SSL), in particular contrastive learning, has made great progress in recent years. However, a common theme in these methods is that they inherit the learning paradigm from the supervised deep learning scenario.…

Computer Vision and Pattern Recognition · Computer Science 2021-03-26 Yun-Hao Cao , Jianxin Wu

Self-supervised learning (SSL), which can automatically generate ground-truth samples from raw data, holds vast potential to improve recommender systems. Most existing SSL-based methods perturb the raw data graph with uniform node/edge…

Information Retrieval · Computer Science 2021-08-27 Junliang Yu , Hongzhi Yin , Min Gao , Xin Xia , Xiangliang Zhang , Nguyen Quoc Viet Hung

Graph neural networks (GNNs) are widely applied in graph data modeling. However, existing GNNs are often trained in a task-driven manner that fails to fully capture the intrinsic nature of the graph structure, resulting in sub-optimal node…

Machine Learning · Computer Science 2024-07-17 Zhenhua Huang , Kunhao Li , Shaojie Wang , Zhaohong Jia , Wentao Zhu , Sharad Mehrotra

Self-supervised learning (SSL) aims to find meaningful representations from unlabeled data by encoding semantic similarities through data augmentations. Despite its current popularity, theoretical insights about SSL are still scarce. For…

Machine Learning · Computer Science 2025-05-27 Maximilian Fleissner , Pascal Esser , Debarghya Ghoshdastidar

Graph Neural Networks (GNNs) have become a prominent approach for learning from graph-structured data. However, their effectiveness can be significantly compromised when the graph structure is suboptimal. To address this issue, Graph…

Machine Learning · Computer Science 2025-02-20 Shen Han , Zhiyao Zhou , Jiawei Chen , Zhezheng Hao , Sheng Zhou , Gang Wang , Yan Feng , Chun Chen , Can Wang

Traditional semi-supervised learning (SSL) assumes that the feature distributions of labeled and unlabeled data are consistent which rarely holds in realistic scenarios. In this paper, we propose a novel SSL setting, where unlabeled samples…

Computer Vision and Pattern Recognition · Computer Science 2024-06-03 Jiachen Liang , Ruibing Hou , Hong Chang , Bingpeng Ma , Shiguang Shan , Xilin Chen

The past few years have witnessed a remarkable advance in deep learning for EEG-based sleep stage classification (SSC). However, the success of these models is attributed to possessing a massive amount of labeled data for training, limiting…

Signal Processing · Electrical Eng. & Systems 2022-10-14 Emadeldeen Eldele , Mohamed Ragab , Zhenghua Chen , Min Wu , Chee-Keong Kwoh , Xiaoli Li

Deep learning-based semi-supervised learning (SSL) algorithms have led to promising results in medical images segmentation and can alleviate doctors' expensive annotations by leveraging unlabeled data. However, most of the existing SSL…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 Xiangde Luo , Jieneng Chen , Tao Song , Yinan Chen , Guotai Wang , Shaoting Zhang

Semantic segmentation of various tissue and nuclei types in histology images is fundamental to many downstream tasks in the area of computational pathology (CPath). In recent years, Deep Learning (DL) methods have been shown to perform well…

Computer Vision and Pattern Recognition · Computer Science 2023-02-14 Raja Muhammad Saad Bashir , Talha Qaiser , Shan E Ahmed Raza , Nasir M. Rajpoot

We experiment graph-based Semi-Supervised Learning (SSL) of Conditional Random Fields (CRF) for the application of Spoken Language Understanding (SLU) on unaligned data. The aligned labels for examples are obtained using IBM Model. We adapt…

Computation and Language · Computer Science 2017-01-31 Mohammad Aliannejadi , Masoud Kiaeeha , Shahram Khadivi , Saeed Shiry Ghidary

Neural scaling laws have driven significant advancements in machine learning, particularly in domains like language modeling and computer vision. However, the exploration of neural scaling laws within robotics has remained relatively…

Robotics · Computer Science 2025-01-28 Sebastian Sartor , Neil Thompson

Self-supervised learning (SSL) is a method that learns the data representation by utilizing supervision inherent in the data. This learning method is in the spotlight in the drug field, lacking annotated data due to time-consuming and…

Biomolecules · Quantitative Biology 2022-08-19 Kisung Moon , Sunyoung Kwon