English
Related papers

Related papers: Self-Supervised Learning with Probabilistic Densit…

200 papers

Deep learning with noisy labels is a challenging task. Recent prominent methods that build on a specific sample selection (SS) strategy and a specific semi-supervised learning (SSL) model achieved state-of-the-art performance. Intuitively,…

Machine Learning · Computer Science 2020-12-03 Zhuowei Wang , Jing Jiang , Bo Han , Lei Feng , Bo An , Gang Niu , Guodong Long

Large amounts of labeled data are typically required to train deep learning models. For many real-world problems, however, acquiring additional data can be expensive or even impossible. We present semi-supervised deep kernel learning…

Machine Learning · Computer Science 2019-03-05 Neal Jean , Sang Michael Xie , Stefano Ermon

This paper focuses on webly supervised learning (WSL), where datasets are built by crawling samples from the Internet and directly using search queries as web labels. Although WSL benefits from fast and low-cost data collection, noises in…

Computer Vision and Pattern Recognition · Computer Science 2020-08-28 Jingkang Yang , Litong Feng , Weirong Chen , Xiaopeng Yan , Huabin Zheng , Ping Luo , Wayne Zhang

Semi-supervised learning (SSL) provides a powerful framework for leveraging unlabeled data when labels are limited or expensive to obtain. SSL algorithms based on deep neural networks have recently proven successful on standard benchmark…

Machine Learning · Computer Science 2019-05-28 Jiaxing Wang , Yin Zheng , Xiaoshuang Chen , Junzhou Huang , Jian Cheng

This paper looks at semi-supervised learning (SSL) for image-based text recognition. One of the most popular SSL approaches is pseudo-labeling (PL). PL approaches assign labels to unlabeled data before re-training the model with a…

Computer Vision and Pattern Recognition · Computer Science 2022-10-10 Gaurav Patel , Jan Allebach , Qiang Qiu

Class-agnostic motion prediction methods aim to comprehend motion within open-world scenarios, holding significance for autonomous driving systems. However, training a high-performance model in a fully-supervised manner always requires…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Kewei Wang , Yizheng Wu , Zhiyu Pan , Xingyi Li , Ke Xian , Zhe Wang , Zhiguo Cao , Guosheng Lin

Unsupervised clustering algorithm can effectively reduce the dimension of high-dimensional unlabeled data, thus reducing the time and space complexity of data processing. However, the traditional clustering algorithm needs to set the upper…

Machine Learning · Computer Science 2022-01-17 Zecang Gu , Xiaoqi Sun , Yuan Sun , Fuquan Zhang

Self-supervised learning (SSL) has empirically shown its data representation learnability in many downstream tasks. There are only a few theoretical works on data representation learnability, and many of those focus on final data…

Machine Learning · Computer Science 2024-01-09 Ruofeng Yang , Xiangyuan Li , Bo Jiang , Shuai Li

We propose a neural network approach to produce probabilistic weather forecasts from a deterministic numerical weather prediction. Our approach is applied to operational surface temperature outputs from the Global Deterministic Prediction…

Atmospheric and Oceanic Physics · Physics 2025-04-07 David Landry , Anastase Charantonis , Claire Monteleoni

Data-driven modeling based on machine learning (ML) is showing enormous potential for weather forecasting. Rapid progress has been made with impressive results for some applications. The uptake of ML methods could be a game-changer for the…

This paper demonstrates that pre-trained language models (PLMs) are strong foundation models for on-device meteorological variables modeling. We present LM-Weather, a generic approach to taming PLMs, that have learned massive sequential…

Atmospheric and Oceanic Physics · Physics 2024-06-03 Shengchao Chen , Guodong Long , Jing Jiang , Chengqi Zhang

Label distribution learning (LDL) provides a framework wherein a distribution over categories rather than a single category is predicted, with the aim of addressing ambiguity in labeled data. Existing research on LDL mainly focuses on the…

Machine Learning · Computer Science 2025-06-10 Daokun Zhang , Russell Tsuchida , Dino Sejdinovic

Self-supervised learning (SSL) methods targeting scene images have seen a rapid growth recently, and they mostly rely on either a dedicated dense matching mechanism or a costly unsupervised object discovery module. This paper shows that…

Computer Vision and Pattern Recognition · Computer Science 2023-10-02 Ke Zhu , Minghao Fu , Jianxin Wu

Recently, deep-learning weather forecasting models have surpassed traditional numerical models in terms of the accuracy of meteorological variables. However, there is considerable potential for improvements in precipitation forecasts,…

Atmospheric and Oceanic Physics · Physics 2024-11-20 Weiwen Ji , Jin Feng , Yueqi Liu , Yulu Qiu , Hua Gao

Learning from large amounts of unsupervised data and a small amount of supervision is an important open problem in computer vision. We propose a new semi-supervised learning method, Semantic Positives via Pseudo-Labels (SemPPL), that…

Computer Vision and Pattern Recognition · Computer Science 2024-01-11 Matko Bošnjak , Pierre H. Richemond , Nenad Tomasev , Florian Strub , Jacob C. Walker , Felix Hill , Lars Holger Buesing , Razvan Pascanu , Charles Blundell , Jovana Mitrovic

Semi-supervised learning (SSL) alleviates the cost of data labeling process by exploiting unlabeled data and has achieved promising results. Meanwhile, with the development of large foundation models, exploiting pre-trained models becomes a…

Machine Learning · Computer Science 2025-10-28 Song-Lin Lv , Rui Zhu , Tong Wei , Yu-Feng Li , Lan-Zhe Guo

Minimizing prediction uncertainty on unlabeled data is a key factor to achieve good performance in semi-supervised learning (SSL). The prediction uncertainty is typically expressed as the \emph{entropy} computed by the transformed…

Machine Learning · Computer Science 2021-12-16 Jing Li , Yuangang Pan , Ivor W. Tsang

Accurate prediction of material properties facilitates the discovery of novel materials with tailored functionalities. Deep learning models have recently shown superior accuracy and flexibility in capturing structure-property relationships.…

Machine Learning · Computer Science 2025-04-30 Chowdhury Mohammad Abid Rahman , Aldo H. Romero , Prashnna K. Gyawali

Given a small set of labeled data and a large set of unlabeled data, semi-supervised learning (SSL) attempts to leverage the location of the unlabeled datapoints in order to create a better classifier than could be obtained from supervised…

Machine Learning · Computer Science 2022-05-25 Michael C. Burkhart , Kyle Shan

In recent years, there has been growing interest in using Precipitable Water Vapor (PWV) derived from Global Positioning System (GPS) signal delays to predict rainfall. However, the occurrence of rainfall is dependent on a myriad of…

Atmospheric and Oceanic Physics · Physics 2020-01-08 Shilpa Manandhar , Soumyabrata Dev , Yee Hui Lee , Yu Song Meng , Stefan Winkler