English
Related papers

Related papers: Improving self-supervised pretraining models for e…

200 papers

In the context of mobile sensing environments, various sensors on mobile devices continually generate a vast amount of data. Analyzing this ever-increasing data presents several challenges, including limited access to annotated data and a…

Machine Learning · Computer Science 2023-05-02 Jason Liu , Shohreh Deldari , Hao Xue , Van Nguyen , Flora D. Salim

Training deep fully convolutional neural networks (F-CNNs) for semantic image segmentation requires access to abundant labeled data. While large datasets of unlabeled image data are available in medical applications, access to manually…

Computer Vision and Pattern Recognition · Computer Science 2017-07-04 Abhijit Guha Roy , Sailesh Conjeti , Debdoot Sheet , Amin Katouzian , Nassir Navab , Christian Wachinger

This paper proposes a deep learning (DL) model for automatic sleep stage classification based on single-channel EEG data. The DL model features a convolutional neural network (CNN) and transformers. The model was designed to run on energy…

Signal Processing · Electrical Eng. & Systems 2022-11-24 Zongyan Yao , Xilin Liu

We exploit a self-supervised deep multi-task learning framework for electrocardiogram (ECG) -based emotion recognition. The proposed solution consists of two stages of learning a) learning ECG representations and b) learning to classify…

Signal Processing · Electrical Eng. & Systems 2020-08-11 Pritam Sarkar , Ali Etemad

The remarkable success of today's deep neural networks highly depends on a massive number of correctly labeled data. However, it is rather costly to obtain high-quality human-labeled data, leading to the active research area of training…

Machine Learning · Computer Science 2020-11-04 Jiacheng Wang , Yue Ma , Shuang Gao

Semi-supervised learning lately has shown much promise in improving deep learning models when labeled data is scarce. Common among recent approaches is the use of consistency training on a large amount of unlabeled data to constrain model…

Machine Learning · Computer Science 2020-11-06 Qizhe Xie , Zihang Dai , Eduard Hovy , Minh-Thang Luong , Quoc V. Le

Medical time series has been playing a vital role in real-world healthcare systems as valuable information in monitoring health conditions of patients. Accurate classification for medical time series, e.g., Electrocardiography (ECG)…

Machine Learning · Computer Science 2025-02-10 Wei Fan , Jingru Fei , Dingyu Guo , Kun Yi , Xiaozhuang Song , Haolong Xiang , Hangting Ye , Min Li

Recent advances in self-supervised learning for EEG representation have largely relied on masked reconstruction, where models are trained to recover randomly masked signal segments. While effective at modeling local dependencies, such…

Machine Learning · Computer Science 2026-04-17 Shaocong Wang , Tong Liu , Yihan Li , Ming Li , Kairui Wen , Pei Yang , Wenqi Ji , Minjing Yu , Yong-Jin Liu

In this study, we investigated whether self-supervised pretraining could produce a neural network feature extractor applicable to multiple classification tasks in B-mode lung ultrasound analysis. When fine-tuning on three lung ultrasound…

Computer Vision and Pattern Recognition · Computer Science 2023-09-07 Blake VanBerlo , Brian Li , Jesse Hoey , Alexander Wong

Semi-supervised algorithms aim to learn prediction functions from a small set of labeled observations and a large set of unlabeled observations. Because this framework is relevant in many applications, they have received a lot of interest…

Machine Learning · Computer Science 2025-02-17 Massih-Reza Amini , Vasilii Feofanov , Loic Pauletto , Lies Hadjadj , Emilie Devijver , Yury Maximov

Pretraining on large labeled datasets is a prerequisite to achieve good performance in many computer vision tasks like 2D object recognition, video classification etc. However, pretraining is not widely used for 3D recognition tasks where…

Computer Vision and Pattern Recognition · Computer Science 2021-01-08 Zaiwei Zhang , Rohit Girdhar , Armand Joulin , Ishan Misra

Few-shot node classification poses a significant challenge for Graph Neural Networks (GNNs) due to insufficient supervision and potential distribution shifts between labeled and unlabeled nodes. Self-training has emerged as a widely popular…

Machine Learning · Computer Science 2024-01-22 Fali Wang , Tianxiang Zhao , Suhang Wang

We introduce Mediffusion -- a new method for semi-supervised learning with explainable classification based on a joint diffusion model. The medical imaging domain faces unique challenges due to scarce data labelling -- insufficient for…

Computer Vision and Pattern Recognition · Computer Science 2024-11-15 Joanna Kaleta , Paweł Skierś , Jan Dubiński , Przemysław Korzeniowski , Kamil Deja

Seizure detection from EEGs is a challenging and time consuming clinical problem that would benefit from the development of automated algorithms. EEGs can be viewed as structural time series, because they are multivariate time series where…

Machine Learning · Computer Science 2019-05-07 Ian Covert , Balu Krishnan , Imad Najm , Jiening Zhan , Matthew Shore , John Hixson , Ming Jack Po

Research on unsupervised domain adaptation (UDA) for semantic segmentation of remote sensing images has been extensively conducted. However, research on how to achieve domain adaptation in practical scenarios where source domain data is…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Wenjie Liu , Hongmin Liu , Lixin Zhang , Bin Fan

Supervised (pre-)training currently yields state-of-the-art performance for representation learning for visual recognition, yet it comes at the cost of (1) intensive manual annotations and (2) an inherent restriction in the scope of data…

Computer Vision and Pattern Recognition · Computer Science 2016-12-05 Ruohan Gao , Dinesh Jayaraman , Kristen Grauman

Early detection of suicidal ideation in depressed individuals can allow for adequate medical attention and support, which in many cases is life-saving. Recent NLP research focuses on classifying, from a given piece of text, if an individual…

Machine Learning · Computer Science 2021-06-23 Ayaan Haque , Viraaj Reddi , Tyler Giallanza

Predicting seizure freedom is essential for tailoring epilepsy treatment. But accurate prediction remains challenging with traditional methods, especially with diverse patient populations. This study developed a deep learning-based graph…

Self-supervised pre-training appears as an advantageous alternative to supervised pre-trained for transfer learning. By synthesizing annotations on pretext tasks, self-supervision allows to pre-train models on large amounts of pseudo-labels…

Computer Vision and Pattern Recognition · Computer Science 2022-08-23 Levy Chaves , Alceu Bissoto , Eduardo Valle , Sandra Avila

Deep neural networks are prone to overfitting noisy labels, resulting in poor generalization performance. To overcome this problem, we present a simple and effective method self-ensemble label correction (SELC) to progressively correct…

Computer Vision and Pattern Recognition · Computer Science 2022-05-04 Yangdi Lu , Wenbo He