English
Related papers

Related papers: Improving self-supervised pretraining models for e…

200 papers

Within the intensive care unit (ICU), a wealth of patient data, including clinical measurements and clinical notes, is readily available. This data is a valuable resource for comprehending patient health and informing medical decisions, but…

Machine Learning · Computer Science 2023-12-13 Ryan King , Tianbao Yang , Bobak Mortazavi

EEG-based Emotion recognition holds significant promise for applications in human-computer interaction, medicine, and neuroscience. While deep learning has shown potential in this field, current approaches usually rely on large-scale…

Signal Processing · Electrical Eng. & Systems 2024-03-08 Hanqi Wang , Tao Chen , Liang Song

We study pseudo-labeling for the semi-supervised training of ResNet, Time-Depth Separable ConvNets, and Transformers for speech recognition, with either CTC or Seq2Seq loss functions. We perform experiments on the standard LibriSpeech…

Deep learning segmentation relies heavily on labeled data, but manual labeling is laborious and time-consuming, especially for volumetric images such as brain magnetic resonance imaging (MRI). While recent domain-randomization techniques…

Computer Vision and Pattern Recognition · Computer Science 2025-12-05 Bella Specktor-Fadida , Malte Hoffmann

Many successful methods developed for medical image analysis that are based on machine learning use supervised learning approaches, which often require large datasets annotated by experts to achieve high accuracy. However, medical data…

Computer Vision and Pattern Recognition · Computer Science 2022-07-25 Banafshe Felfeliyan , Abhilash Hareendranathan , Gregor Kuntze , David Cornell , Nils D. Forkert , Jacob L. Jaremko , Janet L. Ronsky

Self-supervised learning, which benefits from automatically constructing labels through pre-designed pretext task, has recently been applied for strengthen supervised learning. Since previous self-supervised pretext tasks are based on…

Computer Vision and Pattern Recognition · Computer Science 2021-06-10 Zilin Ding , Yuhang Yang , Xuan Cheng , Xiaomin Wang , Ming Liu

Analyzing electroencephalographic (EEG) time series can be challenging, especially with deep neural networks, due to the large variability among human subjects and often small datasets. To address these challenges, various strategies, such…

Machine Learning · Computer Science 2025-09-18 Niklas Grieger , Siamak Mehrkanoon , Stephan Bialonski

With the increasing availability of data for Prognostics and Health Management (PHM), Deep Learning (DL) techniques are now the subject of considerable attention for this application, often achieving more accurate Remaining Useful Life…

Machine Learning · Statistics 2023-01-25 Anass Akrim , Christian Gogu , Rob Vingerhoeds , Michel Salaün

Developing successful artificial intelligence systems in practice depends on both robust deep learning models and large, high-quality data. However, acquiring and labeling data can be prohibitively expensive and time-consuming in many…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Saba Dadsetan , Mohsen Hejrati , Shandong Wu , Somaye Hashemifar

To build a French national electronic injury surveillance system based on emergency room visits, we aim to develop a coding system to classify their causes from clinical notes in free-text. Supervised learning techniques have shown good…

Computation and Language · Computer Science 2021-04-08 Binbin Xu , Cédric Gil-Jardiné , Frantz Thiessard , Eric Tellier , Marta Avalos , Emmanuel Lagarde

Recently, graph-based semi-supervised learning and pseudo-labeling have gained attention due to their effectiveness in reducing the need for extensive data annotations. Pseudo-labeling uses predictions from unlabeled data to improve model…

Computer Vision and Pattern Recognition · Computer Science 2025-10-30 Jingjun Bi , Fadi Dornaika

Noisy labels hurt deep learning-based supervised image classification performance as the models may overfit the noise and learn corrupted feature extractors. For natural image classification training with noisy labeled data, model…

Image and Video Processing · Electrical Eng. & Systems 2023-08-10 Bidur Khanal , Binod Bhattarai , Bishesh Khanal , Cristian A. Linte

Semi-supervised learning has demonstrated promising results in automatic speech recognition (ASR) by self-training using a seed ASR model with pseudo-labels generated for unlabeled data. The effectiveness of this approach largely relies on…

Machine Learning · Computer Science 2021-02-17 Niko Moritz , Takaaki Hori , Jonathan Le Roux

Objective. Deep neural networks (DNNs) have shown unprecedented success in various brain-machine interface applications such as epileptic seizure prediction. However, existing approaches typically train models in a patient-specific fashion…

Machine Learning · Computer Science 2022-06-14 Di Wu , Jie Yang , Mohamad Sawan

Epilepsy is the fourth most common neurological disorder, affecting about 1% of the population at all ages. As many as 60% of people with epilepsy experience focal seizures which originate in a certain brain area and are limited to part of…

Machine Learning · Computer Science 2019-03-20 Diyuan Lu , Jochen Triesch

In this paper, we present a semi-supervised training technique using pseudo-labeling for end-to-end neural diarization (EEND). The EEND system has shown promising performance compared with traditional clustering-based methods, especially in…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-10 Yuki Takashima , Yusuke Fujita , Shota Horiguchi , Shinji Watanabe , Paola García , Kenji Nagamatsu

Unsupervised clustering on speakers is becoming increasingly important for its potential uses in semi-supervised learning. In reality, we are often presented with enormous amounts of unlabeled data from multi-party meetings and discussions.…

Audio and Speech Processing · Electrical Eng. & Systems 2022-04-26 Fuchuan Tong , Siqi Zheng , Min Zhang , Yafeng Chen , Hongbin Suo , Qingyang Hong , Lin Li

Deep neural networks (DNNs) have been shown to over-fit a dataset when being trained with noisy labels for a long enough time. To overcome this problem, we present a simple and effective method self-ensemble label filtering (SELF) to…

Computer Vision and Pattern Recognition · Computer Science 2019-10-07 Duc Tam Nguyen , Chaithanya Kumar Mummadi , Thi Phuong Nhung Ngo , Thi Hoai Phuong Nguyen , Laura Beggel , Thomas Brox

Training deep neural networks requires massive amounts of training data, but for many tasks only limited labeled data is available. This makes weak supervision attractive, using weak or noisy signals like the output of heuristic methods or…

Machine Learning · Computer Science 2017-12-08 Mostafa Dehghani , Aliaksei Severyn , Sascha Rothe , Jaap Kamps

Graph property prediction tasks are important and numerous. While each task offers a small size of labeled examples, unlabeled graphs have been collected from various sources and at a large scale. A conventional approach is training a model…

Machine Learning · Computer Science 2023-10-13 Gang Liu , Eric Inae , Tong Zhao , Jiaxin Xu , Tengfei Luo , Meng Jiang