English
Related papers

Related papers: Pretraining ECG Data with Adversarial Masking Impr…

200 papers

While scaling laws have established a fundamental framework for foundation models in natural language processing, their applicability to electrocardiogram (ECG) models remains poorly characterized. Indeed, recent studies do not always yield…

Machine Learning · Computer Science 2026-05-19 Jiawei Li , Fabio Bonassi , Ming Jin , Stefan Gustafsson , Johan Sundström , Thomas B. Schön , Antônio H. Ribeiro

Acquiring large quantities of data and annotations is known to be effective for developing high-performing deep learning models, but is difficult and expensive to do in the healthcare context. Adding synthetic training data using generative…

Image and Video Processing · Electrical Eng. & Systems 2023-10-06 Menghan Yu , Sourabh Kulhare , Courosh Mehanian , Charles B Delahunt , Daniel E Shea , Zohreh Laverriere , Ishan Shah , Matthew P Horning

Electrocardiogram (ECG) data collection during emergency situations is challenging, making ECG data generation an efficient solution for dealing with highly imbalanced ECG training datasets. In this paper, we propose a novel approach for…

Signal Processing · Electrical Eng. & Systems 2023-06-06 Nour Neifar , Achraf Ben-Hamadou , Afef Mdhaffar , Mohamed Jmaiel , Bernd Freisleben

The task of detecting whether a person wears a face mask from speech is useful in modelling speech in forensic investigations, communication between surgeons or people protecting themselves against infectious diseases such as COVID-19. In…

Audio and Speech Processing · Electrical Eng. & Systems 2020-07-28 Nicolae-Cătălin Ristea , Radu Tudor Ionescu

Deep learning has emerged as the preferred modeling approach for automatic ECG analysis. In this study, we investigate three elements aimed at improving the quantitative accuracy of such systems. These components consistently enhance…

Signal Processing · Electrical Eng. & Systems 2023-08-30 Temesgen Mehari , Nils Strodthoff

We propose to improve unconditional Generative Adversarial Networks (GAN) by training the self-supervised learning with the adversarial process. In particular, we apply self-supervised learning via the geometric transformation on input…

Computer Vision and Pattern Recognition · Computer Science 2019-05-15 Ngoc-Trung Tran , Viet-Hung Tran , Ngoc-Bao Nguyen , Ngai-Man Cheung

With the increasing utilization of deep learning in outdoor settings, its robustness needs to be enhanced to preserve accuracy in the face of distribution shifts, such as compression artifacts. Data augmentation is a widely used technique…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Shohei Enomoto , Monikka Roslianna Busto , Takeharu Eda

Recent methods in self-supervised learning have demonstrated that masking-based pretext tasks extend beyond NLP, serving as useful pretraining objectives in computer vision. However, existing approaches apply random or ad hoc masking…

Computer Vision and Pattern Recognition · Computer Science 2022-12-19 Dylan Sam , Min Bai , Tristan McKinney , Li Erran Li

Recent Self-Supervised Learning (SSL) methods are able to learn feature representations that are invariant to different data augmentations, which can then be transferred to downstream tasks of interest. However, different downstream tasks…

Machine Learning · Computer Science 2023-03-08 Chen Huang , Hanlin Goh , Jiatao Gu , Josh Susskind

EEG signals are usually simple to obtain but expensive to label. Although supervised learning has been widely used in the field of EEG signal analysis, its generalization performance is limited by the amount of annotated data.…

Machine Learning · Computer Science 2021-09-17 Xue Jiang , Jianhui Zhao , Bo Du , Zhiyong Yuan

Artificial Intelligence (AI)-based models can help in diagnosing COVID-19 from lung CT scans and X-ray images; however, these models require large amounts of data for training and validation. Many researchers studied Generative Adversarial…

Image and Video Processing · Electrical Eng. & Systems 2023-04-10 Hazrat Ali , Christer Gronlund , Zubair Shah

Semi-supervised learning (SSL) algorithm is a setup built upon a realistic assumption that access to a large amount of labeled data is tough. In this study, we present a generalized framework, named SCAR, standing for Selecting Clean…

Machine Learning · Computer Science 2023-08-09 Dongyoon Yang , Kunwoong Kim , Yongdai Kim

Supervised deep learning methods for segmentation require large amounts of labelled training data, without which they are prone to overfitting, not generalizing well to unseen images. In practice, obtaining a large number of annotations…

Computer Vision and Pattern Recognition · Computer Science 2019-03-01 Krishna Chaitanya , Neerav Karani , Christian Baumgartner , Olivio Donati , Anton Becker , Ender Konukoglu

Deep learning has become a popular tool for medical image analysis, but the limited availability of training data remains a major challenge, particularly in the medical field where data acquisition can be costly and subject to privacy…

Image and Video Processing · Electrical Eng. & Systems 2024-06-11 Aghiles Kebaili , Jérôme Lapuyade-Lahorgue , Su Ruan

While some powerful neural network architectures (e.g., Transformer, Graph Neural Networks) have achieved improved performance in sequential recommendation with high-order item dependency modeling, they may suffer from poor representation…

Information Retrieval · Computer Science 2023-06-02 Yaowen Ye , Lianghao Xia , Chao Huang

Data augmentation has been widely used to improve generalization in training deep neural networks. Recent works show that using worst-case transformations or adversarial augmentation strategies can significantly improve the accuracy and…

Computer Vision and Pattern Recognition · Computer Science 2022-11-15 Liang Xiao , Jiaolong Xu , Dawei Zhao , Erke Shang , Qi Zhu , Bin Dai

Recent advancements in Generative Adversarial Networks (GANs) have enabled photorealistic image generation with high quality. However, the malicious use of such generated media has raised concerns regarding visual misinformation. Although…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Liviu-Daniel Ştefan , Dan-Cristian Stanciu , Mihai Dogariu , Mihai Gabriel Constantin , Andrei Cosmin Jitaru , Bogdan Ionescu

Random data augmentation is a critical technique to avoid overfitting in training deep neural network models. However, data augmentation and network training are usually treated as two isolated processes, limiting the effectiveness of…

Computer Vision and Pattern Recognition · Computer Science 2018-05-25 Xi Peng , Zhiqiang Tang , Fei Yang , Rogerio Feris , Dimitris Metaxas

Numerous studies are aimed at diagnosing heart diseases based on 12-lead electrocardiographic (ECG) records using deep learning methods. These studies usually use specific datasets that differ in size and parameters, such as patient…

Signal Processing · Electrical Eng. & Systems 2023-05-31 Aram Avetisyan , Shahane Tigranyan , Ariana Asatryan , Olga Mashkova , Sergey Skorik , Vladislav Ananev , Yury Markin

Generative adversarial networks have gained a lot of attention in the computer vision community due to their capability of data generation without explicitly modelling the probability density function. The adversarial loss brought by the…

Computer Vision and Pattern Recognition · Computer Science 2019-09-05 Xin Yi , Ekta Walia , Paul Babyn