English
Related papers

Related papers: HeartBERT: A Self-Supervised ECG Embedding Model f…

200 papers

This study presents a novel approach for EEG-based seizure detection leveraging a BERT-based model. The model, BENDR, undergoes a two-phase training process. Initially, it is pre-trained on the extensive Temple University Hospital EEG…

The way we analyse clinical texts has undergone major changes over the last years. The introduction of language models such as BERT led to adaptations for the (bio)medical domain like PubMedBERT and ClinicalBERT. These models rely on large…

Computation and Language · Computer Science 2023-09-15 Tom van Sonsbeek , Xiantong Zhen , Marcel Worring

Pre-trained BERT models have achieved impressive accuracy on natural language processing (NLP) tasks. However, their excessive amount of parameters hinders them from efficient deployment on edge devices. Binarization of the BERT models can…

Computation and Language · Computer Science 2023-05-10 Jiayi Tian , Chao Fang , Haonan Wang , Zhongfeng Wang

This project addresses the need for efficient, real-time analysis of biomedical signals such as electrocardiograms (ECG) and electroencephalograms (EEG) for continuous health monitoring. Traditional methods rely on long-duration data…

Signal Processing · Electrical Eng. & Systems 2025-04-22 Jinhai Hu

The Bidirectional Encoder Representations from Transformers (BERT) model has achieved the state-of-the-art performance for many natural language processing (NLP) tasks. Yet, limited research has been contributed to studying its…

Computation and Language · Computer Science 2021-09-23 Zimin Wan , Chenchen Xu , Hanna Suominen

The recently proposed BERT has shown great power on a variety of natural language understanding tasks, such as text classification, reading comprehension, etc. However, how to effectively apply BERT to neural machine translation (NMT) lacks…

Computation and Language · Computer Science 2020-02-18 Jinhua Zhu , Yingce Xia , Lijun Wu , Di He , Tao Qin , Wengang Zhou , Houqiang Li , Tie-Yan Liu

While Deep Learning (DL) enhances automated electrocardiogram (ECG) analysis, clinical deployment is hindered by class imbalance and the generalization gap. This paper presents HeartBeatAI, a deep learning framework combining domain…

Artificial Intelligence · Computer Science 2026-05-26 Shubham Gupta , Nikhil Panwar , Partha Pratim Roy

Electrocardiogram (ECG) is the primary non-invasive diagnostic tool for monitoring cardiac conditions and is crucial in assisting clinicians. Recent studies have concentrated on classifying cardiac conditions using ECG data but have…

Computation and Language · Computer Science 2025-07-09 Zhongwei Wan , Che Liu , Xin Wang , Chaofan Tao , Hui Shen , Jing Xiong , Rossella Arcucci , Huaxiu Yao , Mi Zhang

To handle the scarcity and heterogeneity of electroencephalography (EEG) data for Brain-Computer Interface (BCI) tasks, and to harness the power of large publicly available data sets, we propose Neuro-GPT, a foundation model consisting of…

Machine Learning · Computer Science 2024-03-05 Wenhui Cui , Woojae Jeong , Philipp Thölke , Takfarinas Medani , Karim Jerbi , Anand A. Joshi , Richard M. Leahy

Electrocardiogram~(ECG), a key bioelectrical time-series signal, is crucial for assessing cardiac health and diagnosing various diseases. Given its time-series format, ECG data is often incorporated into pre-training datasets for…

Signal Processing · Electrical Eng. & Systems 2026-02-26 Zhijiang Tang , Jiaxin Qi , Yuhua Zheng , Jianqiang Huang

The Bidirectional Encoder Representations from Transformers (BERT) model has been radically improving the performance of many Natural Language Processing (NLP) tasks such as Text Classification and Named Entity Recognition (NER)…

Computation and Language · Computer Science 2021-08-24 Leonard Dahlmann , Tomer Lancewicki

Electrocardiogram (ECG) plays a foundational role in modern cardiovascular care, enabling non-invasive diagnosis of arrhythmias, myocardial ischemia, and conduction disorders. While machine learning has achieved expert-level performance in…

Signal Processing · Electrical Eng. & Systems 2025-07-22 Deyun Zhang , Xiang Lan , Shijia Geng , Qinghao Zhao , Sumei Fan , Mengling Feng , Shenda Hong

The classification of electrocardiogram (ECG) signals is crucial for early detection of arrhythmias and other cardiac conditions. However, despite advances in machine learning, many studies fail to follow standardization protocols, leading…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Guilherme Silva , Pedro Silva , Gladston Moreira , Vander Freitas , Jadson Gertrudes , Eduardo Luz

An arrhythmia, also known as a dysrhythmia, refers to an irregular heartbeat. There are various types of arrhythmias that can originate from different areas of the heart, resulting in either a rapid, slow, or irregular heartbeat. An…

Signal Processing · Electrical Eng. & Systems 2024-01-12 Taymaz Akan , Sait Alp , Mohammad Alfrad Nobel Bhuiyan

Diagnosing pre-existing heart diseases early in life is important as it helps prevent complications such as pulmonary hypertension, heart rhythm problems, blood clots, heart failure and sudden cardiac arrest. To identify such diseases,…

While electronic health records (EHRs) are widely used across various applications in healthcare, most applications use the EHRs in their raw (tabular) format. Relying on raw or simple data pre-processing can greatly limit the performance…

Machine Learning · Computer Science 2024-03-28 Fahmida Liza Piya , Mehak Gupta , Rahmatollah Beheshti

Objective: A novel ECG classification algorithm is proposed for continuous cardiac monitoring on wearable devices with limited processing capacity. Methods: The proposed solution employs a novel architecture consisting of wavelet transform…

Signal Processing · Electrical Eng. & Systems 2020-01-22 Saeed Saadatnejad , Mohammadhosein Oveisi , Matin Hashemi

Lately, pre-trained language models advanced the field of natural language processing (NLP). The introduction of Bidirectional Encoders for Transformers (BERT) and its optimized version RoBERTa have had significant impact and increased the…

Computation and Language · Computer Science 2025-06-13 Raphael Scheible , Fabian Thomczyk , Patric Tippmann , Victor Jaravine , Martin Boeker

Electrocardiography (ECG) signal is a highly applied measurement for individual heart condition, and much effort have been endeavored towards automatic heart arrhythmia diagnosis based on machine learning. However, traditional machine…

Signal Processing · Electrical Eng. & Systems 2021-11-01 Ziyu Liu , Xiang Zhang

Biomedical signal processing extract meaningful information from physiological signals like electrocardiograms (ECGs), electroencephalograms (EEGs), and electromyograms (EMGs) to diagnose, monitor, and treat medical conditions and diseases…

Signal Processing · Electrical Eng. & Systems 2025-08-13 Justin London