English
Related papers

Related papers: Self-Supervised Pre-Training with Joint-Embedding …

200 papers

While self-supervised pretraining has proven beneficial for many computer vision tasks, it requires expensive and lengthy computation, large amounts of data, and is sensitive to data augmentation. Prior work demonstrates that models…

Computer Vision and Pattern Recognition · Computer Science 2021-03-26 Colorado J. Reed , Xiangyu Yue , Ani Nrusimha , Sayna Ebrahimi , Vivek Vijaykumar , Richard Mao , Bo Li , Shanghang Zhang , Devin Guillory , Sean Metzger , Kurt Keutzer , Trevor Darrell

Supervised deep learning has been widely used in the studies of automatic ECG classification, which largely benefits from sufficient annotation of large datasets. However, most of the existing large ECG datasets are roughly annotated, so…

Machine Learning · Computer Science 2020-12-11 Yang Liu , Kuanquan Wang , Qince Li , Runnan He , Yongfeng Yuan , Henggui Zhang

Recent advancements in early assessment of pulmonary hypertension (PH) primarily focus on applying machine learning methods to centralized diagnostic modalities, such as 12-lead electrocardiogram (12L-ECG). Despite their potential, these…

Signal Processing · Electrical Eng. & Systems 2025-09-09 Mohammod N. I. Suvon , Shuo Zhou , Prasun C. Tripathi , Wenrui Fan , Samer Alabed , Bishesh Khanal , Venet Osmani , Andrew J. Swift , Chen , Chen , Haiping Lu

In the medical field, current ECG signal analysis approaches rely on supervised deep neural networks trained for specific tasks that require substantial amounts of labeled data. However, our paper introduces ECGBERT, a self-supervised…

Signal Processing · Electrical Eng. & Systems 2023-06-13 Seokmin Choi , Sajad Mousavi , Phillip Si , Haben G. Yhdego , Fatemeh Khadem , Fatemeh Afghah

Vision-language-action (VLA) models have significantly advanced robotic learning, enabling training on large-scale, cross-embodiment data and fine-tuning for specific robots. However, state-of-the-art autoregressive VLAs struggle with…

Robotics · Computer Science 2025-11-04 Chengmeng Li , Yaxin Peng

Cardiologists use electrocardiograms (ECG) for the detection of arrhythmias. However, continuous monitoring of ECG signals to detect cardiac abnormal-ities requires significant time and human resources. As a result, several deep learning…

Signal Processing · Electrical Eng. & Systems 2024-04-25 JuneYoung Park , Da Young Kim , Yunsoo Kim , Jisu Yoo , Tae Joon Kim

Our study focuses on the potential for modifications of Inception-like architecture within the electrocardiogram (ECG) domain. To this end, we introduce IncepSE, a novel network characterized by strategic architectural incorporation that…

Signal Processing · Electrical Eng. & Systems 2023-12-18 Tue Minh Cao , Nhat Hong Tran , Le Phi Nguyen , Hieu Huy Pham , Hung Thanh Nguyen

Deep learning has emerged as the preferred modeling approach for automatic ECG analysis. In this study, we investigate three elements aimed at improving the quantitative accuracy of such systems. These components consistently enhance…

Signal Processing · Electrical Eng. & Systems 2023-08-30 Temesgen Mehari , Nils Strodthoff

Cardiac disease is the leading cause of death in the US. Accurate heart disease detection is of critical importance for timely medical treatment to save patients' lives. Routine use of electrocardiogram (ECG) is the most common method for…

Signal Processing · Electrical Eng. & Systems 2022-10-21 Zekai Wang , Stavros Stavrakis , Bing Yao

The utilization of deep learning on electrocardiogram (ECG) analysis has brought the advanced accuracy and efficiency of cardiac healthcare diagnostics. By leveraging the capabilities of deep learning in semantic understanding, especially…

Signal Processing · Electrical Eng. & Systems 2024-10-25 Han Yu , Peikun Guo , Akane Sano

Accurate and robust medical image classification is paramount for early disease diagnosis and treatment planning. However, challenges such as limited annotated data, high intra-class variability, and subtle inter-class differences often…

Image and Video Processing · Electrical Eng. & Systems 2026-05-22 Joao Florindo , Viviane Moura

As autonomous vehicles are rolled out, measures must be taken to ensure their safe operation. In order to supervise a system that is already in operation, monitoring frameworks are frequently employed. These run continuously online in the…

Machine Learning · Computer Science 2026-02-11 Alexander Fertig , Karthikeyan Chandra Sekaran , Lakshman Balasubramanian , Michael Botsch

In this work we search for best practices in pre-processing of Electrocardiogram (ECG) signals in order to train better classifiers for the diagnosis of heart conditions. State of the art machine learning algorithms have achieved remarkable…

Signal Processing · Electrical Eng. & Systems 2025-05-16 Amir Salimi , Sunil Vasu Kalmady , Abram Hindle , Osmar Zaiane , Padma Kaul

Joint-Embedding Predictive Architectures (JEPA) learn view-invariant representations and admit projection-based distribution matching for collapse prevention. Existing approaches regularize representations towards isotropic Gaussian…

Machine Learning · Computer Science 2026-05-29 Yilun Kuang , Yash Dagade , Tim G. J. Rudner , Randall Balestriero , Yann LeCun

Although deep learning has advanced automated electrocardiogram (ECG) diagnosis, prevalent supervised methods typically treat recordings as undifferentiated one-dimensional (1D) signals or two-dimensional (2D) images. This formulation…

Machine Learning · Computer Science 2026-01-13 Runze Ma , Caizhi Liao

Electrocardiogram (ECG) delineation plays a crucial role in assisting cardiologists with accurate diagnoses. Prior research studies have explored various methods, including the application of deep learning techniques, to achieve precise…

Machine Learning · Computer Science 2024-06-06 Aram Avetisyan , Nikolas Khachaturov , Ariana Asatryan , Shahane Tigranyan , Yury Markin

In the field of automatic Electrocardiogram (ECG) diagnosis, due to the relatively limited amount of labeled data, how to build a robust ECG pretrained model based on unlabeled data is a key area of focus for researchers. Recent…

Signal Processing · Electrical Eng. & Systems 2025-06-10 Xiaoyu Sun , Yang Yang , Xunde Dong

The development of machine learning for cardiac care is severely hampered by privacy restrictions on sharing real patient electrocardiogram (ECG) data. Although generative AI offers a promising solution, the real-world use of existing…

Effective rehabilitation assessment is essential for monitoring patient progress, particularly in home-based settings. Existing systems often face challenges such as data imbalance and difficulty detecting subtle movement errors. This paper…

Computation and Language · Computer Science 2025-06-12 Omar Sherif , Ali Hamdi

In practical electrocardiography (ECG) interpretation, the scarcity of well-annotated data is a common challenge. Transfer learning techniques are valuable in such situations, yet the assessment of transferability has received limited…

Signal Processing · Electrical Eng. & Systems 2024-06-13 Cuong V. Nguyen , Hieu Minh Duong , Cuong D. Do