English
Related papers

Related papers: ECGBERT: Understanding Hidden Language of ECGs wit…

200 papers

The ability to learn from large unlabeled corpora has allowed neural language models to advance the frontier in natural language understanding. However, existing self-supervision techniques operate at the word form level, which serves as a…

Computation and Language · Computer Science 2020-05-19 Yoav Levine , Barak Lenz , Or Dagan , Ori Ram , Dan Padnos , Or Sharir , Shai Shalev-Shwartz , Amnon Shashua , Yoav Shoham

Numerous code changes are made by developers in their daily work, and a superior representation of code changes is desired for effective code change analysis. Recently, Hoang et al. proposed CC2Vec, a neural network-based approach that…

Software Engineering · Computer Science 2023-09-28 Xin Zhou , Bowen Xu , DongGyun Han , Zhou Yang , Junda He , David Lo

In this paper, we introduce ActBERT for self-supervised learning of joint video-text representations from unlabeled data. First, we leverage global action information to catalyze the mutual interactions between linguistic texts and local…

Computer Vision and Pattern Recognition · Computer Science 2020-11-17 Linchao Zhu , Yi Yang

The label scarcity problem is the main challenge that hinders the wide application of deep learning systems in automatic cardiovascular diseases (CVDs) detection using electrocardiography (ECG). Tuning pre-trained models alleviates this…

Machine Learning · Computer Science 2024-11-18 Rushuang Zhou , Lei Clifton , Zijun Liu , Kannie W. Y. Chan , David A. Clifton , Yuan-Ting Zhang , Yining Dong

Self-supervised learning has been a powerful training paradigm to facilitate representation learning. In this study, we design a masked autoencoder (MAE) to guide deep learning models to learn electroencephalography (EEG) signal…

Human-Computer Interaction · Computer Science 2024-09-04 Yifei Zhou , Sitong Liu

Although machine learning has become a powerful tool to augment doctors in clinical analysis, the immense amount of labeled data that is necessary to train supervised learning approaches burdens each development task as time and resource…

Interpretation of electrocardiography (ECG) signals is required for diagnosing cardiac arrhythmia. Recently, machine learning techniques have been applied for automated computer-aided diagnosis. Machine learning tasks can be divided into…

Recent advances in deep learning and natural language generation have significantly improved image captioning, enabling automated, human-like descriptions for visual content. In this work, we apply these captioning techniques to generate…

Computation and Language · Computer Science 2024-12-06 Amnon Bleich , Antje Linnemann , Bjoern H. Diem , Tim OF Conrad

Large scale databases with high-quality manual annotations are scarce in audio domain. We thus explore a self-supervised graph approach to learning audio representations from highly limited labelled data. Considering each audio sample as a…

Machine Learning · Computer Science 2022-11-23 Amir Shirian , Krishna Somandepalli , Tanaya Guha

For self-supervised speech processing, it is crucial to use pretrained models as speech representation extractors. In recent works, increasing the size of the model has been utilized in acoustic model training in order to achieve better…

Audio and Speech Processing · Electrical Eng. & Systems 2021-05-04 Po-Han Chi , Pei-Hung Chung , Tsung-Han Wu , Chun-Cheng Hsieh , Yen-Hao Chen , Shang-Wen Li , Hung-yi Lee

Electroencephalogram (EEG) decoding aims to identify the perceptual, semantic, and cognitive content of neural processing based on non-invasively measured brain activity. Traditional EEG decoding methods have achieved moderate success when…

Signal Processing · Electrical Eng. & Systems 2022-03-09 Xun Chen , Chang Li , Aiping Liu , Martin J. McKeown , Ruobing Qian , Z. Jane Wang

Electroencephalography (EEG) research typically focuses on tasks with narrowly defined objectives, but recent studies are expanding into the use of unlabeled data within larger models, aiming for a broader range of applications. This…

Signal Processing · Electrical Eng. & Systems 2025-05-26 Anders Gjølbye , Lina Skerath , William Lehn-Schiøler , Nicolas Langer , Lars Kai Hansen

In conventional machine learning (ML) approaches applied to electroencephalography (EEG), this is often a limited focus, isolating specific brain activities occurring across disparate temporal scales (from transient spikes in milliseconds…

Quantitative Methods · Quantitative Biology 2024-02-06 Jonathan W. Kim , Ahmed Alaa , Danilo Bernardo

Self-supervised approaches for speech representation learning are challenged by three unique problems: (1) there are multiple sound units in each input utterance, (2) there is no lexicon of input sound units during the pre-training phase,…

Computation and Language · Computer Science 2021-06-15 Wei-Ning Hsu , Benjamin Bolte , Yao-Hung Hubert Tsai , Kushal Lakhotia , Ruslan Salakhutdinov , Abdelrahman Mohamed

Information in electronic health records (EHR), such as clinical narratives, examination reports, lab measurements, demographics, and other patient encounter entries, can be transformed into appropriate data representations that can be used…

Machine Learning · Computer Science 2019-09-23 Wei-Hung Weng , Peter Szolovits

Biomedical signal processing extract meaningful information from physiological signals like electrocardiograms (ECGs), electroencephalograms (EEGs), and electromyograms (EMGs) to diagnose, monitor, and treat medical conditions and diseases…

Signal Processing · Electrical Eng. & Systems 2025-08-13 Justin London

In order to exploit representations of time-series signals, such as physiological signals, it is essential that these representations capture relevant information from the whole signal. In this work, we propose to use a Transformer-based…

Neurons and Cognition · Quantitative Biology 2022-06-06 Juan Vazquez-Rodriguez , Grégoire Lefebvre , Julien Cumin , James L. Crowley

Electrocardiograms (ECGs) are widely used non-invasive measurements of cardiac activity and play a central role in clinical diagnosis. Recent multimodal approaches align ECG signals with clinical reports to incorporate diagnostic semantics,…

The latest work on language representations carefully integrates contextualized features into language model training, which enables a series of success especially in various machine reading comprehension and natural language inference…

Computation and Language · Computer Science 2020-02-05 Zhuosheng Zhang , Yuwei Wu , Hai Zhao , Zuchao Li , Shuailiang Zhang , Xi Zhou , Xiang Zhou

Emotion recognition models using audio input data can enable the development of interactive systems with applications in mental healthcare, marketing, gaming, and social media analysis. While the field of affective computing using audio…

Sound · Computer Science 2023-07-25 Peranut Nimitsurachat , Peter Washington