English
Related papers

Related papers: TransSleep: Transitioning-aware Attention-based De…

200 papers

In recent years, the use of bio-sensing signals such as electroencephalogram (EEG), electrocardiogram (ECG), etc. have garnered interest towards applications in affective computing. The parallel trend of deep-learning has led to a huge leap…

Machine Learning · Computer Science 2019-05-20 Siddharth Siddharth , Tzyy-Ping Jung , Terrence J. Sejnowski

In the context of inverse problems $\bf y = Ax$, sparse recovery offers a powerful paradigm shift by enabling the stable solution of ill-posed or underdetermined systems through the exploitation of structure, particularly sparsity. Sparse…

Image and Video Processing · Electrical Eng. & Systems 2025-06-03 Di An , Dylan Poppert , Jiayue Li , Mark Foster , Trac D. Tran

We propose TabTransformer, a novel deep tabular data modeling architecture for supervised and semi-supervised learning. The TabTransformer is built upon self-attention based Transformers. The Transformer layers transform the embeddings of…

Machine Learning · Computer Science 2020-12-15 Xin Huang , Ashish Khetan , Milan Cvitkovic , Zohar Karnin

Electroencephalography (EEG) during sleep is used by clinicians to evaluate various neurological disorders. In sleep medicine, it is relevant to detect macro-events (> 10s) such as sleep stages, and micro-events (<2s) such as spindles and…

Signal Processing · Electrical Eng. & Systems 2018-07-17 Stanislas Chambon , Valentin Thorey , Pierrick J. Arnal , Emmanuel Mignot , Alexandre Gramfort

The semi-airborne transient electromagnetic method (SATEM) is capable of conducting rapid surveys over large-scale and hard-to-reach areas. However, the acquired signals are often contaminated by complex noise, which can compromise the…

Machine Learning · Computer Science 2025-03-31 Shuang Wang , Ming Guo , Xuben Wang , Fei Deng , Lifeng Mao , Bin Wang , Wenlong Gao

We used convolutional neural networks (CNNs) for automatic sleep stage scoring based on single-channel electroencephalography (EEG) to learn task-specific filters for classification without using prior domain knowledge. We used an openly…

Machine Learning · Statistics 2016-10-07 Orestis Tsinalis , Paul M. Matthews , Yike Guo , Stefanos Zafeiriou

Recurrent Neural Networks were, until recently, one of the best ways to capture the timely dependencies in sequences. However, with the introduction of the Transformer, it has been proven that an architecture with only attention-mechanisms…

Machine Learning · Computer Science 2021-08-19 Radostin Cholakov , Todor Kolev

Analysis of sleep for the diagnosis of sleep disorders such as Type-1 Narcolepsy (T1N) currently requires visual inspection of polysomnography records by trained scoring technicians. Here, we used neural networks in approximately 3,000…

Deep learning models for scoring sleep stages based on single-channel EEG have been proposed as a promising method for remote sleep monitoring. However, applying these models to new datasets, particularly from wearable devices, raises two…

Signal Processing · Electrical Eng. & Systems 2023-04-27 Akara Supratak , Peter Haddawy

Sleep stage classification constitutes an important element of sleep disorder diagnosis. It relies on the visual inspection of polysomnography records by trained sleep technologists. Automated approaches have been designed to alleviate this…

Quantitative Methods · Quantitative Biology 2020-04-28 Antoine Guillot , Fabien Sauvet , Emmanuel H During , Valentin Thorey

Sleep stage classification is essential for sleep assessment and disease diagnosis. Although previous attempts to classify sleep stages have achieved high classification performance, several challenges remain open: 1) How to effectively…

Signal Processing · Electrical Eng. & Systems 2021-09-07 Ziyu Jia , Youfang Lin , Jing Wang , Xiaojun Ning , Yuanlai He , Ronghao Zhou , Yuhan Zhou , Li-wei H. Lehman

To discover intrinsic inter-class transition probabilities underlying data, learning with noise transition has become an important approach for robust deep learning on corrupted labels. Prior methods attempt to achieve such transition…

Machine Learning · Computer Science 2020-06-15 Jun Shu , Qian Zhao , Zongben Xu , Deyu Meng

Sleep is particularly important to the health of infants, children, and adolescents, and sleep scoring is the first step to accurate diagnosis and treatment of potentially life-threatening conditions. But pediatric sleep is severely…

Signal Processing · Electrical Eng. & Systems 2022-10-27 Harlin Lee , Aaqib Saeed

Effectively predicting transonic unsteady flow over an aerofoil poses inherent challenges. In this study, we harness the power of deep neural network (DNN) models using the attention U-Net architecture. Through efficient training of these…

Fluid Dynamics · Physics 2024-03-27 Li-Wei Chen , Nils Thuerey

Convolutional neural networks (CNNs) have been the de facto standard in a diverse set of computer vision tasks for many years. Especially, deep neural networks based on seminal architectures such as U-shaped models with skip-connections or…

Image and Video Processing · Electrical Eng. & Systems 2022-08-02 Reza Azad , Moein Heidari , Moein Shariatnia , Ehsan Khodapanah Aghdam , Sanaz Karimijafarbigloo , Ehsan Adeli , Dorit Merhof

In this work, a dense recurrent convolutional neural network (DRCNN) was constructed to detect sleep disorders including arousal, apnea and hypopnea using Polysomnography (PSG) measurement channels provided in the 2018 Physionet challenge…

Machine Learning · Computer Science 2019-07-25 Bahareh Pourbabaee , Matthew Howe-Patterson , Matthew Patterson , Frederic Benard

We present STanHop-Net (Sparse Tandem Hopfield Network) for multivariate time series prediction with memory-enhanced capabilities. At the heart of our approach is STanHop, a novel Hopfield-based neural network block, which sparsely learns…

Machine Learning · Computer Science 2024-01-01 Dennis Wu , Jerry Yao-Chieh Hu , Weijian Li , Bo-Yu Chen , Han Liu

Transformer is a ubiquitous model for natural language processing and has attracted wide attentions in computer vision. The attention maps are indispensable for a transformer model to encode the dependencies among input tokens. However,…

Machine Learning · Computer Science 2021-02-26 Yujing Wang , Yaming Yang , Jiangang Bai , Mingliang Zhang , Jing Bai , Jing Yu , Ce Zhang , Gao Huang , Yunhai Tong

Datasets in sleep science present challenges for machine learning algorithms due to differences in recording setups across clinics. We investigate two deep transfer learning strategies for overcoming the channel mismatch problem for cases…

Computer Vision and Pattern Recognition · Computer Science 2020-09-02 Alexander Neergaard Olesen , Poul Jennum , Emmanuel Mignot , Helge B. D. Sorensen

Real-time object detection is critical for the decision-making process for many real-world applications, such as collision avoidance and path planning in autonomous driving. This work presents an innovative real-time streaming perception…

Computer Vision and Pattern Recognition · Computer Science 2024-09-11 Xiang Zhang , Yufei Cui , Chenchen Fu , Weiwei Wu , Zihao Wang , Yuyang Sun , Xue Liu