English
Related papers

Related papers: Comparison of Attention-based Deep Learning Models…

200 papers

Time series prediction with deep learning methods, especially long short-term memory neural networks (LSTMs), have scored significant achievements in recent years. Despite the fact that the LSTMs can help to capture long-term dependencies,…

Machine Learning · Computer Science 2018-11-12 Youru Li , Zhenfeng Zhu , Deqiang Kong , Hua Han , Yao Zhao

Electroencephalografic (EEG) data are complex multi-dimensional time-series that are very useful in many applications, from diagnostics to driving brain-computer interface systems. Their classification is still a challenging task, due to…

Signal Processing · Electrical Eng. & Systems 2024-07-30 Alberto Zancanaro , Giulia Cisotto , Italo Zoppis , Sara Lucia Manzoni

Applications in behavioural research, human-computer interaction, and mental health depend on the ability to recognize emotions. In order to improve the accuracy of emotion recognition using electroencephalography (EEG) data, this work…

Signal Processing · Electrical Eng. & Systems 2024-11-28 Ali Asgar Chandanwala , Srutakirti Bhowmik , Parna Chaudhury , Sheena Christabel Pravin

Artifacts in the electroencephalogram (EEG) degrade signal quality and impact the analysis of brain activity. Current methods for detecting artifacts in sleep EEG rely on simple threshold-based algorithms that require manual intervention,…

Signal Processing · Electrical Eng. & Systems 2025-04-25 Khrystyna Semkiv , Jia Zhang , Maria Laura Ferster , Walter Karlen

While capable of segregating visual data, humans take time to examine a single piece, let alone thousands or millions of samples. The deep learning models efficiently process sizeable information with the help of modern-day computing.…

Computer Vision and Pattern Recognition · Computer Science 2022-09-28 Alankrit Mishra , Nikhil Raj , Garima Bajwa

A major shortcoming of medical practice is the lack of an objective measure of conscious level. Impairment of consciousness is common, e.g. following brain injury and seizures, which can also interfere with sensory processing and volitional…

Neurons and Cognition · Quantitative Biology 2025-12-24 Alexis Pomares Pastor , Ines Ribeiro Violante , Gregory Scott

Deep learning offers a promising avenue for automating many recognition tasks in fields such as medicine and forensics. However, the black-box nature of these models hinders their adoption in high-stakes applications where trust and…

Computer Vision and Pattern Recognition · Computer Science 2025-09-10 Barkin Buyukcakir , Rocharles Cavalcante Fontenele , Reinhilde Jacobs , Jannick De Tobel , Patrick Thevissen , Dirk Vandermeulen , Peter Claes

Theta oscillations, ranging from 4-8 Hz, play a significant role in spatial learning and memory functions during navigation tasks. Frontal theta oscillations are thought to play an important role in spatial navigation and memory.…

Quantitative Methods · Quantitative Biology 2023-11-15 Gabriel Rodrigues Palma , Conor Thornberry , Seán Commins , Rafael de Andrade Moral

Timely diagnosis is important for saving the life of epileptic patients. In past few years, a lot of treatments are available for epilepsy. These treatments require use of anti-seizure drugs but are not effective in controlling frequency of…

Machine Learning · Computer Science 2021-11-08 Shivam Gupta , Jyoti Meena , O. P Gupta

The current electroencephalogram (EEG) based deep learning models are typically designed for specific datasets and applications in brain-computer interaction (BCI), limiting the scale of the models and thus diminishing their perceptual…

Machine Learning · Computer Science 2024-06-06 Wei-Bang Jiang , Li-Ming Zhao , Bao-Liang Lu

Epilepsy is a neurological disorder and for its detection, encephalography (EEG) is a commonly used clinical approach. Manual inspection of EEG brain signals is a time-consuming and laborious process, which puts heavy burden on neurologists…

Computer Vision and Pattern Recognition · Computer Science 2018-01-17 Ihsan Ullah , Muhammad Hussain , Emad-ul-Haq Qazi , Hatim Aboalsamh

Motivation: Electronic Health Records (EHR) represent a comprehensive resource of a patient's medical history. EHR are essential for utilizing advanced technologies such as deep learning (DL), enabling healthcare providers to analyze…

Machine Learning · Computer Science 2024-07-24 Mohammad Al Olaimat , Serdar Bozdag

One of the common human diseases is sleep disorders. The classification of sleep stages plays a fundamental role in diagnosing sleep disorders, monitoring treatment effectiveness, and understanding the relationship between sleep stages and…

Signal Processing · Electrical Eng. & Systems 2023-10-09 Hassan Ardeshir , Mohammad Araghi

Over the past decade, high-frequency oscillations (HFOs) have been studied as a promising biomarker for localizing epileptogenic areas in drug-resistant patients requiring pre-surgical intervention, while exploiting intracranial…

Signal Processing · Electrical Eng. & Systems 2024-12-24 Zayneb Sadek , Abir Hadriche , Rahma Maalej , Nawel Jmail

This paper studies the classification problem on electroencephalogram (EEG) data of mental tasks, using standard architecture of three-layer CNN, stacked LSTM, stacked GRU. We further propose a novel classifier - a mixed LSTM model with a…

Signal Processing · Electrical Eng. & Systems 2019-10-09 Zeyu Bai , Ruizhi Yang , Youzhi Liang

Objective. When a person listens to continuous speech, a corresponding response is elicited in the brain and can be recorded using electroencephalography (EEG). Linear models are presently used to relate the EEG recording to the…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-19 Corentin Puffay , Bernd Accou , Lies Bollens , Mohammad Jalilpour Monesi , Jonas Vanthornhout , Hugo Van hamme , Tom Francart

The neural attention mechanism has been incorporated into deep neural networks to achieve state-of-the-art performance in various domains. Most such models use multi-head self-attention which is appealing for the ability to attend to…

Machine Learning · Computer Science 2021-10-26 Shujian Zhang , Xinjie Fan , Huangjie Zheng , Korawat Tanwisuth , Mingyuan Zhou

In this paper we introduce attention-regression model to demonstrate predicting acoustic features from electroencephalography (EEG) features recorded in parallel with spoken sentences. First we demonstrate predicting acoustic features…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-05 Gautam Krishna , Co Tran , Mason Carnahan , Ahmed Tewfik

Electroencephalogram (EEG) classification plays a key role in medical diagnosis and brain-computer interfaces, but remains challenging due to low signal-to-noise ratios and high inter-subject variability. As a result, many existing…

Machine Learning · Computer Science 2026-05-18 Ahmad Bdeir , Johannes Burchert , Tom Hanika , Lars Schmidt-Thieme , Niels Landwehr

Irregular sampling occurs in many time series modeling applications where it presents a significant challenge to standard deep learning models. This work is motivated by the analysis of physiological time series data in electronic health…

Machine Learning · Computer Science 2021-06-08 Satya Narayan Shukla , Benjamin M. Marlin