English
Related papers

Related papers: Comparison of Attention-based Deep Learning Models…

200 papers

In this paper, we aimed at reviewing present literature on employing nonlinear analysis in combination with machine learning methods, in depression detection or prediction task. We are focusing on an affordable data-driven approach,…

Signal Processing · Electrical Eng. & Systems 2019-09-10 Milena Čukić Radenković , Victoria Lopez Lopez

Deep learning has significantly advanced electrocardiogram (ECG) analysis, enabling automatic annotation, disease screening, and prognosis beyond traditional clinical capabilities. However, understanding these models remains a challenge,…

Machine Learning · Computer Science 2025-09-19 Ahcène Boubekki , Konstantinos Patlatzoglou , Joseph Barker , Fu Siong Ng , Antônio H. Ribeiro

The problem of detecting the presence of Social Anxiety Disorder (SAD) using Electroencephalography (EEG) for classification has seen limited study and is addressed with a new approach that seeks to exploit the knowledge of EEG sensor…

Large-scale models pre-trained on Electroencephalography (EEG) have shown promise in clinical applications such as neurological disorder detection. However, the practical deployment of EEG-based large-scale models faces critical challenges…

Machine Learning · Computer Science 2025-08-12 Guanghao Jin , Yuan Liang , Yihan Ma , Jingpei Wu , Guoyang Liu

Background:The electrocardiogram (ECG) is one of the most commonly used diagnostic tools in medicine and healthcare. Deep learning methods have achieved promising results on predictive healthcare tasks using ECG signals. Objective:This…

Signal Processing · Electrical Eng. & Systems 2020-05-04 Shenda Hong , Yuxi Zhou , Junyuan Shang , Cao Xiao , Jimeng Sun

This study explores the intersection of electroencephalography (EEG) microstates and Large Language Models (LLMs) to enhance the assessment of cognitive load states. By utilizing EEG microstate features, the research aims to fine-tune LLMs…

Human-Computer Interaction · Computer Science 2025-08-12 Bujar Raufi

Attention mechanism has been extensively integrated within mainstream neural network architectures, such as Transformers and graph attention networks. Yet, its underlying working principles remain somewhat elusive. What is its essence? Are…

Machine Learning · Computer Science 2024-12-25 Tianyu Ruan , Shihua Zhang

Accurate automated analysis of electroencephalography (EEG) would largely help clinicians effectively monitor and diagnose patients with various brain diseases. Compared to supervised learning with labelled disease EEG data which can train…

Machine Learning · Computer Science 2022-07-05 Yaojia Zheng , Zhouwu Liu , Rong Mo , Ziyi Chen , Wei-shi Zheng , Ruixuan Wang

Various deep learning algorithms have been developed to analyze different types of clinical data including clinical text classification and extracting information from 'free text' and so on. However, automate the keyword extraction from the…

Computation and Language · Computer Science 2019-10-25 Matthew Tang , Priyanka Gandhi , Md Ahsanul Kabir , Christopher Zou , Jordyn Blakey , Xiao Luo

This paper proposes a deep learning (DL) model for automatic sleep stage classification based on single-channel EEG data. The DL model features a convolutional neural network (CNN) and transformers. The model was designed to run on energy…

Signal Processing · Electrical Eng. & Systems 2022-11-24 Zongyan Yao , Xilin Liu

Cognitively inspired NLP leverages human-derived data to teach machines about language processing mechanisms. Recently, neural networks have been augmented with behavioral data to solve a range of NLP tasks spanning syntax and semantics. We…

Computation and Language · Computer Science 2020-10-06 Lukas Muttenthaler , Nora Hollenstein , Maria Barrett

The detection of pilots' mental states is important due to the potential for their abnormal mental states to result in catastrophic accidents. This study introduces the feasibility of employing deep learning techniques to classify different…

Signal Processing · Electrical Eng. & Systems 2023-12-18 Dae-Hyeok Lee , Sung-Jin Kim , Si-Hyun Kim , Seong-Whan Lee

Electroencephalography (EEG) is essential for the diagnosis of epilepsy, but it requires expertise and experience to identify abnormalities. It is thus crucial to develop automated models for the detection of abnormalities in EEGs related…

Signal Processing · Electrical Eng. & Systems 2021-11-23 Taku Shoji , Noboru Yoshida , Toshihisa Tanaka

Drug-target interaction (DTI) prediction has become a foundational task in drug repositioning, polypharmacology, drug discovery, as well as drug resistance and side-effect prediction. DTI identification using machine learning is gaining…

Quantitative Methods · Quantitative Biology 2023-11-17 Konstantin Y. Kalitin , Alexey A. Nevzorov , Denis A. Babkov , Alexander A. Spasov , Olga Y. Mukha

This study explores different neural network architectures to evaluate their ability to extract spatial and temporal patterns from electrocardiographic (ECG) signals and classify them into three groups: healthy subjects, Left Bundle Branch…

Signal Processing · Electrical Eng. & Systems 2025-08-06 Beatriz Macas Ordóñez , Diego Vinicio Orellana Villavicencio , José Manuel Ferrández , Paula Bonomini

Deep learning techniques have revolutionized the field of machine learning and were recently successfully applied to various classification problems in noninvasive electroencephalography (EEG). However, these methods were so far only rarely…

Heart disease is one of the most common diseases causing morbidity and mortality. Electrocardiogram (ECG) has been widely used for diagnosing heart diseases for its simplicity and non-invasive property. Automatic ECG analyzing technologies…

Machine Learning · Computer Science 2019-08-28 Yang Liu , Runnan He , Kuanquan Wang , Qince Li , Qiang Sun , Na Zhao , Henggui Zhang

Cardiovascular diseases remain the leading cause of global mortality, emphasizing the critical need for efficient diagnostic tools such as electrocardiograms (ECGs). Recent advancements in deep learning, particularly transformers, have…

Electroencephalography (EEG)-based emotion recognition plays a critical role in affective Brain-Computer Interfaces (aBCIs), yet its practical deployment remains limited by inter-subject variability, reliance on target-domain data, and…

Machine Learning · Computer Science 2026-03-19 Guangli Li , Canbiao Wu , Zhehao Zhou , Na Tian , Li Zhang , Zhen Liang

In this paper, we propose a model for the Environment Sound Classification Task (ESC) that consists of multiple feature channels given as input to a Deep Convolutional Neural Network (CNN) with Attention mechanism. The novelty of the paper…

Sound · Computer Science 2020-12-09 Jivitesh Sharma , Ole-Christoffer Granmo , Morten Goodwin