English
Related papers

Related papers: Spatio-Temporal Analysis of Transformer based Arch…

200 papers

Graph attention networks (GATs) provide one of the best frameworks for learning node representations in relational data; but, existing variants such as Graph Attention Network (GAT) mainly operate on static graphs and rely on implicit…

Machine Learning · Computer Science 2026-04-14 Ami Chopra , Supriya Bordoloi , Shyamanta M. Hazarika

Transformers have recently gained attention in the computer vision domain due to their ability to model long-range dependencies. However, the self-attention mechanism, which is the core part of the Transformer model, usually suffers from…

Computer Vision and Pattern Recognition · Computer Science 2023-07-28 Reza Azad , René Arimond , Ehsan Khodapanah Aghdam , Amirhossein Kazerouni , Dorit Merhof

Accurate and continuous estimation of cognitive workload is fundamental to creating adaptive human-machine systems. However, designing architectures that balance representational capacity with computational efficiency has been challenging…

Signal Processing · Electrical Eng. & Systems 2026-05-20 Stefanos Gkikas , Christian Arzate Cruz , Thomas Kassiotis , Giorgos Giannakakis , Raul Fernandez Rojas , Randy Gomez

We propose a novel Transformer-based architecture for the task of generative modelling of 3D human motion. Previous work commonly relies on RNN-based models considering shorter forecast horizons reaching a stationary and often implausible…

Computer Vision and Pattern Recognition · Computer Science 2021-11-30 Emre Aksan , Manuel Kaufmann , Peng Cao , Otmar Hilliges

Recently, physiological data such as electroencephalography (EEG) signals have attracted significant attention in affective computing. In this context, the main goal is to design an automated model that can assess emotional states. Lately,…

Machine Learning · Computer Science 2023-07-07 Shadi Sartipi , Mastaneh Torkamani-Azar , Mujdat Cetin

Spatiotemporal predictive learning offers a self-supervised learning paradigm that enables models to learn both spatial and temporal patterns by predicting future sequences based on historical sequences. Mainstream methods are dominated by…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Xuesong Nie , Xi Chen , Haoyuan Jin , Zhihang Zhu , Yunfeng Yan , Donglian Qi

The Transformer, a breakthrough architecture in artificial intelligence, owes its success to the attention mechanism, which utilizes long-range interactions in sequential data, enabling the emergent coherence between large language models…

Artificial Intelligence · Computer Science 2026-04-23 Zihan Zhou , Bo-Wei Qin , Kai Du , Wei Lin

Electroencephalogram (EEG) signals play a pivotal role in biomedical research and clinical applications, including epilepsy diagnosis, sleep disorder analysis, and brain-computer interfaces. However, the effective analysis and…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Jiahao Qin , Feng Liu

The objective of this study is to investigate the application of various channel attention mechanisms within the domain of brain-computer interface (BCI) for motor imagery decoding. Channel attention mechanisms can be seen as a powerful…

Human-Computer Interaction · Computer Science 2024-02-22 Martin Wimpff , Leonardo Gizzi , Jan Zerfowski , Bin Yang

Electroencephalography (EEG) has emerged as a cost-effective and efficient tool to support neurologists in the detection of Alzheimer's Disease (AD). However, most existing approaches rely heavily on manual feature engineering or data…

Signal Processing · Electrical Eng. & Systems 2025-08-05 Yihe Wang , Nadia Mammone , Darina Petrovsky , Alexandros T. Tzallas , Francesco C. Morabito , Xiang Zhang

Electroencephalography (EEG) analysis is an important domain in the realm of Brain-Computer Interface (BCI) research. To ensure BCI devices are capable of providing practical applications in the real world, brain signal processing…

Signal Processing · Electrical Eng. & Systems 2024-08-08 Teng Liang , Andrews Damoah

Dynamic graph embedding has emerged as a very effective technique for addressing diverse temporal graph analytic tasks (i.e., link prediction, node classification, recommender systems, anomaly detection, and graph generation) in various…

Machine Learning · Computer Science 2023-12-27 Alan John Varghese , Aniruddha Bora , Mengjia Xu , George Em Karniadakis

Working memory (WM), denoting the information temporally stored in the mind, is a fundamental research topic in the field of human cognition. Electroencephalograph (EEG), which can monitor the electrical activity of the brain, has been…

Machine Learning · Computer Science 2024-12-03 Junfu Chen , Sirui Li , Dechang Pi

Resting-state brain networks represent the intrinsic state of the brain during the majority of cognitive and sensorimotor tasks. However, no study has yet presented concise predictors of task-induced vigilance variability from…

Signal Processing · Electrical Eng. & Systems 2019-10-23 Mastaneh Torkamani-Azar , Sumeyra Demir Kanik , Serap Aydin , Mujdat Cetin

Accurate decoding of EEG signals requires comprehensive modeling of both temporal dynamics within individual channels and spatial dependencies across channels. While Transformer-based models utilizing channel-independence (CI) strategies…

Signal Processing · Electrical Eng. & Systems 2025-07-08 Naimahmed Nesaragi , Hemin Ali Qadir , Per Steiner Halvorsen , Ilangko Balasingham

Effectively learning the temporal dynamics in electroencephalogram (EEG) signals is challenging yet essential for decoding brain activities using brain-computer interfaces (BCIs). Although Transformers are popular for their long-term…

Signal Processing · Electrical Eng. & Systems 2024-10-30 Yi Ding , Yong Li , Hao Sun , Rui Liu , Chengxuan Tong , Chenyu Liu , Xinliang Zhou , Cuntai Guan

In this work, we delve into the EEG classification task in the domain of visual brain decoding via two frameworks, involving two different learning paradigms. Considering the spatio-temporal nature of EEG data, one of our frameworks is…

Human-Computer Interaction · Computer Science 2024-08-12 Akanksha Sharma , Jyoti Nigam , Abhishek Rathore , Arnav Bhavsar

Estimating brain effective connectivity (EC) from functional magnetic resonance imaging (fMRI) data can aid in comprehending the neural mechanisms underlying human behavior and cognition, providing a foundation for disease diagnosis.…

Machine Learning · Computer Science 2025-03-17 Wen Xiong , Jinduo Liu , Junzhong Ji , Fenglong Ma

One of the challenges in modeling cognitive events from electroencephalogram (EEG) data is finding representations that are invariant to inter- and intra-subject differences, as well as to inherent noise associated with such data. Herein,…

Machine Learning · Computer Science 2016-03-02 Pouya Bashivan , Irina Rish , Mohammed Yeasin , Noel Codella

Automated seizure detection from electroencephalography (EEG) remains difficult due to the large variability of seizure dynamics across patients, recording conditions, and clinical settings. We introduce LookAroundNet, a transformer-based…

Machine Learning · Computer Science 2026-01-12 Þór Sverrisson , Steinn Guðmundsson