English
Related papers

Related papers: Spatio-Temporal Analysis of Transformer based Arch…

200 papers

Recently, Transformer-based models for long sequence time series forecasting have demonstrated promising results. The self-attention mechanism as the core component of these Transformer-based models exhibits great potential in capturing…

Machine Learning · Computer Science 2024-12-17 Zhicheng Zhang , Yong Wang , Shaoqi Tan , Bowei Xia , Yujie Luo

Human emotions are difficult to convey through words and are often abstracted in the process; however, electroencephalogram (EEG) signals can offer a more direct lens into emotional brain activity. Recent studies show that deep learning…

Neurons and Cognition · Quantitative Biology 2025-11-19 Nilay Kumar , Priyansh Bhandari , G. Maragatham

Event-based vision sensors, inspired by biological neural systems, asynchronously capture local pixel-level intensity changes as a sparse event stream containing position, polarity, and timestamp information. These neuromorphic sensors…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Tiantian Xie , Pengpai Wang , Rosa H. M. Chan

The decoding of electroencephalography (EEG) signals allows access to user intentions conveniently, which plays an important role in the fields of human-machine interaction. To effectively extract sufficient characteristics of the…

Human-Computer Interaction · Computer Science 2024-09-06 Hongqi Li , Haodong Zhang , Yitong Chen

Scene text recognition has attracted particular research interest because it is a very challenging problem and has various applications. The most cutting-edge methods are attentional encoder-decoder frameworks that learn the alignment…

Computer Vision and Pattern Recognition · Computer Science 2019-08-27 Xiaoxue Chen , Tianwei Wang , Yuanzhi Zhu , Lianwen Jin , Canjie Luo

Transformer models have achieved remarkable results in a wide range of applications. However, their scalability is hampered by the quadratic time and memory complexity of the self-attention mechanism concerning the sequence length. This…

Machine Learning · Computer Science 2024-02-27 Yury Nahshan , Joseph Kampeas , Emir Haleva

Cardiovascular diseases remain the leading cause of global mortality, emphasizing the critical need for efficient diagnostic tools such as electrocardiograms (ECGs). Recent advancements in deep learning, particularly transformers, have…

World modelling, i.e. building a representation of the rules that govern the world so as to predict its evolution, is an essential ability for any agent interacting with the physical world. Recent applications of the Transformer…

Machine Learning · Computer Science 2024-05-31 Francesco Petri , Luigi Asprino , Aldo Gangemi

Brain-computer interfaces (BCIs) harness electroencephalographic signals for direct neural control of devices, offering a significant benefit for individuals with motor impairments. Traditional machine learning methods for EEG-based motor…

Human-Computer Interaction · Computer Science 2024-06-25 Wangdan Liao , Weidong Wang

Neuroimaging techniques have shown to be useful when studying the brain's activity. This paper uses Magnetoencephalography (MEG) data, provided by the Human Connectome Project (HCP), in combination with various deep artificial neural…

Machine Learning · Computer Science 2020-07-07 Ismail Alaoui Abdellaoui , Jesus Garcia Fernandez , Caner Sahinli , Siamak Mehrkanoon

Electroencephalography (EEG) is a non-invasive technique for recording brain electrical activity, widely used in brain-computer interface (BCI) and healthcare. Recent EEG foundation models trained on large-scale datasets have shown improved…

Machine Learning · Computer Science 2025-09-29 Yi Ding , Muyun Jiang , Weibang Jiang , Shuailei Zhang , Xinliang Zhou , Chenyu Liu , Shanglin Li , Yong Li , Cuntai Guan

In this study we investigate a textural processing method of electroencephalography (EEG) signal as an indicator to estimate the driver's vigilance in a hypothetical Brain-Computer Interface (BCI) system. The novelty of the solution…

Computer Vision and Pattern Recognition · Computer Science 2020-10-20 Giulia Orrù , Marco Micheletto , Fabio Terranova , Gian Luca Marcialis

Electroencephalography (EEG) is an invaluable tool in neuroscience, offering insights into brain activity with high temporal resolution. Recent advancements in machine learning and generative modeling have catalyzed the application of EEG…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Yashvir Sabharwal , Balaji Rama

Brain Computer Interfaces (BCI) have become very popular with Electroencephalography (EEG) being one of the most commonly used signal acquisition techniques. A major challenge in BCI studies is the individualistic analysis required for each…

Signal Processing · Electrical Eng. & Systems 2019-11-28 Baani Leen Kaur Jolly , Palash Aggrawal , Surabhi S Nath , Viresh Gupta , Manraj Singh Grover , Rajiv Ratn Shah

In this paper we introduce attention-regression model to demonstrate predicting acoustic features from electroencephalography (EEG) features recorded in parallel with spoken sentences. First we demonstrate predicting acoustic features…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-05 Gautam Krishna , Co Tran , Mason Carnahan , Ahmed Tewfik

With the advancements of sensor hardware, traffic infrastructure and deep learning architectures, trajectory prediction of vehicles has established a solid foundation in intelligent transportation systems. However, existing solutions are…

Artificial Intelligence · Computer Science 2024-11-13 Jia Quan Loh , Xuewen Luo , Fan Ding , Hwa Hui Tew , Junn Yong Loo , Ze Yang Ding , Susilawati Susilawati , Chee Pin Tan

Heterogeneous temporal graphs (HTGs) are ubiquitous data structures in the real world. Recently, to enhance representation learning on HTGs, numerous attention-based neural networks have been proposed. Despite these successes, existing…

Machine Learning · Computer Science 2025-10-22 Yili Wang , Tairan Huang , Changlong He , Qiutong Li , Jianliang Gao

Recently, deep learning-based beamforming algorithms have shown promising performance in target speech extraction tasks. However, most systems do not fully utilize spatial information. In this paper, we propose a target speech extraction…

Sound · Computer Science 2023-06-29 Aoqi Guo , Junnan Wu , Peng Gao , Wenbo Zhu , Qinwen Guo , Dazhi Gao , Yujun Wang

Mental disorders present challenges in diagnosis and treatment due to their complex and heterogeneous nature. Electroencephalogram (EEG) has shown promise as a potential biomarker for these disorders. However, existing methods for analyzing…

Methodology · Statistics 2024-01-30 Xingche Guo , Bin Yang , Ji Meng Loh , Qinxia Wang , Yuanjia Wang

Motor imagery (MI) based EEG represents a frontier in enabling direct neural control of external devices and advancing neural rehabilitation. This study introduces a novel time embedding technique, termed traveling-wave based time…

Neurons and Cognition · Quantitative Biology 2024-08-26 Zhengqing Miao , Meirong Zhao