中文
相关论文

相关论文: Benchmarking Positional Encoding Strategies for Tr…

200 篇论文

Compared to other modalities, electroencephalogram (EEG) based emotion recognition can intuitively respond to emotional patterns in the human brain and, therefore, has become one of the most focused tasks in affective computing. The nature…

信号处理 · 电气工程与系统科学 2024-08-14 Chenyu Liu , Xinliang Zhou , Yihao Wu , Yi Ding , Liming Zhai , Kun Wang , Ziyu Jia , Yang Liu

Recent attempts at creating Foundation Models (FMs) for Electroencephalography (EEG) have achieved state-of-the-art performance on multiple tasks including Motor Imagery (MI). These MI tasks have typically involved coarse classification…

人机交互 · 计算机科学 2026-05-18 Srinivas Ravishankar , Ishayu Ghosh , Nora Zajzon , Teng Fei , Virginia de Sa

The electroencephalogram (EEG) is a powerful method to understand how the brain processes speech. Linear models have recently been replaced for this purpose with deep neural networks and yield promising results. In related EEG…

音频与语音处理 · 电气工程与系统科学 2022-07-25 Lies Bollens , Tom Francart , Hugo Van Hamme

We conducted empirical experiments to assess the transferability of a light curve transformer to datasets with different cadences and magnitude distributions using various positional encodings (PEs). We proposed a new approach to…

Electroencephalography (EEG) and Magnetoencephalography (MEG) are pivotal in understanding brain activity but are limited by their poor spatial resolution. EEG/MEG source imaging (ESI) infers the high-resolution electric field distribution…

信号处理 · 电气工程与系统科学 2024-02-01 Song Wang , Chen Wei , Kexin Lou , Dongfeng Gu , Quanying Liu

Reconstructing natural language from non-invasive electroencephalography (EEG) holds great promise as a language decoding technology for brain-computer interfaces (BCIs). However, EEG-based language decoding is still in its nascent stages,…

计算与语言 · 计算机科学 2024-09-27 Jiaqi Wang , Zhenxi Song , Zhengyu Ma , Xipeng Qiu , Min Zhang , Zhiguo Zhang

Positional Encodings (PEs) are used to inject word-order information into transformer-based language models. While they can significantly enhance the quality of sentence representations, their specific contribution to language models is not…

计算与语言 · 计算机科学 2023-10-20 Lihu Chen , Gaël Varoquaux , Fabian M. Suchanek

Clinical electroencephalogram (EEG) analysis rests on a hand-crafted feature catalog refined over decades, \emph{e.g.,} band power, connectivity, complexity, and more. Modern EEG foundation models bypass this catalog, learn directly from…

人工智能 · 计算机科学 2026-05-15 Ling Tang , Qian Chen , Jilin Mei , Houshi Xu , Quanshi Zhang , Jing Shao , Na Zou , Xia Hu , Dongrui Liu

Positional encoding (PE) underpins how permutation-invariant Transformers represent sequence order, yet how positional information is processed and stored remains poorly understood. Modern PE methods such as RoPE still struggle on tasks…

计算与语言 · 计算机科学 2026-05-29 Pierre-Antoine Lequeu , Camille Barboule , Benjamin Piwowarski

The significant inter-subject variability in electroen-cephalogram (EEG) signals often results in substantial changes to neural network weights as data distributions shift. This variability frequently causes catastrophic forgetting in…

信号处理 · 电气工程与系统科学 2025-03-26 Dan Li , Hye-Bin Shin , Kang Yin , Seong-Whan Lee

Accurate electroencephalography (EEG) and magnetoencephalography (MEG) source localization and reconstruction are essential for understanding brain function, yet remain challenging because the underlying EEG/MEG inverse problem is…

最优化与控制 · 数学 2026-04-29 Julia Jurkowska , Joanna Dreszer , Monika Lewandowska , Krzysztof Tołpa , Tomasz Piotrowski

Brain-computer interfaces (BCI) offer numerous human-centered application possibilities, particularly affecting people with neurological disorders. Text or speech decoding from brain activities is a relevant domain that could augment the…

音频与语音处理 · 电气工程与系统科学 2025-01-10 Jihwan Lee , Tiantian Feng , Aditya Kommineni , Sudarsana Reddy Kadiri , Shrikanth Narayanan

We introduce a novel positional encoding strategy for Transformer-style models, addressing the shortcomings of existing, often ad hoc, approaches. Our framework provides a flexible mapping from the algebraic specification of a domain to an…

机器学习 · 计算机科学 2024-11-01 Konstantinos Kogkalidis , Jean-Philippe Bernardy , Vikas Garg

We propose a fusion approach that combines features from simultaneously recorded electroencephalographic (EEG) and magnetoencephalographic (MEG) signals to improve classification performances in motor imagery-based brain-computer interfaces…

EEG based brain state decoding has numerous applications. State of the art decoding is based on processing of the multivariate sensor space signal, however evidence is mounting that EEG source reconstruction can assist decoding. EEG source…

Electroencephalography (EEG) is shown to be a valuable data source for evaluating subjects' mental states. However, the interpretation of multi-modal EEG signals is challenging, as they suffer from poor signal-to-noise-ratio, are highly…

信号处理 · 电气工程与系统科学 2022-04-19 David Bethge , Philipp Hallgarten , Ozan Özdenizci , Ralf Mikut , Albrecht Schmidt , Tobias Grosse-Puppendahl

The ability to perceive and recognize objects is fundamental for the interaction with the external environment. Studies that investigate them and their relationship with brain activity changes have been increasing due to the possible…

信号处理 · 电气工程与系统科学 2020-08-31 Jenifer Kalafatovich , Minji Lee , Seong-Whan Lee

Electroencephalography (EEG) is a widely used technique for measuring brain activity. EEG-based signals can reveal a persons emotional state, as they directly reflect activity in different brain regions. Emotion-aware systems and EEG-based…

机器学习 · 计算机科学 2026-02-03 Ashna Purwar , Gaurav Simkar , Madhumita , Sachin Kadam

Electroencephalography (EEG) is a method of recording brain activity that shows significant promise in applications ranging from disease classification to emotion detection and brain-computer interfaces. Recent advances in deep learning…

机器学习 · 计算机科学 2026-01-15 Amarpal Sahota , Navid Mohammadi Foumani , Raul Santos-Rodriguez , Zahraa S. Abdallah

Recent advancements in transformer-based models have greatly improved time series analysis, providing robust solutions for tasks such as forecasting, anomaly detection, and classification. A crucial element of these models is positional…

机器学习 · 计算机科学 2026-05-07 Habib Irani , Vangelis Metsis