English
Related papers

Related papers: MEBM-Phoneme: Multi-scale Enhanced BrainMagic for …

200 papers

We apply transfer learning to the task of phoneme segmentation and demonstrate the utility of representations learned in self-supervised pre-training for the task. Our model extends transformer-style encoders with strategically placed…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-04 Luke Strgar , David Harwath

It is crucial for auditory attention decoding to classify matched and mismatched speech stimuli with corresponding EEG responses by exploring their relationship. However, existing methods often adopt two independent networks to encode…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-22 Shitong Fan , Wenbo Wang , Feiyang Xiao , Shiheng Zhang , Qiaoxi Zhu , Jian Guan

Speech brain-computer interfaces (BCIs), which translate brain signals into spoken words or sentences, have shown significant potential for high-performance BCI communication. Phonemes are the fundamental units of pronunciation in most…

Human-Computer Interaction · Computer Science 2023-05-16 Xianhan Tan , Junming Zhu , Jianmin Zhang , Yueming Wang , Yu Qi

Electroencephalography (EEG) stands as a crucial tool in neuroscientific research and clinical diagnostics, providing valuable insights into the electrical activities of the brain. Traditional EEG signal processing techniques, predominantly…

Neurons and Cognition · Quantitative Biology 2024-01-12 Aryan Govil , Eric Yao , Christina R. Borao

Electroencephalography (EEG) and magnetoencephalography (MEG) measure neural activity non-invasively by capturing electromagnetic fields generated by dendritic currents. Although rooted in the same biophysics, EEG and MEG exhibit distinct…

Signal Processing · Electrical Eng. & Systems 2025-10-16 Qinfan Xiao , Ziyun Cui , Chi Zhang , Siqi Chen , Wen Wu , Andrew Thwaites , Alexandra Woolgar , Bowen Zhou , Chao Zhang

Multi-modal brain tumor segmentation is critical for clinical diagnosis, and it requires accurate identification of distinct internal anatomical subregions. While the recent prompt-based segmentation paradigms enable interactive experiences…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Yuxiang Luo , Qing Xu , Hai Huang , Yuqi Ouyang , Zhen Chen , Wenting Duan

We study the representation and encoding of phonemes in a recurrent neural network model of grounded speech. We use a model which processes images and their spoken descriptions, and projects the visual and auditory representations into the…

Computation and Language · Computer Science 2018-10-30 Afra Alishahi , Marie Barking , Grzegorz Chrupała

Long Short-Term Memory (LSTM) is widely used in various sequential applications. Complex LSTMs could be hardly deployed on wearable and resourced-limited devices due to the huge amount of computations and memory requirements. Binary LSTMs…

Machine Learning · Computer Science 2020-04-24 Najmeh Nazari , Seyed Ahmad Mirsalari , Sima Sinaei , Mostafa E. Salehi , Masoud Daneshtalab

Accurately monitoring cognitive load in real time is critical for Brain-Computer Interfaces (BCIs) that adapt to user engagement and support personalized learning. Electroencephalography (EEG) offers a non-invasive, cost-effective modality…

Human-Computer Interaction · Computer Science 2026-05-04 Deeksha M. Shama , Dimitra Emmanouilidou , Ivan J. Tashev

We present MeFEm, a vision model based on a modified Joint Embedding Predictive Architecture (JEPA) for biometric and medical analysis from facial images. Key modifications include an axial stripe masking strategy to focus learning on…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Yury Borets , Stepan Botman

Electroencephalography provides a non-invasive window into brain activity, offering valuable insights for neurological research, brain-computer interfaces, and clinical diagnostics. However, the development of robust machine learning models…

Signal Processing · Electrical Eng. & Systems 2025-02-26 Chi-Sheng Chen , Ying-Jung Chen , Aidan Hung-Wen Tsai

A significant challenge in the electroencephalogram EEG lies in the fact that current data representations involve multiple electrode signals, resulting in data redundancy and dominant lead information. However extensive research conducted…

Signal Processing · Electrical Eng. & Systems 2024-07-31 Huyen Ngo , Khoi Do , Duong Nguyen , Viet Dung Nguyen , Lan Dang

Existing memory systems enable Large Language Models (LLMs) to support long-horizon human-LLM interactions by persisting historical interactions beyond limited context windows. However, while recent approaches have succeeded in constructing…

Computation and Language · Computer Science 2026-04-21 Haidong Xin , Xinze Li , Zhenghao Liu , Yukun Yan , Shuo Wang , Cheng Yang , Yu Gu , Ge Yu , Maosong Sun

Electrocardiogram (ECG) analysis is a fundamental tool for diagnosing cardiovascular conditions, yet anomaly detection in ECG signals remains challenging due to their inherent complexity and variability. We propose Multi-scale Masked…

Machine Learning · Computer Science 2025-02-11 Ya Zhou , Yujie Yang , Jianhuang Gan , Xiangjie Li , Jing Yuan , Wei Zhao

Electroencephalograph (EEG) is a crucial tool for studying brain activity. Recently, self-supervised learning methods leveraging large unlabeled datasets have emerged as a potential solution to the scarcity of widely available annotated EEG…

Non-invasive brainwave decoding is usually done using Magneto/Electroencephalography (MEG/EEG) sensor measurements as inputs. This makes combining datasets and building models with inductive biases difficult as most datasets use different…

Signal Processing · Electrical Eng. & Systems 2024-10-29 Yonatan Gideoni , Ryan Charles Timms , Oiwi Parker Jones

In the field of connectomics, neuroscientists seek to identify cortical connectivity comprehensively. Neuronal boundary detection from the Electron Microscopy (EM) images is often done to assist the automatic reconstruction of neuronal…

Computer Vision and Pattern Recognition · Computer Science 2017-08-01 Wei Shen , Bin Wang , Yuan Jiang , Yan Wang , Alan Yuille

Brain-Computer Interfaces (BCIs) can decode imagined speech from neural activity. However, these systems typically require extensive training sessions where participants imaginedly repeat words, leading to mental fatigue and difficulties…

Machine Learning · Computer Science 2025-02-07 Saravanakumar Duraisamy , Mateusz Dubiel , Maurice Rekrut , Luis A. Leiva

Speech-related Brain Computer Interfaces (BCI) aim primarily at finding an alternative vocal communication pathway for people with speaking disabilities. As a step towards full decoding of imagined speech from active thoughts, we present a…

Machine Learning · Computer Science 2019-04-10 Pramit Saha , Muhammad Abdul-Mageed , Sidney Fels

Objective: A novel structure based on channel-wise attention mechanism is presented in this paper. Embedding with the proposed structure, an efficient classification model that accepts multi-lead electrocardiogram (ECG) as input is…

Signal Processing · Electrical Eng. & Systems 2020-03-27 Hao Tung , Chao Zheng , Xinsheng Mao , Dahong Qian