English
Related papers

Related papers: SAMBA: Toward a Long-Context EEG Foundation Model …

200 papers

The accurate automated diagnosis of cardiac abnormalities from 12-lead electrocardiograms (ECGs) is critical for managing cardiovascular disease. However, detecting concurrent conditions remains a challenge for traditional deep learning…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Huawei Jiang , Husna Mutahira , Shibo Wei , Jiahang Li , Vladimir Shin , Juneho Yi , Dongryeol Ryu , Wonyoung Park , Mannan Saeed Muhammad

Electroencephalography (EEG) is an essential technique for neuroscience research and brain-computer interface (BCI) applications. Recently, large-scale EEG foundation models have been developed, exhibiting robust generalization capabilities…

Signal Processing · Electrical Eng. & Systems 2025-10-15 Zhige Chen , Chengxuan Qin , Wenlong You , Rui Liu , Congying Chu , Rui Yang , Kay Chen Tan , Jibin Wu

Widely used traditional pipelines for subcortical brain segmentation are often inefficient and slow, particularly when processing large datasets. Furthermore, deep learning models face challenges due to the high resolution of MRI images and…

Image and Video Processing · Electrical Eng. & Systems 2024-10-15 Aaron Cao , Zongyu Li , Jordan Jomsky , Andrew F. Laine , Jia Guo

Accurate medical image segmentation requires effective modeling of both global anatomical structures and fine-grained boundary details. Recent state space models (e.g., Vision Mamba) offer efficient long-range dependency modeling. However,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 Fuhao Zhang , Lei Liu , Jialin Zhang , Ya-Nan Zhang , Nan Mu

Human-human interaction generation has garnered significant attention in motion synthesis due to its vital role in understanding humans as social beings. However, existing methods typically rely on transformer-based architectures, which…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Zizhao Wu , Yingying Sun , Yiming Chen , Xiaoling Gu , Ruyu Liu , Jiazhou Chen

Abnormality detection in medical imaging is a critical task requiring both high efficiency and accuracy to support effective diagnosis. While convolutional neural networks (CNNs) and Transformer-based models are widely used, both face…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Yao Wang , Dong Yang , Zhi Qiao , Wenjian Huang , Liuzhi Yang , Zhen Qian

Endoscopic Submucosal Dissection (ESD) is a minimally invasive procedure initially developed for early gastric cancer treatment and has expanded to address diverse gastrointestinal lesions. While computer-assisted surgery (CAS) systems…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Xiangning Zhang , Qingwei Zhang , Jinnan Chen , Chengfeng Zhou , Yaqi Wang , Zhengjie Zhang , Xiaobo Li , Dahong Qian

Multi-modal learning that combines pathological images with genomic data has significantly enhanced the accuracy of survival prediction. Nevertheless, existing methods have not fully utilized the inherent hierarchical structure within both…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Ying Chen , Jiajing Xie , Yuxiang Lin , Yuhang Song , Wenxian Yang , Rongshan Yu

Self attention encoders such as Bidirectional Encoder Representations from Transformers(BERT) scale quadratically with sequence length, making long context modeling expensive. Linear time state space models, such as Mamba, are efficient;…

Computation and Language · Computer Science 2026-03-04 Jinwoong Kim , Sangjin Park

Dynamic graphs exhibit intertwined spatio-temporal evolutionary patterns, widely existing in the real world. Nevertheless, the structure incompleteness, noise, and redundancy result in poor robustness for Dynamic Graph Neural Networks…

Machine Learning · Computer Science 2024-12-20 Haonan Yuan , Qingyun Sun , Zhaonan Wang , Xingcheng Fu , Cheng Ji , Yongjian Wang , Bo Jin , Jianxin Li

Convolutional neural networks (CNNs) and transformers are widely employed in constructing UNet architectures for medical image segmentation tasks. However, CNNs struggle to model long-range dependencies, while transformers suffer from…

Image and Video Processing · Electrical Eng. & Systems 2025-03-26 Shaolei Zhang , Jinyan Liu , Tianyi Qian , Xuesong Li

Recent advances in deep learning structured state space models, especially the Mamba architecture, have demonstrated remarkable performance improvements while maintaining linear complexity. In this study, we introduce functional…

Machine Learning · Computer Science 2025-03-24 Yuxiang Wei , Anees Abrol , Vince Calhoun

Long-term time series forecasting (LTSF) provides longer insights into future trends and patterns. Over the past few years, deep learning models especially Transformers have achieved advanced performance in LTSF tasks. However, LTSF faces…

Machine Learning · Computer Science 2024-06-28 Aobo Liang , Xingguo Jiang , Yan Sun , Xiaohou Shi , Ke Li

Selective state-space models (SSMs) like Mamba overcome some of the shortcomings of Transformers, such as quadratic computational complexity with sequence length and large inference-time memory requirements from the key-value cache.…

Recently, spatio-temporal time-series prediction has developed rapidly, yet existing deep learning methods struggle with learning complex long-term spatio-temporal dependencies efficiently. The long-term spatio-temporal dependency learning…

Machine Learning · Computer Science 2026-05-25 Haolong Chen , Liang Zhang , Zhengyuan Xin , Guangxu Zhu

Accurate organ and lesion segmentation is a critical prerequisite for computer-aided diagnosis. Convolutional Neural Networks (CNNs), constrained by their local receptive fields, often struggle to capture complex global anatomical…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Haodong Chen , Xianfei Han , Qwen

Unlike conventional data such as natural images, audio and speech, raw multi-channel Electroencephalogram (EEG) data are difficult to interpret. Modern deep neural networks have shown promising results in EEG studies, however finding robust…

Signal Processing · Electrical Eng. & Systems 2022-06-22 Nikesh Bajaj , Jesús Requena Carrión , Francesco Bellotti

Electroencephalography (EEG) is a vital tool to measure and record brain activity in neuroscience and clinical applications, yet its potential is constrained by signal heterogeneity, low signal-to-noise ratios, and limited labeled datasets.…

Machine Learning · Computer Science 2024-09-20 Enze Shi , Kui Zhao , Qilong Yuan , Jiaqi Wang , Huawen Hu , Sigang Yu , Shu Zhang

Motivated by the challenge of seamless cross-dataset transfer in EEG signal processing, this article presents an exploratory study on the use of Joint Embedding Predictive Architectures (JEPAs). In recent years, self-supervised learning has…

Machine Learning · Computer Science 2024-10-10 Pierre Guetschel , Thomas Moreau , Michael Tangermann

Sequential recommendation systems have become a cornerstone of personalized services, adept at modeling the temporal evolution of user preferences by capturing dynamic interaction sequences. Existing approaches predominantly rely on…

Information Retrieval · Computer Science 2025-05-15 Qianru Zhang , Honggang Wen , Wei Yuan , Crystal Chen , Menglin Yang , Siu-Ming Yiu , Hongzhi Yin