English
Related papers

Related papers: Mentality: A Mamba-based Approach towards Foundati…

200 papers

Epilepsy is one of the most common neurological disorders, affecting about 1% of the population at all ages. Detecting the development of epilepsy, i.e., epileptogenesis (EPG), before any seizures occur could allow for early interventions…

Machine Learning · Computer Science 2020-06-18 Diyuan Lu , Sebastian Bauer , Valentin Neubert , Lara Sophie Costard , Felix Rosenow , Jochen Triesch

In this paper, we aimed at reviewing present literature on employing nonlinear analysis in combination with machine learning methods, in depression detection or prediction task. We are focusing on an affordable data-driven approach,…

Signal Processing · Electrical Eng. & Systems 2019-09-10 Milena Čukić Radenković , Victoria Lopez Lopez

Human engagement estimation in conversational scenarios is essential for applications such as adaptive tutoring, remote healthcare assessment, and socially aware human--computer interaction. Engagement is a dynamic, multimodal signal…

Artificial Intelligence · Computer Science 2025-09-23 Shenwei Kang , Xin Zhang , Wen Liu , Bin Li , Yujie Liu , Bo Gao

Epilepsy represents the most prevalent neurological disease in the world. One-third of people suffering from mesial temporal lobe epilepsy (MTLE) exhibit drug resistance, urging the need to develop new treatments. A key part in anti-seizure…

Mamba-based architectures have shown to be a promising new direction for deep learning models owing to their competitive performance and sub-quadratic deployment speed. However, current Mamba multi-modal large language models (MLLM) are…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Yifei Xing , Xiangyuan Lan , Ruiping Wang , Dongmei Jiang , Wenjun Huang , Qingfang Zheng , Yaowei Wang

State space models (SSMs) with selection mechanisms and hardware-aware architectures, namely Mamba, have recently demonstrated significant promise in long-sequence modeling. Since the self-attention mechanism in transformers has quadratic…

Computer Vision and Pattern Recognition · Computer Science 2024-04-29 Hanwei Zhang , Ying Zhu , Dan Wang , Lijun Zhang , Tianxiang Chen , Zi Ye

Human activity recognition (HAR) from inertial sensors is essential for ubiquitous computing, mobile health, and ambient intelligence. Conventional deep models such as Convolutional Neural Networks (CNNs), Recurrent Neural Networks (RNNs),…

Human-Computer Interaction · Computer Science 2025-11-27 Thai-Khanh Nguyen , Uyen Vo , Tan M. Nguyen , Thieu N. Vo , Trung-Hieu Le , Cuong Pham

This work aims to investigate the use of a recently proposed, attention-free, scalable state-space model (SSM), Mamba, for the speech enhancement (SE) task. In particular, we employ Mamba to deploy different regression-based SE models…

Predicting user preferences and sequential dependencies based on historical behavior is the core goal of sequential recommendation. Although attention-based models have shown effectiveness in this field, they often struggle with inference…

Machine Learning · Computer Science 2024-06-11 Yuda Wang , Xuxin He , Shengxin Zhu

In the era of large-scale pre-trained models, effectively adapting general knowledge to specific affective computing tasks remains a challenge, particularly regarding computational efficiency and multimodal heterogeneity. While…

Artificial Intelligence · Computer Science 2026-03-20 Yan Li , Yifei Xing , Xiangyuan Lan , Xin Li , Haifeng Chen , Dongmei Jiang

Electroencephalography (EEG) is commonly used by physicians for the diagnosis of numerous neurological disorders. Due to the large volume of EEGs requiring interpretation and the specific expertise involved, artificial intelligence-based…

Scalable and generalizable analysis of brain activity is essential for advancing both clinical diagnostics and cognitive research. Electroencephalography (EEG), a non-invasive modality with high temporal resolution, has been widely used for…

Machine Learning · Computer Science 2025-12-01 Sha Zhao , Mingyi Peng , Haiteng Jiang , Tao Li , Shijian Li , Gang Pan

The recent empirical success of Mamba and other selective state space models (SSMs) has renewed interest in non-attention architectures for sequence modeling, yet their theoretical foundations remain underexplored. We present a first-step…

Machine Learning · Computer Science 2026-02-16 Mugunthan Shandirasegaran , Hongkang Li , Songyang Zhang , Meng Wang , Shuai Zhang

We introduce a unified benchmarking framework focused on evaluating EEG-based foundation models in clinical applications. The benchmark spans 11 well-defined diagnostic tasks across 14 publicly available EEG datasets, including epilepsy,…

Machine Learning · Computer Science 2025-12-11 Ard Kastrati , Josua Bürki , Jonas Lauer , Cheng Xuan , Raffaele Iaquinto , Roger Wattenhofer

Despite its widespread adoption as the prominent neural architecture, the Transformer has spurred several independent lines of work to address its limitations. One such approach is selective state space models, which have demonstrated…

Sound · Computer Science 2024-06-11 Sarthak Yadav , Zheng-Hua Tan

Mamba is a newly proposed architecture which behaves like a recurrent neural network (RNN) with attention-like capabilities. These properties are promising for speaker diarization, as attention-based models have unsuitable memory…

Sound · Computer Science 2024-10-11 Alexis Plaquet , Naohiro Tawara , Marc Delcroix , Shota Horiguchi , Atsushi Ando , Shoko Araki

Epilepsy is one of the most prevalent brain disorders that disrupts the lives of millions worldwide. For patients with drug-resistant seizures, there exist implantable devices capable of monitoring neural activity, promptly triggering…

Signal Processing · Electrical Eng. & Systems 2023-10-31 Arman Zarei , Bingzhao Zhu , Mahsa Shoaran

Timely diagnosis is important for saving the life of epileptic patients. In past few years, a lot of treatments are available for epilepsy. These treatments require use of anti-seizure drugs but are not effective in controlling frequency of…

Machine Learning · Computer Science 2021-11-08 Shivam Gupta , Jyoti Meena , O. P Gupta

Mental disorders present challenges in diagnosis and treatment due to their complex and heterogeneous nature. Electroencephalogram (EEG) has shown promise as a potential biomarker for these disorders. However, existing methods for analyzing…

Methodology · Statistics 2024-01-30 Xingche Guo , Bin Yang , Ji Meng Loh , Qinxia Wang , Yuanjia Wang

In recent years, machine learning has become an increasingly powerful tool for supporting seizure detection and monitoring in epilepsy care. Traditional approaches focus on identifying seizures only after they begin, which limits the…

Machine Learning · Computer Science 2025-10-30 Ria Jayanti , Tanish Jain