English
Related papers

Related papers: BioMamba: Leveraging Spectro-Temporal Embedding in…

200 papers

Cross-modal alignment is crucial for multimodal representation fusion due to the inherent heterogeneity between modalities. While Transformer-based methods have shown promising results in modeling inter-modal relationships, their quadratic…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Yan Li , Yifei Xing , Xiangyuan Lan , Xin Li , Haifeng Chen , Dongmei Jiang

Event cameras draw inspiration from biological systems, boasting low latency and high dynamic range while consuming minimal power. The most current approach to processing Event Cloud often involves converting it into frame-based…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Hongwei Ren , Yue Zhou , Jiadong Zhu , Haotian Fu , Yulong Huang , Xiaopeng Lin , Yuetong Fang , Fei Ma , Hao Yu , Bojun Cheng

This study proposes a novel perspective on multimodal deep learning for biomedical signal classification, systematically analyzing how complementary feature domains impact model performance. While fusing multiple domains often presumes…

Machine Learning · Computer Science 2025-08-05 Timothy Oladunni , Alex Wong

Pain is a complex and pervasive condition that affects a significant portion of the population. Accurate and consistent assessment is essential for individuals suffering from pain, as well as for developing effective management strategies…

Artificial Intelligence · Computer Science 2025-09-17 Stefanos Gkikas , Ioannis Kyprakis , Manolis Tsiknakis

Time series prediction plays a pivotal role across diverse domains such as finance, healthcare, energy systems, and environmental modeling. However, existing approaches often struggle to balance efficiency, scalability, and accuracy,…

Machine Learning · Computer Science 2026-01-13 Xingsheng Chen , Regina Zhang , Bo Gao , Xingwei He , Xiaofeng Liu , Pietro Lio , Kwok-Yan Lam , Siu-Ming Yiu

We introduce VideoMamba, a novel adaptation of the pure Mamba architecture, specifically designed for video recognition. Unlike transformers that rely on self-attention mechanisms leading to high computational costs by quadratic complexity,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Jinyoung Park , Hee-Seon Kim , Kangwook Ko , Minbeom Kim , Changick Kim

Mamba-based models have recently demonstrated significant potential in hyperspectral image (HSI) classification, primarily due to their ability to perform contextual modeling with linear computational complexity. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Yichu Xu , Di Wang , Hongzan Jiao , Lefei Zhang , Liangpei Zhang

Multi-modal MRI offers valuable complementary information for diagnosis and treatment; however, its utility is limited by prolonged scanning times. To accelerate the acquisition process, a practical approach is to reconstruct images of the…

Image and Video Processing · Electrical Eng. & Systems 2024-07-09 Jing Zou , Lanqing Liu , Qi Chen , Shujun Wang , Zhanli Hu , Xiaohan Xing , Jing Qin

Speech intelligibility prediction (SIP) models have been used as objective metrics to assess intelligibility for hearing-impaired (HI) listeners. In the Clarity Prediction Challenge 2 (CPC2), non-intrusive binaural SIP models based on…

Sound · Computer Science 2025-07-09 Katsuhiko Yamamoto , Koichi Miyazaki

Advances in computational pathology increasingly rely on extracting meaningful representations from Whole Slide Images (WSIs) to support various clinical and biological tasks. In this study, we propose a generalizable deep learning…

Computer Vision and Pattern Recognition · Computer Science 2025-09-26 Shakib Khan , Fariba Dambandkhameneh , Nazim Shaikh , Yao Nie , Raghavan Venugopal , Xiao Li

The problem of imputing multivariate time series spans a wide range of fields, from clinical healthcare to multi-sensor systems. Initially, Recurrent Neural Networks (RNNs) were employed for this task; however, their error accumulation…

Machine Learning · Computer Science 2024-10-10 Javier Solís-García , Belén Vega-Márquez , Juan A. Nepomuceno , Isabel A. Nepomuceno-Chamorro

Alzheimer's Disease (AD) is a progressive, irreversible neurodegenerative disorder that often originates from Mild Cognitive Impairment (MCI). This progression results in significant memory loss and severely affects patients' quality of…

Computer Vision and Pattern Recognition · Computer Science 2025-01-30 Zhaojie Fang , Shenghao Zhu , Yifei Chen , Binfeng Zou , Fan Jia , Chang Liu , Xiang Feng , Linwei Qiu , Feiwei Qin , Jin Fan , Changbiao Chu , Changmiao Wang

Learning human motion based on a time-dependent input signal presents a challenging yet impactful task with various applications. The goal of this task is to generate or estimate human movement that consistently reflects the temporal…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Quang Nguyen , Tri Le , Baoru Huang , Minh Nhat Vu , Ngan Le , Thieu Vo , Anh Nguyen

DNA barcodes are crucial in biodiversity analysis for building automatic identification systems that recognize known species and discover unseen species. Unlike human genome modeling, barcode-based invertebrate identification poses…

Machine Learning · Computer Science 2024-12-17 Tiancheng Gao , Graham W. Taylor

The human brain receives stimuli in multiple ways; among them, audio constitutes an important source of relevant stimuli for the brain regarding communication, amusement, warning, etc. In this context, the aim of this manuscript is to…

Signal Processing · Electrical Eng. & Systems 2024-11-21 Isaac Ariza , Ana M. Barbancho , Lorenzo J. Tardon , Isabel Barbancho

The HeartBert model is introduced with three primary objectives: reducing the need for labeled data, minimizing computational resources, and simultaneously improving performance in machine learning systems that analyze Electrocardiogram…

Signal Processing · Electrical Eng. & Systems 2026-04-29 Saedeh Tahery , Fatemeh Hamid Akhlaghi , Termeh Amirsoleimani

Infrared Image Super-Resolution (IRSR) is challenged by the low contrast and sparse textures of infrared data, requiring robust long-range modeling to maintain global coherence. While State-Space Models like Mamba offer proficiency in…

Computer Vision and Pattern Recognition · Computer Science 2025-08-13 Yongsong Huang , Tomo Miyazaki , Xiaofeng Liu , Shinichiro Omachi

The advent of single-cell multi-omics technologies has enabled the simultaneous profiling of diverse omics layers within individual cells. Integrating such multimodal data provides unprecedented insights into cellular identity, regulatory…

Cell Behavior · Quantitative Biology 2025-06-27 Zhen Yuan , Shaoqing Jiao , Yihang Xiao , Jiajie Peng

Transformers have revolutionized deep learning across various tasks, including audio representation learning, due to their powerful modeling capabilities. However, they often suffer from quadratic complexity in both GPU memory usage and…

Audio and Speech Processing · Electrical Eng. & Systems 2025-02-06 Siavash Shams , Sukru Samet Dindar , Xilin Jiang , Nima Mesgarani

Biological age, which may be older or younger than chronological age due to factors such as genetic predisposition, environmental exposures, serves as a meaningful biomarker of aging processes and can inform risk stratification, treatment…

Genomics · Quantitative Biology 2025-11-11 Shuyue Jiang , Wenjing Ma , Shaojun Yu , Chang Su , Runze Yan , Jiaying Lu