English
Related papers

Related papers: Latent Representation Learning for Multimodal Brai…

200 papers

Acquiring high-quality annotated data for medical image segmentation is tedious and costly. Semi-supervised segmentation techniques alleviate this burden by leveraging unlabeled data to generate pseudo labels. Recently, advanced state space…

Computer Vision and Pattern Recognition · Computer Science 2025-08-20 Shumeng Li , Jian Zhang , Lei Qi , Luping Zhou , Yinghuan Shi , Yang Gao

Denoising is a crucial preprocessing step for hyperspectral images (HSIs) due to noise arising from intra-imaging mechanisms and environmental factors. Long-range spatial-spectral correlation modeling is beneficial for HSI denoising but…

Image and Video Processing · Electrical Eng. & Systems 2024-08-06 Guanyiman Fu , Fengchao Xiong , Jianfeng Lu , Jun Zhou

Semantic segmentation of remote sensing imagery is a fundamental task in computer vision, supporting a wide range of applications such as land use classification, urban planning, and environmental monitoring. However, this task is often…

Computer Vision and Pattern Recognition · Computer Science 2025-09-26 Qinfeng Zhu , Han Li , Liang He , Lei Fan

Multimodal fusion has made great progress in the field of remote sensing image classification due to its ability to exploit the complementary spatial-spectral information. Deep learning methods such as CNN and Transformer have been widely…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Qingyu Wang , Xue Jiang , Guozheng Xu

Transformer and its derivatives have achieved success in diverse tasks across computer vision, natural language processing, and speech processing. To reduce the complexity of computations within the multi-head self-attention mechanism in…

Audio and Speech Processing · Electrical Eng. & Systems 2025-04-29 Xiangyu Zhang , Qiquan Zhang , Hexin Liu , Tianyi Xiao , Xinyuan Qian , Beena Ahmed , Eliathamby Ambikairajah , Haizhou Li , Julien Epps

Spatial-temporal graph representations play a crucial role in urban sensing applications, including traffic analysis, human mobility behavior modeling, and citywide crime prediction. However, a key challenge lies in the noisy and sparse…

Machine Learning · Computer Science 2025-08-15 Qianru Zhang , Xinyi Gao , Haixin Wang , Dong Huang , Siu-Ming Yiu , Hongzhi Yin

Transformer-based methods have demonstrated excellent performance on super-resolution visual tasks, surpassing conventional convolutional neural networks. However, existing work typically restricts self-attention computation to…

Computer Vision and Pattern Recognition · Computer Science 2024-05-09 Shu-Chuan Chu , Zhi-Chao Dou , Jeng-Shyang Pan , Shaowei Weng , Junbao Li

Reliable large-scale cell detection and segmentation is the fundamental first step to understanding biological processes in the brain. The ability to phenotype cells at scale can accelerate preclinical drug evaluation and system-level brain…

Computer Vision and Pattern Recognition · Computer Science 2023-01-03 Son T. Ly , Bai Lin , Hung Q. Vo , Dragan Maric , Badri Roysam , Hien V. Nguyen

Objective: To enable continuous, long-term neuro-monitoring on wearable devices by overcoming the computational bottlenecks of Transformer-based Electroencephalography (EEG) foundation models and the quantization challenges inherent to…

Signal Processing · Electrical Eng. & Systems 2026-03-31 Anna Tegon , Nicholas Lehmann , Yawei Li , Andrea Cossettini , Luca Benini , Thorir Mar Ingolfsson

High-Density surface Electromyography (HDsEMG) has emerged as a pivotal resource for Human-Computer Interaction (HCI), offering direct insights into muscle activities and motion intentions. However, a significant challenge in practical…

Signal Processing · Electrical Eng. & Systems 2026-02-25 Mehran Shabanpour , Kasra Rad , Sadaf Khademi , Arash Mohammadi

Joint multimodal functional data acquisition, where functional data from multiple modes are measured simultaneously from the same subject, has emerged as an exciting modern approach enabled by recent engineering breakthroughs in the…

Methodology · Statistics 2023-10-03 Katherine Tsai , Boxin Zhao , Sanmi Koyejo , Mladen Kolar

This paper proposes a Mamba-assisted neural network framework incorporating self-attention mechanism to achieve improved channel estimation with low complexity for orthogonal frequency-division multiplexing (OFDM) waveforms, particularly…

Machine Learning · Computer Science 2026-01-27 Dianxin Luan , Chengsi Liang , Jie Huang , Zheng Lin , Kaitao Meng , John Thompson , Cheng-Xiang Wang

A major challenge in multimodal learning is the presence of noise within individual modalities. This noise inherently affects the resulting multimodal representations, especially when these representations are obtained through explicit…

Computer Vision and Pattern Recognition · Computer Science 2025-08-25 Mohammad Zia Ur Rehman , Devraj Raghuvanshi , Umang Jain , Shubhi Bansal , Nagendra Kumar

This study introduces a deep learning framework for the inferential exploration of latent representations in 3D brain MRI, leveraging a simple convolutional autoencoder with a hierarchical encoder and a compact latent space. Trained on…

Applications · Statistics 2026-05-25 J. M. Gorriz , F. Segovia , C. Jimenez , J. E. Arco , F. J. Martinez , J Ramirez , S. Abulikemu , J. Suckling

Action, cognition, emotion and perception can be mapped in the brain by using set of techniques. Translating unimodal concepts from one modality to another is an important step towards understanding the neural mechanisms. This paper…

Other Computer Science · Computer Science 2012-12-18 Revati Shriram , Dr. M. Sundhararajan , Nivedita Daimiwal

Efficiently modeling sequences with infinite context length has long been a challenging problem. Previous approaches have either suffered from quadratic computational complexity or limited extrapolation ability in length generalization. In…

Computation and Language · Computer Science 2025-03-03 Liliang Ren , Yang Liu , Yadong Lu , Yelong Shen , Chen Liang , Weizhu Chen

Mamba, a selective state-space model (SSM), has emerged as an efficient alternative to Transformers for speech modeling, enabling long-sequence processing with linear complexity. While effective in speech separation, existing approaches,…

Sound · Computer Science 2026-01-26 Ke Xue , Chang Sun , Rongfei Fan , Jing Wang , Han Hu

Recent Transformer-based diffusion models have shown remarkable performance, largely attributed to the ability of the self-attention mechanism to accurately capture both global and local contexts by computing all-pair interactions among…

Computer Vision and Pattern Recognition · Computer Science 2024-09-20 Yunxiang Fu , Chaoqi Chen , Yizhou Yu

EEG-based emotion recognition holds significant potential in the field of brain-computer interfaces. A key challenge lies in extracting discriminative spatiotemporal features from electroencephalogram (EEG) signals. Existing studies often…

Human-Computer Interaction · Computer Science 2025-12-02 Xin Zhou , Dawei Huang , Xiaojing Peng , Lijun Yin

Although self-supervised learning enables us to bootstrap the training by exploiting unlabeled data, the generic self-supervised methods for natural images do not sufficiently incorporate the context. For medical images, a desirable method…

Image and Video Processing · Electrical Eng. & Systems 2022-07-08 Li Sun , Ke Yu , Kayhan Batmanghelich