中文
相关论文

相关论文: Latent Representation Learning for Multimodal Brai…

200 篇论文

Acquiring high-quality annotated data for medical image segmentation is tedious and costly. Semi-supervised segmentation techniques alleviate this burden by leveraging unlabeled data to generate pseudo labels. Recently, advanced state space…

计算机视觉与模式识别 · 计算机科学 2025-08-20 Shumeng Li , Jian Zhang , Lei Qi , Luping Zhou , Yinghuan Shi , Yang Gao

Denoising is a crucial preprocessing step for hyperspectral images (HSIs) due to noise arising from intra-imaging mechanisms and environmental factors. Long-range spatial-spectral correlation modeling is beneficial for HSI denoising but…

图像与视频处理 · 电气工程与系统科学 2024-08-06 Guanyiman Fu , Fengchao Xiong , Jianfeng Lu , Jun Zhou

Semantic segmentation of remote sensing imagery is a fundamental task in computer vision, supporting a wide range of applications such as land use classification, urban planning, and environmental monitoring. However, this task is often…

计算机视觉与模式识别 · 计算机科学 2025-09-26 Qinfeng Zhu , Han Li , Liang He , Lei Fan

Multimodal fusion has made great progress in the field of remote sensing image classification due to its ability to exploit the complementary spatial-spectral information. Deep learning methods such as CNN and Transformer have been widely…

计算机视觉与模式识别 · 计算机科学 2025-09-03 Qingyu Wang , Xue Jiang , Guozheng Xu

Transformer and its derivatives have achieved success in diverse tasks across computer vision, natural language processing, and speech processing. To reduce the complexity of computations within the multi-head self-attention mechanism in…

音频与语音处理 · 电气工程与系统科学 2025-04-29 Xiangyu Zhang , Qiquan Zhang , Hexin Liu , Tianyi Xiao , Xinyuan Qian , Beena Ahmed , Eliathamby Ambikairajah , Haizhou Li , Julien Epps

Spatial-temporal graph representations play a crucial role in urban sensing applications, including traffic analysis, human mobility behavior modeling, and citywide crime prediction. However, a key challenge lies in the noisy and sparse…

机器学习 · 计算机科学 2025-08-15 Qianru Zhang , Xinyi Gao , Haixin Wang , Dong Huang , Siu-Ming Yiu , Hongzhi Yin

Transformer-based methods have demonstrated excellent performance on super-resolution visual tasks, surpassing conventional convolutional neural networks. However, existing work typically restricts self-attention computation to…

计算机视觉与模式识别 · 计算机科学 2024-05-09 Shu-Chuan Chu , Zhi-Chao Dou , Jeng-Shyang Pan , Shaowei Weng , Junbao Li

Reliable large-scale cell detection and segmentation is the fundamental first step to understanding biological processes in the brain. The ability to phenotype cells at scale can accelerate preclinical drug evaluation and system-level brain…

计算机视觉与模式识别 · 计算机科学 2023-01-03 Son T. Ly , Bai Lin , Hung Q. Vo , Dragan Maric , Badri Roysam , Hien V. Nguyen

Objective: To enable continuous, long-term neuro-monitoring on wearable devices by overcoming the computational bottlenecks of Transformer-based Electroencephalography (EEG) foundation models and the quantization challenges inherent to…

信号处理 · 电气工程与系统科学 2026-03-31 Anna Tegon , Nicholas Lehmann , Yawei Li , Andrea Cossettini , Luca Benini , Thorir Mar Ingolfsson

High-Density surface Electromyography (HDsEMG) has emerged as a pivotal resource for Human-Computer Interaction (HCI), offering direct insights into muscle activities and motion intentions. However, a significant challenge in practical…

信号处理 · 电气工程与系统科学 2026-02-25 Mehran Shabanpour , Kasra Rad , Sadaf Khademi , Arash Mohammadi

Joint multimodal functional data acquisition, where functional data from multiple modes are measured simultaneously from the same subject, has emerged as an exciting modern approach enabled by recent engineering breakthroughs in the…

统计方法学 · 统计学 2023-10-03 Katherine Tsai , Boxin Zhao , Sanmi Koyejo , Mladen Kolar

This paper proposes a Mamba-assisted neural network framework incorporating self-attention mechanism to achieve improved channel estimation with low complexity for orthogonal frequency-division multiplexing (OFDM) waveforms, particularly…

机器学习 · 计算机科学 2026-01-27 Dianxin Luan , Chengsi Liang , Jie Huang , Zheng Lin , Kaitao Meng , John Thompson , Cheng-Xiang Wang

A major challenge in multimodal learning is the presence of noise within individual modalities. This noise inherently affects the resulting multimodal representations, especially when these representations are obtained through explicit…

计算机视觉与模式识别 · 计算机科学 2025-08-25 Mohammad Zia Ur Rehman , Devraj Raghuvanshi , Umang Jain , Shubhi Bansal , Nagendra Kumar

This study introduces a deep learning framework for the inferential exploration of latent representations in 3D brain MRI, leveraging a simple convolutional autoencoder with a hierarchical encoder and a compact latent space. Trained on…

应用统计 · 统计学 2026-05-25 J. M. Gorriz , F. Segovia , C. Jimenez , J. E. Arco , F. J. Martinez , J Ramirez , S. Abulikemu , J. Suckling

Action, cognition, emotion and perception can be mapped in the brain by using set of techniques. Translating unimodal concepts from one modality to another is an important step towards understanding the neural mechanisms. This paper…

其他计算机科学 · 计算机科学 2012-12-18 Revati Shriram , Dr. M. Sundhararajan , Nivedita Daimiwal

Efficiently modeling sequences with infinite context length has long been a challenging problem. Previous approaches have either suffered from quadratic computational complexity or limited extrapolation ability in length generalization. In…

计算与语言 · 计算机科学 2025-03-03 Liliang Ren , Yang Liu , Yadong Lu , Yelong Shen , Chen Liang , Weizhu Chen

Mamba, a selective state-space model (SSM), has emerged as an efficient alternative to Transformers for speech modeling, enabling long-sequence processing with linear complexity. While effective in speech separation, existing approaches,…

声音 · 计算机科学 2026-01-26 Ke Xue , Chang Sun , Rongfei Fan , Jing Wang , Han Hu

Recent Transformer-based diffusion models have shown remarkable performance, largely attributed to the ability of the self-attention mechanism to accurately capture both global and local contexts by computing all-pair interactions among…

计算机视觉与模式识别 · 计算机科学 2024-09-20 Yunxiang Fu , Chaoqi Chen , Yizhou Yu

EEG-based emotion recognition holds significant potential in the field of brain-computer interfaces. A key challenge lies in extracting discriminative spatiotemporal features from electroencephalogram (EEG) signals. Existing studies often…

人机交互 · 计算机科学 2025-12-02 Xin Zhou , Dawei Huang , Xiaojing Peng , Lijun Yin

Although self-supervised learning enables us to bootstrap the training by exploiting unlabeled data, the generic self-supervised methods for natural images do not sufficiently incorporate the context. For medical images, a desirable method…

图像与视频处理 · 电气工程与系统科学 2022-07-08 Li Sun , Ke Yu , Kayhan Batmanghelich