English
Related papers

Related papers: Latent Representation Learning for Multimodal Brai…

200 papers

While many neuroscience questions aim to understand the human brain, much current knowledge has been gained using animal models, which replicate genetic, structural, and connectivity aspects of the human brain. While voxel-based analysis…

In the domain of 3D biomedical image segmentation, Mamba exhibits the superior performance for it addresses the limitations in modeling long-range dependencies inherent to CNNs and mitigates the abundant computational overhead associated…

Computer Vision and Pattern Recognition · Computer Science 2025-09-19 Weitong Wu , Zhaohu Xing , Jing Gong , Qin Peng , Lei Zhu

Weakly supervised semantic segmentation offers a label-efficient solution to train segmentation models for volumetric medical imaging. However, existing approaches often rely on 2D encoders that neglect the inherent volumetric nature of the…

Computer Vision and Pattern Recognition · Computer Science 2025-12-12 Yiheng Lyu , Lian Xu , Mohammed Bennamoun , Farid Boussaid , Coen Arrow , Girish Dwivedi

Accurate microscopic medical image segmentation plays a crucial role in diagnosing various cancerous cells and identifying tumors. Driven by advancements in deep learning, convolutional neural networks (CNNs) and transformer-based models…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Daniya Najiha Abdul Kareem , Abdul Hannan , Mubashir Noman , Jean Lahoud , Mustansar Fiaz , Hisham Cholakkal

Effectively modeling global context information in hyperspectral image (HSI) denoising is crucial, but prevailing methods using convolution or transformers still face localized or computational efficiency limitations. Inspired by the…

Computer Vision and Pattern Recognition · Computer Science 2025-09-16 Yang Liu , Jiahua Xiao , Xiang Song , Yu Guo , Peilin Jiang , Haiwei Yang , Fei Wang

Current non-invasive neuroimaging techniques trade off between spatial resolution and temporal resolution. While magnetoencephalography (MEG) can capture rapid neural dynamics and functional magnetic resonance imaging (fMRI) can spatially…

Neurons and Cognition · Quantitative Biology 2025-10-13 Beige Jerry Jin , Leila Wehbe

Vision-Language-Action (VLA) models often suffer from performance degradation under distribution shifts, as they struggle to learn generalized behavior representations across varying environments. While existing approaches attempt to…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Bing Hu , Zaijing Li , Rui Shao , Junda Chen , April Hua Liu , Wei-Shi Zheng , Liqiang Nie

Optical and Synthetic Aperture Radar (SAR) image registration is crucial for multi-modal image fusion and applications. However, several challenges limit the performance of existing deep learning-based methods in cross-modal image…

Computer Vision and Pattern Recognition · Computer Science 2026-02-11 Wei Wang , Dou Quan , Ning Huyan , Chonghua Lv , Shuang Wang , Yunan Li , Licheng Jiao

Efficient extraction of spectral sequences and geospatial information has always been a hot topic in hyperspectral image classification. In terms of spectral sequence feature capture, RNN and Transformer have become mainstream…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Aitao Yang , Min Li , Yao Ding , Leyuan Fang , Yaoming Cai , Yujie He

Current automatic speech recognition systems struggle with modeling long speech sequences due to high quadratic complexity of Transformer-based models. Selective state space models such as Mamba has performed well on long-sequence modeling…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-30 Xiaoxue Gao , Nancy F. Chen

Human tissue and its constituent cells form a microenvironment that is fundamentally three-dimensional (3D). However, the standard-of-care in pathologic diagnosis involves selecting a few two-dimensional (2D) sections for microscopic…

Recent State Space Models (SSM), especially Mamba, have demonstrated impressive performance in visual modeling and possess superior model efficiency. However, the application of Mamba to visual tasks suffers inferior performance due to…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Fei Xie , Jiahao Nie , Yujin Tang , Wenkang Zhang , Hongshen Zhao

Learning meaningful and interpretable representations from high-dimensional volumetric magnetic resonance (MR) images is essential for advancing personalized medicine. While Vision Transformers (ViTs) have shown promise in handling image…

Computer Vision and Pattern Recognition · Computer Science 2024-09-13 Qingqiao Hu , Daoan Zhang , Jiebo Luo , Zhenyu Gong , Benedikt Wiestler , Jianguo Zhang , Hongwei Bran Li

In recent years, the field of electroencephalography (EEG) analysis has witnessed remarkable advancements, driven by the integration of machine learning and artificial intelligence. This survey aims to encapsulate the latest developments,…

Signal Processing · Electrical Eng. & Systems 2025-01-09 Pengfei Wang , Huanran Zheng , Silong Dai , Yiqiao Wang , Xiaotian Gu , Yuanbin Wu , Xiaoling Wang

Numerous CNN-Transformer hybrid models rely on high-complexity global attention mechanisms to capture long-range dependencies, which introduces non-linear computational complexity and leads to significant resource consumption. Although…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Dayu Tan , Ziwei Zhang , Yansan Su , Xin Peng , Yike Dai , Chunhou Zheng , Weimin Zhong

With the rapid development of the new energy vehicle industry, the efficient disassembly and recycling of power batteries have become a critical challenge for the circular economy. In current unstructured disassembly scenarios, the dynamic…

Robotics · Computer Science 2025-09-16 Ziwen He , Zhigang Wang , Yanlong Peng , Pengxu Chang , Hong Yang , Ming Chen

We propose a heterogeneous graph mamba network (HGMN) as the first exploration in leveraging the selective state space models (SSSMs) for heterogeneous graph learning. Compared with the literature, our HGMN overcomes two major challenges:…

Machine Learning · Computer Science 2024-05-24 Zhenyu Pan , Yoonsung Jeong , Xiaoda Liu , Han Liu

Mesh saliency enhances the adaptability of 3D vision by identifying and emphasizing regions that naturally attract visual attention. To investigate the interaction between geometric structure and texture in shaping visual attention, we…

Computer Vision and Pattern Recognition · Computer Science 2025-04-10 Kaiwei Zhang , Dandan Zhu , Xiongkuo Min , Guangtao Zhai

Reasoning about motion and space is a fundamental cognitive capability that is required by multiple real-world applications. While many studies highlight that large multimodal language models (MLMs) struggle to reason about space, they only…

Computer Vision and Pattern Recognition · Computer Science 2025-12-08 Arijit Ray , Jiafei Duan , Ellis Brown , Reuben Tan , Dina Bashkirova , Rose Hendrix , Kiana Ehsani , Aniruddha Kembhavi , Bryan A. Plummer , Ranjay Krishna , Kuo-Hao Zeng , Kate Saenko

Multimodal sensors provide complementary information to develop accurate machine-learning methods for human activity recognition (HAR), but introduce significantly higher computational load, which reduces efficiency. This paper proposes an…

Computer Vision and Pattern Recognition · Computer Science 2023-10-13 Ziqi Gao , Yuntao Wang , Jianguo Chen , Junliang Xing , Shwetak Patel , Xin Liu , Yuanchun Shi