English
Related papers

Related papers: Multiscale Causal Geometric Deep Learning for Mode…

200 papers

The convolution operation suffers from a limited receptive filed, while global modeling is fundamental to dense prediction tasks, such as semantic segmentation. In this paper, we apply graph convolution into the semantic segmentation task…

Computer Vision and Pattern Recognition · Computer Science 2020-03-24 Xia Li , Yibo Yang , Qijie Zhao , Tiancheng Shen , Zhouchen Lin , Hong Liu

Magnetic Resonance Imaging (MRI) of the brain has benefited from deep learning (DL) to alleviate the burden on radiologists and MR technologists, and improve throughput. The easy accessibility of DL tools have resulted in the rapid increase…

Image and Video Processing · Electrical Eng. & Systems 2023-01-04 Kunal Aggarwal , Marina Manso Jimeno , Keerthi Sravan Ravi , Gilberto Gonzalez , Sairam Geethanath

We propose a framework for constructing combinatorial complexes (CCs) from fMRI time series data that captures both pairwise and higher-order neural interactions through information-theoretic measures, bridging topological deep learning and…

Neurons and Cognition · Quantitative Biology 2026-01-06 Valentina Sánchez , Çiçek Güven , Koen Haak , Theodore Papamarkou , Gonzalo Nápoles , Marie Šafář Postma

The prediction of subjects with mild cognitive impairment (MCI) who will progress to Alzheimer's disease (AD) is clinically relevant, and may above all have a significant impact on accelerate the development of new treatments. In this…

Image and Video Processing · Electrical Eng. & Systems 2019-07-16 Kilian Hett , Vinh-Thong Ta , José V. Manjón , Pierrick Coupé

With the wide adoption of functional magnetic resonance imaging (fMRI) by cognitive neuroscience researchers, large volumes of brain imaging data have been accumulated in recent years. Aggregating these data to derive scientific insights…

Applications · Statistics 2020-06-01 Ming Bo Cai , Michael Shvartsman , Anqi Wu , Hejia Zhang , Xia Zhu

Generic deep learning (DL) networks for image restoration like denoising and interpolation lack mathematical interpretability, require voluminous training data to tune a large parameter set, and are fragile in the face of covariate shift.…

Image and Video Processing · Electrical Eng. & Systems 2025-03-13 Jianghe Cai , Gene Cheung , Fei Chen

Brain tumor segmentation is often based on multiple magnetic resonance imaging (MRI). However, in clinical practice, certain modalities of MRI may be missing, which presents a more difficult scenario. To cope with this challenge, Knowledge…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Tianyi Liu , Zhaorui Tan , Muyin Chen , Xi Yang , Haochuan Jiang , Kaizhu Huang

Unveiling visual semantics from neural signals such as EEG, MEG, and fMRI remains a fundamental challenge due to subject variability and the entangled nature of visual features. Existing approaches primarily align neural activity directly…

Computer Vision and Pattern Recognition · Computer Science 2025-11-07 Zehui Feng , Chenqi Zhang , Mingru Wang , Minuo Wei , Shiwei Cheng , Cuntai Guan , Ting Han

We present Brain Harmony (BrainHarmonix), the first multimodal brain foundation model that unifies structural morphology and functional dynamics into compact 1D token representations. The model was pretrained on two of the largest…

Real-world multimodal data usually exhibit complex structural relationships beyond traditional one-to-one mappings like image-caption pairs. Entities across modalities interact in intricate ways, with images and text forming diverse…

Machine Learning · Computer Science 2025-10-21 Xuying Ning , Dongqi Fu , Tianxin Wei , Wujiang Xu , Jingrui He

Deep learning has been successfully applied to medical image segmentation, enabling accurate identification of regions of interest such as organs and lesions. This approach works effectively across diverse datasets, including those with…

Image and Video Processing · Electrical Eng. & Systems 2025-04-08 Tianyi Ren , Juampablo Heras Rivera , Hitender Oswal , Yutong Pan , Agamdeep Chopra , Jacob Ruzevick , Mehmet Kurt

Multi-modal Magnetic Resonance Imaging (MRI) translation leverages information from source MRI sequences to generate target modalities, enabling comprehensive diagnosis while overcoming the limitations of acquiring all sequences. While…

Image and Video Processing · Electrical Eng. & Systems 2025-05-20 Jiyao Liu , Shangqi Gao , Yuxin Li , Lihao Liu , Xin Gao , Zhaohu Xing , Junzhi Ning , Yanzhou Su , Xiao-Yong Zhang , Junjun He , Ningsheng Xu , Xiahai Zhuang

This paper asks whether integrating multimodal EEG and fMRI data offers a better characterisation of functional brain architectures than either modality alone. This evaluation rests upon a dynamic causal model that generates both EEG and…

Quantitative Methods · Quantitative Biology 2019-06-19 Huilin Wei , Amirhossein Jafarian , Peter Zeidman , Vladimir Litvak , Adeel Razi , Dewen Hu , Karl J. Friston

Aggregating multi-site brain MRI data can enhance deep learning model training, but also introduces non-biological heterogeneity caused by site-specific variations (e.g., differences in scanner vendors, acquisition parameters, and imaging…

Computer Vision and Pattern Recognition · Computer Science 2026-01-14 Mengqi Wu , Yongheng Sun , Qianqian Wang , Pew-Thian Yap , Mingxia Liu

Unsupervised deep learning is a promising method in brain MRI registration to reduce the reliance on anatomical labels, while still achieving anatomically accurate transformations. For the Learn2Reg2024 LUMIR challenge, we propose…

Image and Video Processing · Electrical Eng. & Systems 2024-12-31 Lukas Förner , Kartikay Tehlan , Thomas Wendler

Accurate beam prediction is essential for mitigating signalling overhead and latency in integrated sensing and communication-enabled massive multi-input multi-output systems. With the aid of multimodal learning, the prediction accuracy can…

Signal Processing · Electrical Eng. & Systems 2026-05-15 Zijian Zheng , Wenqiang Yi , Hyundong Shin , Arumugam Nallanathan

Following the success of deep learning in a wide range of applications, neural network-based machine learning techniques have received interest as a means of accelerating magnetic resonance imaging (MRI). A number of ideas inspired by deep…

Signal Processing · Electrical Eng. & Systems 2019-04-03 Florian Knoll , Kerstin Hammernik , Chi Zhang , Steen Moeller , Thomas Pock , Daniel K. Sodickson , Mehmet Akcakaya

Segmenting healthy tissue structures alongside lesions in brain Magnetic Resonance Images (MRI) remains a challenge for today's algorithms due to lesion-caused disruption of the anatomy and lack of jointly labeled training datasets, where…

Image and Video Processing · Electrical Eng. & Systems 2025-03-26 Meva Himmetoglu , Ilja Ciernik , Ender Konukoglu

Brain-computer interface (BCI) aims to decode motor intent from noninvasive neural signals to enable control of external devices, but practical deployment remains limited by noise and variability in motor imagery (MI)-based…

Machine Learning · Computer Science 2025-11-12 Si-Hyun Kim , Heon-Gyu Kwak , Byoung-Hee Kwon , Seong-Whan Lee