English
Related papers

Related papers: BrainSymphony: A parameter-efficient multimodal fo…

200 papers

Foundation models have emerged as a powerful approach for processing electronic health records (EHRs), offering flexibility to handle diverse medical data modalities. In this study, we present a comprehensive benchmark that evaluates the…

Machine Learning · Computer Science 2025-07-22 Kunyu Yu , Rui Yang , Jingchi Liao , Siqi Li , Huitao Li , Irene Li , Yifan Peng , Rishikesan Kamaleswaran , Nan Liu

Foundation models (FMs) are able to leverage large volumes of unlabeled data to demonstrate superior performance across a wide range of tasks. However, FMs developed for biomedical domains have largely remained unimodal, i.e., independently…

In clinical practice, medical segmentation datasets are often limited and heterogeneous, with variations in modalities, protocols, and anatomical targets across institutions. Existing deep learning models struggle to jointly learn from such…

Computer Vision and Pattern Recognition · Computer Science 2026-01-22 Weiwei Ma , Xiaobing Yu , Peijie Qiu , Jin Yang , Pan Xiao , Xiaoqi Zhao , Xiaofeng Liu , Tomo Miyazaki , Shinichiro Omachi , Yongsong Huang

Evaluating foundation models under appropriate adaptation settings is essential for understanding the quality and transferability of the learned representations. Recent EEG foundation models have demonstrated promising transfer capabilities…

Machine Learning · Computer Science 2026-05-28 Aditya Kommineni , Emily Zhou , Kleanthis Avramidis , Tiantian Feng , Shrikanth Narayanan

Multimodal deep learning harnesses diverse imaging modalities, such as MRI sequences, to enhance diagnostic accuracy in medical imaging. A key challenge is determining the optimal timing for integrating these modalities-specifically,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-16 Valerio Guarrasi , Klara Mogensen , Sara Tassinari , Sara Qvarlander , Paolo Soda

Millimeter wave (mmWave) communication, utilizing beamforming techniques to address the inherent path loss limitation, is considered as one of the key technologies to support ever increasing high throughput and low latency demands of…

Networking and Internet Architecture · Computer Science 2026-02-17 Muhammad Baqer Mollah , Honggang Wang , Mohammad Ataul Karim , Hua Fang

Understanding how the brain's complex nonlinear dynamics give rise to cognitive function remains a central challenge in neuroscience. While brain functional dynamics exhibits scale-free and multifractal properties across temporal scales,…

Neurons and Cognition · Quantitative Biology 2025-06-18 Sangyoon Bae , Junbeom Kwon , Shinjae Yoo , Jiook Cha

Magnetic resonance imaging (MRI) is a vital diagnostic tool, but its inherently long acquisition times reduce clinical efficiency and patient comfort. Recent advancements in deep learning, particularly diffusion models, have improved…

Image and Video Processing · Electrical Eng. & Systems 2026-04-28 Yuxuan Zhang , Jinkui Hao , Bo Zhou

Mapping human brain activity to natural images offers a new window into vision and cognition, yet current diffusion-based decoders face a core difficulty: most condition directly on fMRI features without analyzing how visual information is…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Guowei Zhang , Yun Zhao , Moein Khajehnejad , Adeel Razi , Levin Kuhlmann

The success of precision medicine requires computational models that can effectively process and interpret diverse physiological signals across heterogeneous patient populations. While foundation models have demonstrated remarkable transfer…

Machine Learning · Computer Science 2024-12-05 Matthias Christenson , Cove Geary , Brian Locke , Pranav Koirala , Warren Woodrich Pettine

The brain is a highly complex organ consisting of a myriad of subsystems that flexibly interact and adapt over time and context to enable perception, cognition, and behavior. Understanding the multi-scale nature of the brain, i.e., how…

Neurons and Cognition · Quantitative Biology 2025-01-17 Adam S. Charles

The rapid evolution of artificial intelligence (AI) has shifted from static, data-driven models to dynamic systems capable of perceiving and interacting with real-world environments. Despite advancements in pattern recognition and symbolic…

The spatial topography of functional brain organization is increasingly recognized to play an important role in cognition and disease. Accounting for individual differences in functional topography is also crucial for accurately…

Accurate and reproducible brain morphometry from structural MRI is critical for monitoring neuroanatomical changes across time and across imaging domains. Although deep learning has accelerated segmentation workflows, scanner-induced…

Computer Vision and Pattern Recognition · Computer Science 2025-04-23 Ekaterina Kondrateva , Sandzhi Barg , Mikhail Vasiliev

Affine image registration is a cornerstone of medical image analysis. While classical algorithms can achieve excellent accuracy, they solve a time-consuming optimization for every image pair. Deep-learning (DL) methods learn a function that…

Image and Video Processing · Electrical Eng. & Systems 2024-07-15 Malte Hoffmann , Andrew Hoopes , Douglas N. Greve , Bruce Fischl , Adrian V. Dalca

In recent years, analyzing task-based fMRI (tfMRI) data has become an essential tool for understanding brain function and networks. However, due to the sheer size of tfMRI data, its intrinsic complex structure, and lack of ground truth of…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-03-06 Milad Makkie , Heng Huang , Yu Zhao , Athanasios V. Vasilakos , Tianming Liu

Modeling spatiotemporal brain dynamics from high-dimensional data, such as functional Magnetic Resonance Imaging (fMRI), is a formidable task in neuroscience. Existing approaches for fMRI analysis utilize hand-crafted features, but the…

Computer Vision and Pattern Recognition · Computer Science 2023-11-01 Peter Yongho Kim , Junbeom Kwon , Sunghwan Joo , Sangyoon Bae , Donggyu Lee , Yoonho Jung , Shinjae Yoo , Jiook Cha , Taesup Moon

Early identification of stroke symptoms is essential for enabling timely intervention and improving patient outcomes, particularly in prehospital settings. This study presents a fast, non-invasive multimodal deep learning framework for…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Ngoc-Khai Hoang , Thi-Nhu-Mai Nguyen , Huy-Hieu Pham

Data fusion refers to the joint analysis of multiple datasets which provide complementary views of the same task. In this preprint, the problem of jointly analyzing electroencephalography (EEG) and functional Magnetic Resonance Imaging…

Signal Processing · Electrical Eng. & Systems 2020-05-15 Christos Chatzichristos , Eleftherios Kofidis , Lieven De Lathauwer , Sergios Theodoridis , Sabine Van Huffel

Reconstructions of visual perception from brain activity have improved tremendously, but the practical utility of such methods has been limited. This is because such models are trained independently per subject where each subject requires…