English
Related papers

Related papers: SLIM-Brain: A Data- and Training-Efficient Foundat…

200 papers

Transformer-based models, such as BERT and ViT, have achieved state-of-the-art results across different natural language processing (NLP) and computer vision (CV) tasks. However, these models are extremely memory intensive during their…

Computation and Language · Computer Science 2023-05-31 Arash Ardakani , Altan Haan , Shangyin Tan , Doru Thom Popovici , Alvin Cheung , Costin Iancu , Koushik Sen

Foundation models for medical imaging are typically pretrained on increasingly large datasets, following a "scale-at-all-costs" paradigm. However, this strategy faces two critical challenges: large-scale medical datasets often contain…

As large language models (LLMs) continue to revolutionize AI research, there is a growing interest in building large-scale brain foundation models to advance neuroscience. While most existing brain foundation models are pre-trained on…

Neurons and Cognition · Quantitative Biology 2026-02-11 Xinxu Wei , Kanhao Zhao , Yong Jiao , Lifang He , Yu Zhang

Current challenges in developing foundational models for volumetric imaging data, such as magnetic resonance imaging (MRI), stem from the computational complexity of training state-of-the-art architectures in high dimensions and curating…

Image and Video Processing · Electrical Eng. & Systems 2025-07-14 Ulzee An , Moonseong Jeong , Simon A. Lee , Aditya Gorla , Yuzhe Yang , Sriram Sankararaman

Aggregating multi-subject functional magnetic resonance imaging (fMRI) data is indispensable for generating valid and general inferences from patterns distributed across human brains. The disparities in anatomical structures and functional…

Machine Learning · Computer Science 2019-11-20 Weida Li , Mingxia Liu , Fang Chen , Daoqiang Zhang

Large Language Models (LLMs) have enabled remarkable progress in natural language processing, yet their high computational and memory demands pose challenges for deployment in resource-constrained environments. Although recent low-rank…

Computation and Language · Computer Science 2026-02-09 Jiayi Tian , Ryan Solgi , Jinming Lu , Yifan Yang , Hai Li , Zheng Zhang

Combining Functional MRI (fMRI) data across different subjects and datasets is crucial for many neuroscience tasks. Relying solely on shared anatomy for brain-to-brain mapping is inadequate. Existing functional transformation methods thus…

Neurons and Cognition · Quantitative Biology 2025-03-18 Navve Wasserman , Roman Beliy , Roy Urbach , Michal Irani

Single-subject mapping of resting-state brain functional activity to non-imaging phenotypes is a major goal of neuroimaging. The large majority of learning approaches applied today rely either on static representations or on short-term…

Machine Learning · Computer Science 2022-08-09 Ahmed El-Gazzar , Rajat Mani Thomas , Guido Van Wingen

Training large language models (LLMs) relies on adaptive optimizers such as Adam, which introduce extra operations and require significantly more memory to maintain first- and second-order moments than SGD. While recent works such as…

Machine Learning · Computer Science 2026-05-22 Athanasios Glentis , Jiaxiang Li , Andi Han , Mingyi Hong

This thesis is dedicated to the statistical analysis of multi-sub ject fMRI data, with the purpose of identifying bain structures involved in certain cognitive or sensori-motor tasks, in a reproducible way across sub jects. To overcome…

Applications · Statistics 2010-05-19 Merlin Keller , Alexis Roche , Marc Lavielle

Foundation models (FMs), large neural networks pretrained on extensive and diverse datasets, have revolutionized artificial intelligence and shown significant promise in medical imaging by enabling robust performance with limited labeled…

Image and Video Processing · Electrical Eng. & Systems 2025-06-17 Salah Ghamizi , Georgia Kanli , Yu Deng , Magali Perquin , Olivier Keunen

Functional MRI (fMRI) is crucial for studying brain function and diagnosing neurological disorders. However, existing analysis methods suffer from reproducibility and transferability challenges due to complex preprocessing pipelines and…

Multi-slice magnetic resonance images of the fetal brain are usually contaminated by severe and arbitrary fetal and maternal motion. Hence, stable and robust motion correction is necessary to reconstruct high-resolution 3D fetal brain…

Image and Video Processing · Electrical Eng. & Systems 2022-09-23 Wen Shi , Haoan Xu , Cong Sun , Jiwei Sun , Yamin Li , Xinyi Xu , Tianshu Zheng , Yi Zhang , Guangbin Wang , Dan Wu

Vision-Language-Action (VLA) models built on pretrained Vision-Language Models (VLMs) show strong potential but are limited in practicality due to their large parameter counts. To mitigate this issue, using a lightweight VLM has been…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Chaojun Ni , Cheng Chen , Xiaofeng Wang , Zheng Zhu , Wenzhao Zheng , Boyuan Wang , Tianrun Chen , Guosheng Zhao , Haoyun Li , Zhehao Dong , Qiang Zhang , Yun Ye , Yang Wang , Guan Huang , Wenjun Mei

Developing Foundation Models for medical image analysis is essential to overcome the unique challenges of radiological tasks. The first challenges of this kind for 3D brain MRI, SSL3D and FOMO25, were held at MICCAI 2025. Our solution…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Pedro M. Gordaliza , Jaume Banus , Benoît Gérin , Maxence Wynen , Nataliia Molchanova , Jonas Richiardi , Meritxell Bach Cuadra

Vision foundation models (VFMs) have demonstrated remarkable performance across a wide range of downstream tasks. While several VFM adapters have shown promising results by leveraging the prior knowledge of VFMs, we identify two…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Yifan Li , Xin Li , Tianqin Li , Wenbin He , Yu Kong , Liu Ren

The shared response model provides a simple but effective framework to analyse fMRI data of subjects exposed to naturalistic stimuli. However when the number of subjects or runs is large, fitting the model requires a large amount of memory…

Computer Vision and Pattern Recognition · Computer Science 2019-12-04 Hugo Richard , Lucas Martin , Ana Luısa Pinho , Jonathan Pillow , Bertrand Thirion

Foundation models in computational pathology promise to unlock the development of new clinical decision support systems and models for precision medicine. However, there is a mismatch between most clinical analysis, which is defined at the…

Purpose: To investigate whether a vision-language foundation model can enhance undersampled MRI reconstruction by providing high-level contextual information beyond conventional priors. Methods: We proposed a semantic distribution-guided…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Ruimin Feng , Xingxin He , Ronald Mercer , Zachary Stewart , Fang Liu

Whole-brain neural connectivity data are now available from viral tracing experiments, which reveal the connections between a source injection site and elsewhere in the brain. These hold the promise of revealing spatial patterns of…

Neurons and Cognition · Quantitative Biology 2016-10-27 Kameron Decker Harris , Stefan Mihalas , Eric Shea-Brown