中文
相关论文

相关论文: SLIM-Brain: A Data- and Training-Efficient Foundat…

200 篇论文

Transformer-based models, such as BERT and ViT, have achieved state-of-the-art results across different natural language processing (NLP) and computer vision (CV) tasks. However, these models are extremely memory intensive during their…

计算与语言 · 计算机科学 2023-05-31 Arash Ardakani , Altan Haan , Shangyin Tan , Doru Thom Popovici , Alvin Cheung , Costin Iancu , Koushik Sen

Foundation models for medical imaging are typically pretrained on increasingly large datasets, following a "scale-at-all-costs" paradigm. However, this strategy faces two critical challenges: large-scale medical datasets often contain…

As large language models (LLMs) continue to revolutionize AI research, there is a growing interest in building large-scale brain foundation models to advance neuroscience. While most existing brain foundation models are pre-trained on…

神经元与认知 · 定量生物学 2026-02-11 Xinxu Wei , Kanhao Zhao , Yong Jiao , Lifang He , Yu Zhang

Current challenges in developing foundational models for volumetric imaging data, such as magnetic resonance imaging (MRI), stem from the computational complexity of training state-of-the-art architectures in high dimensions and curating…

图像与视频处理 · 电气工程与系统科学 2025-07-14 Ulzee An , Moonseong Jeong , Simon A. Lee , Aditya Gorla , Yuzhe Yang , Sriram Sankararaman

Aggregating multi-subject functional magnetic resonance imaging (fMRI) data is indispensable for generating valid and general inferences from patterns distributed across human brains. The disparities in anatomical structures and functional…

机器学习 · 计算机科学 2019-11-20 Weida Li , Mingxia Liu , Fang Chen , Daoqiang Zhang

Large Language Models (LLMs) have enabled remarkable progress in natural language processing, yet their high computational and memory demands pose challenges for deployment in resource-constrained environments. Although recent low-rank…

计算与语言 · 计算机科学 2026-02-09 Jiayi Tian , Ryan Solgi , Jinming Lu , Yifan Yang , Hai Li , Zheng Zhang

Combining Functional MRI (fMRI) data across different subjects and datasets is crucial for many neuroscience tasks. Relying solely on shared anatomy for brain-to-brain mapping is inadequate. Existing functional transformation methods thus…

神经元与认知 · 定量生物学 2025-03-18 Navve Wasserman , Roman Beliy , Roy Urbach , Michal Irani

Single-subject mapping of resting-state brain functional activity to non-imaging phenotypes is a major goal of neuroimaging. The large majority of learning approaches applied today rely either on static representations or on short-term…

机器学习 · 计算机科学 2022-08-09 Ahmed El-Gazzar , Rajat Mani Thomas , Guido Van Wingen

Training large language models (LLMs) relies on adaptive optimizers such as Adam, which introduce extra operations and require significantly more memory to maintain first- and second-order moments than SGD. While recent works such as…

机器学习 · 计算机科学 2026-05-22 Athanasios Glentis , Jiaxiang Li , Andi Han , Mingyi Hong

This thesis is dedicated to the statistical analysis of multi-sub ject fMRI data, with the purpose of identifying bain structures involved in certain cognitive or sensori-motor tasks, in a reproducible way across sub jects. To overcome…

应用统计 · 统计学 2010-05-19 Merlin Keller , Alexis Roche , Marc Lavielle

Foundation models (FMs), large neural networks pretrained on extensive and diverse datasets, have revolutionized artificial intelligence and shown significant promise in medical imaging by enabling robust performance with limited labeled…

图像与视频处理 · 电气工程与系统科学 2025-06-17 Salah Ghamizi , Georgia Kanli , Yu Deng , Magali Perquin , Olivier Keunen

Functional MRI (fMRI) is crucial for studying brain function and diagnosing neurological disorders. However, existing analysis methods suffer from reproducibility and transferability challenges due to complex preprocessing pipelines and…

Multi-slice magnetic resonance images of the fetal brain are usually contaminated by severe and arbitrary fetal and maternal motion. Hence, stable and robust motion correction is necessary to reconstruct high-resolution 3D fetal brain…

图像与视频处理 · 电气工程与系统科学 2022-09-23 Wen Shi , Haoan Xu , Cong Sun , Jiwei Sun , Yamin Li , Xinyi Xu , Tianshu Zheng , Yi Zhang , Guangbin Wang , Dan Wu

Vision-Language-Action (VLA) models built on pretrained Vision-Language Models (VLMs) show strong potential but are limited in practicality due to their large parameter counts. To mitigate this issue, using a lightweight VLM has been…

计算机视觉与模式识别 · 计算机科学 2025-12-02 Chaojun Ni , Cheng Chen , Xiaofeng Wang , Zheng Zhu , Wenzhao Zheng , Boyuan Wang , Tianrun Chen , Guosheng Zhao , Haoyun Li , Zhehao Dong , Qiang Zhang , Yun Ye , Yang Wang , Guan Huang , Wenjun Mei

Developing Foundation Models for medical image analysis is essential to overcome the unique challenges of radiological tasks. The first challenges of this kind for 3D brain MRI, SSL3D and FOMO25, were held at MICCAI 2025. Our solution…

计算机视觉与模式识别 · 计算机科学 2026-01-21 Pedro M. Gordaliza , Jaume Banus , Benoît Gérin , Maxence Wynen , Nataliia Molchanova , Jonas Richiardi , Meritxell Bach Cuadra

Vision foundation models (VFMs) have demonstrated remarkable performance across a wide range of downstream tasks. While several VFM adapters have shown promising results by leveraging the prior knowledge of VFMs, we identify two…

计算机视觉与模式识别 · 计算机科学 2025-07-22 Yifan Li , Xin Li , Tianqin Li , Wenbin He , Yu Kong , Liu Ren

The shared response model provides a simple but effective framework to analyse fMRI data of subjects exposed to naturalistic stimuli. However when the number of subjects or runs is large, fitting the model requires a large amount of memory…

计算机视觉与模式识别 · 计算机科学 2019-12-04 Hugo Richard , Lucas Martin , Ana Luısa Pinho , Jonathan Pillow , Bertrand Thirion

Foundation models in computational pathology promise to unlock the development of new clinical decision support systems and models for precision medicine. However, there is a mismatch between most clinical analysis, which is defined at the…

Purpose: To investigate whether a vision-language foundation model can enhance undersampled MRI reconstruction by providing high-level contextual information beyond conventional priors. Methods: We proposed a semantic distribution-guided…

计算机视觉与模式识别 · 计算机科学 2025-11-26 Ruimin Feng , Xingxin He , Ronald Mercer , Zachary Stewart , Fang Liu

Whole-brain neural connectivity data are now available from viral tracing experiments, which reveal the connections between a source injection site and elsewhere in the brain. These hold the promise of revealing spatial patterns of…

神经元与认知 · 定量生物学 2016-10-27 Kameron Decker Harris , Stefan Mihalas , Eric Shea-Brown