English
Related papers

Related papers: Bridging Foundation Models and Efficient Architect…

200 papers

To support future intelligent multifunctional sixth-generation (6G) wireless communication networks, Synesthesia of Machines (SoM) is proposed as a novel paradigm for artificial intelligence (AI)-native intelligent multi-modal…

Signal Processing · Electrical Eng. & Systems 2025-06-10 Xiang Cheng , Boxun Liu , Xuanyu Liu , Ensong Liu , Ziwei Huang

Accurate identification of brain function is necessary to understand the neurobiology of cognitive ageing, and thereby promote well-being across the lifespan. A common tool used to investigate neurocognitive ageing is functional magnetic…

Neurons and Cognition · Quantitative Biology 2020-05-21 Kamen A. Tsvetanov , Richard N. A. Henson , James B. Rowe

Federated learning (FL) offers privacy-preserving decentralized machine learning, optimizing models at edge clients without sharing private data. Simultaneously, foundation models (FMs) have gained traction in the artificial intelligence…

Machine Learning · Computer Science 2023-10-06 Sixing Yu , J. Pablo Muñoz , Ali Jannesari

Foundation models (FMs) have demonstrated strong transferability across medical imaging tasks, yet their clinical utility depends critically on how pretrained representations are adapted to domain-specific data, supervision regimes, and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Karma Phuntsho , Abdullah , Kyungmi Lee , Ickjai Lee , Euijoon Ahn

Due to the prevalence of scale variance in nature images, we propose to use image scale as a self-supervised signal for Masked Image Modeling (MIM). Our method involves selecting random patches from the input image and downsampling them to…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Zhiming Wang , Lin Gu , Feng Lu

We propose a novel two-phase approach to functional network estimation of multi-subject functional Magnetic Resonance Imaging (fMRI) data, which applies model-based image segmentation to determine a group-representative connectivity map. In…

Computation · Statistics 2018-09-05 Aditi Iyer , Bingjing Tang , Vinayak Rao , Nan Kong

As a fundamental task in computer vision, semantic segmentation is widely applied in fields such as autonomous driving, remote sensing image analysis, and medical image processing. In recent years, Transformer-based segmentation methods…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Tai An , Weiqiang Huang , Da Xu , Qingyuan He , Jiacheng Hu , Yujia Lou

We propose a novel matrix autoencoder to map functional connectomes from resting state fMRI (rs-fMRI) to structural connectomes from Diffusion Tensor Imaging (DTI), as guided by subject-level phenotypic measures. Our specialized autoencoder…

In this work, we propose a fast adaptive federated meta-learning (FAM) framework for collaboratively learning a single global model, which can then be personalized locally on individual clients. Federated learning enables multiple clients…

Machine Learning · Computer Science 2023-09-04 Indrajeet Kumar Sinha , Shekhar Verma , Krishna Pratap Singh

This thesis is dedicated to the statistical analysis of multi-sub ject fMRI data, with the purpose of identifying bain structures involved in certain cognitive or sensori-motor tasks, in a reproducible way across sub jects. To overcome…

Applications · Statistics 2010-05-19 Merlin Keller , Alexis Roche , Marc Lavielle

The architecture of a neural network and the selection of its activation function are both fundamental to its performance. Equally vital is ensuring these two elements are well-matched, as their alignment is key to achieving effective…

Machine Learning · Computer Science 2025-06-25 Shijun Zhang , Hongkai Zhao , Yimin Zhong , Haomin Zhou

We present the Material Masked Autoencoder (MMAE), a self-supervised Vision Transformer pretrained on a large corpus of short-fiber composite images via masked image reconstruction. The pretrained MMAE learns latent representations that…

Computational Engineering, Finance, and Science · Computer Science 2025-10-23 Ting-Ju Wei , Chuin-Shan Chen

Dynamic functional connectivity (dFC) using resting-state functional magnetic resonance imaging (rs-fMRI) is an advanced technique for capturing the dynamic changes of neural activities, and can be very useful in the studies of brain…

Image and Video Processing · Electrical Eng. & Systems 2025-01-29 Jing Zhang , Yanjun Lyu , Xiaowei Yu , Lu Zhang , Chao Cao , Tong Chen , Minheng Chen , Yan Zhuang , Tianming Liu , Dajiang Zhu

This paper proposes a vision-conditioned flow matching (FM) framework for beam prediction in millimeter-wave vehicle-to-infrastructure links. Instead of modeling discrete beam-index sequences, the proposed method learns the temporal…

Signal Processing · Electrical Eng. & Systems 2026-04-14 Can Zheng , Jiguang He , Chung G. Kang , Guofa Cai , Chongwen Huang , Henk Wymeersch

Current artificial intelligence models for medical imaging are predominantly single modality and single disease. Attempts to create multimodal and multi-disease models have resulted in inconsistent clinical accuracy. Furthermore, training…

Purpose: To investigate whether a vision-language foundation model can enhance undersampled MRI reconstruction by providing high-level contextual information beyond conventional priors. Methods: We proposed a semantic distribution-guided…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Ruimin Feng , Xingxin He , Ronald Mercer , Zachary Stewart , Fang Liu

Continual learning (CL) for Foundation Models (FMs) is an essential yet underexplored challenge, especially in Federated Continual Learning (FCL), where each client learns from a private, evolving task stream under strict data and…

Machine Learning · Computer Science 2025-08-14 Hao Yu , Xin Yang , Boyang Fan , Xuemei Cao , Hanlin Gu , Lixin Fan , Qiang Yang

Decoding brain states from functional magnetic resonance imaging (fMRI) data is vital for advancing neuroscience and clinical applications. While traditional machine learning and deep learning approaches have made strides in leveraging the…

Machine Learning · Computer Science 2025-12-10 Danial Jafarzadeh Jazi , Maryam Hajiesmaeili

Functional magnetic resonance imaging or functional MRI (fMRI) is a non-invasive way to assess brain activity by detecting changes associated with blood flow. In this work, we propose a full Bayesian procedure to analyze fMRI data for…

This paper presents a novel approach towards creating a foundational model for aligning neural data and visual stimuli across multimodal representationsof brain activity by leveraging contrastive learning. We used electroencephalography…

Computer Vision and Pattern Recognition · Computer Science 2024-11-18 Matteo Ferrante , Tommaso Boccato , Grigorii Rashkov , Nicola Toschi