English
Related papers

Related papers: Nonlocal operator learning for fMRI encoding and d…

200 papers

Functional magnetic resonance imaging (fMRI) provides an indirect measurement of neuronal activity via hemodynamic responses that vary across brain regions and individuals. Ignoring this hemodynamic variability can bias downstream…

Image and Video Processing · Electrical Eng. & Systems 2026-01-26 William Consagra , Eardi Lila

Recent advances in multimodal large language models (LLMs) have enabled unified reasoning across images, audio, and video, but extending such capability to brain imaging remains largely unexplored. Bridging this gap is essential to link…

Computation and Language · Computer Science 2026-05-15 Yuxiang Wei , Yanteng Zhang , Xi Xiao , Chengxuan Qian , Tianyang Wang , Vince D. Calhoun

Non-invasive cortical neural interfaces have only achieved modest performance in cortical decoding of limb movements and their forces, compared to invasive brain-computer interfaces (BCIs). While non-invasive methodologies are safer,…

Machine Learning · Computer Science 2021-03-25 Pablo Ortega , Tong Zhao , Aldo Faisal

In the near future, more and more machines will perform tasks in the vicinity of human spaces or support them directly in their spatially bound activities. In order to simplify the verbal communication and the interaction between robotic…

Machine Learning · Computer Science 2020-04-14 Sebastian Feld , Steffen Illium , Andreas Sedlmeier , Lenz Belzner

Background: Traumatic brain injury modeling requires integrating volumetric neuroimaging, demographic parameters, and acquisition metadata. Finite element solvers are too computationally expensive for clinical settings. Neural operators…

Machine Learning · Computer Science 2026-04-27 Anusha Agarwal , Dibakar Roy Sarkar , Somdatta Goswami

Multimodal MRI offers complementary multi-scale information to characterize the brain structure. However, it remains challenging to effectively integrate multimodal MRI while achieving neuroscience interpretability. Here we propose to use…

Neurons and Cognition · Quantitative Biology 2025-12-15 Chengzhi Xia , Jianwei Chen , Yixuan Jiang , Qi Yan , Chao Li

Analyzing surgical workflow is crucial for surgical assistance robots to understand surgeries. With the understanding of the complete surgical workflow, the robots are able to assist the surgeons in intra-operative events, such as by giving…

Computer Vision and Pattern Recognition · Computer Science 2021-05-12 Yutong Ban , Guy Rosman , Thomas Ward , Daniel Hashimoto , Taisei Kondo , Hidekazu Iwaki , Ozanan Meireles , Daniela Rus

Multivariate Pattern (MVP) classification holds enormous potential for decoding visual stimuli in the human brain by employing task-based fMRI data sets. There is a wide range of challenges in the MVP techniques, i.e. decreasing noise and…

Machine Learning · Statistics 2016-12-28 Muhammad Yousefnezhad , Daoqiang Zhang

Efficient operation of intelligent machines in the real world requires methods that allow them to understand and predict the uncertainties presented by the unstructured environments with good accuracy, scalability and generalization,…

In recent years, the rapid development of neuroimaging technology has been providing many powerful tools for cognitive neuroscience research. Among them, the functional magnetic resonance imaging (fMRI), which has high spatial resolution,…

Human-Computer Interaction · Computer Science 2018-08-20 Yang Wang , Dongrui Wu

Learning structured task representations from human demonstrations is essential for understanding long-horizon manipulation behaviors, particularly in bimanual settings where action ordering, object involvement, and interaction geometry can…

Robotics · Computer Science 2026-01-19 Franziska Herbert , Vignesh Prasad , Han Liu , Dorothea Koert , Georgia Chalvatzaki

The majority of AI models in imaging and vision are customized to perform on specific high-precision task. However, this strategy is inefficient for applications with a series of modular tasks, since each requires a mapping into a disparate…

Computer Vision and Pattern Recognition · Computer Science 2025-09-26 Jing Li , Oskar Bartosz , Chengyu Wang , Michal Wnuczynski , Dilshan Godaliyadda , Michael Polley

fMRI semantic category understanding using linguistic encoding models attempts to learn a forward mapping that relates stimuli to the corresponding brain activation. State-of-the-art encoding models use a single global model (linear or…

Machine Learning · Computer Science 2020-06-02 Subba Reddy Oota , Naresh Manwani , Raju S. Bapi

Now over 20 years old, functional MRI (fMRI) has a large and growing literature that is best synthesised with meta-analytic tools. As most authors do not share image data, only the peak activation coordinates (foci) reported in the paper…

The acquisition of MRI images offers a trade-off in terms of acquisition time, spatial/temporal resolution and signal-to-noise ratio (SNR). Thus, for instance, increasing the time efficiency of MRI often comes at the expense of reduced SNR.…

Computer Vision and Pattern Recognition · Computer Science 2011-10-28 Sudipto Dolui , Alan Kuurstra , Iván C. Salgado Patarroyo , Oleg V. Michailovich

Reconstructing dynamic videos from fMRI is important for understanding visual cognition and enabling vivid brain-computer interfaces. However, current methods are critically limited to single-shot clips, failing to address the multi-shot…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Wenwen Zeng , Yonghuang Wu , Yifan Chen , Xuan Xie , Chengqian Zhao , Feiyu Yin , Guoqing Wu , Jinhua Yu

Multimodal representation learning has demonstrated remarkable potential in enabling models to process and integrate diverse data modalities, such as text and images, for improved understanding and performance. While the medical domain can…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Shuvendu Roy , Franklin Ogidi , Ali Etemad , Elham Dolatabadi , Arash Afkanpour

Dynamic MRI suffers from limited spatiotemporal resolution due to long acquisition times. Undersampling k-space accelerates imaging but makes accurate reconstruction challenging. Supervised deep learning methods achieve impressive results…

Image and Video Processing · Electrical Eng. & Systems 2025-11-18 Yuanyuan Liu , Yuanbiao Yang , Jing Cheng , Zhuo-Xu Cui , Qingyong Zhu , Congcong Liu , Yuliang Zhu , Jingran Xu , Hairong Zheng , Dong Liang , Yanjie Zhu

This study introduces a deep learning framework for the inferential exploration of latent representations in 3D brain MRI, leveraging a simple convolutional autoencoder with a hierarchical encoder and a compact latent space. Trained on…

Applications · Statistics 2026-05-25 J. M. Gorriz , F. Segovia , C. Jimenez , J. E. Arco , F. J. Martinez , J Ramirez , S. Abulikemu , J. Suckling

Recent advances in deep learning have made it possible to predict phenotypic measures directly from functional magnetic resonance imaging (fMRI) brain volumes, sparking significant interest in the neuroimaging community. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Arunkumar Kannan , Martin A. Lindquist , Brian Caffo