English
Related papers

Related papers: Functional Brain-to-Brain Transformation with No S…

200 papers

Despite participants engaging in unimodal stimuli, such as watching images or silent videos, recent work has demonstrated that multi-modal Transformer models can predict visual brain activity impressively well, even with incongruent…

Neurons and Cognition · Quantitative Biology 2025-05-27 Subba Reddy Oota , Khushbu Pahwa , Mounika Marreddy , Maneesh Singh , Manish Gupta , Bapi S. Raju

The field of neuroimaging has truly become data rich, and novel analytical methods capable of gleaning meaningful information from large stores of imaging data are in high demand. Those methods that might also be applicable on the level of…

As a technology to read brain states from measurable brain activities, brain decoding are widely applied in industries and medical sciences. In spite of high demands in these applications for a universal decoder that can be applied to all…

Machine Learning · Statistics 2015-02-03 Sotetsu Koyamada , Yumi Shikauchi , Ken Nakae , Masanori Koyama , Shin Ishii

Fetal brain magnetic resonance imaging (MRI) offers exquisite images of the developing brain but is not suitable for anomaly screening. For this ultrasound (US) is employed. While expert sonographers are adept at reading US images, MR…

Computer Vision and Pattern Recognition · Computer Science 2019-09-19 Jianbo Jiao , Ana I. L. Namburete , Aris T. Papageorghiou , J. Alison Noble

Brain metabolism is controlled by complex regulation mechanisms. As part of their nature many complex systems show scaling behavior in their timeseries data. Corresponding scaling exponents can sometimes be used to characterize these…

Condensed Matter · Physics 2007-05-23 Stefan Thurner , Christian Windischberger , Ewald Moser , Markus Barth

LLMs have demonstrated remarkable capabilities in linguistic reasoning and are increasingly adept at vision-language tasks. The integration of image tokens into transformers has enabled direct visual input and output, advancing research…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Jonghun Kim , Sinyoung Ra , Hyunjin Park

Brain encoding and decoding aims to understand the relationship between external stimuli and brain activities, and is a fundamental problem in neuroscience. In this article, we study latent embedding alignment for brain encoding and…

Methodology · Statistics 2026-03-24 Shuoxun Xu , Zhanhao Yan , Lexin Li

The goal of this study is to investigate whether latent space representations of visual stimuli and fMRI data share common information. Decoding and reconstructing stimuli from fMRI data remains a challenge in AI and neuroscience, with…

Neurons and Cognition · Quantitative Biology 2025-03-28 Cesare Maria Dalbagno , Manuel de Castro Ribeiro Jardim , Mihnea Angheluţă

Contemporary computational neuroscience features two prominent modeling traditions. Bottom-up whole-brain modeling (WBM) builds biophysically detailed simulations of brain structure and dynamics, whereas top-down neuroconnectionism…

Neurons and Cognition · Quantitative Biology 2026-05-19 Mario Senden , Leonardo Dalla Porta , Jan Fousek , Jorge F. Mejias , Gorka Zamora-López

Compensating changes between a subjects' training and testing session in Brain Computer Interfacing (BCI) is challenging but of great importance for a robust BCI operation. We show that such changes are very similar between subjects, thus…

Machine Learning · Statistics 2013-04-04 Wojciech Samek , Frank C. Meinecke , Klaus-Robert Müller

How to identify and characterize functional brain networks (BN) is fundamental to gain system-level insights into the mechanisms of brain organizational architecture. Current functional magnetic resonance (fMRI) analysis highly relies on…

Neurons and Cognition · Quantitative Biology 2022-06-28 Xiaowei Yu , Lu Zhang , Lin Zhao , Yanjun Lyu , Tianming Liu , Dajiang Zhu

Reconstructing perceived images from human brain activity monitored by functional magnetic resonance imaging (fMRI) is hard, especially for natural images. Existing methods often result in blurry and unintelligible reconstructions with low…

Computer Vision and Pattern Recognition · Computer Science 2022-05-31 Mali Halac , Murat Isik , Hasan Ayaz , Anup Das

This paper proposes a novel approach of integrating different neuroimaging techniques to characterize an autistic brain. Different techniques like EEG, fMRI and DTI have traditionally been used to find biomarkers for autism, but there have…

Deep learning models have shown their advantage in many different tasks, including neuroimage analysis. However, to effectively train a high-quality deep learning model, the aggregation of a significant amount of patient information is…

Machine Learning · Computer Science 2020-12-08 Xiaoxiao Li , Yufeng Gu , Nicha Dvornek , Lawrence Staib , Pamela Ventola , James S. Duncan

Purpose: Functional Magnetic Resonance Imaging (fMRI) data acquired through resting-state studies have been used to obtain information about the spontaneous activations inside the brain. One of the approaches for analysis and interpretation…

Image and Video Processing · Electrical Eng. & Systems 2022-02-24 Harshit Parmar , Brian Nutter , Rodney Long , Sameer Antani , Sunanda Mitra

Reconstructing visual stimulus (image) only from human brain activity measured with functional Magnetic Resonance Imaging (fMRI) is a significant and meaningful task in Human-AI collaboration. However, the inconsistent distribution and…

Computer Vision and Pattern Recognition · Computer Science 2019-10-23 Ziqi Ren , Jie Li , Xuetong Xue , Xin Li , Fan Yang , Zhicheng Jiao , Xinbo Gao

In this work we introduce a self-supervised pretraining framework for transformers on functional Magnetic Resonance Imaging (fMRI) data. First, we pretrain our architecture on two self-supervised tasks simultaneously to teach the model a…

Machine Learning · Computer Science 2023-05-17 Sean Paulsen , Michael Casey

Neuroscience studies have revealed that the brain encodes visual content and embeds information in neural activity. Recently, deep learning techniques have facilitated attempts to address visual reconstructions by mapping brain activity to…

Image and Video Processing · Electrical Eng. & Systems 2022-07-05 Pei-Chun Chang , Yan-Yu Tien , Chia-Lin Chen , Li-Fen Chen , Yong-Sheng Chen , Hui-Ling Chan

Understanding how the brain responds to external stimuli and decoding this process has been a significant challenge in neuroscience. While previous studies typically concentrated on brain-to-image and brain-to-language reconstruction, our…

Artificial Intelligence · Computer Science 2025-12-02 Chunzheng Zhu , Jialin Shao , Jianxin Lin , Yijun Wang , Jing Wang , Jinhui Tang , Kenli Li

Objective: A variety of pattern analysis techniques for model training in brain interfaces exploit neural feature dimensionality reduction based on feature ranking and selection heuristics. In the light of broad evidence demonstrating the…

Machine Learning · Computer Science 2019-04-08 Ozan Ozdenizci , Deniz Erdogmus