English
Related papers

Related papers: Inferring Brain Dynamics via Multimodal Joint Grap…

200 papers

Machine learning provides a valuable tool for analyzing high-dimensional functional neuroimaging data, and is proving effective in predicting various neurological conditions, psychiatric disorders, and cognitive patterns. In functional…

Machine Learning · Computer Science 2024-11-25 Anwar Said , Roza G. Bayrak , Tyler Derr , Mudassir Shabbir , Daniel Moyer , Catie Chang , Xenofon Koutsoukos

Comprehending the interplay between spatial and temporal characteristics of neural dynamics can contribute to our understanding of information processing in the human brain. Graph neural networks (GNNs) provide a new possibility to…

Neurons and Cognition · Quantitative Biology 2022-04-29 Simon Wein , Alina Schüller , Ana Maria Tomé , Wilhelm M. Malloni , Mark W. Greenlee , Elmar W. Lang

fMRI is a non-invasive technique for investigating brain activity, offering high-resolution insights into neural processes. Understanding and decoding cognitive brain states from fMRI depends on how functional interactions are represented.…

Neurons and Cognition · Quantitative Biology 2026-02-23 Daniil Vlasenko , Vadim Ushakov , Alexey Zaikin , Denis Zakharov

In the past five years, the use of generative and foundational AI systems has greatly improved the decoding of brain activity. Visual perception, in particular, can now be decoded from functional Magnetic Resonance Imaging (fMRI) with…

Image and Video Processing · Electrical Eng. & Systems 2024-03-15 Yohann Benchetrit , Hubert Banville , Jean-Rémi King

Understanding neural responses to visual stimuli remains challenging due to the inherent complexity of brain representations and the modality gap between neural data and visual inputs. Existing methods, mainly based on reducing neural…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Weihang You , Hanqi Jiang , Yi Pan , Junhao Chen , Tianming Liu , Fei Dou

Exploring the complex structure of the human brain is crucial for understanding its functionality and diagnosing brain disorders. Thanks to advancements in neuroimaging technology, a novel approach has emerged that involves modeling the…

Machine Learning · Computer Science 2024-06-06 Xuexiong Luo , Jia Wu , Jian Yang , Shan Xue , Amin Beheshti , Quan Z. Sheng , David McAlpine , Paul Sowman , Alexis Giral , Philip S. Yu

Electroencephalography (EEG) is a neuroimaging technique that records brain neural activity with high temporal resolution. Unlike other methods, EEG does not require prohibitively expensive equipment and can be easily set up using…

Human-Computer Interaction · Computer Science 2024-10-01 Arash Akbarinia

Multimodal neuroimaging modeling has becomes a widely used approach but confronts considerable challenges due to heterogeneity, which encompasses variability in data types, scales, and formats across modalities. This variability…

Neurons and Cognition · Quantitative Biology 2025-04-15 Gang Qu , Ziyu Zhou , Vince D. Calhoun , Aiying Zhang , Yu-Ping Wang

Current high-throughput data acquisition technologies probe dynamical systems with different imaging modalities, generating massive data sets at different spatial and temporal resolutions posing challenging problems in multimodal data…

Brain interfaces are cyber-physical systems that aim to harvest information from the (physical) brain through sensing mechanisms, extract information about the underlying processes, and decide/actuate accordingly. Nonetheless, the brain…

Neurons and Cognition · Quantitative Biology 2018-03-29 Gaurav Gupta , Sergio Pequito , Paul Bogdan

One of the challenges in modeling cognitive events from electroencephalogram (EEG) data is finding representations that are invariant to inter- and intra-subject differences, as well as to inherent noise associated with such data. Herein,…

Machine Learning · Computer Science 2016-03-02 Pouya Bashivan , Irina Rish , Mohammed Yeasin , Noel Codella

Advances in neuroscience and artificial intelligence have enabled preliminary decoding of brain activity. However, despite the progress, the interpretability of neural representations remains limited. A significant challenge arises from the…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Hasib Aslam , Muhammad Talal Faiz , Muhammad Imran Malik

This study investigated the dynamic connectivity patterns between EEG and fMRI modalities, contributing to our understanding of brain network interactions. By employing a comprehensive approach that integrated static and dynamic analyses of…

Machine Learning · Computer Science 2024-12-02 Guiran Liu , Binrong Zhu

Neuroimaging data, particularly from techniques like MRI or PET, offer rich but complex information about brain structure and activity. To manage this complexity, latent representation models - such as Autoencoders, Generative Adversarial…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 C. Vázquez-García , F. J. Martínez-Murcia , F. Segovia Román , Juan M. Górriz

Multimodal medical image fusion helps in combining contrasting features from two or more input imaging modalities to represent fused information in a single image. One of the pivotal clinical applications of medical image fusion is the…

Image and Video Processing · Electrical Eng. & Systems 2019-09-20 Nishant Kumar , Nico Hoffmann , Martin Oelschlägel , Edmund Koch , Matthias Kirsch , Stefan Gumhold

Electroencephalography (EEG) monitors ---by either intrusive or noninvasive electrodes--- time and frequency variations and spectral content of voltage fluctuations or waves, known as brain rhythms, which in some way uncover activity during…

Neurons and Cognition · Quantitative Biology 2019-03-13 Javier A. Galadí , Joaquín J. Torres , J. Marro

Resting-state functional MRI (rs-fMRI) in functional neuroimaging techniques have improved in brain disorders, dysfunction studies via mapping the topology of the brain connections, i.e. connectopic mapping. Since, there are the slight…

Image and Video Processing · Electrical Eng. & Systems 2019-07-18 Jalal Mirakhorli , Hamidreza Amindavar , Mojgan Mirakhorli

We consider the problem of estimating the difference between two functional undirected graphical models with shared structures. In many applications, data are naturally regarded as high-dimensional random function vectors rather than…

Machine Learning · Statistics 2019-11-19 Boxin Zhao , Y. Samuel Wang , Mladen Kolar

Electroencephalography (EEG) is shown to be a valuable data source for evaluating subjects' mental states. However, the interpretation of multi-modal EEG signals is challenging, as they suffer from poor signal-to-noise-ratio, are highly…

Signal Processing · Electrical Eng. & Systems 2022-04-19 David Bethge , Philipp Hallgarten , Ozan Özdenizci , Ralf Mikut , Albrecht Schmidt , Tobias Grosse-Puppendahl

Magnetic Resonance Imaging (MRI) provides detailed structural information, while functional MRI (fMRI) captures temporal brain activity. In this work, we present a multimodal deep learning framework that integrates MRI and fMRI for…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Anima Kujur , Zahra Monfared