English
Related papers

Related papers: An Open-Access Multi-modal Dataset for Cognitive, …

200 papers

Decoding human brain activity from electroencephalography (EEG) signals is a central challenge at the intersection of neuroscience and artificial intelligence, enabling diverse applications in mental state assessment, clinical monitoring,…

Human-Computer Interaction · Computer Science 2026-05-12 Weiheng Lu , Zhouheng Yao , Jiamin Wu , Pengyu Zhu , Yuchen Zhou , Weijian Mai , Qihao Zheng , Wanli Ouyang , Chunfeng Song

Understanding the interaction of neural and cardiac systems during cognitive activity is critical to advancing physiological computing. Although EEG has been the gold standard for assessing mental workload, its limited portability restricts…

Machine Learning · Computer Science 2026-01-06 Akshay Sasi , Malavika Pradeep , Nusaibah Farrukh , Rahul Venugopal , Elizabeth Sherly

This paper presents a novel approach towards creating a foundational model for aligning neural data and visual stimuli across multimodal representationsof brain activity by leveraging contrastive learning. We used electroencephalography…

Computer Vision and Pattern Recognition · Computer Science 2024-11-18 Matteo Ferrante , Tommaso Boccato , Grigorii Rashkov , Nicola Toschi

Localizing neuronal activity in the brain, both in time and in space, is a central challenge to advance the understanding of brain function. Because of the inability of any single neuroimaging techniques to cover all aspects at once, there…

Neurons and Cognition · Quantitative Biology 2013-07-09 Yaroslav O. Halchenko , Michael Hanke , James V. Haxby , Stephen Jose Hanson , Christoph S. Herrmann

Neurofeedback is a promising approach for non-invasive modulation of human brain activity with applications for treatment of mental disorders and enhancement of brain performance. Neurofeedback techniques are commonly based on either…

Medical Physics · Physics 2013-12-10 Vadim Zotev , Raquel Phillips , Han Yuan , Masaya Misaki , Jerzy Bodurka

Multimodal learning has been a popular area of research, yet integrating electroencephalogram (EEG) data poses unique challenges due to its inherent variability and limited availability. In this paper, we introduce a novel multimodal…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Kang Yin , Hye-Bin Shin , Dan Li , Seong-Whan Lee

Deep Learning has revolutionized various fields, including Computer Vision, Natural Language Processing, as well as Biomedical research. Within the field of neuroscience, specifically in electrophysiological neuroimaging, researchers are…

Machine Learning · Computer Science 2022-04-14 Dung Truong , Manisha Sinha , Kannan Umadevi Venkataraju , Michael Milham , Arnaud Delorme

A core goal of functional neuroimaging is to study how the environment is processed in the brain. The mainstream paradigm involves concurrently measuring a broad spectrum of brain responses to a small set of environmental features…

Neurons and Cognition · Quantitative Biology 2021-06-14 Pedro F. da Costa , Rianne Haartsen , Elena Throm , Luke Mason , Anna Gui , Robert Leech , Emily J. H. Jones

Accurate assessment of bimanual motor skills is essential across various professions, yet, traditional methods often rely on subjective assessments or focus solely on motor actions, overlooking the integral role of cognitive processes. This…

Artificial Intelligence · Computer Science 2024-04-18 Erim Yanik , Xavier Intes , Suvranu De

Cognitive effort, defined as the relationship between cognitive load and task performance, provides insight into how individuals allocate mental resources during demanding tasks. This construct is particularly important in high-stakes…

Human-Computer Interaction · Computer Science 2026-04-13 Shayla Sharmin , Mohammad Fahim Abrar , Gael Lucero-Palacios , Aditya Raikwar , Roghayeh Leila Barmaki

The real-time assessment of complex motor skills presents a challenge in fields such as surgical training and rehabilitation. Recent advancements in neuroimaging, particularly functional near-infrared spectroscopy (fNIRS), have enabled…

Signal Processing · Electrical Eng. & Systems 2025-04-08 Aseem Subedi , Rahul , Lora Cavuoto , Steven Schwaitzberg , Matthew Hackett , Jack Norfleet , Suvranu De

In Brain-Computer Interface (BCI) research, the detailed study of blinks is crucial. They can be considered as noise, affecting the efficiency and accuracy of decoding users' cognitive states and intentions, or as potential features,…

Neurons and Cognition · Quantitative Biology 2025-06-10 E. Guttmann-Flury , X. Sheng , X. Zhu

Neuroimaging techniques including functional magnetic resonance imaging (fMRI) and electroencephalogram (EEG) have shown promise in detecting functional abnormalities in various brain disorders. However, existing studies often focus on a…

Image and Video Processing · Electrical Eng. & Systems 2024-10-01 Xinxu Wei , Kanhao Zhao , Yong Jiao , Nancy B. Carlisle , Hua Xie , Gregory A. Fonzo , Yu Zhang

According to the World Health Organization, the number of mental disorder patients, especially depression patients, has grown rapidly and become a leading contributor to the global burden of disease. However, the present common practice of…

Motor execution, a fundamental aspect of human behavior, has been extensively studied using BCI technologies. EEG and fNIRS have been utilized to provide valuable insights, but their individual limitations have hindered performance. This…

Human-Computer Interaction · Computer Science 2025-01-13 Gourav Siddhad , Juhi Singh , Partha Pratim Roy

Machine learning provides a valuable tool for analyzing high-dimensional functional neuroimaging data, and is proving effective in predicting various neurological conditions, psychiatric disorders, and cognitive patterns. In functional…

Machine Learning · Computer Science 2024-11-25 Anwar Said , Roza G. Bayrak , Tyler Derr , Mudassir Shabbir , Daniel Moyer , Catie Chang , Xenofon Koutsoukos

Physiological signals such as electrocardiograms (ECG) and electroencephalograms (EEG) provide complementary insights into human health and cognition, yet multi-modal integration is challenging due to limited multi-modal labeled data, and…

Cognitive neuroscience is enjoying rapid increase in extensive public brain-imaging datasets. It opens the door to large-scale statistical models. Finding a unified perspective for all available data calls for scalable and automated…

Machine Learning · Statistics 2019-05-16 Arthur Mensch , Julien Mairal , Danilo Bzdok , Bertrand Thirion , Gaël Varoquaux

Cybersickness poses a serious challenge for users of virtual reality (VR) technology. Consequently, there has been significant effort to track its occurrence during VR use with passive measures like brain activity recorded through…

Human-Computer Interaction · Computer Science 2026-03-30 Jacqueline Yau , Katherine J. Mimnaugh , Evan G. Center , Timo Ojala , Steven M. LaValle , Wenzhen Yuan , Nancy Amato , Minje Kim , Kara D. Federmeier

The electroencephalogram (EEG) has been the gold standard for quantifying mental workload; however, due to its complexity and non-portability, it can be constraining. ECG signals, which are feasible on wearable equipment pieces such as…

Machine Learning · Computer Science 2026-01-13 Malavika Pradeep , Akshay Sasi , Nusaibah Farrukh , Rahul Venugopal , Elizabeth Sherly