English
Related papers

Related papers: Scaling laws for decoding images from brain activi…

200 papers

We present a novel approach to EEG decoding for non-invasive brain machine interfaces (BMIs), with a focus on motor-behavior classification. While conventional convolutional architectures such as EEGNet and DeepConvNet are effective in…

Machine Learning · Computer Science 2025-12-09 Tian Lan

Humans can effortlessly recognize others' actions in the presence of complex transformations, such as changes in viewpoint. Several studies have located the regions in the brain involved in invariant action recognition, however, the…

Neurons and Cognition · Quantitative Biology 2017-08-16 Leyla Isik , Andrea Tacchetti , Tomaso Poggio

Visual decoding from brain signals is a key challenge at the intersection of computer vision and neuroscience, requiring methods that bridge neural representations and computational models of vision. A field-wide goal is to achieve…

The human neuromuscular system consisting of skeletal muscles and neural circuits is a complex system that is not yet fully understood. Surface electromyography (EMG) can be used to study muscle behavior from the outside. Computer…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-07-16 Benjamin Maier

Human's perception of the visual world is shaped by the stereo processing of 3D information. Understanding how the brain perceives and processes 3D visual stimuli in the real world has been a longstanding endeavor in neuroscience. Towards…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Zhanqiang Guo , Jiamin Wu , Yonghao Song , Jiahui Bu , Weijian Mai , Qihao Zheng , Wanli Ouyang , Chunfeng Song

The human brain is constantly processing and integrating information in order to make decisions and interact with the world, for tasks from recognizing a familiar face to playing a game of tennis. These complex cognitive processes require…

Neurons and Cognition · Quantitative Biology 2019-05-14 Thomas A. Carlson , Tijl Grootswagers , Amanda K. Robinson

Visual encoding and decoding models act as gateways to understanding the neural mechanisms underlying human visual perception. Typically, visual encoding models that predict brain activity from stimuli and decoding models that reproduce…

Machine Learning · Computer Science 2026-04-14 Weijian Mai , Mu Nan , Yu Zhu , Jiahang Cao , Rui Zhang , Yuqin Dai , Chunfeng Song , Andrew F. Luo , Jiamin Wu

Brain-to-image decoding has been recently propelled by the progress in generative AI models and the availability of large ultra-high field functional Magnetic Resonance Imaging (fMRI). However, current approaches depend on complicated…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Marlène Careil , Yohann Benchetrit , Jean-Rémi King

In this study, we adopted visual motion imagery, which is a more intuitive brain-computer interface (BCI) paradigm, for decoding the intuitive user intention. We developed a 3-dimensional BCI training platform and applied it to assist the…

Signal Processing · Electrical Eng. & Systems 2020-05-19 Byoung-Hee Kwon , Ji-Hoon Jeong , Jeong-Hyun Cho , Seong-Whan Lee

In this study we present a kernel based convolution model to characterize neural responses to natural sounds by decoding their time-varying acoustic features. The model allows to decode natural sounds from high-dimensional neural…

Machine Learning · Statistics 2016-11-15 Ali Faisal , Anni Nora , Jaeho Seol , Hanna Renvall , Riitta Salmelin

In brain-computer interfaces (BCI) research, recording data is time-consuming and expensive, which limits access to big datasets. This may influence the BCI system performance as machine learning methods depend strongly on the training…

Signal Processing · Electrical Eng. & Systems 2022-09-09 Maciej Śliwowski , Matthieu Martin , Antoine Souloumiac , Pierre Blanchart , Tetiana Aksenova

Extensive literature has drawn comparisons between recordings of biological neurons in the brain and deep neural networks. This comparative analysis aims to advance and interpret deep neural networks and enhance our understanding of…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Mai Gamal , Mohamed Rashad , Eman Ehab , Seif Eldawlatly , Mennatullah Siam

Reconstructing images using brain signals of imagined visuals may provide an augmented vision to the disabled, leading to the advancement of Brain-Computer Interface (BCI) technology. The recent progress in deep learning has boosted the…

Human-Computer Interaction · Computer Science 2023-03-21 Prajwal Singh , Pankaj Pandey , Krishna Miyapuram , Shanmuganathan Raman

How to decode human vision through neural signals has attracted a long-standing interest in neuroscience and machine learning. Modern contrastive learning and generative models improved the performance of visual decoding and reconstruction…

Human-Computer Interaction · Computer Science 2024-10-07 Dongyang Li , Chen Wei , Shiying Li , Jiachen Zou , Haoyang Qin , Quanying Liu

Understanding how neural activity gives rise to perception is a central challenge in neuroscience. We address the problem of decoding visual information from high-density intracortical recordings in primates, using the THINGS Ventral Stream…

Neurons and Cognition · Quantitative Biology 2026-01-19 Matteo Ciferri , Matteo Ferrante , Nicola Toschi

Scaling up model and data size have demonstrated impressive performance improvement over a wide range of tasks. Despite extensive studies on scaling behaviors for general-purpose tasks, medical images exhibit substantial differences from…

Computer Vision and Pattern Recognition · Computer Science 2025-05-15 Jiarun Liu , Hong-Yu Zhou , Weijian Huang , Hao Yang , Dongning Song , Tao Tan , Yong Liang , Shanshan Wang

Current EEG/MEG-to-text decoding systems suffer from three key limitations: (1) reliance on teacher-forcing methods, which compromises robustness during inference, (2) sensitivity to session-specific noise, hindering generalization across…

Artificial Intelligence · Computer Science 2025-08-06 Jilong Li , Zhenxi Song , Jiaqi Wang , Meishan Zhang , Honghai Liu , Min Zhang , Zhiguo Zhang

An accurate classification of upper limb movements using electroencephalography (EEG) signals is gaining significant importance in recent years due to the prevalence of brain-computer interfaces. The upper limbs in the human body are…

Signal Processing · Electrical Eng. & Systems 2023-04-14 Saadat Ullah Khan , Muhammad Majid , Syed Muhammad Anwar

Brain-computer interface uses brain signals to control external devices without actual control behavior. Recently, speech imagery has been studied for direct communication using language. Speech imagery uses brain signals generated when the…

Human-Computer Interaction · Computer Science 2020-12-08 Byeong-Hoo Lee , Byeong-Hee Kwon , Do-Yeun Lee , Ji-Hoon Jeong

Brain signals accompany various information relevant to human actions and mental imagery, making them crucial to interpreting and understanding human intentions. Brain-computer interface technology leverages this brain activity to generate…

Artificial Intelligence · Computer Science 2024-11-15 Jung-Sun Lee , Ha-Na Jo , Seo-Hyun Lee