English
Related papers

Related papers: Brain2Music: Reconstructing Music from Human Brain…

200 papers

Music is frequently used to establish atmosphere and to enhance/alter emotion in dramas and films. During music listening, visual imagery is a common mechanism underlying emotion induction. The present functional magnetic resonance imaging…

Neurons and Cognition · Quantitative Biology 2023-01-27 Chia-Wei Li , Tzu-Han Cheng , Chen-Gia Tsai

How does the human brain represent simple compositions of objects, actors,and actions? We had subjects view action sequence videos during neuroimaging (fMRI) sessions and identified lexical descriptions of those videos by decoding (SVM) the…

The goal of emotional brain state classification on functional MRI (fMRI) data is to recognize brain activity patterns related to specific emotion tasks performed by subjects during an experiment. Distinguishing emotional brain states from…

Image and Video Processing · Electrical Eng. & Systems 2022-11-01 Maxime Tchibozo , Donggeun Kim , Zijing Wang , Xiaofu He

This perspective article investigates how auditory stimuli influence neural network dynamics using the FitzHugh-Nagumo (FHN) model and empirical brain connectivity data. Results show that synchronization is sensitive to both the frequency…

Neurons and Cognition · Quantitative Biology 2025-04-11 Jakub Sawicki

Large language models (LLMs) excel at modeling relationships between strings in natural language and have shown promise in extending to other symbolic domains like coding or mathematics. However, the extent to which they implicitly model…

Computation and Language · Computer Science 2025-07-18 Andrew Shin , Kunitake Kaneko

Reconstructing seeing images from fMRI recordings is an absorbing research area in neuroscience and provides a potential brain-reading technology. The challenge lies in that visual encoding in brain is highly complex and not fully revealed.…

Neural and Evolutionary Computing · Computer Science 2021-01-29 Tao Fang , Yu Qi , Gang Pan

In the past five years, the use of generative and foundational AI systems has greatly improved the decoding of brain activity. Visual perception, in particular, can now be decoded from functional Magnetic Resonance Imaging (fMRI) with…

Image and Video Processing · Electrical Eng. & Systems 2024-03-15 Yohann Benchetrit , Hubert Banville , Jean-Rémi King

We propose an end-to-end deep neural encoder-decoder model to encode and decode brain activity in response to naturalistic stimuli using functional magnetic resonance imaging (fMRI) data. Leveraging temporally correlated input from…

Computer Vision and Pattern Recognition · Computer Science 2025-07-17 Florian David , Michael Chan , Elenor Morgenroth , Patrik Vuilleumier , Dimitri Van De Ville

The subject of this work is to check how different types of music affect human emotions. While listening to music, a subjective survey and brain activity measurements were carried out using an EEG helmet. The aim is to demonstrate the…

Computer Vision and Pattern Recognition · Computer Science 2025-10-31 Jelizaveta Jankowska , Bożena Kostek , Fernando Alonso-Fernandez , Prayag Tiwari

The human brain is a complex system requiring both macroscopic and microscopic components for comprehensive understanding. However, mapping nonlinear relationships between these scales remains challenging due to technical limitations and…

Image and Video Processing · Electrical Eng. & Systems 2025-10-28 Sooyoung Kim , Joonwoo Kwon , Junbeom Kwon , Jungyoun Janice Min , Sangyoon Bae , Yuewei Lin , Shinjae Yoo , Jiook Cha

Music is essential in daily life, fulfilling emotional and entertainment needs, and connecting us personally, socially, and culturally. A better understanding of music can enhance our emotions, cognitive skills, and cultural connections.…

Recent advances in brain-vision decoding have driven significant progress, reconstructing with high fidelity perceived visual stimuli from neural activity, e.g., functional magnetic resonance imaging (fMRI), in the human visual cortex. Most…

Computer Vision and Pattern Recognition · Computer Science 2025-07-04 Le Xu , Qi Zhang , Qixian Zhang , Hongyun Zhang , Duoqian Miao , Cairong Zhao

We propose MusicRL, the first music generation system finetuned from human feedback. Appreciation of text-to-music models is particularly subjective since the concept of musicality as well as the specific intention behind a caption are…

Understanding how spontaneous brain activity relates to stimulus-driven neural responses is a fundamental challenge in cognitive neuroscience. While task-based functional magnetic resonance imaging (fMRI) captures localized stimulus-evoked…

Neurons and Cognition · Quantitative Biology 2025-09-18 Chuyang Zhou , Ziao Ji , Daochang Liu , Dongang Wang , Chenyu Wang , Chang Xu

When evaluating stimuli reconstruction results it is tempting to assume that higher fidelity text and image generation is due to an improved understanding of the brain or more powerful signal extraction from neural recordings. However, in…

Machine Learning · Computer Science 2024-11-06 David Mayo , Christopher Wang , Asa Harbin , Abdulrahman Alabdulkareem , Albert Eaton Shaw , Boris Katz , Andrei Barbu

Reconstructing the viewed images from human brain activity bridges human and computer vision through the Brain-Computer Interface. The inherent variability in brain function between individuals leads existing literature to focus on…

Computer Vision and Pattern Recognition · Computer Science 2024-04-01 Ruijie Quan , Wenguan Wang , Zhibo Tian , Fan Ma , Yi Yang

Functional connectomes capture brain interactions via synchronized fluctuations in the functional magnetic resonance imaging signal. If measured during rest, they map the intrinsic functional architecture of the brain. With task-driven…

Neurons and Cognition · Quantitative Biology 2013-04-16 Gaël Varoquaux , R. C. Craddock

Non-invasive brainwave decoding is usually done using Magneto/Electroencephalography (MEG/EEG) sensor measurements as inputs. This makes combining datasets and building models with inductive biases difficult as most datasets use different…

Signal Processing · Electrical Eng. & Systems 2024-10-29 Yonatan Gideoni , Ryan Charles Timms , Oiwi Parker Jones

Music is a complex auditory stimulus capable of eliciting significant changes in brain activity, influencing cognitive processes such as memory, attention, and emotional regulation. However, the underlying mechanisms of music-induced…

Neural and Evolutionary Computing · Computer Science 2024-07-29 Daniel Szelogowski

The human brain has long inspired the pursuit of artificial intelligence (AI). Recently, neuroimaging studies provide compelling evidence of alignment between the computational representation of artificial neural networks (ANNs) and the…

Neurons and Cognition · Quantitative Biology 2024-11-01 Haiyang Sun , Lin Zhao , Zihao Wu , Xiaohui Gao , Yutao Hu , Mengfei Zuo , Wei Zhang , Junwei Han , Tianming Liu , Xintao Hu