English
Related papers

Related papers: Optimizing deep video representation to match brai…

200 papers

Is analogical reasoning a task that must be learned to solve from scratch by applying deep learning models to massive numbers of reasoning problems? Or are analogies solved by computing similarities between structured representations of…

Artificial Intelligence · Computer Science 2021-05-18 Nicholas Ichien , Qing Liu , Shuhao Fu , Keith J. Holyoak , Alan Yuille , Hongjing Lu

Human learning is a complex process in which future behavior is altered via the reorganization of brain activity and connectivity. It remains unknown whether activity and connectivity differentially reorganize during learning, and, if so,…

Every day, the human brain processes an immense volume of visual information, relying on intricate neural mechanisms to perceive and interpret these stimuli. Recent breakthroughs in functional magnetic resonance imaging (fMRI) have enabled…

Computer Vision and Pattern Recognition · Computer Science 2023-05-22 Matteo Ferrante , Furkan Ozcelik , Tommaso Boccato , Rufin VanRullen , Nicola Toschi

How does the human brain represent simple compositions of objects, actors,and actions? We had subjects view action sequence videos during neuroimaging (fMRI) sessions and identified lexical descriptions of those videos by decoding (SVM) the…

The release of large datasets and developments in AI have led to dramatic improvements in decoding methods that reconstruct seen images from human brain activity. We evaluate the prospect of further improving recent decoding methods by…

Neurons and Cognition · Quantitative Biology 2023-12-14 Reese Kneeland , Jordyn Ojeda , Ghislain St-Yves , Thomas Naselaris

Neuroimaging data analysis often involves \emph{a-priori} selection of data features to study the underlying neural activity. Since this could lead to sub-optimal feature selection and thereby prevent the detection of subtle patterns in…

Neurons and Cognition · Quantitative Biology 2018-07-03 Arna Ghosh , Fabien dal Maso , Marc Roig , Georgios D Mitsis , Marie-Hélène Boudrias

An unprecedented amount of existing functional Magnetic Resonance Imaging (fMRI) data provides a new opportunity to understand the relationship between functional fluctuation and human cognition/behavior using a data-driven approach. To…

Machine Learning · Computer Science 2024-09-18 Jiaqi Ding , Tingting Dan , Ziquan Wei , Hyuna Cho , Paul J. Laurienti , Won Hwa Kim , Guorong Wu

This workshop explores the interface between cognitive neuroscience and recent advances in AI fields that aim to reproduce human performance such as natural language processing and computer vision, and specifically deep learning approaches…

Neuroscience has focused on the detailed implementation of computation, studying neural codes, dynamics and circuits. In machine learning, however, artificial neural networks tend to eschew precisely designed codes, dynamics or circuits in…

Neurons and Cognition · Quantitative Biology 2020-02-04 Adam Marblestone , Greg Wayne , Konrad Kording

Artificial and biological systems may evolve similar computational solutions despite fundamental differences in architecture and learning mechanisms -- a form of convergent evolution. We demonstrate this phenomenon through large-scale…

Neurons and Cognition · Quantitative Biology 2025-07-04 Guobin Shen , Dongcheng Zhao , Yiting Dong , Qian Zhang , Yi Zeng

We all are fascinated by the phenomena of intelligent behavior, as generated both by our own brains and by the brains of other animals. As physicists we would like to understand if there are some general principles that govern the structure…

Biological Physics · Physics 2007-05-23 William Bialek

Video activity recognition by deep neural networks is impressive for many classes. However, it falls short of human performance, especially for challenging to discriminate activities. Humans differentiate these complex activities by…

Computer Vision and Pattern Recognition · Computer Science 2022-01-12 Joseph Chrol-Cannon , Andrew Gilbert , Ranko Lazic , Adithya Madhusoodanan , Frank Guerin

A long standing goal in neuroscience has been to elucidate the functional organization of the brain. Within higher visual cortex, functional accounts have remained relatively coarse, focusing on regions of interest (ROIs) and taking the…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Andrew F. Luo , Margaret M. Henderson , Leila Wehbe , Michael J. Tarr

We introduce Net2Brain, a graphical and command-line user interface toolbox for comparing the representational spaces of artificial deep neural networks (DNNs) and human brain recordings. While different toolboxes facilitate only single…

Computer Vision and Pattern Recognition · Computer Science 2025-09-08 Domenic Bersch , Kshitij Dwivedi , Martina Vilas , Radoslaw M. Cichy , Gemma Roig

The human brain has long inspired the pursuit of artificial intelligence (AI). Recently, neuroimaging studies provide compelling evidence of alignment between the computational representation of artificial neural networks (ANNs) and the…

Neurons and Cognition · Quantitative Biology 2024-11-01 Haiyang Sun , Lin Zhao , Zihao Wu , Xiaohui Gao , Yutao Hu , Mengfei Zuo , Wei Zhang , Junwei Han , Tianming Liu , Xintao Hu

In the past few years, significant advancements were made in reconstruction of observed natural images from fMRI brain recordings using deep-learning tools. Here, for the first time, we show that dense 3D depth maps of observed 2D natural…

Computer Vision and Pattern Recognition · Computer Science 2022-03-23 Guy Gaziv , Michal Irani

Decades of psychological research have been aimed at modeling how people learn features and categories. The empirical validation of these theories is often based on artificial stimuli with simple representations. Recently, deep neural…

Computer Vision and Pattern Recognition · Computer Science 2018-07-25 Joshua C. Peterson , Joshua T. Abbott , Thomas L. Griffiths

Conventional visualization media such as MRI prints and computer screens are inherently two dimensional, making them incapable of displaying true 3D volume data sets. By applying only transparency or intensity projection, and ignoring…

Graphics · Computer Science 2007-05-23 Gibby Koldenhof

Visual scene understanding often requires the processing of human-object interactions. Here we seek to explore if and how well Deep Neural Network (DNN) models capture features similar to the brain's representation of humans, objects, and…

Neurons and Cognition · Quantitative Biology 2019-11-07 Aditi Jha , Sumeet Agarwal

Understanding how human brains interpret and process information is important. Here, we investigated the selectivity and inter-individual differences in human brain responses to images via functional MRI. In our first experiment, we found…

Quantitative Methods · Quantitative Biology 2023-04-20 Zijin Gu , Keith Jamison , Mert R. Sabuncu , Amy Kuceyeski