English
Related papers

Related papers: Neuronal Sequence Models for Bayesian Online Infer…

200 papers

Models of neural networks have proven their utility in the development of learning algorithms in computer science and in the theoretical study of brain dynamics in computational neuroscience. We propose in this paper a spatial neural…

Neural and Evolutionary Computing · Computer Science 2014-05-06 Lucas Antiqueira , Liang Zhao

Studying neural connectivity is considered one of the most promising and challenging areas of modern neuroscience. The underpinnings of cognition are hidden in the way neurons interact with each other. However, our experimental methods of…

Machine Learning · Statistics 2018-06-22 George Panagopoulos

Various animals, including humans, have been suggested to perform Bayesian inferences to handle noisy, time-varying external information. In performing Bayesian inference, the prior distribution must be shaped by sampling noisy external…

Neurons and Cognition · Quantitative Biology 2022-10-25 Kohei Ichikawa , Kunihiko Kaneko

Segmental structure is a common pattern in many types of sequences such as phrases in human languages. In this paper, we present a probabilistic model for sequences via their segmentations. The probability of a segmented sequence is…

Machine Learning · Statistics 2018-07-20 Chong Wang , Yining Wang , Po-Sen Huang , Abdelrahman Mohamed , Dengyong Zhou , Li Deng

In recent times, neural networks have become a powerful tool for the analysis of complex and abstract data models. However, their introduction intrinsically increases our uncertainty about which features of the analysis are model-related…

Machine Learning · Statistics 2020-11-09 Tom Charnock , Laurence Perreault-Levasseur , François Lanusse

This paper describes a process for combining patterns and features, to guide a search process and make predictions. It is based on the functionality that a human brain might have, which is a highly distributed network of simple neuronal…

Artificial Intelligence · Computer Science 2021-01-05 Kieran Greer

We present a new family of exchangeable stochastic processes, the Functional Neural Processes (FNPs). FNPs model distributions over functions by learning a graph of dependencies on top of latent representations of the points in the given…

Machine Learning · Computer Science 2019-11-05 Christos Louizos , Xiahan Shi , Klamer Schutte , Max Welling

Recurrent Neural Networks (RNNs) have been proven to be effective in modeling sequential data and they have been applied to boost a variety of tasks such as document classification, speech recognition and machine translation. Most of…

Computation and Language · Computer Science 2018-08-21 Zhiwei Wang , Yao Ma , Dawei Yin , Jiliang Tang

An increasing body of evidence suggests that the trial-to-trial variability of spiking activity in the brain is not mere noise, but rather the reflection of a sampling-based encoding scheme for probabilistic computing. Since the precise…

The apparent stochasticity of in-vivo neural circuits has long been hypothesized to represent a signature of ongoing stochastic inference in the brain. More recently, a theoretical framework for neural sampling has been proposed, which…

Neurons and Cognition · Quantitative Biology 2017-03-14 Mihai A. Petrovici , Ilja Bytschok , Johannes Bill , Johannes Schemmel , Karlheinz Meier

Speech perception involves storing and integrating sequentially presented items. Recent work in cognitive neuroscience has identified temporal and contextual characteristics in humans' neural encoding of speech that may facilitate this…

Computation and Language · Computer Science 2024-05-15 Oli Danyi Liu , Hao Tang , Naomi Feldman , Sharon Goldwater

The thesis explores the role machine learning methods play in creating intuitive computational models of neural processing. Combined with interpretability techniques, machine learning could replace human modeler and shift the focus of human…

Neurons and Cognition · Quantitative Biology 2020-10-20 Ilya Kuzovkin

Network data are increasingly collected along with other variables of interest. Our motivation is drawn from neurophysiology studies measuring brain connectivity networks for a sample of individuals along with their membership to a low or…

Methodology · Statistics 2018-09-11 Daniele Durante , David B. Dunson

Recent work has attempted to characterize the structure of semantic memory and the search algorithms which, together, best approximate human patterns of search revealed in a semantic fluency task. There are a number of models that seek to…

Computation and Language · Computer Science 2017-12-01 Filip Miscevic , Aida Nematzadeh , Suzanne Stevenson

Bayesian interpretations of neural processing require that biological mechanisms represent and operate upon probability distributions in accordance with Bayes' theorem. Many have speculated that synaptic failure constitutes a mechanism of…

Neurons and Cognition · Quantitative Biology 2022-10-05 Kevin McKee , Ian Crandell , Rishidev Chaudhuri , Randall O'Reilly

A Bayesian network is a graphical model that encodes probabilistic relationships among variables of interest. When used in conjunction with statistical techniques, the graphical model has several advantages for data analysis. One, because…

Machine Learning · Computer Science 2022-01-11 David Heckerman

Sequential modelling entails making sense of sequential data, which naturally occurs in a wide array of domains. One example is systems that interact with users, log user actions and behaviour, and make recommendations of items of potential…

Information Retrieval · Computer Science 2021-09-15 Christian Hansen

Neural networks have achieved remarkable performance across various problem domains, but their widespread applicability is hindered by inherent limitations such as overconfidence in predictions, lack of interpretability, and vulnerability…

Machine Learning · Statistics 2023-09-29 Julyan Arbel , Konstantinos Pitas , Mariia Vladimirova , Vincent Fortuin

Recent years have witnessed a growing call for renewed emphasis on neuroscience-inspired approaches in artificial intelligence research, under the banner of NeuroAI. A prime example of this is predictive coding networks (PCNs), based on the…

Machine Learning · Computer Science 2026-03-09 Björn van Zwol , Ro Jefferson , Egon L. van den Broek

Questions about information encoded by the brain demand statistical frameworks for inferring relationships between neural firing and features of the world. The landmark discovery of grid cells demonstrates that neurons can represent spatial…