English
Related papers

Related papers: Non-parametric generalized linear model

200 papers

We propose stochastic, non-parametric activation functions that are fully learnable and individual to each neuron. Complexity and the risk of overfitting are controlled by placing a Gaussian process prior over these functions. The result is…

Machine Learning · Statistics 2017-12-01 Sebastian Urban , Marcus Basalla , Patrick van der Smagt

This is a continuation of a recent study on the modeling of the information coding in sensory system in the brain. The data from a sensory neurons are available as discrete spike timings with no amplitude information. In the simulations,…

Neurons and Cognition · Quantitative Biology 2018-07-27 Resat Ozgur Doruk

This paper is concerned with the problem of how to speed up computation for Gaussian process models trained on autocorrelated data. The Gaussian process model is a powerful tool commonly used in nonlinear regression applications. Standard…

Machine Learning · Computer Science 2025-12-03 Ahmadreza Chokhachian , Matthias Katzfuss , Yu Ding

Large-scale Gaussian process inference has long faced practical challenges due to time and space complexity that is superlinear in dataset size. While sparse variational Gaussian process models are capable of learning from large-scale data,…

Machine Learning · Statistics 2018-01-23 Ching-An Cheng , Byron Boots

Many real-world applications demand accurate and fast predictions, as well as reliable uncertainty estimates. However, quantifying uncertainty on high-dimensional predictions is still a severely under-investigated problem, especially when…

Computational Engineering, Finance, and Science · Computer Science 2025-02-04 Saurabh Deshpande , Hussein Rappel , Mark Hobbs , Stéphane P. A. Bordas , Jakub Lengiewicz

The dynamic emulation of non-linear deterministic computer codes where the output is a time series, possibly multivariate, is examined. Such computer models simulate the evolution of some real-world phenomenon over time, for example models…

Machine Learning · Statistics 2022-03-22 Hossein Mohammadi , Peter Challenor , Marc Goodfellow

We consider the problem of sequential estimation of the unknowns of state-space and deep state-space models that include estimation of functions and latent processes of the models. The proposed approach relies on Gaussian and deep Gaussian…

Machine Learning · Computer Science 2024-03-26 Yuhao Liu , Marzieh Ajirak , Petar Djuric

System identification is of special interest in science and engineering. This article is concerned with a system identification problem arising in stochastic dynamic systems, where the aim is to estimate the parameters of a system along…

Methodology · Statistics 2022-01-27 Christos Merkatas , Simo Särkkä

We study the Gaussian Process regression model in the context of training data with noise in both input and output. The presence of two sources of noise makes the task of learning accurate predictive models extremely challenging. However,…

Machine Learning · Statistics 2015-07-03 Cuong Tran , Vladimir Pavlovic , Robert Kopp

The recent discovered spatial-temporal information processing capability of bio-inspired Spiking neural networks (SNN) has enabled some interesting models and applications. However designing large-scale and high-performance model is yet a…

Neural and Evolutionary Computing · Computer Science 2020-07-28 Haowen Fang , Amar Shrestha , Ziyi Zhao , Qinru Qiu

A key problem in computational neuroscience is to find simple, tractable models that are nevertheless flexible enough to capture the response properties of real neurons. Here we examine the capabilities of recurrent point process models…

Neurons and Cognition · Quantitative Biology 2017-07-11 Alison I. Weber , Jonathan W. Pillow

Spike trains data find a growing list of applications in computational neuroscience, imaging, streaming data and finance. Machine learning strategies for spike trains are based on various neural network and probabilistic models. The…

Information Theory · Computer Science 2023-08-10 Mirosław Pawlak , Mateusz Pabian , Dominik Rzepka

We present a theoretical study aiming at model fitting for sensory neurons. Conventional neural network training approaches are not applicable to this problem due to lack of continuous data. Although the stimulus can be considered as a…

Neurons and Cognition · Quantitative Biology 2017-09-28 R. Ozgur Doruk , Kechen Zhang

The increasing need for compact and low-power computing solutions for machine learning applications has triggered significant interest in energy-efficient neuromorphic systems. However, most of these architectures rely on spiking neural…

Neural and Evolutionary Computing · Computer Science 2019-12-23 Manu V Nair , Giacomo Indiveri

This paper introduces a new sparse spatio-temporal structured Gaussian process regression framework for online and offline Bayesian inference. This is the first framework that gives a time-evolving representation of the interdependencies…

Machine Learning · Statistics 2018-08-01 Danil Kuzin , Olga Isupova , Lyudmila Mihaylova

We propose a method (TT-GP) for approximate inference in Gaussian Process (GP) models. We build on previous scalable GP research including stochastic variational inference based on inducing inputs, kernel interpolation, and structure…

Machine Learning · Computer Science 2018-01-18 Pavel Izmailov , Alexander Novikov , Dmitry Kropotov

How do humans and animals perform trial-and-error learning when the space of possibilities is infinite? In a previous study, we used an interval timing production task and discovered an updating strategy in which the agent adjusted the…

Neurons and Cognition · Quantitative Biology 2022-05-10 Jing Wang , Yousuf El-Jayyousi , Ilker Ozden

We study filtering of multiscale dynamical systems with model error arising from unresolved smaller scale processes. The analysis assumes continuous-time noisy observations of all components of the slow variables alone. For a linear model…

Dynamical Systems · Mathematics 2014-12-03 Tyrus Berry , John Harlim

Normative modeling has recently been introduced as a promising approach for modeling variation of neuroimaging measures across individuals in order to derive biomarkers of psychiatric disorders. Current implementations rely on Gaussian…

Machine Learning · Statistics 2019-04-16 Seyed Mostafa Kia , Andre F. Marquand

Fitting network models to neural activity is an important tool in neuroscience. A popular approach is to model a brain area with a probabilistic recurrent spiking network whose parameters maximize the likelihood of the recorded activity.…

Machine Learning · Statistics 2021-11-16 Guillaume Bellec , Shuqi Wang , Alireza Modirshanechi , Johanni Brea , Wulfram Gerstner