English
Related papers

Related papers: Non-linear regression models for behavioral and ne…

200 papers

Gaussian processes (GPs) are a powerful tool for probabilistic inference over functions. They have been applied to both regression and non-linear dimensionality reduction, and offer desirable properties such as uncertainty estimates,…

Machine Learning · Statistics 2014-10-01 Yarin Gal , Mark van der Wilk , Carl E. Rasmussen

The gamma belief network (GBN), often regarded as a deep topic model, has demonstrated its potential for uncovering multi-layer interpretable latent representations in text data. Its notable capability to acquire interpretable latent…

Machine Learning · Computer Science 2024-08-16 Zhibin Duan , Tiansheng Wen , Muyao Wang , Bo Chen , Mingyuan Zhou

While deep neural networks (DNNs) are used for prediction, inference on DNN-estimated subject-specific means for categorical or exponential family outcomes remains underexplored. We address this by proposing a DNN estimator under…

Machine Learning · Statistics 2026-03-18 Xuran Meng , Yi Li

Gaussian process (GP) priors are non-parametric generative models with appealing modelling properties for Bayesian inference: they can model non-linear relationships through noisy observations, have closed-form expressions for training and…

Machine Learning · Statistics 2020-01-31 Gonzalo Rios

Generalized additive models (GAMs) are a widely used class of models of interest to statisticians as they provide a flexible way to design interpretable models of data beyond linear models. We here propose a scalable and well-calibrated…

Machine Learning · Computer Science 2018-12-31 Vincent Adam , Nicolas Durrande , ST John

Unmeasured or latent variables are often the cause of correlations between multivariate measurements, which are studied in a variety of fields such as psychology, ecology, and medicine. For Gaussian measurements, there are classical tools…

Machine Learning · Computer Science 2022-01-28 Łukasz Kidziński , Francis K. C. Hui , David I. Warton , Trevor Hastie

Generalized additive models (GAMs) are flexible non-linear regression models, which can be fitted efficiently using the approximate Bayesian methods provided by the mgcv R package. While the GAM methods provided by mgcv are based on the…

Methodology · Statistics 2020-07-08 Matteo Fasiolo , Simon N. Wood , Margaux Zaffran , Raphaël Nedellec , Yannig Goude

We propose an L1-penalized algorithm for fitting high-dimensional generalized linear mixed models. Generalized linear mixed models (GLMMs) can be viewed as an extension of generalized linear models for clustered observations. This…

Computation · Statistics 2014-06-03 Jürg Schelldorfer , Lukas Meier , Peter Bühlmann

Gaussian processes (GPs) are versatile tools that have been successfully employed to solve nonlinear estimation problems in machine learning, but that are rarely used in signal processing. In this tutorial, we present GPs for regression as…

Large language models (LLMs) can learn from a few demonstrations provided at inference time. We study this in-context learning phenomenon through the lens of Gaussian Processes (GPs). We build controlled experiments where models observe…

Machine Learning · Computer Science 2026-02-13 Elif Akata , Konstantinos Voudouris , Vincent Fortuin , Eric Schulz

Multi-output regression models must exploit dependencies between outputs to maximise predictive performance. The application of Gaussian processes (GPs) to this setting typically yields models that are computationally demanding and have…

Machine Learning · Statistics 2019-02-27 James Requeima , Will Tebbutt , Wessel Bruinsma , Richard E. Turner

Probabilistic graphical models are traditionally known for their successes in generative modeling. In this work, we advocate layered graphical models (LGMs) for probabilistic discriminative learning. To this end, we design LGMs in close…

Machine Learning · Computer Science 2019-02-04 Yuesong Shen , Tao Wu , Csaba Domokos , Daniel Cremers

Existing approaches for analyzing neural network activations, such as PCA and sparse autoencoders, rely on strong structural assumptions. Generative models offer an alternative: they can uncover structure without such assumptions and act as…

Machine Learning · Computer Science 2026-02-09 Grace Luo , Jiahai Feng , Trevor Darrell , Alec Radford , Jacob Steinhardt

We present a Gaussian Process - Latent Class Choice Model (GP-LCCM) to integrate a non-parametric class of probabilistic machine learning within discrete choice models (DCMs). Gaussian Processes (GPs) are kernel-based algorithms that…

Econometrics · Economics 2023-08-02 Georges Sfeir , Filipe Rodrigues , Maya Abou-Zeid

Climate projections using data driven machine learning models acting as emulators, is one of the prevailing areas of research to enable policy makers make informed decisions. Use of machine learning emulators as surrogates for…

Machine Learning · Computer Science 2023-08-24 Anmol Chaure , Ashok Kumar Behera , Sudip Bhattacharya

Modern biomedical datasets are increasingly high dimensional and exhibit complex correlation structures. Generalized Linear Mixed Models (GLMMs) have long been employed to account for such dependencies. However, proper specification of the…

Gaussian processes have become a popular tool for nonparametric regression because of their flexibility and uncertainty quantification. However, they often use stationary kernels, which limit the expressiveness of the model and may be…

Machine Learning · Computer Science 2025-07-17 Zachary James , Joseph Guinness

This paper introduces distributional regression, also known as generalized additive models for location, scale and shape (GAMLSS), as a modeling framework for analyzing treatment effects beyond the mean. By relating each parameter of the…

Applications · Statistics 2019-03-29 Maike Hohberg , Peter Pütz , Thomas Kneib

ProfileGLMM is an R package integrating Generalised Linear Mixed Models (GLMMs) as the outcome model for Bayesian profile regression. This statistical framework simultaneously i) explains the variation in the outcome and ii) clusters the…

Methodology · Statistics 2026-04-23 Matteo Amestoy , Mark A. van de Wiel , Wessel N. van Wieringen

We develop and present a generalization of the GN-model - the generalized Gaussian noise (GGN) model - to enabling a fair application of GN-model to predict generation of nonlinear interference when loss parameters relevantly vary with…

Optics · Physics 2018-06-25 Mattia Cantono , Dario Pilori , Alessio Ferrari , Vittorio Curri