English
Related papers

Related papers: Generalised Linear Models Driven by Latent Process…

200 papers

We present the Mixed Likelihood Gaussian process latent variable model (GP-LVM), capable of modeling data with attributes of different types. The standard formulation of GP-LVM assumes that each observation is drawn from a Gaussian…

Machine Learning · Computer Science 2018-11-20 Samuel Murray , Hedvig Kjellström

A large amount of observational data has been accumulated in various fields in recent times, and there is a growing need to estimate the generating processes of these data. A linear non-Gaussian acyclic model (LiNGAM) based on the…

Machine Learning · Statistics 2014-08-05 Naoki Tanaka , Shohei Shimizu , Takashi Washio

We introduce graph gamma process (GGP) linear dynamical systems to model real-valued multivariate time series. For temporal pattern discovery, the latent representation under the model is used to decompose the time series into a…

Methodology · Statistics 2020-07-28 Rahi Kalantari , Mingyuan Zhou

Generalized linear models (GLMs) arise in high-dimensional machine learning, statistics, communications and signal processing. In this paper we analyze GLMs when the data matrix is random, as relevant in problems such as compressed sensing,…

Information Theory · Computer Science 2019-04-01 Jean Barbier , Florent Krzakala , Nicolas Macris , Léo Miolane , Lenka Zdeborová

The gamma belief network (GBN), often regarded as a deep topic model, has demonstrated its potential for uncovering multi-layer interpretable latent representations in text data. Its notable capability to acquire interpretable latent…

Machine Learning · Computer Science 2024-08-16 Zhibin Duan , Tiansheng Wen , Muyao Wang , Bo Chen , Mingyuan Zhou

Inference for the parameters indexing generalised linear models is routinely based on the assumption that the model is correct and a priori specified. This is unsatisfactory because the chosen model is usually the result of a data-adaptive…

Methodology · Statistics 2020-06-16 Stijn Vansteelandt , Oliver Dukes

This work establishes regularity conditions for consistency and asymptotic normality of the multiple parameter maximum likelihood estimator(MLE) from censored data, where the censoring mechanism is in the form of $1$-bit measurements. The…

Statistics Theory · Mathematics 2025-02-11 Jaimin Shah , Martina Cardone , Cynthia Rush , Alex Dytso

We study generalised linear regression and classification for a synthetically generated dataset encompassing different problems of interest, such as learning with random features, neural networks in the lazy training regime, and the hidden…

Statistics Theory · Mathematics 2022-03-28 Federica Gerace , Bruno Loureiro , Florent Krzakala , Marc Mézard , Lenka Zdeborová

Latent Gaussian Models (LGMs) are a subset of Bayesian Hierarchical models where Gaussian priors, conditional on variance parameters, are assigned to all effects in the model. LGMs are employed in many fields for their flexibility and…

Methodology · Statistics 2025-01-28 Luisa Ferrari , Massimo Ventrucci

While including pairwise interactions in a regression model can better approximate response surface, fitting such an interaction model is a well-known difficult problem. In particular, analyzing contemporary high-dimensional datasets often…

Methodology · Statistics 2024-01-17 Hai Lu , Guo Yu

Two popular approaches for relating correlated measurements of a non-Gaussian response variable to a set of predictors are to fit a marginal model using generalized estimating equations and to fit a generalized linear mixed model by…

Methodology · Statistics 2017-02-23 Jeffrey J. Gory , Peter F. Craigmile , Steven N. MacEachern

We give two prediction intervals (PI) for Generalized Linear Models that take model selection uncertainty into account. The first is a straightforward extension of asymptotic normality results and the second includes an extra optimization…

Methodology · Statistics 2023-05-26 Dean Dustin , Bertrand Clarke

Generalized linear models (GLM) are link function based statistical models. Many supervised learning algorithms are extensions of GLMs and have link functions built into the algorithm to model different outcome distributions. There are two…

Methodology · Statistics 2019-05-02 Colleen M. Farrelly , Srikanth Namuduri , Uchenna Chukwu

Prediction and causal explanation are fundamentally distinct tasks of data analysis. In health applications, this difference can be understood in terms of the difference between prognosis (prediction) and prevention/treatment (causal…

Generalized Linear Mixed Models (GLMMs) are widely used for analysing clustered data. One well-established method of overcoming the integral in the marginal likelihood function for GLMMs is penalized quasi-likelihood (PQL) estimation,…

Statistics Theory · Mathematics 2024-05-03 Xu Ning , Francis Hui , Alan Welsh

Although deep learning has achieved appealing results on several machine learning tasks, most of the models are deterministic at inference, limiting their application to single-modal settings. We propose a novel general-purpose framework…

Machine Learning · Computer Science 2020-10-12 Sameera Ramasinghe , Kanchana Ranasinghe , Salman Khan , Nick Barnes , Stephen Gould

In this paper we develop inference for high dimensional linear models, with serially correlated errors. We examine Lasso under the assumption of strong mixing in the covariates and error process, allowing for fatter tails in their…

Econometrics · Economics 2023-10-05 Ilias Chronopoulos , Katerina Chrysikou , George Kapetanios

Power law scaling models have been used to understand the complexity of systems as diverse as cities, neurological activity, and rainfall and lightning. In the scaling framework, power laws and standard linear regression methods are widely…

Methodology · Statistics 2024-04-16 Jack Sutton , Golnaz Shahtahmassebi , Quentin S. Hanley , Haroldo V. Ribeiro

Generalized linear models (GLMs) are fundamental tools for statistical modeling, with maximum likelihood estimation (MLE) serving as the classical approach for parameter inference. While MLE performs well for canonical GLMs, it can become…

Methodology · Statistics 2026-03-03 Linglingzhi Zhu , Jonghyeok Lee , Yao Xie

We introduce a class of semiparametric time series models by assuming a quasi-likelihood approach driven by a latent factor process. More specifically, given the latent process, we only specify the conditional mean and variance of the time…

Methodology · Statistics 2021-04-02 Gisele O. Maia , Wagner Barreto-Souza , Fernando S. Bastos , Hernando Ombao