English
Related papers

Related papers: Generalized Matrix Factorization: efficient algori…

200 papers

Generalized additive models (GAMs) provide a way to blend parametric and non-parametric (function approximation) techniques together, making them flexible tools suitable for many modeling problems. For instance, GAMs can be used to…

Methodology · Statistics 2023-03-07 Antti Solonen , Stratos Staboulis

The paper deals with generalized functional regression. The aim is to estimate the influence of covariates on observations, drawn from an exponential distribution. The link considered has a semiparametric expression: if we are interested in…

Statistics Theory · Mathematics 2013-09-20 Irène Gannaz

With the increasing penetration of machine learning applications in critical decision-making areas, calls for algorithmic fairness are more prominent. Although there have been various modalities to improve algorithmic fairness through…

Machine Learning · Computer Science 2024-05-21 Zhihao Hu , Yiran Xu , Mengnan Du , Jindong Gu , Xinmei Tian , Fengxiang He

We study a general factor analysis framework where the $n$-by-$p$ data matrix is assumed to follow a general exponential family distribution entry-wise. While this model framework has been proposed before, we here further relax its…

Methodology · Statistics 2025-12-02 Liang Wang , Luis Carvalho

We study the problem of detecting a change in the mean of one-dimensional Gaussian process data. This problem is investigated in the setting of increasing domain (customarily employed in time series analysis) and in the setting of fixed…

Statistics Theory · Mathematics 2017-04-11 Hossein Keshavarz , Clayton Scott , XuanLong Nguyen

Variational inference methods for latent variable statistical models have gained popularity because they are relatively fast, can handle large data sets, and have deterministic convergence guarantees. However, in practice it is unclear…

Methodology · Statistics 2017-03-22 Hachem Saddiki , Andrew C. Trapp , Patrick Flaherty

In many domains such as healthcare or finance, data often come in different assays or measurement modalities, with features in each assay having a common theme. Simply concatenating these assays together and performing prediction can be…

Methodology · Statistics 2018-07-17 J. Kenneth Tay , Robert Tibshirani

Dimensionality reduction is a main step in the learning process which plays an essential role in many applications. The most popular methods in this field like SVD, PCA, and LDA, only can be applied to data with vector format. This means…

Machine Learning · Computer Science 2019-03-01 Soheil Ahmadi , Mansoor Rezghi

The generalized Gauss-Newton (GGN) approximation is often used to make practical Bayesian deep learning approaches scalable by replacing a second order derivative with a product of first order derivatives. In this paper we argue that the…

Machine Learning · Statistics 2021-02-26 Alexander Immer , Maciej Korzepa , Matthias Bauer

We study the task of learning Generalized Linear models (GLMs) in the agnostic model under the Gaussian distribution. We give the first polynomial-time algorithm that achieves a constant-factor approximation for \textit{any} monotone…

Machine Learning · Computer Science 2025-08-05 Nikos Zarifis , Puqian Wang , Ilias Diakonikolas , Jelena Diakonikolas

Generalized linear models (GLMs) are routinely used for modeling relationships between a response variable and a set of covariates. The simple form of a GLM comes with easy interpretability, but also leads to concerns about model…

Methodology · Statistics 2023-11-10 Davide Agnoletto , Tommaso Rigon , David B. Dunson

We present a new method for estimating multivariate, second-order stationary Gaussian Random Field (GRF) models based on the Sparse Precision matrix Selection (SPS) algorithm, proposed by Davanloo et al. (2015) for estimating scalar GRF…

Machine Learning · Statistics 2021-01-12 Sam Davanloo Tajbakhsh , Necdet Serhat Aybat , Enrique del Castillo

Generalized linear models (GLMs) are fundamental tools for statistical modeling, with maximum likelihood estimation (MLE) serving as the classical approach for parameter inference. While MLE performs well for canonical GLMs, it can become…

Methodology · Statistics 2026-03-03 Linglingzhi Zhu , Jonghyeok Lee , Yao Xie

It can be difficult to assess the quality of a fitted model when facing unsupervised learning problems. Latent variable models, such as variation autoencoders and Gaussian mixture models, are often trained with likelihood-based approaches.…

Machine Learning · Computer Science 2023-06-16 Cédric Beaulac

Generalized linear models are flexible tools for the analysis of diverse datasets, but the classical formulation requires that the parametric component is correctly specified and the data contain no atypical observations. To address these…

Methodology · Statistics 2023-04-21 Ioannis Kalogridis , Gerda Claeskens , Stefan Van Aelst

Bayes' rule describes how to infer posterior beliefs about latent variables given observations, and inference is a critical step in learning algorithms for latent variable models (LVMs). Although there are exact algorithms for inference and…

Machine Learning · Computer Science 2025-09-22 Sacha Sokoloski

A generalized method of moments (GMM) estimator is unreliable for a large number of moment conditions, that is, it is comparable, or larger than the sample size. While classical GMM literature proposes several provisions to this problem,…

Computation · Statistics 2021-03-11 Masahiro Tanaka

In the classic measurement error framework, covariates are contaminated by independent additive noise. This paper considers parameter estimation in such a linear errors-in-variables model where the unknown measurement error distribution is…

Methodology · Statistics 2023-10-24 Linh H. Nghiem , Cornelis J. Potgieter

Gaussian processes (GPs) are a powerful tool for probabilistic inference over functions. They have been applied to both regression and non-linear dimensionality reduction, and offer desirable properties such as uncertainty estimates,…

Machine Learning · Statistics 2014-10-01 Yarin Gal , Mark van der Wilk , Carl E. Rasmussen

Generalized additive partial linear models (GAPLMs) are appealing for model interpretation and prediction. However, for GAPLMs, the covariates and the degree of smoothing in the nonparametric parts are often difficult to determine in…

Methodology · Statistics 2022-12-06 Ze Chen , Jun Liao , Wangli Xu , Yuhong Yang