English
Related papers

Related papers: Fast generalised linear models by database samplin…

200 papers

Linear mixed models are a versatile statistical tool to study data by accounting for fixed effects and random effects from multiple sources of variability. In many situations, a large number of candidate fixed effects is available and it is…

Methodology · Statistics 2022-09-09 Emanuele Degani , Luca Maestrini , Dorota Toczydłowska , Matt P. Wand

Generalized additive model is a powerful statistical learning and predictive modeling tool that has been applied in a wide range of applications. The need of high-dimensional additive modeling is eminent in the context of dealing with high…

Methodology · Statistics 2021-07-08 Kaixu Yang , Tapabrata Maiti

We consider the sparsification of sums $F : \mathbb{R}^n \to \mathbb{R}$ where $F(x) = f_1(\langle a_1,x\rangle) + \cdots + f_m(\langle a_m,x\rangle)$ for vectors $a_1,\ldots,a_m \in \mathbb{R}^n$ and functions $f_1,\ldots,f_m : \mathbb{R}…

Data Structures and Algorithms · Computer Science 2023-12-01 Arun Jambulapati , James R. Lee , Yang P. Liu , Aaron Sidford

We consider methods for learning vector representations of SQL queries to support generalized workload analytics tasks, including workload summarization for index selection and predicting queries that will trigger memory errors. We consider…

Databases · Computer Science 2018-02-06 Shrainik Jain , Bill Howe , Jiaqi Yan , Thierry Cruanes

In distributed, or privacy-preserving learning, we are often given a set of probabilistic models estimated from different local repositories, and asked to combine them into a single model that gives efficient statistical estimation. A…

Machine Learning · Statistics 2017-03-01 Jun Han , Qiang Liu

We present a unified framework for estimation and analysis of generalized additive models in high dimensions. The framework defines a large class of penalized regression estimators, encompassing many existing methods. An efficient…

Methodology · Statistics 2019-03-13 Asad Haris , Noah Simon , Ali Shojaie

In this paper we develop inference for high dimensional linear models, with serially correlated errors. We examine Lasso under the assumption of strong mixing in the covariates and error process, allowing for fatter tails in their…

Econometrics · Economics 2023-10-05 Ilias Chronopoulos , Katerina Chrysikou , George Kapetanios

Interactive response time is important in analytical pipelines for users to explore a sufficient number of possibilities and make informed business decisions. We consider a forecasting pipeline with large volumes of high-dimensional time…

Databases · Computer Science 2021-01-19 Shuyuan Yan , Bolin Ding , Wei Guo , Jingren Zhou , Zhewei Wei , Xiaowei Jiang , Sheng Xu

The Generalized Linear Model (GLM) for the Gamma distribution (glmGamma) is widely used in modeling continuous, non-negative and positive-skewed data, such as insurance claims and survival data. However, model selection for GLM depends on…

Methodology · Statistics 2018-04-24 Xin Chen , Aleksandr Y. Aravkin , R. Douglas Martin

We propose a neural hybrid model consisting of a linear model defined on a set of features computed by a deep, invertible transformation (i.e. a normalizing flow). An attractive property of our model is that both p(features), the density of…

Machine Learning · Computer Science 2019-05-30 Eric Nalisnick , Akihiro Matsukawa , Yee Whye Teh , Dilan Gorur , Balaji Lakshminarayanan

This paper aims to review the methodology behind the generalized linear models which are used in analyzing the actuarial situations instead of the ordinary multiple linear regression. We introduce how to assess the adequacy of the model…

Statistical Finance · Quantitative Finance 2016-11-09 Murwan H. M. A. Siddig

Kelly (2007, hereafter K07) described an efficient algorithm, using Gibbs sampling, for performing linear regression in the fairly general case where non-zero measurement errors exist for both the covariates and response variables, where…

Instrumentation and Methods for Astrophysics · Physics 2016-02-17 Adam B. Mantz

Additive models and generalized additive models are effective semiparametric tools for multidimensional data. In this article we propose an online smoothing backfitting method for generalized additive models with local polynomial smoothers.…

Statistics Theory · Mathematics 2021-12-20 Ying Yang , Fang Yao

This paper considers generalized linear models using rule-based features, also referred to as rule ensembles, for regression and probabilistic classification. Rules facilitate model interpretation while also capturing nonlinear dependences…

Machine Learning · Computer Science 2019-06-06 Dennis Wei , Sanjeeb Dash , Tian Gao , Oktay Günlük

We propose a finite sample based predictor for estimated linear one dimensional time series models and compute the associated total forecasting error. The expression for the error that we present takes into account the estimation error.…

Statistics Theory · Mathematics 2012-09-20 Lyudmila Grigoryeva , Juan-Pablo Ortega

Generalized Labeled Multi-Bernoulli (GLMB) densities arise in a host of multi-object system applications analogous to Gaussians in single-object filtering. However, computing the GLMB filtering density requires solving NP-hard problems. To…

Machine Learning · Statistics 2023-12-29 Changbeom Shim , Ba-Tuong Vo , Ba-Ngu Vo , Jonah Ong , Diluka Moratuwage

We describe the \proglang{R} package \pkg{glmmrBase} and an extension \pkg{glmmrOptim}. \pkg{glmmrBase} provides a flexible approach to specifying, fitting, and analysing generalised linear mixed models. We use an object-orientated class…

Computation · Statistics 2024-03-15 Samuel I. Watson

Existing computationally efficient methods for penalized likelihood GAM fitting employ iterative smoothness selection on working linear models (or working mixed models). Such schemes fail to converge for a non-negligible proportion of…

Methodology · Statistics 2015-11-13 Simon N. Wood

This paper presents a comprehensive algorithm for fitting generative models whose likelihood, moments, and other quantities typically used for inference are not analytically or numerically tractable. The proposed method aims to provide a…

Methodology · Statistics 2025-11-12 Guido Masarotto

We describe a Big Data-practical, SQL-implementable algorithm for efficiently determining connected components for graph data stored in a Massively Parallel Processing (MPP) relational database. The algorithm described is a linear-space,…

Data Structures and Algorithms · Computer Science 2019-10-18 Harald Bögeholz , Michael Brand , Radu-Alexandru Todor