English
Related papers

Related papers: Integrating Complex Covariate Transformations in G…

200 papers

Generalized additive models (GAMs) offer interpretability through independent univariate feature effects but underfit when interactions are present in data. GA$^2$Ms add selected pairwise interactions which improves accuracy, but sacrifices…

Multiple generalized additive models (GAMs) are a type of distributional regression wherein parameters of probability distributions depend on predictors through smooth functions, with selection of the degree of smoothness via $L_2$…

Machine Learning · Statistics 2018-09-26 Yousra El-Bachir , Anthony C. Davison

Generalized Additive Models (GAMs) balance predictive accuracy and interpretability, but manually configuring their structure is challenging. We propose using the multi-objective genetic algorithm NSGA-II to automatically optimize GAMs,…

Machine Learning · Computer Science 2026-02-19 Kaaustaaub Shankar , Kelly Cohen

We present a novel Bayesian framework to decompose the posterior predictive variance in a fitted Generalized Additive Mixed Model (GAMM) into explained and unexplained components. This decomposition enables a rigorous definition of Bayesian…

Methodology · Statistics 2024-10-21 Abdollah Jalilian , Aki Vehtari , Luigi Sedda

Generalized additive models (GAMs) have become a leading modelclass for interpretable machine learning. However, there are many algorithms for training GAMs, and these can learn different or even contradictory models, while being equally…

Machine Learning · Computer Science 2021-06-08 Chun-Hao Chang , Sarah Tan , Ben Lengerich , Anna Goldenberg , Rich Caruana

Deployment of machine learning models in real high-risk settings (e.g. healthcare) often depends not only on the model's accuracy but also on its fairness, robustness, and interpretability. Generalized Additive Models (GAMs) are a class of…

Machine Learning · Computer Science 2022-03-17 Chun-Hao Chang , Rich Caruana , Anna Goldenberg

This article introduces the pammtools package, which facilitates data transformation, estimation and interpretation of Piece-wise exponential Additive Mixed Models. A special focus is on time-varying effects and cumulative effects of…

Computation · Statistics 2018-06-05 Andreas Bender , Fabian Scheipl

Sparse generalized additive models (GAMs) are an extension of sparse generalized linear models which allow a model's prediction to vary non-linearly with an input variable. This enables the data analyst build more accurate models,…

Methodology · Statistics 2020-01-15 J. Kenneth Tay , Robert Tibshirani

Regression problems with time-series predictors are common in banking and many other areas of application. In this paper, we use multi-head attention networks to develop interpretable features and use them to achieve good predictive…

Machine Learning · Computer Science 2022-05-26 Tianjie Wang , Jie Chen , Joel Vaughan , Vijayan N. Nair

One fundamental statistical question for research areas such as precision medicine and health disparity is about discovering effect modification of treatment or exposure by observed covariates. We propose a semiparametric framework for…

Methodology · Statistics 2020-08-04 Muxuan Liang , Menggang Yu

Statistical integration of diverse data sources is an essential step in the building of generalizable prediction tools, especially in precision health. The invariant features model is a new paradigm for multi-source data integration which…

Methodology · Statistics 2025-03-05 Parker Knight , Ndey Isatou Jobe , Rui Duan

Modeling the time-varying covariance structures of high-dimensional variables is critical across diverse scientific and industrial applications; however, existing approaches exhibit notable limitations in either modeling flexibility or…

Methodology · Statistics 2026-01-21 Taehee Lee , Jun S. Liu

Generalized additive models (GAMs) are a commonly used, flexible framework applied to many problems in statistical ecology. GAMs are often considered to be a purely frequentist framework (`generalized linear models with wiggly bits'),…

Methodology · Statistics 2025-01-27 David L. Miller

Factorization machine (FM) is an effective model for feature-based recommendation which utilizes inner product to capture second-order feature interactions. However, one of the major drawbacks of FM is that it couldn't capture complex…

Machine Learning · Computer Science 2024-04-03 Enneng Yang , Xin Xin , Li Shen , Guibing Guo

Statistical learning additions to physically derived mathematical models are gaining traction in the literature. A recent approach has been to augment the underlying physics of the governing equations with data driven Bayesian statistical…

Methodology · Statistics 2022-05-25 Connor Duffin , Edward Cripps , Thomas Stemler , Mark Girolami

Structural equation modeling (SEM) is a prevalent approach for studying constructs.Traditionally, these constructs are modeled as reflectively measured latent variables - common factors that account for the variance-covariance structure of…

Methodology · Statistics 2026-04-02 Tamara Schamberger , Florian Schuberth , Jörg Henseler , Yves Rosseel

Normalizing flows have shown great success as general-purpose density estimators. However, many real world applications require the use of domain-specific knowledge, which normalizing flows cannot readily incorporate. We propose…

Machine Learning · Statistics 2022-03-17 Gianluigi Silvestri , Emily Fertig , Dave Moore , Luca Ambrogioni

Before any publication, data analysis of high-energy physics experiments must be validated. This validation is granted only if a perfect understanding of the data and the analysis process is demonstrated. Therefore, physicists prefer using…

Machine Learning · Computer Science 2019-12-18 Noëlie Cherrier , Maxime Defurne , Jean-Philippe Poli , Franck Sabatié

Variational regression methods are an increasingly popular tool for their efficient estimation of complex. Given the mixed model representation of penalized effects, additive regression models with smoothed effects and scalar-on-function…

Methodology · Statistics 2024-06-13 Mark J. Meyer , Junyi Wei

This study introduces a framework for the forecasting, reconstruction and feature engineering of multivariate processes along with its renewable energy applications. We integrate derivative-free optimization with an ensemble of…

Machine Learning · Computer Science 2020-03-03 Mohammad Pirhooshyaran , Katya Scheinberg , Lawrence V. Snyder