English
Related papers

Related papers: Interpretable Generalized Additive Models for Data…

200 papers

The functional generalized additive model (FGAM) was recently proposed in McLean et al. (2013) as a more flexible alternative to the common functional linear model (FLM) for regressing a scalar on functional covariates. In this paper, we…

Methodology · Statistics 2017-05-29 Mathew W. McLean , Fabian Scheipl , Giles Hooker , Sonja Greven , David Ruppert

Recent years have seen important advances in the building of interpretable models, machine learning models that are designed to be easily understood by humans. In this work, we show that large language models (LLMs) are remarkably good at…

Machine Learning · Computer Science 2024-02-23 Sebastian Bordt , Ben Lengerich , Harsha Nori , Rich Caruana

The generalized partially linear additive model (GPLAM) is a flexible and interpretable approach to building predictive models. It combines features in an additive manner, allowing each to have either a linear or nonlinear effect on the…

Methodology · Statistics 2018-03-29 Yin Lou , Jacob Bien , Rich Caruana , Johannes Gehrke

This paper reviews recent advances in missing data research using graphical models to represent multivariate dependencies. We first examine the limitations of traditional frameworks from three different perspectives: \textit{transparency,…

Methodology · Statistics 2019-11-15 Karthika Mohan , Judea Pearl

There are proposals that extend the classical generalized additive models (GAMs) to accommodate high-dimensional data ($p>>n$) using group sparse regularization. However, the sparse regularization may induce excess shrinkage when estimating…

Methodology · Statistics 2022-07-07 Boyi Guo , Byron C. Jaeger , A. K. M. Fazlur Rahman , D. Leann Long , Nengjun Yi

Generalized Additive Models (GAMs) are commonly considered *interpretable* within the ML community, as their structure makes the relationship between inputs and outputs relatively understandable. Therefore, it may seem natural to…

Machine Learning · Computer Science 2026-02-06 Shahaf Bassan , Michal Moshkovitz , Guy Katz

Generalized Additive Models (GAMs) have quickly become the leading choice for inherently-interpretable machine learning. However, unlike uninterpretable methods such as DNNs, they lack expressive power and easy scalability, and are hence…

Machine Learning · Computer Science 2022-10-20 Abhimanyu Dubey , Filip Radenovic , Dhruv Mahajan

Feature selection is a critical component in predictive analytics that significantly affects the prediction accuracy and interpretability of models. Intrinsic methods for feature selection are built directly into model learning, providing a…

Machine Learning · Computer Science 2024-03-19 Theodor Stoecker , Nico Hambauer , Patrick Zschech , Mathias Kraus

Generalized additive models (GAMs) are favored in many regression and binary classification problems because they are able to fit complex, nonlinear functions while still remaining interpretable. In the first part of this paper, we…

Machine Learning · Computer Science 2019-06-03 Xuezhou Zhang , Sarah Tan , Paul Koch , Yin Lou , Urszula Chajewska , Rich Caruana

Missing data is common in applied data science, particularly for tabular data sets found in healthcare, social sciences, and natural sciences. Most supervised learning methods only work on complete data, thus requiring preprocessing such as…

Machine Learning · Computer Science 2023-10-25 Mike Van Ness , Tomas M. Bosschieter , Roberto Halpin-Gregorio , Madeleine Udell

Missing values are a fundamental problem in data science. Many datasets have missing values that must be properly handled because the way missing values are treated can have large impact on the resulting machine learning model. In medical…

Machine Learning · Computer Science 2023-04-25 Zhi Chen , Sarah Tan , Urszula Chajewska , Cynthia Rudin , Rich Caruana

We propose to learn latent graphical models when data have mixed variables and missing values. This model could be used for further data analysis, including regression, classification, ranking etc. It also could be used for imputing missing…

Methodology · Statistics 2015-11-17 Xiao Li , Jinzhu Jia , Yuan Yao

Generalized additive models (GAMs) are flexible non-linear regression models, which can be fitted efficiently using the approximate Bayesian methods provided by the mgcv R package. While the GAM methods provided by mgcv are based on the…

Methodology · Statistics 2020-07-08 Matteo Fasiolo , Simon N. Wood , Margaux Zaffran , Raphaël Nedellec , Yannig Goude

Real-world datasets often have missing values associated with complex generative processes, where the cause of the missingness may not be fully observed. This is known as missing not at random (MNAR) data. However, many imputation methods…

Machine Learning · Computer Science 2021-10-29 Chao Ma , Cheng Zhang

We propose an l1-regularized likelihood method for estimating the inverse covariance matrix in the high-dimensional multivariate normal model in presence of missing data. Our method is based on the assumption that the data are missing at…

Methodology · Statistics 2012-02-28 Nicolas Städler , Peter Bühlmann

Missing values are unavoidable in many applications of machine learning and present challenges both during training and at test time. When variables are missing in recurring patterns, fitting separate pattern submodels have been proposed as…

Machine Learning · Computer Science 2023-11-27 Lena Stempfle , Ashkan Panahi , Fredrik D. Johansson

Exploring missing data in attributed graphs introduces unique challenges beyond those found in tabular datasets. In this work, we extend the taxonomy for missing data mechanisms to attributed graphs by proposing GAMM (Graph Attributes…

Machine Learning · Computer Science 2026-02-10 Richard Serrano , Baptiste Jeudy , Charlotte Laclau , Christine Largeron

We introduce GAMSEL (Generalized Additive Model Selection), a penalized likelihood approach for fitting sparse generalized additive models in high dimension. Our method interpolates between null, linear and additive models by allowing the…

Machine Learning · Statistics 2015-06-18 Alexandra Chouldechova , Trevor Hastie

Missing data can pose a challenge for machine learning (ML) modeling. To address this, current approaches are categorized into feature imputation and label prediction and are primarily focused on handling missing data to enhance ML…

Machine Learning · Computer Science 2023-09-19 Laixin Xie , Yang Ouyang , Longfei Chen , Ziming Wu , Quan Li

Interpretability is one of the considerations when applying machine learning to high-stakes fields such as healthcare that involve matters of life safety. Generalized Additive Models (GAMs) enhance interpretability by visualizing shape…

Machine Learning · Computer Science 2025-10-06 Fumin Wang