English
Related papers

Related papers: Tweedie Gradient Boosting for Extremely Unbalanced…

200 papers

We explore a statistical distribution that can simultaneously model the probability of zero outcome for non-users of health care utilization and continuous costs for users. We compare this distribution to other com- monly used models on…

Applications · Statistics 2019-01-09 Christoph Kurz

Dimension reduction of high-dimensional microbiome data facilitates subsequent analysis such as regression and clustering. Most existing reduction methods cannot fully accommodate the special features of the data such as count-valued and…

Methodology · Statistics 2023-05-02 Tianchen Xu , Ryan T. Demmer , Gen Li

Combining the merits of both denoising diffusion probabilistic models and gradient boosting, the diffusion boosting paradigm is introduced for tackling supervised learning problems. We develop Diffusion Boosted Trees (DBT), which can be…

Machine Learning · Statistics 2024-06-05 Xizewen Han , Mingyuan Zhou

This paper evaluates Machine Learning (ML) in establishing ratemaking for new insurance schemes. To make the evaluation feasible, we established expected indemnities as premiums. Then, we use ML to forecast indemnities using a minimum set…

General Economics · Economics 2022-12-20 Luigi Biagini

This paper proposes a new generalized linear model with the fractional binomial distribution. Zero-inflated Poisson/negative binomial distributions are used for count data with many zeros. To analyze the association of such a count variable…

Methodology · Statistics 2025-08-01 Jeonghwa Lee , Chloe Breece

Researchers in urban and regional studies increasingly deal with spatial data that reflects geographic location and spatial relationships. As a framework for dealing with the unique nature of spatial data, various spatial regression models…

Econometrics · Economics 2025-06-17 Michael Balzer

Pricing actuaries typically operate within the framework of generalized linear models (GLMs). With the upswing of data analytics, our study puts focus on machine learning methods to develop full tariff plans built from both the frequency…

Applications · Statistics 2020-03-04 Roel Henckaerts , Marie-Pier Côté , Katrien Antonio , Roel Verbelen

Traditional power flow methods often adopt certain assumptions designed for passive balanced distribution systems, thus lacking practicality for unbalanced operation. Moreover, their computation accuracy and efficiency are heavily subject…

Systems and Control · Electrical Eng. & Systems 2024-07-30 Sungjoo Chung , Ying Zhang , Zhaoyu Wang , Fei Ding

In this work we apply several Poisson and zero-inflated models for software defect prediction. We apply different functions from several R packages such as pscl, MASS, R2Jags and the recent glmmTMB. We test the functions using the Equinox…

Software Engineering · Computer Science 2019-10-31 Daniel Rodriguez , Javier Dolado , Javier Tuya , Dietmar Pfahl

The Dirichlet-multinomial (DM) distribution plays a fundamental role in modern statistical methodology development and application. Recently, the DM distribution and its variants have been used extensively to model multivariate count data…

Methodology · Statistics 2023-02-27 Matthew D. Koslovsky

The problem of class imbalance along with class-overlapping has become a major issue in the domain of supervised learning. Most supervised learning algorithms assume equal cardinality of the classes under consideration while optimizing the…

Probabilistic prediction aims to compute predictive distributions rather than single point predictions. These distributions enable practitioners to quantify uncertainty, compute risk, and detect outliers. However, most probabilistic methods…

Machine Learning · Computer Science 2024-10-23 Nicolas Beltran-Velez , Alessandro Antonio Grande , Achille Nazaret , Alp Kucukelbir , David Blei

Ambient diffusion is a recently proposed framework for training diffusion models using corrupted data. Both Ambient Diffusion and alternative SURE-based approaches for learning diffusion models from corrupted data resort to approximations…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Giannis Daras , Alexandros G. Dimakis , Constantinos Daskalakis

We present a new variable selection method based on model-based gradient boosting and randomly permuted variables. Model-based boosting is a tool to fit a statistical model while performing variable selection at the same time. A drawback of…

Machine Learning · Statistics 2017-02-16 Janek Thomas , Tobias Hepp , Andreas Mayr , Bernd Bischl

We present a new algorithm for boosting generalized additive models for location, scale and shape (GAMLSS) that allows to incorporate stability selection, an increasingly popular way to obtain stable sets of covariates while controlling the…

Computation · Statistics 2017-05-16 Janek Thomas , Andreas Mayr , Bernd Bischl , Matthias Schmid , Adam Smith , Benjamin Hofner

We present a Bayesian nonparametric model for conditional distribution estimation using Bayesian additive regression trees (BART). The generative model we use is based on rejection sampling from a base model. Typical of BART models, our…

Methodology · Statistics 2022-02-02 Yinpu Li , Antonio R. Linero , Jared S. Murray

With the insight of variance-bias decomposition, we design a new hybrid bagging-boosting algorithm named SBPMT for classification problems. For the boosting part of SBPMT, we propose a new tree model called Probit Model Tree (PMT) as base…

Machine Learning · Statistics 2023-11-07 Tian Qin , Wei-Min Huang

Over an extensive duration, administrators and clinicians have endeavoured to predict Emergency Department (ED) visits with precision, aiming to optimise resource distribution. Despite the proliferation of diverse AI-driven models tailored…

Machine Learning · Computer Science 2025-11-11 Mehdi Neshat , Michael Phipps , Nikhil Jha , Danial Khojasteh , Michael Tong , Amir Gandomi

Standard gradient descent methods yield point estimates with no measure of confidence. This limitation is acute in overparameterized and low-data regimes, where models have many parameters relative to available data and can easily overfit.…

Machine Learning · Computer Science 2025-08-22 Carlos Stein Brito

When random effects are correlated with sample design variables, the usual approach of employing individual survey weights (constructed to be inversely proportional to the unit survey inclusion probabilities) to form a pseudo-likelihood no…

Methodology · Statistics 2021-08-26 Terrance D. Savitsky , Matthew R. Williams