English
Related papers

Related papers: Combining Structural and Unstructured Data: A Topi…

200 papers

We study the high-dimensional linear regression problem with categorical predictors that have many levels. We propose a new estimation approach, which performs model compression via two mechanisms by simultaneously encouraging (a)…

Methodology · Statistics 2026-03-30 Kayhan Behdin , Riade Benbaki , Peter Radchenko , Rahul Mazumder

Conventional survival analysis methods are typically ineffective to characterize heterogeneity in the population while such information can be used to assist predictive modeling. In this study, we propose a hybrid survival analysis method,…

Machine Learning · Computer Science 2024-04-09 Bojian Hou , Hongming Li , Zhicheng Jiao , Zhen Zhou , Hao Zheng , Yong Fan

The property and casualty (P&C) insurance industry faces challenges in developing claim predictive models due to the highly right-skewed distribution of positive claims with excess zeros. To address this, actuarial science researchers have…

Machine Learning · Computer Science 2024-06-19 Banghee So

Multivariate longitudinal data of mixed-type are increasingly collected in many science domains. However, algorithms to cluster this kind of data remain scarce, due to the challenge to simultaneously model the within- and between-time…

Machine Learning · Statistics 2025-09-16 Francesco Amato , Julien Jacques

In this paper, we consider bivariate composite models for modeling jointly different types of claims and their associated costs in a flexible manner. For expository purposes, the Gumbel copula is paired with the composite Weibull-Inverse…

Applications · Statistics 2022-10-12 Girish Aradhye , George Tzougas , Deepesh Bhati

Topic modeling is a widely used technique for uncovering thematic structures from large text corpora. However, most topic modeling approaches e.g. Latent Dirichlet Allocation (LDA) struggle to capture nuanced semantics and contextual…

Information Retrieval · Computer Science 2024-09-25 Satya Kapoor , Alex Gil , Sreyoshi Bhaduri , Anshul Mittal , Rutu Mulkar

How to forecast next year's portfolio-wide credit default rate based on last year's default observations and the current score distribution? A classical approach to this problem consists of fitting a mixture of the conditional score…

Machine Learning · Statistics 2014-11-21 Dirk Tasche

We introduce a novel class of Bayesian mixtures for normal linear regression models which incorporates a further Gaussian random component for the distribution of the predictor variables. The proposed cluster-weighted model aims to…

Methodology · Statistics 2026-05-26 Panagiotis Papastamoulis , Konstantinos Perrakis

We propose a multi-criteria Composite Index Method (CIM) to compare the performance of alternative approaches to solving an optimization problem. The CIM is convenient in those situations when neither approach dominates the other when…

Optimization and Control · Mathematics 2022-12-29 Yulan Bai , Eli Olinick

Variance components estimation and mixed model analysis are central themes in statistics with applications in numerous scientific disciplines. Despite the best efforts of generations of statisticians and numerical analysts, maximum…

Computation · Statistics 2015-09-25 Hua Zhou , Liuyi Hu , Jin Zhou , Kenneth Lange

We present a mixture Poisson model for claims counts in which the number of components in the mixture are estimated by reversible jump MCMC methods.

Applications · Statistics 2010-12-22 Garfield Brown , Steve Brooks , Winston Buckley

Insurance industry is one of the most vulnerable sectors to climate change. Assessment of future number of claims and incurred losses is critical for disaster preparedness and risk management. In this project, we study the effect of…

Applications · Statistics 2021-03-17 Asim K. Dey , Vyacheslav Lyubchich , Yulia R. Gel

This paper develops a two-part finite mixture quantile regression model for semi-continuous longitudinal data. The proposed methodology allows heterogeneity sources that influence the model for the binary response variable, to influence…

Methodology · Statistics 2021-07-19 Antonello Maruotti , Luca Merlo , Lea Petrella

In this paper, we propose a regularized mixture probabilistic model to cluster matrix data and apply it to brain signals. The approach is able to capture the sparsity (low rank, small/zero values) of the original signals by introducing…

Methodology · Statistics 2018-08-07 Xu Gao , Weining Shen , Hernando Ombao

In this article, we present the maximum weighted likelihood estimator (MWLE) for robust estimations of heavy-tail finite mixture models (FMM). This is motivated by the complex distributional phenomena of insurance claim severity data, where…

Methodology · Statistics 2021-08-04 Tsz Chai Fung

The Expectation-Maximization (EM) algorithm is a fundamental tool in unsupervised machine learning. It is often used as an efficient way to solve Maximum Likelihood (ML) estimation problems, especially for models with latent variables. It…

Quantum Physics · Physics 2020-07-08 Iordanis Kerenidis , Alessandro Luongo , Anupam Prakash

Finite mixtures are a flexible modeling tool for irregularly shaped densities and samples from heterogeneous populations. When modeling with mixtures using an exchangeable prior on the component features, the component labels are arbitrary…

Methodology · Statistics 2020-07-10 Deborah Kunkel , Mario Peruggia

This paper is concerned with learning of mixture regression models for individuals that are measured repeatedly. The adjective "unsupervised" implies that the number of mixing components is unknown and has to be determined, ideally by data…

Methodology · Statistics 2018-01-09 Peirong Xu , Heng Peng , Tao Huang

Topic models have become popular tools for dimension reduction and exploratory analysis of text data which consists in observed frequencies of a vocabulary of $p$ words in $n$ documents, stored in a $p\times n$ matrix. The main premise is…

Machine Learning · Statistics 2020-01-23 Xin Bing , Florentina Bunea , Marten Wegkamp

Despite the high importance of grouping in practice, there exists little research on the respective topic. The present work presents a complete framework for grouping and a novel method to optimize model points. Model points are used to…

Risk Management · Quantitative Finance 2019-12-23 Mark Kiermayer , Christian Weiß