English
Related papers

Related papers: Fast leave-one-cluster-out cross-validation using …

200 papers

Credit risk scoring must support high-stakes lending decisions where data distributions change over time, probability estimates must be reliable, and group-level fairness is required. While modern machine learning models improve default…

Risk Management · Quantitative Finance 2026-03-10 Srikumar Nayak

We propose to bridge the gap between semi-supervised and unsupervised image recognition with a flexible method that performs well for both generalized category discovery (GCD) and image clustering. Despite the overlap in motivation between…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Gihan Jayatilaka , Abhinav Shrivastava , Matthew Gwilliam

In multivariate extreme value analysis, the estimation of the dependence structure in extremes is demanding, especially in the context of high-dimensional data. Therefore, a common approach is to reduce the model dimension by considering…

Methodology · Statistics 2025-07-08 Lucas Butsch , Vicky Fasen-Hartmann

Network Intrusion Detection Systems (NIDS) are a fundamental tool in cybersecurity. Their ability to generalize across diverse networks is a critical factor in their effectiveness and a prerequisite for real-world applications. In this…

Cryptography and Security · Computer Science 2025-09-18 Marco Cantone , Claudio Marrocco , Alessandro Bria

The semiparametric estimation approach, which includes inverse-probability-weighted and doubly robust estimation using propensity scores, is a standard tool in causal inference, and it is rapidly being extended in various directions. On the…

Methodology · Statistics 2022-12-29 Takamichi Baba , Yoshiyuki Ninomiya

In statistical learning, models are classified as regular or singular depending on whether the mapping from parameters to probability distributions is injective. Most models with hierarchical structures or latent variables are singular, for…

Machine Learning · Statistics 2025-11-26 Naoki Hayashi , Takuro Kutsuna , Sawa Takamuku

The Akaike information criterion (AIC) is commonly used to select a logistic regression model for optimal prediction of a binary response by a specified family of models. It however lacks a convincing method of prescribing a proper family…

Methodology · Statistics 2018-04-10 Jiun-Wei Liou , Michelle Liou , Philip E. Cheng , Chin-Chiuan Lin

We define the notion of a well-clusterable data set combining the point of view of the objective of $k$-means clustering algorithm (minimising the centric spread of data elements) and common sense (clusters shall be separated by gaps). We…

Machine Learning · Computer Science 2020-04-07 Mieczysław A. Kłopotek

Model selection is a pivotal process in the quantitative sciences, where researchers must navigate between numerous candidate models of varying complexity. Traditional information criteria, such as the corrected Akaike Information Criterion…

Quantitative Methods · Quantitative Biology 2025-12-16 Jakob Vanhoefer , Antonia Körner , Domagoj Doresic , Jan Hasenauer , Dilan Pathirana

The information criterion AIC has been used successfully in many areas of statistical modeling, and since it is derived based on the Taylor expansion of the log-likelihood function and the asymptotic distribution of the maximum likelihood…

Methodology · Statistics 2025-03-12 Genshiro Kitagawa

Claeskens and Hjort (2003) constructed the focused information criterion (FIC) and developed frequentist model averaging methods using maximum likelihood estimators assuming the observations to be independent and identically distributed.…

Statistics Theory · Mathematics 2018-07-24 S. C. Pandhare , T. V. Ramanathan

There are various cluster validity indices used for evaluating clustering results. One of the main objectives of using these indices is to seek the optimal unknown number of clusters. Some indices work well for clusters with different…

Machine Learning · Statistics 2024-01-09 Nathakhun Wiroonsri

In this work, we propose a modified Bayesian Information Criterion (BIC) specifically designed for mixture models and hierarchical structures. This criterion incorporates the determinant of the Hessian matrix of the log-likelihood function,…

In the realm of the model selection context, Akaike's and Schwarz's information criteria, AIC and BIC, have been applied successfully for decades for model order identification. The Efficient Determination Criterion (EDC) is a…

Statistics Theory · Mathematics 2016-07-20 Paulo Angelo Alves Resende , Chang Chung Yu Dorea

In this paper we propose a measure of clustering quality or accuracy that is appropriate in situations where it is desirable to evaluate a clustering algorithm by somehow comparing the clusters it produces with ``ground truth' consisting of…

Machine Learning · Computer Science 2013-01-07 Byron E Dom

Confusion matrices and derived metrics provide a comprehensive framework for the evaluation of model performance in machine learning. These are well-known and extensively employed in the supervised learning domain, particularly…

Machine Learning · Computer Science 2023-04-05 Pablo Andretta Jaskowiak , Ivan Gesteira Costa

Maximum likelihood estimates (MLEs) are asymptotically normally distributed, and this property is used in meta-analyses to test the heterogeneity of estimates, either for a single cluster or for several sub-groups. More recently, MLEs for…

Statistics Theory · Mathematics 2022-02-28 Anthony J. Webster

Clustering is a crucial component of many data mining systems involving the analysis and exploration of various data. Data diversity calls for clustering algorithms to be accurate while providing stable (i.e., deterministic and robust)…

Social and Information Networks · Computer Science 2019-12-19 Artem Lutov , Mourad Khayati , Philippe Cudré-Mauroux

We propose two methods to evaluate the conditional Akaike information (cAI) for nonlinear mixed-effects models with no restriction on cluster size. Method 1 is designed for continuous data and includes formulae for the derivatives of fixed…

Methodology · Statistics 2024-11-22 Nan Zheng , Noel Cadigan , James T. Thorson

Traditional probabilistic methods for the simulation of advection-diffusion equations (ADEs) often overlook the entropic contribution of the discretization, e.g., the number of particles, within associated numerical methods. Many times, the…

Numerical Analysis · Mathematics 2021-06-15 Nhat Thanh Tran , David A. Benson , Michael J. Schmidt , Stephen D. Pankavich