English
Related papers

Related papers: Using an expert deviation carrying the knowledge o…

200 papers

In recent years, Deep-Learning Earth System Models (DL-ESMs) have emerged as promising, computationally efficient complements to traditional Earth system models. Here, we present an evaluation framework for testing DL-ESMs from a…

Atmospheric and Oceanic Physics · Physics 2026-05-20 Giuliana Pallotta , Shiheng Duan , Céline Bonfils , Jiwoo Lee , Seth Goodnight , Paul Ullrich

This study tackles the efficient estimation of Kullback-Leibler (KL) Divergence in Dirichlet Mixture Models (DMM), crucial for clustering compositional data. Despite the significance of DMMs, obtaining an analytically tractable solution for…

Machine Learning · Statistics 2024-03-20 Samyajoy Pal , Christian Heumann

We propose a new method to test the effectiveness of a spatial point process forecast based on a log-likelihood score for predicted point density and the information gain for events that actually occurred in the test period. The method…

Data Analysis, Statistics and Probability · Physics 2010-11-24 Yan Y. Kagan

The EM algorithm is a widely used methodology for penalized likelihood estimation. Provable monotonicity and convergence are the hallmarks of the EM algorithm and these properties are well established for smooth likelihood and smooth…

Computation · Statistics 2011-06-02 Stéphane Chrétien , Alfred Hero , Hervé Perdry

We examine the integrated squared difference, also known as the L2 distance (L2D), between two probability densities. Such a distance metric allows for comparison of differences between pairs of distributions or changes in a distribution…

Methodology · Statistics 2019-06-03 George Shan , Mark J. van der Laan

Climate model evaluation plays a crucial role in ensuring the accuracy of climatological predictions. However, existing statistical evaluation methods often overlook time misalignment of events in a system's evolution, which can lead to a…

Methodology · Statistics 2025-04-29 Robert C. Garrett , Trevor Harris , Zhuo Wang , Bo Li

Clustering is widely used in unsupervised learning to find homogeneous groups of observations within a dataset. However, clustering mixed-type data remains a challenge, as few existing approaches are suited for this task. This study…

Machine Learning · Statistics 2025-11-26 Badih Ghattas , Alvaro Sanchez San-Benito

A recurrent question in climate risk analysis is determining how climate change will affect heavy precipitation patterns. Dividing the globe into homogeneous sub-regions should improve the modelling of heavy precipitation by inferring…

Methodology · Statistics 2021-11-02 Philomène Le Gall , Anne-Catherine Favre , Philippe Naveau , Alexandre Tuel

Clustering algorithms have long been the topic of research, representing the more popular side of unsupervised learning. Since clustering analysis is one of the best ways to find some clarity and structure within raw data, this paper…

Machine Learning · Computer Science 2025-11-25 Naitik Gada

Clustering is one of the most fundamental tasks in machine learning, and the k-means clustering algorithm is perhaps one of the most widely used clustering algorithms. However, it suffers from several limitations, such as sensitivity to…

Quantum Physics · Physics 2026-04-10 Syed M. Abdullah , Alisha Baba , Muhammad Siddique , Muhammad Faryad

Different distance measures have been used for efficiently predicting software faults at early stages of software development. One stereotyped approach for software fault prediction due to its computational efficiency is K-means clustering,…

Software Engineering · Computer Science 2014-12-01 Deepinder Kaur

We consider the problem of clustering noisy finite-length observations of stationary ergodic random processes according to their generative models without prior knowledge of the model statistics and the number of generative models. Two…

Machine Learning · Computer Science 2017-09-29 Michael Tschannen , Helmut Bölcskei

The development of robust Early Warning Signals (EWS) is necessary to quantify the risk of crossing tipping points in the present-day climate change. Classically, EWS are statistical measures based on time series of climate state variables,…

Atmospheric and Oceanic Physics · Physics 2025-03-25 Laure Moinat , Jérôme Kasparian , Maura Brunetti

In location-based resource allocation scenarios, the distances between each individual and the facility are desired to be approximately equal, thereby ensuring fairness. Individually fair clustering is often employed to achieve the…

Machine Learning · Computer Science 2024-06-25 Shengkun Zhu , Jinshan Zeng , Yuan Sun , Sheng Wang , Xiaodong Li , Zhiyong Peng

Assignment methods are at the heart of many algorithms for unsupervised learning and clustering - in particular, the well-known K-means and Expectation-Maximization (EM) algorithms. In this work, we study several different methods of…

Machine Learning · Computer Science 2013-02-08 Michael Kearns , Yishay Mansour , Andrew Y. Ng

Existing approaches remain largely constrained by traditional distance metrics, limiting their effectiveness in handling random data. In this work, we introduce the first k-means variant in the literature that operates within a…

In this paper, we outline the use of Mixture Models in density estimation of large astronomical databases. This method of density estimation has been known in Statistics for some time but has not been implemented because of the large…

Astrophysics · Physics 2007-05-23 A. J. Connolly , C. Genovese , A. W. Moore , R. C. Nichol , J. Schneider , L. Wasserman

The conditional extremes (CE) framework has proven useful for analysing the joint tail behaviour of random vectors. However, when applied across many locations or variables, it can be difficult to interpret or compare the resulting extremal…

Methodology · Statistics 2025-10-24 Patrick O'Toole , Christian Rohrbeck , Jordan Richards

In the field of psychopathology, Ecological Momentary Assessment (EMA) methodological advancements have offered new opportunities to collect time-intensive, repeated and intra-individual measurements. This way, a large amount of data has…

Machine Learning · Computer Science 2022-12-05 Mandani Ntekouli , Gerasimos Spanakis , Lourens Waldorp , Anne Roefs

In this paper an approach based on expectation maximization (EM) clustering to find the climate regions and a support vector machine to build a predictive model for each of these regions is proposed. To minimize the biases in the…

Machine Learning · Statistics 2015-09-24 Naresh Kumar Mallenahalli