English
Related papers

Related papers: Application of optimal data-based binning method t…

200 papers

We consider a simulation optimization problem for a context-dependent decision-making. A Gaussian mixture model is proposed to capture the performance clustering phenomena of context-dependent designs. Under a Bayesian framework, we develop…

Methodology · Statistics 2020-12-15 Haidong Li , Henry Lam , Yijie Peng

Efficient and accurate estimation of multivariate empirical probability distributions is fundamental to the calculation of information-theoretic measures such as mutual information and transfer entropy. Common techniques include variations…

Information Theory · Computer Science 2023-03-23 Z. Keskin

In this paper we present a fast scalable heuristic for bin packing that partitions the given problem into identical sub-problems of constant size and solves these constant size sub-problems by considering only a constant number of bin…

Data Structures and Algorithms · Computer Science 2019-04-30 Srikrishnan Divakaran

Predictions are often probabilities; e.g., a prediction could be for precipitation tomorrow, but with only a 30% chance. Given such probabilistic predictions together with the actual outcomes, "reliability diagrams" help detect and diagnose…

Statistics Theory · Mathematics 2022-11-15 Imanol Arrieta-Ibarra , Paman Gujral , Jonathan Tannen , Mark Tygert , Cherie Xu

In this paper, we determine which non-random sampling of fixed size gives the best linear predictor of the sum of a finite spatial population. We employ different multiscale superpopulation models and use the minimum mean-squared error as…

Statistics Theory · Mathematics 2007-06-13 Vinay J. Ribeiro , Rudolf H. Riedi , Richard G. Baraniuk

A limitation of many clustering algorithms is the requirement to tune adjustable parameters for each application or even for each dataset. Some techniques require an \emph{a priori} estimate of the number of clusters while density-based…

Methodology · Statistics 2016-05-20 Jeremy F. Magland , Alex H. Barnett

Despite compelling theoretical arguments, the use of clusters as cosmological probes is, in practice, frequently questioned because of the many uncertainties impinging on cluster mass estimates. Our aim is to develop a fully self-consistent…

Cosmology and Nongalactic Astrophysics · Physics 2017-11-29 M. Pierre , A. Valotti , L. Faccioli , N. Clerc , R. Gastaud , E. Koulouridis , F. Pacaud

A LiDAR Statistical Barnes Objective Analysis (LiSBOA) for optimal design of LiDAR scans and retrieval of the velocity statistical moments is proposed. The LiSBOA represents an adaptation of the classical Barnes scheme for the statistical…

Fluid Dynamics · Physics 2021-09-06 Stefano Letizia , Lu Zhan , Giacomo Valerio Iungo

When nonlinear measures are estimated from sampled temporal signals with finite-length, a radius parameter must be carefully selected to avoid a poor estimation. These measures are generally derived from the correlation integral which…

Methodology · Statistics 2024-01-09 Johan Medrano , Abderrahmane Kheddar , Annick Lesne , Sofiane Ramdani

We present a generic dynamic programming method to compute the optimal clustering of $n$ scalar elements into $k$ pairwise disjoint intervals. This case includes 1D Euclidean $k$-means, $k$-medoids, $k$-medians, $k$-centers, etc. We extend…

Information Theory · Computer Science 2014-05-27 Frank Nielsen , Richard Nock

The last decade has seen an explosion in data sources available for the monitoring and prediction of environmental phenomena. While several inferential methods have been developed that make predictions on the underlying process by combining…

Methodology · Statistics 2023-03-06 Eun-Hye Yoo , Andrew Zammit-Mangion , Michael G. Chipeta

In this paper, we outline the use of Mixture Models in density estimation of large astronomical databases. This method of density estimation has been known in Statistics for some time but has not been implemented because of the large…

Astrophysics · Physics 2007-05-23 A. J. Connolly , C. Genovese , A. W. Moore , R. C. Nichol , J. Schneider , L. Wasserman

Statistical models for describing the probability distribution over the states of biological systems are commonly used for dimensional reduction. Among these models, pairwise models are very attractive in part because they can be fit using…

Quantitative Methods · Quantitative Biology 2009-11-30 Yasser Roudi , Erik Aurell , John Hertz

Distributed data mining techniques and mainly distributed clustering are widely used in the last decade because they deal with very large and heterogeneous datasets which cannot be gathered centrally. Current distributed clustering…

Databases · Computer Science 2018-02-02 Malika Bendechache , M-Tahar Kechadi

We study graph estimation and density estimation in high dimensions, using a family of density estimators based on forest structured undirected graphical models. For density estimation, we do not assume the true distribution corresponds to…

Machine Learning · Statistics 2010-10-21 Han Liu , Min Xu , Haijie Gu , Anupam Gupta , John Lafferty , Larry Wasserman

This paper presents a comparative analysis of different optimization techniques for the K-means algorithm in the context of big data. K-means is a widely used clustering algorithm, but it can suffer from scalability issues when dealing with…

Machine Learning · Computer Science 2024-05-21 Ravil Mussabayev , Rustam Mussabayev

Line transect sampling is a method used to estimate wildlife populations, with the resulting data often grouped in intervals. Estimating the density from grouped data can be challenging. In this paper we propose a kernel density estimator…

Applications · Statistics 2010-11-10 Woncheol Jang , Ji Meng Loh

Objective: The main objective of this paper is to construct a distributed clustering algorithm based upon spatial data correlation among sensor nodes and perform data accuracy for each distributed cluster at their respective cluster head…

Networking and Internet Architecture · Computer Science 2011-08-15 Jyotirmoy Karjee , H. S Jamadagni

The impact of an extreme climate event depends strongly on its geographical scale. Max-stable processes can be used for the statistical investigation of climate extremes and their spatial dependencies on a continuous area. Most existing…

Methodology · Statistics 2023-06-14 Justus Contzen , Thorsten Dickhaus , Gerrit Lohmann

In general, comprehension of any type of complex system depends on the resolution used to examine the phenomena occurring within it. However, identifying a priori, for example, the best time frequencies/scales to study a certain system…

Data Analysis, Statistics and Probability · Physics 2025-12-01 Domiziano Doria , Simone Martino , Matteo Becchi , Giovanni M. Pavan