English
Related papers

Related papers: Determining the minimum embedding dimension for st…

200 papers

Time irreversibility, defined as the lack of invariance of the statistical properties of a system or time series under the operation of time reversal, has received an increasing attention during the last decades, thanks to the information…

Data Analysis, Statistics and Probability · Physics 2021-11-03 Massimiliano Zanin

We apply two variations of the principle of Minimum Cross Entropy (the Kullback information measure) to fit parameterized probability density models to observed data densities. For an array beamforming problem with P incident narrowband…

Information Theory · Computer Science 2008-06-24 Cheng-Yuan Liou , Bruce R. Musicus

Choosing a nonlinear state estimator for an application often involves a trade-off between local optimality (such as provided by an extended Kalman filter) and (almost-/semi-) global asymptotic stability (such as provided by a constructive…

Systems and Control · Electrical Eng. & Systems 2024-09-16 Pieter van Goor , Robert Mahony

In many problems in data mining and machine learning, data items that need to be clustered or classified are not points in a high-dimensional space, but are distributions (points on a high dimensional simplex). For distributions, natural…

Data Structures and Algorithms · Computer Science 2007-07-13 Sudipto Guha , Andrew McGregor , Suresh Venkatasubramanian

The real-life data have a complex and non-linear structure due to their nature. These non-linearities and the large number of features can usually cause problems such as the empty-space phenomenon and the well-known curse of dimensionality.…

Machine Learning · Computer Science 2025-03-13 Kadir Özçoban , Murat Manguoğlu , Emrullah Fatih Yetkin

Complex, high-dimensional data is ubiquitous across many scientific disciplines, including machine learning, biology, and the social sciences. One of the primary methods of visualizing these datasets is with two-dimensional scatter plots…

Machine Learning · Computer Science 2025-10-13 Kiran Smelser , Kaviru Gunaratne , Jacob Miller , Stephen Kobourov

We study the approximation of arbitrary distributions $P$ on $d$-dimensional space by distributions with log-concave density. Approximation means minimizing a Kullback--Leibler-type functional. We show that such an approximation exists if…

Statistics Theory · Mathematics 2011-10-17 Lutz Duembgen , Richard Samworth , Dominic Schuhmacher

Reconstruction of a dynamical system from a time series requires the selection of two parameters, the embedding dimension $d_e$ and the embedding lag $\tau$. Many competing criteria to select these parameters exist, and all are heuristic.…

Data Analysis, Statistics and Probability · Physics 2009-11-10 Michael Small , Chi K. Tse

The accurate detection of small deviations in given density matrices is important for quantum information processing. Here we propose a new method based on the concept of data mining. We demonstrate that the proposed method can more…

Quantum Physics · Physics 2015-06-18 Satoshi Hara , Takafumi Ono , Ryo Okamoto , Takashi Washio , Shigeki Takeuchi

The Kullback-Leibler (KL) divergence is frequently used in data science. For discrete distributions on large state spaces, approximations of probability vectors may result in a few small negative entries, rendering the KL divergence…

A method for selecting a graphical model for $p$-vector-valued stationary Gaussian time series was recently proposed by Matsuda and uses the Kullback-Leibler divergence measure to define a test statistic. This statistic was used in a…

Applications · Statistics 2023-07-19 R. J. Wolstenholme , A. T. Walden

Neural network emulators are widely used in astrophysics and cosmology to approximate complex simulations inside Bayesian inference loops. Ad hoc rules of thumb are often used to justify the emulator accuracy required for reliable posterior…

Cosmology and Nongalactic Astrophysics · Physics 2026-02-25 H. T. J. Bevins , T. Gessey-Jones , W. J. Handley

The arrow of time can be quantified through the Kullback-Leibler divergence ($D_{KL}$) between the distributions of forward and reverse trajectories in a system. Many approaches to estimate this rely on specific models, but the use of…

Statistical Mechanics · Physics 2024-12-30 Trevor GrandPre , Gianluca Teza , William Bialek

The random equivalent sampling (RES) is a well-known sampling technique that can be used to capture a high-speed repetitive waveform with low sampling rate. In this paper, the feasibility of spectrum-blind multiband signal reconstruction…

Instrumentation and Detectors · Physics 2017-01-10 Yijiu Zhao , Li Wang , Houjun Wang , Changjian Liu

In the analysis of complex, nonlinear time series, scientists in a variety of disciplines have relied on a time delayed embedding of their data, i.e. attractor reconstruction. The process has focused primarily on heuristic and empirical…

Chaotic Dynamics · Physics 2015-06-26 Louis M. Pecora , Linda Moniz , Jonathan Nichols , Thomas L. Carroll

Low-dimensional embeddings are essential for machine learning tasks involving graphs, such as node classification, link prediction, community detection, network visualization, and network compression. Although recent studies have identified…

Machine Learning · Computer Science 2025-03-04 Nikolaos Nakis , Niels Raunkjær Holm , Andreas Lyhne Fiehn , Morten Mørup

The distance metric plays an important role in nearest neighbor (NN) classification. Usually the Euclidean distance metric is assumed or a Mahalanobis distance metric is optimized to improve the NN performance. In this paper, we study the…

Machine Learning · Statistics 2007-06-26 Bharath K. Sriperumbudur , Gert R. G. Lanckriet

Although recovering an Euclidean distance matrix from noisy observations is a common problem in practice, how well this could be done remains largely unknown. To fill in this void, we study a simple distance matrix estimate based upon the…

Machine Learning · Statistics 2014-09-18 Luwan Zhang , Grace Wahba , Ming Yuan

This work presents a novel framework for time series analysis using entropic measures based on the kernel density estimate (KDE) of the time series' Takens' embeddings. Using this framework we introduce two distinct analytical tools: (1) a…

Information Theory · Computer Science 2025-12-05 Audun Myers , Bill Kay , Iliana Alvarez , Michael Hughes , Cameron Mackenzie , Carlos Ortiz Marrero , Emily Ellwein , Erik Lentz

Recent medical image reconstruction techniques focus on generating high-quality medical images suitable for clinical use at the lowest possible cost and with the fewest possible adverse effects on patients. Recent works have shown…

Image and Video Processing · Electrical Eng. & Systems 2025-01-07 Shijun Liang , Anish Lahiri , Saiprasad Ravishankar