English
Related papers

Related papers: Determining the minimum embedding dimension for st…

200 papers

Time-series analysis is fundamental for modeling and predicting dynamical behaviors from time-ordered data, with applications in many disciplines such as physics, biology, finance, and engineering. Measured time-series data, however, are…

Chaotic Dynamics · Physics 2023-01-11 Arthur N. Montanari , Leandro Freitas , Daniele Proverbio , Jorge Gonçalves

We propose a method to measure real-valued time series irreversibility which combines two differ- ent tools: the horizontal visibility algorithm and the Kullback-Leibler divergence. This method maps a time series to a directed network…

Data Analysis, Statistics and Probability · Physics 2015-05-30 Lucas Lacasa , Ángel M. Núñez , Édgar Roldán , Juan M. R. Parrondo , Bartolo Luque

Network reconstruction, i.e., obtaining network structure from data, is a central theme in systems biology, economics and engineering. In some previous work, we introduced dynamical structure functions as a tool for posing and solving the…

Systems and Control · Computer Science 2012-09-19 Ye Yuan , Guy-Bart Stan , Sean Warnick , Jorge Goncalves

This paper studies the minimal dimension required to embed subset memberships ($m$ elements and ${m\choose k}$ subsets of at most $k$ elements) into vector spaces, denoted as Minimal Embeddable Dimension (MED). The tight bounds of MED are…

Machine Learning · Computer Science 2026-01-30 Zihao Wang , Hang Yin , Lihui Liu , Hanghang Tong , Yangqiu Song , Ginny Wong , Simon See

Kernel methods are widely used for probability estimation by measuring the distribution of low-passed vector distances in reconstructed state spaces. However, the information conveyed by the vector distances that are greater than the…

Data Analysis, Statistics and Probability · Physics 2021-11-09 Wenpo Yao , Wenli Yao , Jun Wang

Data collection is a critical step in statistical inference and data science, and the goal of statistical experimental design (ED) is to find the data collection setup that can provide most information for the inference. In this work we…

Computation · Statistics 2020-07-01 Ziqiao Ao , Jinglai Li

As network data has become ubiquitous in the sciences, there has been growing interest in network models whose structure is driven by latent node-level variables in a (typically low-dimensional) latent geometric space. These "latent…

Statistics Theory · Mathematics 2026-01-12 Roddy Taing , Keith Levin

This paper compares a family of methods for characterizing neural feature selectivity with natural stimuli in the framework of the linear-nonlinear model. In this model, the neural firing rate is a nonlinear function of a small number of…

Neurons and Cognition · Quantitative Biology 2008-01-03 Tatyana O. Sharpee

Estimating the Kullback-Leibler (KL) divergence between random variables is a fundamental problem in statistical analysis. For continuous random variables, traditional information-theoretic estimators scale poorly with dimension and/or…

Machine Learning · Computer Science 2025-10-08 Mikil Foss , Andrew Lamperski

Couplings in complex real-world systems are often nonlinear and scale-dependent. In many cases, it is crucial to consider a multitude of interlinked variables and the strengths of their correlations to adequately fathom the dynamics of a…

Data Analysis, Statistics and Probability · Physics 2022-10-26 Tobias Braun , K. Hauke Kraemer , Norbert Marwan

This paper studies how to find compact state embeddings from high-dimensional Markov state trajectories, where the transition kernel has a small intrinsic rank. In the spirit of diffusion map, we propose an efficient method for learning a…

Machine Learning · Computer Science 2019-10-29 Yifan Sun , Yaqi Duan , Hao Gong , Mengdi Wang

We propose a dimension reduction technique for Bayesian inverse problems with nonlinear forward operators, non-Gaussian priors, and non-Gaussian observation noise. The likelihood function is approximated by a ridge function, i.e., a map…

Probability · Mathematics 2022-01-31 Olivier Zahm , Tiangang Cui , Kody Law , Alessio Spantini , Youssef Marzouk

Selecting an appropriate divergence measure is a critical aspect of machine learning, as it directly impacts model performance. Among the most widely used, we find the Kullback-Leibler (KL) divergence, originally introduced in kinetic…

Mathematical Physics · Physics 2025-07-16 Gennaro Auricchio , Giovanni Brigati , Paolo Giudici , Giuseppe Toscani

The aim of this paper is to investigate the rebinding effect, a phenomenon describing a "short-time memory" which can occur when projecting a Markov process onto a smaller state space. For guaranteeing a correct mapping by the Markov State…

Numerical Analysis · Mathematics 2020-12-04 Susanne Röhl , Marcus Weber , Konstantin Fackeldey

For any finite point set in $D$-dimensional space equipped with the 1-norm, we present random linear embeddings to $k$-dimensional space, with a new metric, having the following properties. For any pair of points from the point set that are…

Probability · Mathematics 2020-11-09 Michael P. Casey

Decentralized state estimation in a communication-constrained sensor network is considered. The exchanged estimates are dimension-reduced to reduce the communication load using a linear mapping to a lower-dimensional space. The mean squared…

Systems and Control · Electrical Eng. & Systems 2023-12-13 Robin Forsling , Fredrik Gustafsson , Zoran Sjanic , Gustaf Hendeby

We propose a kernel-spectral embedding algorithm for learning low-dimensional nonlinear structures from high-dimensional and noisy observations, where the datasets are assumed to be sampled from an intrinsically low-dimensional manifold and…

Machine Learning · Statistics 2023-07-07 Xiucai Ding , Rong Ma

Distance metric learning can be viewed as one of the fundamental interests in pattern recognition and machine learning, which plays a pivotal role in the performance of many learning methods. One of the effective methods in learning such a…

Machine Learning · Computer Science 2020-02-21 Mostafa Razavi Ghods , Mohammad Hossein Moattar , Yahya Forghani

A measurement strategy is developed for a new kind of hypothesis testing. It assigns, with minimum probability of error, the state of a quantum system to one or the other of two complementary subsets of a set of N given non-orthogonal…

Quantum Physics · Physics 2009-11-07 Ulrike Herzog , Janos A. Bergou

The problem of filtering information from large correlation matrices is of great importance in many applications. We have recently proposed the use of the Kullback-Leibler distance to measure the performance of filtering algorithms in…

Data Analysis, Statistics and Probability · Physics 2008-12-02 M. Tumminello , F. Lillo , R. N. Mantegna