English
Related papers

Related papers: Determining the minimum embedding dimension for st…

200 papers

Reducing dimension redundancy to find simplifying patterns in high-dimensional datasets and complex networks has become a major endeavor in many scientific fields. However, detecting the dimensionality of their latent space is challenging…

Physics and Society · Physics 2022-11-09 Pedro Almagro , Marian Boguna , M. Angeles Serrano

Time-delay embedding is a powerful technique for reconstructing the state space of nonlinear time series. However, the fidelity of reconstruction relies on the assumption that the time-delay map is an embedding, which is implicitly…

Computation · Statistics 2026-02-02 Yiting Duan , Zhikun Zhang , Yi Guo

This paper proposes two linear projection methods for supervised dimension reduction using only the first and second-order statistics. The methods, each catering to a different parameter regime, are derived under the general Gaussian model…

Information Theory · Computer Science 2024-08-13 Biao Chen , Joshua Kortje

The statistical problem of estimating the effective dimension-reduction (EDR) subspace in the multi-index regression model with deterministic design and additive noise is considered. A new procedure for recovering the directions of the EDR…

Statistics Theory · Mathematics 2007-06-13 Arnak Dalalyan , Anatoly Juditsky , Vladimir Spokoiny

Much of social network analysis is - implicitly or explicitly - predicated on the assumption that individuals tend to be more similar to their friends than to strangers. Thus, an observed social network provides a noisy signal about the…

Social and Information Networks · Computer Science 2014-08-18 Ittai Abraham , Shiri Chechik , David Kempe , Aleksandrs Slivkins

In this work we propose an objective function to guide the search for a state space reconstruction of a dynamical system from a time series of measurements. This statistics can be evaluated on any reconstructed attractor, thereby allowing a…

Chaotic Dynamics · Physics 2012-05-16 L. C. Uzal , G. L. Grinblat , P. F. Verdes

Experimental measurements of physical systems often have a limited number of independent channels, causing essential dynamical variables to remain unobserved. However, many popular methods for unsupervised inference of latent dynamics from…

Machine Learning · Computer Science 2020-10-23 William Gilpin

A well-known technique in estimating probabilities of rare events in general and in information theory in particular (used, e.g., in the sphere-packing bound), is that of finding a reference probability measure under which the event of…

Information Theory · Computer Science 2014-12-23 Rami Atar , Neri Merhav

Statistical distance measures have found wide applicability in information retrieval tasks that typically involve high dimensional datasets. In order to reduce the storage space and ensure efficient performance of queries, dimensionality…

Computational Geometry · Computer Science 2010-03-09 Arnab Bhattacharya , Purushottam Kar , Manjish Pal

Nonlinear dimensionality reduction or, equivalently, the approximation of high-dimensional data using a low-dimensional nonlinear manifold is an active area of research. In this paper, we will present a thematically different approach to…

Machine Learning · Computer Science 2019-12-21 Kelum Gajamannage , Randy Paffenroth

Equations governing the nonlinear dynamics of complex systems are usually unknown and indirect methods are used to reconstruct their manifolds. In turn, they depend on embedding parameters requiring other methods and long temporal sequences…

Chaotic Dynamics · Physics 2020-06-24 Valeria d'Andrea , Manlio De Domenico

In this paper, a purely measurement-based method is proposed to estimate the dynamic system state matrix by applying the regression theorem of the multivariate Ornstein-Uhlenbeck process. The proposed method employs a recursive algorithm to…

Signal Processing · Electrical Eng. & Systems 2019-05-29 Hao Sheng , Xiaozhe Wang

The density matrices are positively semi-definite Hermitian matrices of unit trace that describe the state of a quantum system. The goal of the paper is to develop minimax lower bounds on error rates of estimation of low rank density…

Machine Learning · Statistics 2016-04-19 Vladimir Koltchinskii , Dong Xia

This paper addresses the problem of distributed detection in fixed and switching networks. A network of agents observe partially informative signals about the unknown state of the world. Hence, they collaborate with each other to identify…

Systems and Control · Computer Science 2016-01-01 Shahin Shahrampour , Alexander Rakhlin , Ali Jadbabaie

Network embedding is a general-purpose machine learning technique that encodes network structure in vector spaces with tunable dimension. Choosing an appropriate embedding dimension -- small enough to be efficient and large enough to be…

Physics and Society · Physics 2021-06-22 Weiwei Gu , Aditya Tandon , Yong-Yeol Ahn , Filippo Radicchi

The aim of this paper is to introduce new statistical criterions for estimation, suitable for inference in models with common continuous support. This proposal is in the direct line of a renewed interest for divergence based inference tools…

Statistics Theory · Mathematics 2015-03-19 Michel Broniatowski , Aida Toma , Igor Vajda

Reconstructing state-space dynamics from scalar data using time-delay embedding requires choosing values for the delay $\tau$ and the dimension $m$. Both parameters are critical to the success of the procedure and neither is easy to…

Data Analysis, Statistics and Probability · Physics 2023-06-08 Varad Deshmukh , Robert Meikle , Elizabeth Bradley , James D. Meiss , Joshua Garland

Randomized dimensionality reduction has been recognized as one of the fundamental techniques in handling high-dimensional data. Starting with the celebrated Johnson-Lindenstrauss Lemma, such reductions have been studied in depth for the…

Computational Geometry · Computer Science 2019-09-10 Ioannis Z. Emiris , Vasilis Margonis , Ioannis Psarros

In many linear inverse problems, we want to estimate an unknown vector belonging to a high-dimensional (or infinite-dimensional) space from few linear measurements. To overcome the ill-posed nature of such problems, we use a low-dimension…

Information Theory · Computer Science 2017-07-18 Yann Traonmilin , Gilles Puy , Rémi Gribonval , Mike Davies

In this paper we propose a dimension-reduction strategy in order to improve the performance of importance sampling in high dimension. The idea is to estimate variance terms in a small number of suitably chosen directions. We first prove…

Computation · Statistics 2022-03-24 Maxime ElMasri , Jérôme Morio , Florian Simatos