English
Related papers

Related papers: Local estimates for entropy densities in coupled m…

200 papers

We propose a new embedding method which is particularly well-suited for settings where the sample size greatly exceeds the ambient dimension. Our technique consists of partitioning the space into simplices and then embedding the data points…

Machine Learning · Computer Science 2020-02-07 Lee-Ad Gottlieb , Eran Kaufman , Aryeh Kontorovich , Gabriel Nivasch , Ofir Pele

A numerical algorithm to compute the topological entropy of multimodal maps is proposed. This algorithm results from a closed formula containing the so-called min-max symbols, which are closely related to the kneading symbols. Furthermore,…

Dynamical Systems · Mathematics 2022-04-13 José M. Amigó , Angel Giménez

Saliency methods can make deep neural network predictions more interpretable by identifying a set of critical features in an input sample, such as pixels that contribute most strongly to a prediction made by an image classifier.…

Machine Learning · Computer Science 2021-06-15 Yang Lu , Wenbo Guo , Xinyu Xing , William Stafford Noble

In this note we present that the patch counting entropy can be obtained as a limit and investigate which sequences of compact sets are suitable to define this quantity. We furthermore present a geometric definition of patch counting entropy…

Dynamical Systems · Mathematics 2020-11-26 Till Hauser

Understanding the statistics of collisions among locally confined gas particles poses a major challenge. In this work we investigate $\mathbb Z^d$-map lattices coupled by collision with simplified local dynamics that offer significant…

Dynamical Systems · Mathematics 2026-01-21 Wael Bahsoun , Maxence Phalempin

Behavior of the entropy numbers of classes of multivariate functions with mixed smoothness is studied here. This problem has a long history and some fundamental problems in the area are still open. The main goal of this paper is to develop…

Numerical Analysis · Mathematics 2016-03-01 V. Temlyakov

Maximum a posteriori (MAP) inference in discrete-valued Markov random fields is a fundamental problem in machine learning that involves identifying the most likely configuration of random variables given a distribution. Due to the…

Machine Learning · Computer Science 2020-07-03 Jonathan N. Lee , Aldo Pacchiano , Peter Bartlett , Michael I. Jordan

In this paper, we propose a maximum smoothed likelihood method to estimate the component density functions of mixture models, in which the mixing proportions are known and may differ among observations. The proposed estimates maximize a…

Methodology · Statistics 2014-07-14 Tao Yu , Pengfei Li , Jing Qin

We show that the dynamical behavior of a coupled map lattice where the individual maps are Bernoulli shift maps can be solved analytically for integer couplings. We calculate the invariant density of the system and show that it displays a…

chao-dyn · Physics 2009-10-30 R. O. Grigoriev , H. G. Schuster

We consider lattice gas automata where the lack of semi-detailed balance results from node occupation redistribution ruled by distant configurations; such models with nonlocal interactions are interesting because they exhibit non-ideal gas…

Statistical Mechanics · Physics 2016-08-31 Olivier Tribel , Jean Pierre Boon

This article investigates the possibility to use the class entropy of the output of a connectionist phoneme recogniser to predict time boundaries between phonetic classes. The rationale is that the value of the entropy should increase in…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-15 Giampiero Salvi

We present a new algorithm for community detection. The algorithm uses random walks to embed the graph in a space of measures, after which a modification of $k$-means in that space is applied. The algorithm is therefore fast and easily…

Machine Learning · Computer Science 2016-05-11 Mark Kozdoba , Shie Mannor

The goal of this paper is to develop an estimate for the entropy of random long-range correlated symbolic sequences with elements belonging to a finite alphabet. As a plausible model, we use the high-order additive stationary ergodic Markov…

Information Theory · Computer Science 2014-12-12 S. S. Melnik , O. V. Usatenko

We compute the polynomial entropy of the induced maps on hyperspace for a homeomorphism $f$ of an interval or a circle with finitely many non-wandering points.

Dynamical Systems · Mathematics 2023-05-18 Maša Djorić , Jelena Katić

In this article, we propose a sampling-based motion planning algorithm equipped with an information-theoretic convergence criterion for incremental informative motion planning. The proposed approach allows dense map representations and…

Robotics · Computer Science 2019-05-24 Maani Ghaffari Jadidi , Jaime Valls Miro , Gamini Dissanayake

Topological entropy or spatial entropy is a way to measure the complexity of shift spaces. This study investigates the relationships between the spatial entropy and the various periodic entropies which are computed by skew-coordinated…

Dynamical Systems · Mathematics 2022-07-26 Wen-Guei Hu , Guan-Yu Lai , Song-Sun Lin

In statistical physics entropy is usually introduced as a global quantity which expresses the amount of information that would be needed to specify the microscopic configuration of a system. However, for lattice models with infinitely many…

Statistical Mechanics · Physics 2015-06-12 Ulrich Müller , Haye Hinrichsen

This paper provides a general result on controlling local Rademacher complexities, which captures in an elegant form to relate the complexities with constraint on the expected norm to the corresponding ones with constraint on the empirical…

Artificial Intelligence · Computer Science 2015-10-07 Yunwen Lei , Lixin Ding , Yingzhou Bi

In many high-impact applications, it is important to ensure the quality of output of a machine learning algorithm as well as its reliability in comparison with the complexity of the algorithm used. In this paper, we have initiated a…

Machine Learning · Computer Science 2023-03-03 Katarina Doctor , Tong Mao , Hrushikesh Mhaskar

In a quasi-one-dimensional system the particles remain ordered from left to right allowing the association of a volume element to the particle which on average resides there. Thus the properties of that single particle can give the local…

Statistical Mechanics · Physics 2014-09-12 Gary Morriss