English
Related papers

Related papers: Entropy-Assisted Quality Pattern Identification in…

200 papers

In this paper we present a novel methodology based on a topological entropy, the so-called persistent entropy, for addressing the comparison between discrete piecewise linear functions. The comparison is certified by the stability theorem…

Comparison-based algorithms are algorithms for which the execution of each operation is solely based on the outcome of a series of comparisons between elements. Comparison-based computations can be naturally represented via the following…

Data Structures and Algorithms · Computer Science 2020-11-17 Michel Schellekens

Anomaly detection is a challenging task, particularly in systems with many variables. Anomalies are outliers that statistically differ from the analyzed data and can arise from rare events, malfunctions, or system misuse. This study…

Artificial Intelligence · Computer Science 2023-08-10 Kleyton da Costa

We compare some methods recently used in the literature to detect the existence of a certain degree of common behavior of stock returns belonging to the same economic sector. Specifically, we discuss methods based on random matrix theory…

Disordered Systems and Neural Networks · Physics 2008-12-02 C. Coronnello , M. Tumminello , F. Lillo , S. Miccichè , R. N. Mantegna

This paper explores neural network-based approaches for algorithmic trading in cryptocurrency markets. Our approach combines multi-timeframe trend analysis with high-frequency direction prediction networks, achieving positive risk-adjusted…

Computational Finance · Quantitative Finance 2025-08-05 Wěi Zhāng

Scale invariance, collective behaviours and structural reorganization are crucial for portfolio management (portfolio composition, hedging, alternative definition of risk, etc.). This lack of any characteristic scale and such elaborated…

Statistical Finance · Quantitative Finance 2014-03-24 Thomas Bury

Empirical researchers increasingly use upstream machine-learning (ML) methods to construct proxies for latent target variables from complex, unstructured data. A naive plug-in use of such proxies in downstream econometric models, however,…

Econometrics · Economics 2026-04-14 Lixiong Li

Entropy production is a universal measure of irreversibility and energy dissipation in physical, chemical, and biological systems operating far from equilibrium. However, quantifying and spatiotemporally localising it in complex processes…

Statistical Mechanics · Physics 2026-05-18 Biswajit Das , Sreekanth K Manikandan

A considerable amount of clustering algorithms take instance-feature matrices as their inputs. As such, they cannot directly analyze time series data due to its temporal nature, usually unequal lengths, and complex properties. This is a…

Artificial Intelligence · Computer Science 2019-06-04 Qi Lei , Jinfeng Yi , Roman Vaculin , Lingfei Wu , Inderjit S. Dhillon

To quantify the complexity of a system, entropy-based methods have received considerable critical attentions in real-world data analysis. Among numerous entropy algorithms, amplitude-based formulas, represented by Sample Entropy, suffer…

Signal Processing · Electrical Eng. & Systems 2022-01-12 Hongjian Xiao , Danilo P. Mandic

Information theoretic measures (entropies, entropy rates, mutual information) are nowadays commonly used in statistical signal processing for real-world data analysis. The present work proposes the use of Auto Mutual Information (Mutual…

Data Analysis, Statistics and Probability · Physics 2019-07-24 C Granero-Belinchón , S. Roux , P. Abry , N. Garnier

Predictive inference requires balancing statistical accuracy against informational complexity, yet the choice of complexity measure is usually imposed rather than derived. We treat econometric objects as predictive rules, mappings from…

Statistics Theory · Mathematics 2026-02-16 Nicholas G. Polson , Daniel Zantedeschi

This paper presents a command-line tool, called Entropia, that implements a family of conformance checking measures for process mining founded on the notion of entropy from information theory. The measures allow quantifying classical…

We present a new method of generating mixture models for data with categorical attributes. The keys to this approach are an entropy-based density metric in categorical space and annealing of high-entropy/low-density components from an…

Machine Learning · Statistics 2017-08-25 Cetin Savkli , Jeffrey Lin , Philip Graff , Matthew Kinsey

This paper presents a new period finding method based on conditional entropy that is both efficient and accurate. We demonstrate its applicability on simulated and real data. We find that it has comparable performance to other…

Instrumentation and Methods for Astrophysics · Physics 2015-06-16 Matthew J. Graham , Andrew J. Drake , S. G. Djorgovski , Ashish A Mahabal , Ciro Donalek

Obtaining high certainty in predictive models is crucial for making informed and trustworthy decisions in many scientific and engineering domains. However, extensive experimentation required for model accuracy can be both costly and…

Machine Learning · Computer Science 2024-12-17 Giorgio Morales , John Sheppard

Existing training criteria in automatic speech recognition(ASR) permit the model to freely explore more than one time alignments between the feature and label sequences. In this paper, we use entropy to measure a model's uncertainty, i.e.…

Computation and Language · Computer Science 2022-12-26 Ehsan Variani , Ke Wu , David Rybach , Cyril Allauzen , Michael Riley

Accurate prediction of price behavior in the foreign exchange market is crucial. This paper proposes a novel approach that leverages technical indicators and deep neural networks. The proposed architecture consists of a Long Short-Term…

Machine Learning · Computer Science 2024-12-02 Sahabeh Saadati , Mohammad Manthouri

Google uses continuous streams of data from industry partners in order to deliver accurate results to users. Unexpected drops in traffic can be an indication of an underlying issue and may be an early warning that remedial action may be…

Machine Learning · Statistics 2017-08-15 Dominique T. Shipmon , Jason M. Gurevitch , Paolo M. Piselli , Stephen T. Edwards

The entropy of the codes usually serves as the rate loss in the recent learned lossy image compression methods. Precise estimation of the probabilistic distribution of the codes plays a vital role in the performance. However, existing deep…

Image and Video Processing · Electrical Eng. & Systems 2020-05-12 Mu Li , Kai Zhang , Wangmeng Zuo , Radu Timofte , David Zhang