English
Related papers

Related papers: Extropy Rate: Properties and Application in Featur…

200 papers

In this paper we focus on the study of the monotonicity properties of the residual and the past extropy as well as on some characterization problems. We then apply the derived results to analyze further stochastic aspects of order…

Statistics Theory · Mathematics 2024-06-24 Mohamed Kayid

The extraction of a physical law y=yo(x) from joint experimental data about x and y is treated. The joint, the marginal and the conditional probability density functions (PDF) are expressed by given data over an estimator whose kernel is…

Data Analysis, Statistics and Probability · Physics 2007-10-10 I. Grabec

Inferring models, predicting the future, and estimating the entropy rate of discrete-time, discrete-event processes is well-worn ground. However, a much broader class of discrete-event processes operates in continuous-time. Here, we provide…

Statistical Mechanics · Physics 2020-05-11 S. E. Marzen , J. P. Crutchfield

We study failure rate monotonicity and generalized convex transform stochastic ordering properties of random variables, with a concern on applications. We are especially interested in the effect of a tail weight iteration procedure to…

Probability · Mathematics 2026-01-14 Idir Arab , Milto Hadjikyriakou , Paulo Eduardo Oliveira

Recently Qiu et al. (2017) have introduced residual extropy as measure of uncertainty in residual lifetime distributions analogues to residual entropy (1996). Also, they obtained some properties and applications of that. In this paper, we…

Statistics Theory · Mathematics 2020-09-07 Osman Kamari , Francesco Buono

Incorporating feature selection into a classification or regression method often carries a number of advantages. In this paper we formalize feature selection specifically from a discriminative perspective of improving…

Machine Learning · Computer Science 2013-01-18 Tony S. Jebara , Tommi S. Jaakkola

We extend the notion of estimation entropy of autonomous dynamical systems proposed by Liberzon and Mitra [1] to nonlinear dynamical systems with uncertain inputs with bounded variation. We call this new notion the {$\epsilon$}-estimation…

Systems and Control · Electrical Eng. & Systems 2023-11-14 Hussein Sibai , Sayan Mitra

Conditional differential entropy provides an intuitive measure for relatively ranking time-series complexity by quantifying uncertainty in future observations given past context. However, its direct computation for high-dimensional…

Signal Processing · Electrical Eng. & Systems 2025-10-24 Jacob Ayers , Richard Hahnloser , Julia Ulrich , Lothar Sebastian Krapp , Remo Nitschke , Sabine Stoll , Balthasar Bickel , Reinhard Furrer

We study the continuity property of the generalized entropy as a function of the underlying probability distribution, defined with an action space and a loss function, and use this property to answer the basic questions in statistical…

Machine Learning · Computer Science 2022-01-04 Aolin Xu

We consider a generic class of stochastic particle-based models whose state at an instant in time is described by a set of continuous degrees of freedom (e.g. positions), and the length of this set changes stochastically in time due to…

Statistical Mechanics · Physics 2025-09-03 Samuel Cameron , Elsen Tjhung

The interrelationships of the fundamental biological processes natural selection, mutation, and stochastic drift are quantified by the entropy rate of Moran processes with mutation, measuring the long-run variation of a Markov process. The…

Dynamical Systems · Mathematics 2014-01-14 Marc Harper

This study explores information measures based on extropy, introducing dynamic relative extropy measures for residual and past lifetimes, and investigating their various properties. Furthermore, the study analyzes the relationships between…

Applications · Statistics 2025-03-11 Saranya P. , Sunoj S. M.

We introduce a method for quantifying the inherent unpredictability of a continuous-valued time series via an extension of the differential Shannon entropy rate. Our extension, the specific entropy rate, quantifies the amount of predictive…

Machine Learning · Computer Science 2016-06-09 David Darmon

Extropy and its properties are explored to quantify the uncertainty. In this paper, we obtain alternative expressions for cumulative residual extropy and negative cumulative extropy. We obtain simple estimators of cumulative (residual)…

Methodology · Statistics 2021-08-23 Sudheesh K. K. , Sreedevi E. P

In environmental applications of extreme value statistics, the underlying stochastic process is often modeled either as a max-stable process in continuous time/space or as a process in the domain of attraction of such a max-stable process.…

Statistics Theory · Mathematics 2018-02-13 Holger Drees , Laurens de Haan , Feridun Turkman

We consider discrete stochastic processes, modeled by classical master equations, on networks. The temporal growth of the lack of information about the system is captured by its non-equilibrium entropy, defined via the transition…

Statistical Mechanics · Physics 2017-04-26 Oliver Muelken , Sarah Heinzelmann , Maxim Dolgushev

In this paper, we introduce a new distribution generated by Lindley random variable which offers a more flexible model for modelling lifetime data. Various statistical properties like distribution function, survival function, moments,…

Applications · Statistics 2016-11-25 Deepesh Bhati , Mohd. Aamir Malik

This thesis is devoted to the study of extreme value statistics in stochastic processes and their applications. In the first part, we obtain exact analytical results on the extreme value statistics of both discrete-time and continuous-time…

Statistical Mechanics · Physics 2023-10-24 Benjamin De Bruyne

Recommendations based on behavioral data may be faced with ambiguous statistical evidence. We consider the case of association rules, relevant e.g.~for query and product recommendations. For example: Suppose that a customer belongs to…

Databases · Computer Science 2015-01-12 Rasmus Pagh , Morten Stöckel

Maximum entropy estimation is of broad interest for inferring properties of systems across many different disciplines. In this work, we significantly extend a technique we previously introduced for estimating the maximum entropy of a set of…

Data Analysis, Statistics and Probability · Physics 2016-01-05 Elliot A. Martin , Jaroslav Hlinka , Alexander Meinke , Filip Děchtěrenko , Jörn Davidsen