English
Related papers

Related papers: Interval extropy and weighted interval extropy

200 papers

We commonly encounter the problem of identifying an optimally weight adjusted version of the empirical distribution of observed data, adhering to predefined constraints on the weights. Such constraints often manifest as restrictions on the…

Machine Learning · Statistics 2024-01-17 Abhisek Chakraborty , Anirban Bhattacharya , Debdeep Pati

The R\'{e}nyi cross-entropy measure between two distributions, a generalization of the Shannon cross-entropy, was recently used as a loss function for the improved design of deep learning generative adversarial networks. In this work, we…

Information Theory · Computer Science 2022-08-09 Ferenc Cole Thierrin , Fady Alajaji , Tamás Linder

In this paper, we consider recent progress in estimating the average treatment effect when extreme inverse probability weights are present and focus on methods that account for a possible violation of the positivity assumption. These…

Methodology · Statistics 2022-10-26 Roland A. Matsouaka , Yunji Zhou

In this paper, we extend the existing double linear policy by incorporating time-varying weights instead of constant weights and study a certain robustness property, called robust positive expectation (RPE), in a discrete-time setting. We…

Optimization and Control · Mathematics 2024-01-17 Xin-Yu Wang , Chung-Han Hsieh

We propose a new estimator to measure directed dependencies in time series. The dimensionality of data is first reduced using a new non-uniform embedding technique, where the variables are ranked according to a weighted sum of the amount of…

Methodology · Statistics 2020-12-02 Payam Shahsavari Baboukani , Carina Graversen , Emina Alickovic , Jan Østergaard

The weak law of large numbers implies that, under mild assumptions on the source, the Renyi entropy per produced symbol converges (in probability) towards the Shannon entropy rate. This paper quantifies the speed of this convergence for…

Information Theory · Computer Science 2017-05-01 Maciej Skorski

This paper introduces a measure of uncertainty in the determination of the Shapley value, illustrates it with examples, and studies some of its properties. The introduced measure of uncertainty quantifies random variations in a player's…

General Mathematics · Mathematics 2007-09-03 Vladislav Kargin

The concept of mean inactivity time plays a crucial role in reliability, risk theory and life testing. In this regard, we introduce a weighted mean inactivity time function by considering a non-negative weight function. Based on this…

Probability · Mathematics 2021-03-16 Antonio Di Crescenzo , Abdolsaeed Toomaj

Entropy metrics (for example, permutation entropy) are nonlinear measures of irregularity in time series (one-dimensional data). Some of these entropy metrics can be generalised to data on periodic structures such as a grid or lattice…

Combinatorics · Mathematics 2021-10-22 John Stewart Fabila-Carrasco , Chao Tan , Javier Escudero

This paper proposes a versatile covariate adjustment method that directly incorporates covariate balance in regression discontinuity (RD) designs. The new empirical entropy balancing method reweights the standard local polynomial RD…

Econometrics · Economics 2024-05-29 Jun Ma , Zhengfei Yu

We examine the problem of construction of confidence intervals within the basic single-parameter, single-iteration variation of the method of quasi-optimal weights. Two kinds of distortions of such intervals due to insufficiently large…

Data Analysis, Statistics and Probability · Physics 2020-05-27 A. D. Morozov , A. V. Lokhov , F. V. Tkachov

The concept of univariate Range Value-at-Risk, presented by Cont et al. (2010), is extended in the multidimensional setting. Traditional risk measures are not well suited when dealing with heavy-tail distributions and infinite tail…

Risk Management · Quantitative Finance 2020-05-27 Roba Bairakdar , Lu Cao , Melina Mailhot

We study vectors chosen at random from a compact convex polytope in $\mathbb{R}^n$ given by a finite number of linear constraints. We determine which projections of these random vectors are asymptotically normal as $n\to\infty$. Marginal…

Probability · Mathematics 2025-03-18 Fabrice Gamboa , Martin Venker

Upper and lower bounds are obtained for the joint entropy of a collection of random variables in terms of an arbitrary collection of subset joint entropies. These inequalities generalize Shannon's chain rule for entropy as well as…

Information Theory · Computer Science 2024-05-07 Mokshay Madiman , Prasad Tetali

This paper serves a twofold purpose. First, a unified perspective on diversity indices is introduced based on an entropic basis. It is shown that the class of all linear combinations of the entropic basis, referred to as the class of linear…

Statistics Theory · Mathematics 2020-01-22 Zhiyi Zhang , Michael Grabchak

A probabilistic source is defined as the set of infinite words (over a given denumerable alphabet) endowed with a probability $\mu$. The paper deals with general binary sources where the distribution of any symbol (0 or 1) may depend on an…

Dynamical Systems · Mathematics 2025-04-07 Ali Akhavi , Eda Cesaratto , Frédéric Paccaut , Pablo Rotondo , Brigitte Vallée

This paper examines nonparametric regression with an exogenous threshold variable, allowing for an unknown number of thresholds. Given the number of thresholds and corresponding threshold values, we first establish the asymptotic properties…

Economics · Quantitative Finance 2018-02-26 Yan-Yu Chiou , Mei-Yuan Chen , Jau-er Chen

The definition of weighted entropy allows for easy calculation of the entropy of the mixture of measures. In this paper we investigate the problem of equivalent definition of the general entropy function in weighted form. We show that under…

Information Theory · Computer Science 2013-05-15 Marek Śmieja

Uncertainties in successive measurements of general canonically conjugate variables are examined. Such operators are approached within a limiting procedure of the Pegg-Barnett type. Dealing with unbounded observables, we should take into…

Quantum Physics · Physics 2017-01-02 Alexey E. Rastegin

We consider the uncertainty between two pairs of local projective measurements performed on a multipartite system. We show that the optimal bound in any linear uncertainty relation, formulated in terms of the Shannon entropy, is additive.…

Quantum Physics · Physics 2018-03-28 Rene Schwonnek