English
Related papers

Related papers: Enhancing Markov and Chebyshev's inequalities

200 papers

Essentially all anytime-valid methods hinge on Ville's inequality to gain validity across time without incurring a union bound. Ville's inequality is a proper generalisation of Markov's inequality. It states that a non-negative…

Statistics Theory · Mathematics 2025-02-25 Wouter M. Koolen , Muriel Felipe Pérez-Ortiz , Tyron Lardy

In this paper we shall consider some famous means such as arithmetic, harmonic, geometric, root square mean, etc. Considering the difference of these means, we can establish. some inequalities among them. Interestingly, the difference of…

Information Theory · Computer Science 2011-03-29 Inder Jeet Taneja

In this paper, we derive optimality conditions (Chebyshev approximation) for multivariate functions. The theory of Chebyshev (uniform) approximation for univariate functions is very elegant. The optimality conditions are based on the notion…

Optimization and Control · Mathematics 2015-10-22 Nadezda Sukhorukova , Julien Ugon , David Yost

MCMC methods are used in Bayesian statistics not only to sample from posterior distributions but also to estimate expectations. Underlying functions are most often defined on a continuous state space and can be unbounded. We consider a…

Methodology · Statistics 2009-07-29 Krzysztof Latuszynski , Blazej Miasojedow , Wojciech Niemiro

In numerous regular statistical models, median bias reduction (Kenne Pagui et al., 2017) has proven to be a noteworthy improvement over maximum likelihood, alternative to mean bias reduction. The estimator is obtained as solution to a…

Methodology · Statistics 2020-12-01 Euloge Clovis Kenne Pagui , Alessandra Salvan , Nicola Sartori

Adaptive and interacting Markov Chains Monte Carlo (MCMC) algorithms are a novel class of non-Markovian algorithms aimed at improving the simulation efficiency for complicated target distributions. In this paper, we study a general…

Statistics Theory · Mathematics 2011-07-15 Gersende Fort , Eric Moulines , Pierre Priouret , Pierre Vandekerkhove

We develop novel empirical Bernstein inequalities for the variance of bounded random variables. Our inequalities hold under constant conditional variance and mean, without further assumptions like independence or identical distribution of…

Statistics Theory · Mathematics 2026-05-28 Diego Martinez-Taboada , Aaditya Ramdas

I show how any reversible Markov chain on a finite state space that is irreducible, and hence suitable for estimating expectations with respect to its invariant distribution, can be used to construct a non-reversible Markov chain on a…

Probability · Mathematics 2007-06-13 Radford M. Neal

Groups of humans are often able to find ways to cooperate with one another in complex, temporally extended social dilemmas. Models based on behavioral economics are only able to explain this phenomenon for unrealistic stateless matrix…

Generalization bounds which assess the difference between the true risk and the empirical risk have been studied extensively. However, to obtain bounds, current techniques use strict assumptions such as a uniformly bounded or a Lipschitz…

Machine Learning · Computer Science 2020-02-25 Yossi Adi , Yaniv Nemcovsky , Alex Schwing , Tamir Hazan

Consider the problem of learning a large number of response functions simultaneously based on the same input variables. The training data consist of a single independent random sample of the input variables drawn from a common distribution…

Machine Learning · Statistics 2021-11-30 Vincent Plassier , François Portier , Johan Segers

ReRecent studies in machine learning are based on models in which parameters or state variables are bounded restricted. These restrictions are from prior information to ensure the validity of scientific theories or structural consistency…

Methodology · Statistics 2024-01-26 Solmaz Seifollahi , Hossein Bevrani , Kristofer Mansson

The study of Markov models is central to control theory and machine learning. A quantum analogue of partially observable Markov decision process was studied in (Barry, Barry, and Aaronson, Phys. Rev. A, 90, 2014). It was proved that…

Quantum Physics · Physics 2019-11-06 Christino Tamon , Weichen Xie

The paper offers a novel unified approach to studying the accuracy of parameter estimation by the quasi likelihood method. Important features of the approach are: (1) The underlying model {is not assumed to be parametric}. (2) No conditions…

Statistics Theory · Mathematics 2009-03-11 V. Spokoiny

We introduce the Lyapunov approach to optimal control problems of average risk-sensitive Markov control processes with general risk maps. Motivated by applications in particular to behavioral economics, we consider possibly non-convex risk…

Optimization and Control · Mathematics 2015-07-23 Yun Shen , Klaus Obermayer , Wilhelm Stannat

Discrete Markov random fields form a natural class of models to represent images and spatial data sets. The use of such models is, however, hampered by a computationally intractable normalising constant. This makes parameter estimation and…

Computation · Statistics 2015-05-25 Haakon Michael Austad , Håkon Tjelmeland

For a discrete time Markov chain and in line with Strotz' consistent planning we develop a framework for problems of optimal stopping that are time-inconsistent due to the consideration of a non-linear function of an expected reward. We…

Optimization and Control · Mathematics 2020-01-23 Sören Christensen , Kristoffer Lindensjö

In this paper, we derive upper bounds on generalization errors for deep neural networks with Markov datasets. These bounds are developed based on Koltchinskii and Panchenko's approach for bounding the generalization error of combined…

Machine Learning · Statistics 2022-10-13 Lan V. Truong

Mathematical models of the real world are simplified representations of complex systems. A caveat to using mathematical models is that predicted causal effects and conditional independences may not be robust under model extensions, limiting…

Methodology · Statistics 2022-08-30 Tineke Blom , Joris M. Mooij

Machine learning models are often used to inform real world risk assessment tasks: predicting consumer default risk, predicting whether a person suffers from a serious illness, or predicting a person's risk to appear in court. Given…

Machine Learning · Computer Science 2023-06-27 Jamelle Watson-Daniels , David C. Parkes , Berk Ustun