English
Related papers

Related papers: A Maximum Entropy solution of the Covariance Exten…

200 papers

We show that a simple geometric result suffices to derive the form of the optimal solution in a large class of finite and infinite-dimensional maximum entropy problems concerning probability distributions, spectral densities and covariance…

Optimization and Control · Mathematics 2012-12-24 Michele Pavon , Augusto Ferrante

We consider a new class of non Markovian processes with a countable number of interacting components. At each time unit, each component can take two values, indicating if it has a spike or not at this precise moment. The system evolves as…

Probability · Mathematics 2015-06-12 Antonio Galves , Eva Löcherbach

R\'esum\'e: Le principal objet de cette communication est de faire une r\'etro perspective succincte de l'utilisation de l'entropie et du principe du maximum d'entropie dans le domaine du traitement du signal. Apr\`es un bref rappel de…

Data Analysis, Statistics and Probability · Physics 2007-05-23 Ali Mohammad-Djafari

In this work, we consider the problem of bounding the values of a covariance function corresponding to a continuous-time stationary stochastic process or signal. Specifically, for two signals whose covariance functions agree on a finite…

Signal Processing · Electrical Eng. & Systems 2021-10-07 Filip Elvander , Johan Karlsson , Toon van Waterschoot

We extend the Longstaff-Schwartz algorithm for approximately solving optimal stopping problems on high-dimensional state spaces. We reformulate the optimal stopping problem for Markov processes in discrete time as a generalized statistical…

Probability · Mathematics 2007-05-23 Daniel Egloff

The relaxed maximum entropy problem is concerned with finding a probability distribution on a finite set that minimizes the relative entropy to a given prior distribution, while satisfying relaxed max-norm constraints with respect to a…

Machine Learning · Computer Science 2013-11-08 Moshe Dubiner , Matan Gavish , Yoram Singer

Nonlinear dynamics play an important role in the analysis of signals. A popular, readily interpretable nonlinear measure is Permutation Entropy. It has recently been extended for the analysis of graph signals, thus providing a framework for…

Predictability of behavior has emerged an an important characteristic in many fields including biology, medicine, and marketing. Behavior can be recorded as a sequence of actions performed by an individual over a given time period. This…

Methodology · Statistics 2017-11-13 Brian Vegetabile , Jenny Molet , Tallie Z. Baram , Hal Stern

Empirical processes for stationary, causal sequences are considered. We establish empirical central limit theorems for classes of indicators of left half lines, absolutely continuous functions and piecewise differentiable functions. Sample…

Statistics Theory · Mathematics 2007-06-13 Wei Biao Wu

We study the persistence in a class of continuous stochastic processes that are stationary only under integer shifts of time. We show that under certain conditions, the persistence of such a continuous process reduces to the persistence of…

Statistical Mechanics · Physics 2009-11-07 Satya N. Majumdar , Deepak Dhar

We derive an efficient stochastic algorithm for inverse problems that present an unknown linear forcing term and a set of nonlinear parameters to be recovered. It is assumed that the data is noisy and that the linear part of the problem is…

Numerical Analysis · Mathematics 2019-09-17 Darko Volkov

The use of higher-order stochastic processes such as nonlinear Markov chains or vertex-reinforced random walks is significantly growing in recent years as they are much better at modeling high dimensional data and nonlinear dynamics in…

Numerical Analysis · Mathematics 2020-04-29 Dario Fasino , Francesco Tudisco

We propose two algorithms for simulating continuous time Markov chains in the presence of metastability. We show that the algorithms correctly estimate, under the ergodicity assumption, stationary averages of the process. Both algorithms,…

Numerical Analysis · Mathematics 2017-12-22 Ting Wang , Petr Plecháč , David Aristoff

We prove a strong approximation result for the empirical process associated to a stationary sequence of real-valued random variables, under dependence conditions involving only indicators of half lines. This strong approximation result also…

Probability · Mathematics 2013-10-22 Jérôme Dedecker , Florence Merlevède , Emmanuel Rio

Finding the entropy rate of Hidden Markov Processes is an active research topic, of both theoretical and practical importance. A recently used approach is studying the asymptotic behavior of the entropy rate in various regimes. In this…

Information Theory · Computer Science 2016-11-17 Or Zuk , Eytan Domany , Ido Kanter , Michael Aizenman

The problem of optimal estimation of linear functionals $A {\xi}=\int_{0}^{\infty} a(t)\xi(t)dt$ and $A_T{\xi}=\int_{0}^{T} a(t)\xi(t)dt$ depending on the unknown values of random process $\xi(t)$, $t\in R$, with stationary $n$th increments…

Statistics Theory · Mathematics 2025-10-17 Maksym Luz , Mikhail Moklyachuk

Exponential inequalities are main tools in machine learning theory. To prove exponential inequalities for non i.i.d random variables allows to extend many learning techniques to these variables. Indeed, much work has been done both on…

Machine Learning · Statistics 2020-08-03 Pierre Alquier , Paul Doukhan , Xiequan Fan

This article introduces the class of periodic trawl processes, which are continuous-time, infinitely divisible, stationary stochastic processes, that allow for periodicity and flexible forms of their serial correlation, including both…

Methodology · Statistics 2023-07-20 Almut E. D. Veraart

In this paper, we present a numerical framework for constructing bounds on stationary performance measures of random walks in the positive orthant using the Markov reward approach. These bounds are established in terms of stationary…

Probability · Mathematics 2018-11-22 Xinwei Bai , Jasper Goseling

The theory of ``Markov-up'' processes is being developed. This is a new class of stochastic processes with ``partial'' markovian features; it could also be called ``one-sided Markov''. Such a behavior may be found in the real world and in…

Probability · Mathematics 2024-07-01 D. O. Kalikaeva