Related papers: A temporal factorization at the maximum for spectr…

We consider reinforcement learning in parameterized Markov Decision Processes (MDPs), where the parameterization may induce correlation across transition probabilities or rewards. Consequently, observing a particular state transition might…

We give several general theorems concerning positive definite solutions of Riemann-Hilbert problems on the real line. Furthermore, as an example, we apply our theory to the characteristic function of a class of L\'{e}vy processes and we…

This paper focuses on testing for the presence of alpha in time-varying factor pricing models, specifically when the number of securities N is larger than the time dimension of the return series T. We introduce a maximum-type test that…

A novel approach is proposed to establish a sharp upper bound on the expected supremum of a separable martingale random field, serving as an alternative to classical universal chaining-based methods. The proposed approach begins by deriving…

A new approach to space-time asymptotics is presented, refining Penrose's idea of conformal transformations with infinity represented by the conformal boundary of space-time. Generalizing examples such as flat and Schwarzschild space-times,…

Let $\mathbb{X}=(\mathbb{X}_t)_{t\geq 0}$ be the subdiffusive process defined, for any $t\geq 0$, by $ \mathbb{X}_t = X_{\ell_t}$ where $X=(X_t)_{t\geq 0}$ is a L\'evy process and $\ell_t=\inf \{s>0;\: \mathcal{K}_s>t \}$ with…

We consider the Wiener--Hopf factorization problem for a matrix function that is completely defined by its first column: the succeeding columns are obtained from the first one by means of a finite group of permutations. The symmetry of this…

In this paper, we develop necessary and sufficient conditions for the validity of a martingale approximation for the partial sums of a stationary process in terms of the maximum of consecutive errors. Such an approximation is useful for…

Given a stable L\'{e}vy process $X=(X_t)_{0\le t\le T}$ of index $\alpha\in(1,2)$ with no negative jumps, and letting $S_t=\sup_{0\le s\le t}X_s$ denote its running supremum for $t\in [0,T]$, we consider the optimal prediction problem…

In this Note we study optimal stopping problems for strong Markov processes and affine functions. We give a justification of the Snell envelope form using standard results of optimal stopping. We also justify the convexity of the value…

We present a general method to derive the metastable behavior of weakly mixing Markov chains. This approach is based on properties of the resolvent equations and can be applied to metastable dynamics which do not satisfy the mixing…

A Markov Additive Process is a bi-variate Markov process $(\xi,J)=\big((\xi_t,J_t),t\geq0\big)$ which should be thought of as a multi-type L\'evy process: the second component $J$ is a Markov chain on a finite space $\{1,\ldots,K\}$, and…

In this paper we study a continuous time, optimal stochastic investment problem under limited resources in a market with N firms. The investment processes are subject to a time-dependent stochastic constraint. Rather than using a dynamic…

Finitarily Markovian processes are those processes $\{X_n\}_{n=-\infty}^{\infty}$ for which there is a finite $K$ ($K = K(\{X_n\}_{n=-\infty}^0$) such that the conditional distribution of $X_1$ given the entire past is equal to the…

This paper presents an axiomatic approach to finite Markov decision processes where the discount rate is zero. One of the principal difficulties in the no discounting case is that, even if attention is restricted to stationary policies, a…

We establish a new integral equation for the probability density of the exponential functional of a L\'evy process and provide a three-term (Wiener-Hopf type) factorisation of its law. We explain how these results complement the techniques…

We consider the class of (possibly killed) spectrally positive L\'evy process that have been time-changed by the inverse of an integral functional. Within this class we characterize the family of those processes which satisfy the following…

We prove that if $\Sigma_{\mathbf A}(\mathbb N)$ is an irreducible Markov shift space over $\mathbb N$ and $f:\Sigma_{\mathbf A}(\mathbb N) \rightarrow \mathbb R$ is coercive with bounded variation then there exists a maximizing probability…

We prove that for a sequence of finite vertex-transitive graphs of increasing sizes, the cover times are asymptotically concentrated if and only if the product of the spectral-gap and the expected cover time diverges. In fact, we prove this…

We introduce a spatiotemporal self-exciting point process $(N_t(x))$, boundedly finite both over time $[0,\infty)$ and space $\mathscr X$, with excitation structure determined by a graphon $W$ on $\mathscr{X}^2$. This graphon Hawkes process…