Probabilistic renormalization and analytic continuation

We introduce a theory of probabilistic renormalization for series, the renormalized values being encoded in the expectation of a certain random variable on the set of natural numbers. We identify a large class of weakly renormalizable series of Dirichlet type, whose analysis depends on the properties of a (infinite order) difference operator that we call Bernoulli operator. For the series in this class, we show that the probabilistic renormalization is compatible with analytic continuation. The general zeta series for $s\neq 1$ is found to be strongly renormalizable and its renormalized value is given by the Riemann zeta function.