English
Related papers

Related papers: Interacting reinforced stochastic processes: stati…

200 papers

We study the large-population limit of interacting particle systems evolving on adaptive dynamical networks, motivated in particular by models of opinion dynamics. In such systems, agents interact through weighted graphs whose structure…

Analysis of PDEs · Mathematics 2026-01-13 Nathalie Ayi

A random graph evolution based on the interactions of N vertices is studied. During the evolution both the preferential attachment method and the uniform choice of vertices are allowed. The weight of a vertex means the number of its…

Probability · Mathematics 2014-05-07 István Fazekas , Bettina Porvázsnyik

We study the long-time asymptotics of a network of weakly reinforced P\'olya urns. In this system, which extends the WARM introduced by R. van der Hofstad et. al. (2016) to countable networks, the nodes fire at times given by a Poisson…

Probability · Mathematics 2021-06-28 Yannick Couzinié , Christian Hirsch

This paper introduces a new asymptotic regime for simplifying stochastic models having non-stationary effects, such as those that arise in the presence of time-of-day effects. This regime describes an operating environment within which the…

Probability · Mathematics 2018-07-19 Zeyu Zheng , Harsha Honnappa , Peter W. Glynn

We consider a sequential decision making problem where the agent faces the environment characterized by the stochastic discrete events and seeks an optimal intervention policy such that its long-term reward is maximized. This problem exists…

Machine Learning · Computer Science 2022-12-29 Chao Qu , Xiaoyu Tan , Siqiao Xue , Xiaoming Shi , James Zhang , Hongyuan Mei

This paper investigates causal influences between agents linked by a social graph and interacting over time. In particular, the work examines the dynamics of social learning models and distributed decision-making protocols, and derives…

Social and Information Networks · Computer Science 2026-05-19 Mert Kayaalp , Ali H. Sayed

In a wide variety of applications, humans interact with a complex environment by means of asynchronous stochastic discrete events in continuous time. Can we design online interventions that will help humans achieve certain goals in such…

Machine Learning · Computer Science 2018-11-07 Utkarsh Upadhyay , Abir De , Manuel Gomez-Rodriguez

We consider stochastic systems of interacting particles or agents, with dynamics determined by an interaction kernel which only depends on pairwise distances. We study the problem of inferring this interaction kernel from observations of…

Statistics Theory · Mathematics 2020-07-31 Fei Lu , Mauro Maggioni , Sui Tang

The purpose of this paper is to study the asymptotic behavior of the weighted least square estimators of the unknown parameters of random coefficient bifurcating autoregressive processes. Under suitable assumptions on the immigration and…

Probability · Mathematics 2015-03-20 Vassili Blandin

A succesful method to describe the asymptotic behavior of a discrete time stochastic process governed by some recursive formula is to relate it to the limit sets of a well chosen mean differential equation. Under an attainability condition,…

Probability · Mathematics 2011-01-19 Mathieu Faure , Gregory Roth

We study the asymptotic properties of distributed consensus algorithms over switching directed random networks. More specifically, we focus on consensus algorithms over independent and identically distributed, directed random graphs, where…

Multiagent Systems · Computer Science 2010-04-21 Victor M. Preciado , Alireza Tahbaz-Salehi , Ali Jadbabaie

We consider a complex-valued linear mixture model, under discrete weakly stationary processes. We recover latent components of interest, which have undergone a linear mixing. We study asymptotic properties of a classical unmixing estimator,…

Statistics Theory · Mathematics 2020-03-12 Niko Lietzén , Lauri Viitasaari , Pauliina Ilmonen

In this work, we introduce a new methodology for inferring the interaction structure of discrete valued time series which are Poisson distributed. While most related methods are premised on continuous state stochastic processes, in fact,…

Methodology · Statistics 2021-08-12 Jeremie Fish , Jie Sun , Erik Bollt

There exists a wide variety of works on the dynamics of large populations ranging from simple heuristic modeling to those based on advanced computer supported methods. Their interconnections, however, remain mostly vague, which…

Dynamical Systems · Mathematics 2023-04-27 Yuri Kozitsky , Krzysztof Pilorz

Knowing how and when trends are formed is a frequently visited research goal. In our work, we focus on the progression of trends through (social) networks. We use a random graph (RG) model to mimic the progression of a trend through the…

Social and Information Networks · Computer Science 2015-11-06 Marijn ten Thij , Sandjai Bhulai

We address the problem of reinforcement learning in which observations may exhibit an arbitrary form of stochastic dependence on past observations and actions. The task for an agent is to attain the best possible asymptotic reward where the…

Machine Learning · Computer Science 2007-05-23 Daniil Ryabko , Marcus Hutter

This paper extends the link between stochastic approximation (SA) theory and randomized urn models developed in Laruelle, Pag{\`e}s (2013), and their applications to clinical trials introduced in Bai, HU (1999,2005) and Bai, Hu, Shen…

Probability · Mathematics 2018-05-16 Sophie Laruelle , Gilles Pagès

Model predictive control strategies require to solve in an sequential manner, many, possibly non-convex, optimization problems. In this work, we propose an interacting stochastic agent system to solve those problems. The agents evolve in…

Optimization and Control · Mathematics 2023-12-21 Giacomo Borghi , Michael Herty

Hawkes process provides an effective statistical framework for analyzing the time-dependent interaction of neuronal spiking activities. Although utilized in many real applications, the classic Hawkes process is incapable of modelling…

Machine Learning · Statistics 2021-02-23 Feng Zhou , Yixuan Zhang , Jun Zhu

In [arXiv:1906.10951 (forthcoming on Advances in Applied Probability),arXiv:2011.05933 (published on PLOS ONE)] the authors introduce, study and apply a new variant of the Eggenberger-Polya urn, called the "Rescaled" Polya urn, which, for a…

Probability · Mathematics 2022-03-30 Giacomo Aletti , Irene Crimaldi