English
Related papers

Related papers: Decoupled Functional Central Limit Theorems for Tw…

200 papers

Simultaneous perturbation stochastic approximation (SPSA) is widely used in stochastic optimization due to its high efficiency, asymptotic stability, and reduced number of required loss function measurements. However, the standard SPSA…

Optimization and Control · Mathematics 2023-02-07 Zhichao Jia , Ziyi Wei , James C. Spall

We consider the effect of asymmetric temporal delays in a system of two coupled Hopfield neurons. For couplings of opposite signs, a limit cycle emerges via a supercritical Hopf bifurcation when the sum of the delays reaches a critical…

Biological Physics · Physics 2011-11-10 Sebastian F. Brandt , Axel Pelster , Ralf Wessel

Stochastic Approximation (SA) is a widely used algorithmic approach in various fields, including optimization and reinforcement learning (RL). Among RL algorithms, Q-learning is particularly popular due to its empirical success. In this…

Machine Learning · Statistics 2024-01-26 Yixuan Zhang , Qiaomin Xie

A renewal system divides the slotted timeline into back to back time periods called renewal frames. At the beginning of each frame, it chooses a policy from a set of options for that frame. The policy determines the duration of the frame,…

Optimization and Control · Mathematics 2021-02-02 Xiaohan Wei

We derive limit theorems for the empirical distribution function of "devolatilized" increments of an It\^{o} semimartingale observed at high frequencies. These "devolatilized" increments are formed by suitably rescaling and truncating the…

Probability · Mathematics 2014-07-03 Viktor Todorov , George Tauchen

A quantity of interest to characterise continuous-valued stochastic processes is the differential entropy rate. The rate of convergence of many properties of LRD processes is slower than might be expected, based on the intuition for…

Information Theory · Computer Science 2021-11-02 Andrew Feutrill , Matthew Roughan

The challenging problem of conducting fully Bayesian inference for the reaction rate constants governing stochastic kinetic models (SKMs) is considered. Given the challenges underlying this problem, the Markov jump process representation is…

Computation · Statistics 2019-01-10 Andrew Golightly , Emma Bradley , Tom Lowe , Colin S. Gillespie

We study the impact of competing time delays in coupled stochastic synchronization and coordination problems. We consider two types of delays: transmission delays between interacting elements and processing, cognitive, or execution delays…

Statistical Mechanics · Physics 2011-01-12 D. Hunt , G. Korniss , B. K. Szymanski

Stochastic approximation (SA) and stochastic gradient descent (SGD) algorithms are work-horses for modern machine learning algorithms. Their constant stepsize variants are preferred in practice due to fast convergence behavior. However,…

Machine Learning · Computer Science 2021-11-12 Zaiwei Chen , Shancong Mou , Siva Theja Maguluri

Recently, the distributed state estimation problem for continuous-time linear systems over jointly connected switching networks was solved. It was shown that the estimation errors will asymptotically converge to the origin by using the…

Optimization and Control · Mathematics 2022-10-07 Tao Liu , Jie Huang

This paper introduces a class of two-stage stochastic minimax problems where the first-stage objective function is nonconvex-concave while the second-stage objective function is strongly convex-concave. We establish properties of the…

Optimization and Control · Mathematics 2025-11-06 Hailin Sun , Xiaojun Chen

The paper addresses a continuous-time continuous-space chance-constrained stochastic optimal control (SOC) problem where the probability of failure to satisfy given state constraints is explicitly bounded. We leverage the notion of exit…

Systems and Control · Electrical Eng. & Systems 2025-11-26 Apurva Patil , Alfredo Duarte , Fabrizio Bisetti , Takashi Tanaka

We consider controlled martingales with bounded steps where the controller is allowed at each step to choose the distribution of the next step, and where the goal is to hit a fixed ball at the origin at time $n$. We show that the algebraic…

Probability · Mathematics 2016-06-23 Scott N. Armstrong , Ofer Zeitouni

In this paper it is established that any jointly controllable, jointly observable, multi-channel, discrete or continuous time linear system with a strongly connected neighbor (communication) graph can be exponentially stabilized with any…

Systems and Control · Electrical Eng. & Systems 2022-12-02 Fengjiao Liu , Lili Wang , Daniel Fullmer , A. Stephen Morse

This paper revisits the classical notion of sampling in the setting of real-time temporal logics for the modeling and analysis of systems. The relationship between the satisfiability of Metric Temporal Logic (MTL) formulas over…

Logic in Computer Science · Computer Science 2015-03-13 Carlo A. Furia , Matteo Rossi

Motivated by problems arising in decentralized control problems and non-cooperative Nash games, we consider a class of strongly monotone Cartesian variational inequality (VI) problems, where the mappings either contain expectations or their…

Optimization and Control · Mathematics 2013-01-10 Farzad Yousefian , Angelia Nedić , Uday V. Shanbhag

We consider an infinite-dimensional stochastic clustering model on $\mathbb{R}$. In discrete time, each point of a unit-intensity simple point process moves halfway toward either of its left or right neighbors, chosen uniformly at random.…

Probability · Mathematics 2026-03-10 Partha S. Dey , S. Rasoul Etesami , Aditya S. Gopalan

We begin by briefly surveying some results on the convergence of the Stochastic Gradient Descent (SGD) Method, proved in a companion paper by the present authors. These results are based on viewing SGD as a version of Stochastic…

Machine Learning · Statistics 2025-09-10 Rajeeva L. Karandikar , M. Vidyasagar

We study the problem of controlling multi-agent systems under a set of signal temporal logic tasks. Signal temporal logic is a formalism that is used to express time and space constraints for dynamical systems. Recent methods to solve the…

Systems and Control · Electrical Eng. & Systems 2020-11-26 Lars Lindemann , Dimos V. Dimarogonas

Stochastic optimization naturally appear in many application areas, including machine learning. Our goal is to go further in the analysis of the Stochastic Average Gradient Accelerated (SAGA) algorithm. To achieve this, we introduce a new…

Optimization and Control · Mathematics 2024-10-08 Luis Fredes , Bernard Bercu , Eméric Gbaguidi