English
Related papers

Related papers: Decoupled Functional Central Limit Theorems for Tw…

200 papers

We consider the two-species totally asymmetric simple exclusion process on $\mathbb{Z}$ with a translation-invariant stationary measure as the initial condition. We establish the asymptotic decoupling of the marginal height profiles along…

Probability · Mathematics 2025-07-22 Patrik L. Ferrari , Sabrina Gernholt

Single fault sequential change point problems have become important in modeling for various phenomena in large distributed systems, such as sensor networks. But such systems in many situations present multiple interacting faults. For…

Information Theory · Computer Science 2015-03-17 Ram Rajagopal , XuanLong Nguyen , Sinem Coleri Ergen , Pravin Varaiya

A functional limit theorem is established for the partial-sum process of a class of stationary sequences which exhibit both heavy tails and long-range dependence. The stationary sequence is constructed using multiple stochastic integrals…

Probability · Mathematics 2020-04-09 Shuyang Bai , Takashi Owada , Yizao Wang

This study introduces Skewed Fully Asynchronous Cellular Automata (SACA), a novel update scheme in cellular automata that updates the states of only two consecutive and adjacent cells, such as ci and ci+1, simultaneously at each time step.…

Formal Languages and Automata Theory · Computer Science 2025-01-07 Virendra Kumar Gautam

Stochastic gradient descent in continuous time (SGDCT) provides a computationally efficient method for the statistical learning of continuous-time models, which are widely used in science, engineering, and finance. The SGDCT algorithm…

Probability · Mathematics 2019-06-18 Justin Sirignano , Konstantinos Spiliopoulos

This work provides a novel convergence analysis for stochastic optimization in terms of stopping times, addressing the practical reality that algorithms are often terminated adaptively based on observed progress. Unlike prior approaches,…

Optimization and Control · Mathematics 2025-07-17 Yasong Feng , Yifan Jiang , Tianyu Wang , Zhiliang Ying

We study the asymptotic behavior for an inhomogeneous multiscale stochastic dynamical system with non-smooth coefficients. Depending on the averaging regime and the homogenization regime, two strong convergences in the averaging principle…

Probability · Mathematics 2021-04-21 Michael Röckner , Longjie Xie

Gradient temporal difference (Gradient TD) algorithms are a popular class of stochastic approximation (SA) algorithms used for policy evaluation in reinforcement learning. Here, we consider Gradient TD algorithms with an additional heavy…

Machine Learning · Computer Science 2021-11-23 Rohan Deb , Shalabh Bhatnagar

In this paper, we develop necessary and sufficient conditions for the validity of a martingale approximation for the partial sums of a stationary process in terms of the maximum of consecutive errors. Such an approximation is useful for…

Probability · Mathematics 2011-02-11 Mikhail Gordin , Magda Peligrad

Time-parallel algorithms, such as Parareal, are well-understood for linear problems, but their convergence analysis for nonlinear, chaotic systems remains limited. This paper introduces a new theoretical framework for analysing…

Numerical Analysis · Mathematics 2026-04-02 Giancarlo Antonino Antonucci , Raphael Andreas Hauser , Debasmita Samaddar , James Buchanan

In this article, we quantify the functional convergence of the rescaled random walk with heavy tails to a stable process.This generalizes the Generalized Central Limit Theorem for stable random variables infinite dimension. We show that…

Probability · Mathematics 2026-04-02 Lorick Huang , Laurent Decreusefond , Laure Coutin

This work develops new results for stochastic approximation algorithms. The emphases are on treating algorithms and limits with discontinuities. The main ingredients include the use of differential inclusions, set-valued analysis, and…

Probability · Mathematics 2021-08-31 Nhu Nguyen , George Yin

We consider a setting in which $N$ agents aim to speedup a common Stochastic Approximation (SA) problem by acting in parallel and communicating with a central server. We assume that the up-link transmissions to the server are subject to…

Artificial Intelligence · Computer Science 2024-08-05 Nicolò Dal Fabbro , Arman Adibi , H. Vincent Poor , Sanjeev R. Kulkarni , Aritra Mitra , George J. Pappas

Two-time-scale stochastic approximation is a popular iterative method for finding the solution of a system of two equations. Such methods have found broad applications in many areas, especially in machine learning and reinforcement…

Optimization and Control · Mathematics 2019-12-24 Thinh T. Doan , Justin Romberg

We study the so-called two-time-scale stochastic approximation, a simulation-based approach for finding the roots of two coupled nonlinear operators. Our focus is to characterize its finite-time performance in a Markov setting, which often…

Optimization and Control · Mathematics 2021-04-06 Thinh T. Doan

Supervised fine-tuning (SFT) is a crucial step for adapting large language models (LLMs) to downstream tasks. However, conflicting objectives across heterogeneous SFT tasks often induce the "seesaw effect": optimizing for one task may…

Computation and Language · Computer Science 2026-01-27 Xiaoyu Liu , Xiaoyu Guan , Di Liang , Xianjie Wu

Dynamical decoupling is a key method to mitigate errors in a quantum mechanical system, and we studied it in a series of papers dealing in particular with the problems arising from unbounded Hamiltonians. The standard bangbang model of…

Mathematical Physics · Physics 2022-11-15 Daniel Burgarth , Paolo Facchi , Robin Hillier

Stochastic approximation (SA) is a key method used in statistical learning. Recently, its non-asymptotic convergence analysis has been considered in many papers. However, most of the prior analyses are made under restrictive assumptions…

Machine Learning · Statistics 2019-06-18 Belhal Karimi , Blazej Miasojedow , Eric Moulines , Hoi-To Wai

The paper is concerned with stochastic approximation procedures having three main characteristics: truncations with random moving bounds, a matrix valued random step-size sequence, and a dynamically changing random regression function. We…

Statistics Theory · Mathematics 2016-11-14 Teo Sharia , Lei Zhong

Online Conformal Prediction (CP) struggles to balance temporal adaptability and structural stability. Feedback-driven methods (e.g., Adaptive Conformal Inference (ACI)) suffer from systemic marginal under-coverage and high interval variance…

Machine Learning · Computer Science 2026-05-04 Yu-Hsueh Fang , Chia-Yen Lee