English
Related papers

Related papers: Stochastic Approximation with Two Time Scales: The…

200 papers

Bilevel optimization problems are receiving increasing attention in machine learning as they provide a natural framework for hyperparameter optimization and meta-learning. A key step to tackle these problems is the efficient computation of…

Machine Learning · Statistics 2025-05-20 Riccardo Grazzi , Massimiliano Pontil , Saverio Salzo

We establish a rate of convergence of the two scale expansion (in the sense of homogenization theory) of the solution to a highly oscillatory elliptic partial differential equation with random coefficients that are a perturbation of…

Analysis of PDEs · Mathematics 2011-10-25 C. Le Bris , F. Legoll , F. Thomines

Stochastic averaging allows for the reduction of the dimension and complexity of stochastic dynamical systems with multiple time scales, replacing fast variables with statistically equivalent stochastic processes in order to analyze…

Probability · Mathematics 2015-02-25 William F. Thompson , Rachel A. Kuske , Adam H. Monahan

As an application of Stein's method for Poisson approximation, we prove rates of convergence for the tail probabilities of two scan statistics that have been suggested for detecting local signals in sequences of independent random variables…

Probability · Mathematics 2015-05-29 Xiao Fang , David Siegmund

Bayesian optimization is a sample-efficient method for solving expensive, black-box optimization problems. Stochastic programming concerns optimization under uncertainty where, typically, average performance is the quantity of interest. In…

Machine Learning · Statistics 2025-02-19 Jack M. Buckingham , Ivo Couckuyt , Juergen Branke

Current statistics can be calculated in various ways. Event-based approaches use the statistics of the number of events occuring during a given time. Time-based approaches use the statistics of the time needed to reach a given number of…

Statistical Mechanics · Physics 2015-05-14 Massimiliano Esposito , Katja Lindenberg , Igor M. Sokolov

We study a class of second order variational inequalities with bilateral constraints. Under certain conditions we show the existence of a unique viscosity solution of these variational inequalities and give a stochastic representation to…

Analysis of PDEs · Mathematics 2007-05-23 Mrinal K Ghosh , K S Mallikarjuna Rao

This paper studies high-dimensional curve time series with common stochastic trends. A dual functional factor model structure is adopted with a high-dimensional factor model for the observed curve time series and a low-dimensional factor…

Econometrics · Economics 2025-09-16 Degui Li , Yu-Ning Li , Peter C. B. Phillips

In this paper we compare the notion of stochastic two-scale convergence in the mean (by Bourgeat, Mikeli\'c and Wright), the notion of stochastic unfolding (recently introduced by the authors), and the quenched notion of stochastic…

Probability · Mathematics 2021-05-27 Martin Heida , Stefan Neukamm , Mario Varga

We describe two families of statistical tests to detect partial correlation in vectorial timeseries. The tests measure whether an observed timeseries Y can be predicted from a second series X, even after accounting for a third series Z…

Methodology · Statistics 2024-04-25 Kenneth D. Harris , Alex E. Yuan

The (conditional or unconditional) distribution of the continuous scan statistic in a one-dimensional Poisson process may be approximated by that of a discrete analogue via time discretization (to be referred to as the discrete…

Probability · Mathematics 2016-02-09 Yi-Ching Yao , Daniel Wei-Chung Miao , Xenos Chang-Shuo Lin

In this paper I provide simple and easily verifiable conditions under which a strong form of stochastic equicontinuity holds in a wide variety of modern time series models. In contrast to most results currently available in the literature,…

Statistics Theory · Mathematics 2014-02-20 Andreas Hagemann

The second-largest order statistic is of special importance in reliability theory since it represents the time to failure of a $2$-out-of-$n$ system. Consider two $2$-out-of-$n$ systems with heterogeneous random lifetimes. The lifetimes are…

Statistics Theory · Mathematics 2021-04-20 Sangita Das , Suchandan Kayal

From a continuous-time long memory stochastic process, a discrete-time randomly sampled one is drawn. We investigate the second-order properties of this process and establish some time-and frequency-domain asymptotic results. We mainly…

Statistics Theory · Mathematics 2021-10-12 Mohamedou Ould Haye , Anne Philippe , Caroline Robet

In two-time-scale stochastic approximation (SA), two iterates are updated at different rates, governed by distinct step sizes, with each update influencing the other. Previous studies have demonstrated that the convergence rates of the…

Probability · Mathematics 2026-02-12 Yuze Han , Xiang Li , Jiadong Liang , Zhihua Zhang

For a Bayesian, real-time forecasting with the posterior predictive distribution can be challenging for a variety of time series models. First, estimating the parameters of a time series model can be difficult with sample-based approaches…

Applications · Statistics 2022-08-08 Taylor R. Brown

Sequentially obtained dataset usually exhibits different behavior at different data resolutions/scales. Instead of inferring from data at each scale individually, it is often more informative to interpret the data as an ensemble of time…

Mesoscale and Nanoscale Physics · Physics 2021-03-19 Yuan Yang , Jie Ding

We propose a novel study of the stochastic proximal gradient method for minimizing the sum of two convex functions, one of which is smooth. Under suitable assumptions and without requiring any boundedness or control of the variance of the…

Optimization and Control · Mathematics 2026-04-16 Javier I. Madariaga

Two-sample testing is a fundamental problem in statistics. Despite its long history, there has been renewed interest in this problem with the advent of high-dimensional and complex data. Specifically, in the machine learning literature,…

Methodology · Statistics 2019-11-19 Ilmun Kim , Ann B. Lee , Jing Lei

The dynamics of non-equilibrium Ising model with parallel updates is investigated using a generalized mean field approximation that incorporates multiple two-site correlations at any two time steps, which can be obtained recursively. The…

Disordered Systems and Neural Networks · Physics 2015-06-17 Hamed Mahmoudi , David Saad
‹ Prev 1 3 4 5 6 7 10 Next ›