English
Related papers

Related papers: Fast and Robust Online Inference with Stochastic G…

200 papers

Stochastic Gradient Descent (SGD) is an important algorithm in machine learning. With constant learning rates, it is a stochastic process that, after an initial phase of convergence, generates samples from a stationary distribution. We show…

Machine Learning · Statistics 2017-09-12 Stephan Mandt , Matthew D. Hoffman , David M. Blei

Stochastic Gradient Descent (SGD) has become a cornerstone method in modern data science. However, deploying SGD in high-stakes applications necessitates rigorous quantification of its inherent uncertainty. In this work, we establish…

Machine Learning · Computer Science 2025-10-23 Bhavya Agrawalla , Krishnakumar Balasubramanian , Promit Ghosal

Privacy preservation in machine learning, particularly through Differentially Private Stochastic Gradient Descent (DP-SGD), is critical for sensitive data analysis. However, existing statistical inference methods for SGD predominantly focus…

Machine Learning · Statistics 2025-12-15 Xintao Xia , Linjun Zhang , Zhanrui Cai

Stochastic Gradient Descent (SGD) and its Ruppert-Polyak averaged variant (ASGD) lie at the heart of modern large-scale learning, yet their theoretical properties in high-dimensional settings are rarely understood. In this paper, we provide…

Machine Learning · Statistics 2025-10-15 Jiaqi Li , Zhipeng Lou , Johannes Schmidt-Hieber , Wei Biao Wu

We develop methods for parameter estimation in settings with large-scale data sets, where traditional methods are no longer tenable. Our methods rely on stochastic approximations, which are computationally efficient as they maintain one…

Computation · Statistics 2015-09-23 Dustin Tran , Panos Toulis , Edoardo M. Airoldi

Stream stochastic gradient descent (SGD) is a simple and efficient method for solving online optimization problems in operations research (OR), where data is generated by parameter-dependent Markov chains. Unlike traditional approaches…

Optimization and Control · Mathematics 2025-09-03 Xiang Li , Jiadong Liang , Xinyun Chen , Zhihua Zhang

The construction of confidence intervals and hypothesis tests for functionals is a cornerstone of statistical inference. Traditionally, the most efficient procedures - such as the Wald interval or the Likelihood Ratio Test - require both a…

Machine Learning · Statistics 2026-03-19 Selina Carter , Arun K Kuchibhotla

With the fast development of big data, learning the optimal decision rule by recursively updating it and making online decisions has been easier than before. We study the online statistical inference of model parameters in a contextual…

Machine Learning · Statistics 2026-01-22 Xiangyu Chang , Xi Chen , Zehua Lai , He Li , Zhihong Liu , Yichen Zhang

Stochastic gradient descent (SGD) or stochastic approximation has been widely used in model training and stochastic optimization. While there is a huge literature on analyzing its convergence, inference on the obtained solutions from SGD…

Machine Learning · Statistics 2026-04-01 Henry Lam , Zitong Wang

The implicit stochastic gradient descent (ISGD), a proximal version of SGD, is gaining interest in the literature due to its stability over (explicit) SGD. In this paper, we conduct an in-depth analysis of the two modes of ISGD for smooth…

Machine Learning · Statistics 2022-06-29 Yoonhyung Lee , Sungdong Lee , Joong-Ho Won

We introduce data structures for solving robust regression through stochastic gradient descent (SGD) by sampling gradients with probability proportional to their norm, i.e., importance sampling. Although SGD is widely used for large scale…

Machine Learning · Computer Science 2022-07-19 Sepideh Mahabadi , David P. Woodruff , Samson Zhou

Stochastic gradient descent (SGD) is a scalable and memory-efficient optimization algorithm for large datasets and stream data, which has drawn a great deal of attention and popularity. The applications of SGD-based estimators to…

Methodology · Statistics 2026-03-04 Ruiqi Liu , Xi Chen , Zuofeng Shang

In this work, we propose a stochastic gradient descent (SGD) framework to design data-driven policy gradient descent algorithms for the linear quadratic regulator problem. Two alternative schemes are considered to estimate the policy…

Systems and Control · Electrical Eng. & Systems 2026-02-24 Bowen Song , Simon Weissmann , Mathias Staudigl , Andrea Iannelli

Matrix completion, where we wish to recover a low rank matrix by observing a few entries from it, is a widely studied problem in both theory and practice with wide applications. Most of the provable algorithms so far on this problem have…

Machine Learning · Computer Science 2016-05-27 Chi Jin , Sham M. Kakade , Praneeth Netrapalli

Motivated by robust and quantile regression problems, we investigate the stochastic gradient descent (SGD) algorithm for minimizing an objective function $f$ that is locally strongly convex with a sub--quadratic tail. This setting covers…

Machine Learning · Statistics 2025-04-16 Yixuan Zhang , Dongyan Huo , Yudong Chen , Qiaomin Xie

With the rapid development of data collection and aggregation technologies in many scientific disciplines, it is becoming increasingly ubiquitous to conduct large-scale or online regression to analyze real-world data and unveil real-world…

Methodology · Statistics 2021-03-22 Jinfeng Xu , Zhiliang Ying , Na Zhao

We study online covariance matrix estimation for Polyak--Ruppert averaged stochastic gradient descent (SGD). The online batch-means estimator of Zhu, Chen and Wu (2023) achieves an operator-norm convergence rate of $O(n^{-(1-\alpha)/4})$,…

Machine Learning · Computer Science 2026-04-14 Yijin Ni , Xiaoming Huo

In recent literature, a general two step procedure has been formulated for solving the problem of phase retrieval. First, a spectral technique is used to obtain a constant-error initial estimate, following which, the estimate is refined to…

Machine Learning · Statistics 2023-07-10 Yan Shuo Tan , Roman Vershynin

We provide non-asymptotic convergence rates of the Polyak-Ruppert averaged stochastic gradient descent (SGD) to a normal random vector for a class of twice-differentiable test functions. A crucial intermediate step is proving a…

Statistics Theory · Mathematics 2019-04-04 Andreas Anastasiou , Krishnakumar Balasubramanian , Murat A. Erdogdu

Constrained stochastic nonlinear optimization problems have attracted significant attention for their ability to model complex real-world scenarios in physics, economics, and biology. As datasets continue to grow, online inference methods…

Machine Learning · Statistics 2025-05-27 Xinchen Du , Wanrong Zhu , Wei Biao Wu , Sen Na