English
Related papers

Related papers: Understanding and Improving Shampoo and SOAP via K…

200 papers

An efficient algorithm for the determination of Bayesian optimal discriminating designs for competing regression models is developed, where the main focus is on models with general distributional assumptions beyond the "classical" case of…

Computation · Statistics 2015-08-04 Holger Dette , Roman Guchenko , Viatcheslav B. Melas

Adam is the go-to optimizer for training modern machine learning models, but it requires additional memory to maintain the moving averages of the gradients and their squares. While various low-memory optimizers have been proposed that…

Machine Learning · Computer Science 2025-03-19 Dayal Singh Kalra , John Kirchenbauer , Maissam Barkeshli , Tom Goldstein

Coupling arguments are a central tool for bounding the deviation between two stochastic processes, but traditionally have been limited to Wasserstein metrics. In this paper, we apply the shifted composition rule--an information-theoretic…

Statistics Theory · Mathematics 2024-12-25 Jason M. Altschuler , Sinho Chewi

We examine the estimation of the Kullback-Leibler (KL) divergence and the use of the goodness-of-fit test for multivariate continuous distributions. Our starting point is the maximum entropy principle for Shannon entropy: among all…

Statistics Theory · Mathematics 2026-03-10 Mehmet Siddik Cadirci , Martin Singull

Kullback-Leibler (KL) regularization is widely used in offline decision-making and offers several benefits, motivating recent work on the sample complexity of offline learning with respect to KL-regularized performance metrics.…

Machine Learning · Computer Science 2026-05-05 Kaixuan Ji , Qiwei Di , Heyang Zhao , Qingyue Zhao , Quanquan Gu

The rapid scaling of large language models (LLMs) has made low-precision training essential for reducing memory, improving efficiency, and enabling larger models and datasets. Existing convergence theories for adaptive optimizers, however,…

Machine Learning · Computer Science 2026-03-03 Xuan Tang , Jichu Li , Difan Zou

Limited by the scale and diversity of time series data, the neural networks trained on time series data often overfit and show unsatisfacotry performances. In comparison, large language models (LLMs) recently exhibit impressive…

Machine Learning · Computer Science 2024-06-14 Ruibing Jin , Qing Xu , Min Wu , Yuecong Xu , Dan Li , Xiaoli Li , Zhenghua Chen

The forward Kullback-Leibler (KL) divergence is a ubiquitous objective for fitting a parameterized distribution to samples due to its tractability and equivalence to maximum likelihood estimation (MLE). Its inherent asymmetry, however, may…

Machine Learning · Computer Science 2026-05-12 Omri Ben-Dov , Luiz F. O. Chamon

Online machine learning (OML) algorithms do not need any training phase and can be deployed directly in an unknown environment. OML includes multi-armed bandit (MAB) algorithms that can identify the best arm among several arms by achieving…

Signal Processing · Electrical Eng. & Systems 2020-02-19 S. V. Sai Santosh , Sumit J. Darak

Despite the success of two-stage few-shot classification methods, in the episodic meta-training stage, the model suffers severe overfitting. We hypothesize that it is caused by over-discrimination, i.e., the model learns to over-rely on the…

Machine Learning · Computer Science 2023-07-10 Siqi Hui , Sanping Zhou , Ye deng , Jinjun Wang

Recently, the nearest Kronecker product (NKP) decomposition-based normalized least mean square (NLMS-NKP) algorithm has demonstrated superior convergence performance compared to the conventional NLMS algorithm. However, its convergence rate…

Audio and Speech Processing · Electrical Eng. & Systems 2026-01-16 Jianhong Ye , Haiquan Zhao

We derive a deterministic, non-asymptotic upper bound on the Kullback-Leibler (KL) divergence of the flow-matching distribution approximation. In particular, if the $L_2$ flow-matching loss is bounded by $\epsilon^2 > 0$, then the KL…

Machine Learning · Computer Science 2025-11-10 Maojiang Su , Jerry Yao-Chieh Hu , Sophia Pi , Han Liu

In this paper, we delve deeper into the Kullback-Leibler (KL) Divergence loss and mathematically prove that it is equivalent to the Decoupled Kullback-Leibler (DKL) Divergence loss that consists of 1) a weighted Mean Square Error (wMSE)…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Jiequan Cui , Zhuotao Tian , Zhisheng Zhong , Xiaojuan Qi , Bei Yu , Hanwang Zhang

Normalizing flows can generate complex target distributions and thus show promise in many applications in Bayesian statistics as an alternative or complement to MCMC for sampling posteriors. Since no data set from the target posterior…

Machine Learning · Statistics 2021-07-19 Marylou Gabrié , Grant M. Rotskoff , Eric Vanden-Eijnden

The Kullback-Leibler (KL) divergence plays a central role in probabilistic machine learning, where it commonly serves as the canonical loss function. Optimization in such settings is often performed over the probability simplex, where the…

Machine Learning · Computer Science 2025-07-31 Adwait Datar , Nihat Ay

We introduce two complementary techniques for efficient optimization that reduce memory requirements while accelerating training of large-scale neural networks. The first technique, Subset-Norm step size, generalizes AdaGrad-Norm and…

Machine Learning · Computer Science 2025-05-27 Thien Hang Nguyen , Huy Le Nguyen

We study the problem of spectrum estimation from transmission data of a known phantom. The goal is to reconstruct an x-ray spectrum that can accurately model the x-ray transmission curves and reflects a realistic shape of the typical energy…

Medical Physics · Physics 2021-07-14 Wooseok Ha , Emil Y. Sidky , Rina Foygel Barber , Taly Gilat Schmidt , Xiaochuan Pan

The LogSumExp function, dual to the Kullback-Leibler (KL) divergence, plays a central role in many important optimization problems, including entropy-regularized optimal transport (OT) and distributionally robust optimization (DRO). In…

Optimization and Control · Mathematics 2026-02-04 Egor Gladin , Alexey Kroshnin , Jia-Jie Zhu , Pavel Dvurechensky

Efficiently sampling from un-normalized target distributions is a fundamental problem in scientific computing and machine learning. Traditional approaches such as Markov Chain Monte Carlo (MCMC) guarantee asymptotically unbiased samples…

Machine Learning · Statistics 2025-06-06 Weijian Luo , Boya Zhang , Zhihua Zhang

Curvature regularization techniques like Sharpness Aware Minimization (SAM) have shown great promise in improving generalization on vision tasks. However, we find that SAM performs poorly in domains like natural language processing (NLP),…

Machine Learning · Computer Science 2025-02-05 Sidak Pal Singh , Hossein Mobahi , Atish Agarwala , Yann Dauphin