English
Related papers

Related papers: PETScML: Second-order solvers for training regress…

200 papers

Bilevel optimization, addressing challenges in hierarchical learning tasks, has gained significant interest in machine learning. The practical implementation of the gradient descent method to bilevel optimization encounters computational…

Machine Learning · Computer Science 2025-02-04 Sheng Fang , Yong-Jin Liu , Wei Yao , Chengming Yu , Jin Zhang

A stochastic second-order trust region method is proposed, which can be viewed as a second-order extension of the trust-region-ish (TRish) algorithm proposed by Curtis et al. (INFORMS J. Optim. 1(3) 200-220, 2019). In each iteration, a…

Optimization and Control · Mathematics 2019-11-19 Frank E. Curtis , Rui Shi

A framework previously introduced in [3] for solving a sequence of stochastic optimization problems with bounded changes in the minimizers is extended and applied to machine learning problems such as regression and classification. The…

Machine Learning · Computer Science 2019-04-08 Craig Wilson , Yuheng Bu , Venugopal Veeravalli

Recurrent Neural Networks (RNNs) are widely used for online regression due to their ability to generalize nonlinear temporal dependencies. As an RNN model, Long-Short-Term-Memory Networks (LSTMs) are commonly preferred in practice, as these…

Machine Learning · Computer Science 2021-06-01 N. Mert Vural , Fatih Ilhan , Selim F. Yilmaz , Salih Ergüt , Suleyman S. Kozat

Deep neural networks are usually trained with stochastic gradient descent (SGD), which minimizes objective function using very rough approximations of gradient, only averaging to the real gradient. Standard approaches like momentum or ADAM…

Machine Learning · Computer Science 2023-03-14 Jarek Duda

We propose a multi-step training method for designing generalized linear classifiers. First, an initial multi-class linear classifier is found through regression. Then validation error is minimized by pruning of unnecessary inputs.…

Machine Learning · Computer Science 2023-12-15 Kanishka Tyagi , Chinmay Rane , Michael Manry

In this paper a robust second-order method is developed for the solution of strongly convex l1-regularized problems. The main aim is to make the proposed method as inexpensive as possible, while even difficult problems can be efficiently…

Optimization and Control · Mathematics 2015-01-13 Kimon Fountoulakis , Jacek Gondzio

Second-order methods for neural network optimization have several advantages over methods based on first-order gradient descent, including better scaling to large mini-batch sizes and fewer updates needed for convergence. But they are…

Machine Learning · Computer Science 2017-12-21 Huishuai Zhang , Caiming Xiong , James Bradbury , Richard Socher

Despite their popularity in the field of continuous optimisation, second-order quasi-Newton methods are challenging to apply in machine learning, as the Hessian matrix is intractably large. This computational burden is exacerbated by the…

Machine Learning · Computer Science 2024-02-28 Elre T. Oldewage , Ross M. Clarke , José Miguel Hernández-Lobato

Sampling from the posterior distribution poses a major computational challenge in solving inverse problems using latent diffusion models. Common methods rely on Tweedie's first-order moments, which are known to induce a quality-limiting…

Machine Learning · Computer Science 2023-12-05 Litu Rout , Yujia Chen , Abhishek Kumar , Constantine Caramanis , Sanjay Shakkottai , Wen-Sheng Chu

The term `surrogate modeling' in computational science and engineering refers to the development of computationally efficient approximations for expensive simulations, such as those arising from numerical solution of partial differential…

Numerical Analysis · Mathematics 2022-08-12 Maarten V. de Hoop , Daniel Zhengyu Huang , Elizabeth Qian , Andrew M. Stuart

Bayesian inverse problems arise in various scientific and engineering domains, and solving them can be computationally demanding. This is especially the case for problems governed by partial differential equations, where the repeated…

Numerical Analysis · Mathematics 2025-11-04 Juntao Yang , Jeff Adie , Simon See , Adriano Gualandi , Gianmarco Mengaldo

Second-order methods are widely adopted to improve the convergence rate of learning algorithms. In federated learning (FL), these methods require the clients to share their local Hessian matrices with the parameter server (PS), which comes…

Machine Learning · Computer Science 2024-12-06 Shayan Mohajer Hamidi , Ali Bereyhi , Saba Asaad , H. Vincent Poor

The slow convergence rate and pathological curvature issues of first-order gradient methods for training deep neural networks, initiated an ongoing effort for developing faster $\mathit{second}$-$\mathit{order}$ optimization algorithms…

Machine Learning · Computer Science 2020-12-10 Jan van den Brand , Binghui Peng , Zhao Song , Omri Weinstein

Scientific research faces high costs and inefficiencies with traditional methods, but the rise of deep learning and large language models (LLMs) offers innovative solutions. This survey reviews transformer-based LLM applications across…

Machine Learning · Computer Science 2025-09-16 Kaiyuan Tian , Linbo Qiao , Baihui Liu , Gongqingjian Jiang , Shanshan Li , Dongsheng Li

Second-order optimization methods offer notable advantages in training deep neural networks by utilizing curvature information to achieve faster convergence. However, traditional second-order techniques are computationally prohibitive,…

Machine Learning · Computer Science 2024-10-04 James Vo

Training deep neural networks consumes increasing computational resource shares in many compute centers. Often, a brute force approach to obtain hyperparameter values is employed. Our goal is (1) to enhance this by enabling second-order…

Machine Learning · Computer Science 2022-08-04 Severin Reiz , Tobias Neckel , Hans-Joachim Bungartz

Machine learning methods are increasingly used to build computationally inexpensive surrogates for complex physical models. The predictive capability of these surrogates suffers when data are noisy, sparse, or time-dependent. As we are…

Machine Learning · Computer Science 2024-05-20 A. Diaw , M. McKerns , I. Sagert , L. G. Stanton , M. S. Murillo

In modern deep learning, highly subsampled stochastic approximation (SA) methods are preferred to sample average approximation (SAA) methods because of large data sets as well as generalization properties. Additionally, due to perceived…

Optimization and Control · Mathematics 2021-08-26 Thomas O'Leary-Roseberry , Nick Alger , Omar Ghattas

We present two sampled quasi-Newton methods (sampled LBFGS and sampled LSR1) for solving empirical risk minimization problems that arise in machine learning. Contrary to the classical variants of these methods that sequentially build…

Optimization and Control · Mathematics 2021-07-29 Albert S. Berahas , Majid Jahani , Peter Richtárik , Martin Takáč