English
Related papers

Related papers: A Robust Multi-Batch L-BFGS Method for Machine Lea…

200 papers

Multi-Modal Learning (MML) integrates information from diverse modalities to improve predictive accuracy. While existing optimization strategies have made significant strides by mitigating gradient direction conflicts, we revisit MML from a…

Machine Learning · Computer Science 2026-02-09 Peizheng Guo , Jingyao Wang , Wenwen Qiang , Jiahuan Zhou , Changwen Zheng , Gang Hua

Physics-informed machine learning and inverse modeling require the solution of ill-conditioned non-convex optimization problems. First-order methods, such as SGD and ADAM, and quasi-Newton methods, such as BFGS and L-BFGS, have been applied…

Numerical Analysis · Mathematics 2021-05-18 Kailai Xu , Eric Darve

The BFGS quasi-Newton methodology, popular for smooth minimization, has also proved surprisingly effective in nonsmooth optimization. Through a variety of simple examples and computational experiments, we explore how the BFGS matrix update…

Optimization and Control · Mathematics 2018-02-20 Jiayi Guo , Adrian S. Lewis

Parallel stochastic gradient methods are gaining prominence in solving large-scale machine learning problems that involve data distributed across multiple nodes. However, obtaining unbiased stochastic gradients, which have been the focus of…

Machine Learning · Computer Science 2025-01-14 Ali Beikmohammadi , Sarit Khirirat , Sindri Magnússon

In this work, we develop analysis and algorithms for a class of (stochastic) bilevel optimization problems whose lower-level (LL) problem is strongly convex and linearly constrained. Most existing approaches for solving such problems rely…

Optimization and Control · Mathematics 2025-04-08 Prashant Khanduri , Ioannis Tsaknakis , Yihua Zhang , Sijia Liu , Mingyi Hong

In this paper, we develop a new accelerated stochastic gradient method for efficiently solving the convex regularized empirical risk minimization problem in mini-batch settings. The use of mini-batches is becoming a golden standard in the…

Optimization and Control · Mathematics 2017-09-20 Tomoya Murata , Taiji Suzuki

We study optimization algorithms for the finite sum problems frequently arising in machine learning applications. First, we propose novel variants of stochastic gradient descent with a variance reduction property that enables linear…

Machine Learning · Computer Science 2017-07-06 Jakub Konečný

Stochastic gradient methods for minimizing nonconvex composite objective functions typically rely on the Lipschitz smoothness of the differentiable part, but this assumption fails in many important problem classes like quadratic inverse…

Optimization and Control · Mathematics 2025-01-22 Kuangyu Ding , Jingyang Li , Kim-Chuan Toh

In this paper, a novel stochastic extra-step quasi-Newton method is developed to solve a class of nonsmooth nonconvex composite optimization problems. We assume that the gradient of the smooth part of the objective function can only be…

Optimization and Control · Mathematics 2019-10-22 Minghan Yang , Andre Milzarek , Zaiwen Wen , Tong Zhang

Distribution shifts are ubiquitous in real-world machine learning applications, posing a challenge to the generalization of models trained on one data distribution to another. We focus on scenarios where data distributions vary across…

Machine Learning · Statistics 2024-06-05 Steven Wilkins-Reeves , Xu Chen , Qi Ma , Christine Agarwal , Aude Hofleitner

We consider the problem of minimizing the average of a large number of smooth but possibly non-convex functions. In the context of most machine learning applications, each loss function is non-negative and thus can be expressed as the…

Optimization and Control · Mathematics 2024-07-08 Antonio Orvieto , Lin Xiao

In this paper, we consider non-convex multi-block bilevel optimization (MBBO) problems, which involve $m\gg 1$ lower level problems and have important applications in machine learning. Designing a stochastic gradient and controlling its…

Optimization and Control · Mathematics 2023-06-05 Quanqi Hu , Zi-Hao Qiu , Zhishuai Guo , Lijun Zhang , Tianbao Yang

We propose an online learning algorithm for a class of machine learning models under a separable stochastic approximation framework. The essence of our idea lies in the observation that certain parameters in the models are easier to…

Machine Learning · Computer Science 2023-05-23 Min Gan , Xiang-xiang Su , Guang-yong Chen , Jing Chen

Multi-task learning (MTL) aims at solving multiple related tasks simultaneously and has experienced rapid growth in recent years. However, MTL models often suffer from performance degeneration with negative transfer due to learning several…

Machine Learning · Computer Science 2023-02-01 Xin Dong , Ruize Wu , Chao Xiong , Hai Li , Lei Cheng , Yong He , Shiyou Qian , Jian Cao , Linjian Mo

This paper introduces novel alternate training procedures for hard-parameter sharing Multi-Task Neural Networks (MTNNs). Traditional MTNN training faces challenges in managing conflicting loss gradients, often yielding sub-optimal…

Machine Learning · Computer Science 2025-05-20 Stefania Bellavia , Francesco Della Santa , Alessandra Papini

Matrix-parametrized models, including multiclass logistic regression and sparse coding, are used in machine learning (ML) applications ranging from computer vision to computational biology. When these models are applied to large-scale ML…

Machine Learning · Computer Science 2015-11-30 Pengtao Xie , Jin Kyu Kim , Yi Zhou , Qirong Ho , Abhimanu Kumar , Yaoliang Yu , Eric Xing

Matrix-parametrized models, including multiclass logistic regression and sparse coding, are used in machine learning (ML) applications ranging from computer vision to computational biology. When these models are applied to large-scale ML…

Machine Learning · Computer Science 2015-09-08 Pengtao Xie , Jin Kyu Kim , Yi Zhou , Qirong Ho , Abhimanu Kumar , Yaoliang Yu , Eric Xing

We present practical Levenberg-Marquardt variants of Gauss-Newton and natural gradient methods for solving non-convex optimization problems that arise in training deep neural networks involving enormous numbers of variables and huge data…

Machine Learning · Computer Science 2019-06-07 Yi Ren , Donald Goldfarb

We propose a modified BFGS algorithm for multiobjective optimization problems with global convergence, even in the absence of convexity assumptions on the objective functions. Furthermore, we establish the superlinear convergence of the…

Optimization and Control · Mathematics 2024-04-12 L. F. Prudente , D. R. Souza

When using stochastic gradient descent to solve large-scale machine learning problems, a common practice of data processing is to shuffle the training data, partition the data across multiple machines if needed, and then perform several…

Machine Learning · Statistics 2017-10-02 Qi Meng , Wei Chen , Yue Wang , Zhi-Ming Ma , Tie-Yan Liu