English
Related papers

Related papers: An Exact Distributed Newton Method for Reinforceme…

200 papers

Following early work on Hessian-free methods for deep learning, we study a stochastic generalized Gauss-Newton method (SGN) for training DNNs. SGN is a second-order optimization method, with efficient iterations, that we demonstrate to…

Machine Learning · Computer Science 2020-06-11 Matilde Gargiani , Andrea Zanelli , Moritz Diehl , Frank Hutter

In this paper, we propose a quasi Newton method to solve the robust counterpart of an uncertain multiobjective optimization problem under an arbitrary finite uncertainty set. Here the robust counterpart of an uncertain multiobjective…

Optimization and Control · Mathematics 2023-10-12 Shubham kumar , Nihar Kumar Mahato , Md Abu T Ansary , Debdas Ghosh

Sparse training is a natural idea to accelerate the training speed of deep neural networks and save the memory usage, especially since large modern neural networks are significantly over-parameterized. However, most of the existing methods…

Machine Learning · Computer Science 2021-11-11 Xiao Zhou , Weizhong Zhang , Zonghao Chen , Shizhe Diao , Tong Zhang

Flow matching has emerged as a powerful generative modeling approach with flexible choices of source distribution. While Gaussian distributions are commonly used, the potential for better alternatives in high-dimensional data generation…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Junho Lee , Kwanseok Kim , Joonseok Lee

First-order stochastic methods are the state-of-the-art in large-scale machine learning optimization owing to efficient per-iteration complexity. Second-order methods, while able to provide faster convergence, have been much less explored…

Machine Learning · Statistics 2017-12-01 Naman Agarwal , Brian Bullins , Elad Hazan

Motivated by distributed machine learning settings such as Federated Learning, we consider the problem of fitting a statistical model across a distributed collection of heterogeneous data sets whose similarity structure is encoded by a…

Statistics Theory · Mathematics 2021-11-30 Dominic Richards , Sahand N. Negahban , Patrick Rebeschini

In this paper, we formulate the Load Flow (LF) problem in radial electricity distribution networks as an unconstrained Riemannian optimization problem, consisting of two manifolds, and we consider alternative retractions and initialization…

Optimization and Control · Mathematics 2020-04-09 M. Heidarifar , P. Andrianesis , M. C. Caramanis

Scalable and efficient distributed learning is one of the main driving forces behind the recent rapid advancement of machine learning and artificial intelligence. One prominent feature of this topic is that recent progresses have been made…

Machine Learning · Computer Science 2021-04-13 Ji Liu , Ce Zhang

Computing exact Optimal Transport (OT) distances for large-scale datasets is computationally prohibitive. While entropy-regularized alternatives offer speed, they sacrifice precision and frequently suffer from numerical instability in…

Optimization and Control · Mathematics 2026-03-17 Jianting Pan , Ji'an Li , Ming Yan

This paper investigates accelerating the convergence of distributed optimization algorithms on non-convex problems. We propose a distributed primal-dual stochastic gradient descent~(SGD) equipped with "powerball" method to accelerate. We…

Optimization and Control · Mathematics 2021-10-15 Shengjun Zhang , Colleen P. Bailey

Distributed optimization is the standard way of speeding up machine learning training, and most of the research in the area focuses on distributed first-order, gradient-based methods. Yet, there are settings where some…

Machine Learning · Computer Science 2025-11-03 Matin Ansaripour , Shayan Talaei , Giorgi Nadiradze , Dan Alistarh

Many machine learning applications require operating on a spatially distributed dataset. Despite technological advances, privacy considerations and communication constraints may prevent gathering the entire dataset in a central unit. In…

Machine Learning · Statistics 2024-01-30 Alexandros E. Tzikas , Licio Romao , Mert Pilanci , Alessandro Abate , Mykel J. Kochenderfer

We consider the problem of control in the setting of reinforcement learning (RL), where model information is not available. Policy gradient algorithms are a popular solution approach for this problem and are usually shown to converge to a…

Machine Learning · Computer Science 2023-04-24 Mizhaan Prajit Maniyar , Akash Mondal , Prashanth L. A. , Shalabh Bhatnagar

Backpropagation is driving today's artificial neural networks (ANNs). However, despite extensive research, it remains unclear if the brain implements this algorithm. Among neuroscientists, reinforcement learning (RL) algorithms are often…

Neurons and Cognition · Quantitative Biology 2020-04-24 Benjamin James Lansdell , Prashanth Ravi Prakash , Konrad Paul Kording

Nowadays, analysing data from different classes or over a temporal grid has attracted a great deal of interest. As a result, various multiple graphical models for learning a collection of graphical models simultaneously have been derived by…

Optimization and Control · Mathematics 2021-04-23 Ning Zhang , Yangjing Zhang , Defeng Sun , Kim-Chuan Toh

We present the first accelerated randomized algorithm for solving linear systems in Euclidean spaces. One essential problem of this type is the matrix inversion problem. In particular, our algorithm can be specialized to invert positive…

Optimization and Control · Mathematics 2018-06-21 Robert M. Gower , Filip Hanzely , Peter Richtárik , Sebastian Stich

It is well known that Tikhonov regularization is one of the most commonly used methods for solving ill-posed problems. One of the most widely applied approaches is based on constructing a new dataset whose sample size is greater than the…

Optimization and Control · Mathematics 2020-12-11 Ning Zhang

Model predictive control can optimally deal with nonlinear systems under consideration of constraints. The control performance depends on the model accuracy and the prediction horizon. Recent advances propose to use reinforcement learning…

Machine Learning · Computer Science 2024-11-01 Dean Brandner , Sergio Lucia

The present paper discusses the application of the recently proposed Augmented Lagrangian Alternating Direction Inexact Newton (ALADIN) method to non-convex AC Optimal Power Flow Problems (OPF) in a distributed fashion. In contrast to the…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-11-13 Alexander Engelmann , Yuning Jiang , Tillmann Mühlpfordt , Boris Houska , Timm Faulwasser

We study the problem of how to distribute the training of large-scale deep learning models in the parallel computing environment. We propose a new distributed stochastic optimization method called Elastic Averaging SGD (EASGD). We analyze…

Machine Learning · Computer Science 2016-05-10 Sixin Zhang