English
Related papers

Related papers: Quasi-Newton Updating for Large-Scale Distributed …

200 papers

The problem of minimizing an objective that can be written as the sum of a set of $n$ smooth and strongly convex functions is considered. The Incremental Quasi-Newton (IQN) method proposed here belongs to the family of stochastic and…

Optimization and Control · Mathematics 2017-03-29 Aryan Mokhtari , Mark Eisen , Alejandro Ribeiro

We present two sampled quasi-Newton methods (sampled LBFGS and sampled LSR1) for solving empirical risk minimization problems that arise in machine learning. Contrary to the classical variants of these methods that sequentially build…

Optimization and Control · Mathematics 2021-07-29 Albert S. Berahas , Majid Jahani , Peter Richtárik , Martin Takáč

This PhD thesis combines two of the most exciting research areas of the last decades: quantum computing and machine learning. We introduce dissipative quantum neural networks (DQNNs), which are designed for fully quantum learning tasks, are…

Quantum Physics · Physics 2022-05-18 Kerstin Beer

Deep learning algorithms often require solving a highly non-linear and nonconvex unconstrained optimization problem. Methods for solving optimization problems in large-scale machine learning, such as deep learning and deep reinforcement…

Machine Learning · Computer Science 2019-09-06 Jacob Rafati , Roummel F. Marcia

We propose a distributed, cubic-regularized Newton method for large-scale convex optimization over networks. The proposed method requires only local computations and communications and is suitable for federated learning applications over…

Optimization and Control · Mathematics 2020-07-08 César A. Uribe , Ali Jadbabaie

The question of how to incorporate curvature information in stochastic approximation methods is challenging. The direct application of classical quasi- Newton updating techniques for deterministic optimization leads to noisy curvature…

Optimization and Control · Mathematics 2015-02-19 R. H. Byrd , S. L. Hansen , J. Nocedal , Y. Singer

We consider distributed optimization in the client-server setting. By use of Douglas-Rachford splitting to the dual of the sum problem, we design a BFGS method that requires minimal communication (sending/receiving one vector per round for…

Optimization and Control · Mathematics 2024-10-30 Dingran Yi , Nikolaos M. Freris

Newton's method leverages curvature information to boost performance, and thus outperforms first-order methods for distributed learning problems. However, Newton's method is not practical in large-scale and heterogeneous learning…

Machine Learning · Computer Science 2024-12-18 Shuzhen Chen , Yuan Yuan , Youming Tao , Tianzhu Wang , Zhipeng Cai , Dongxiao Yu

Recent Newton-type federated learning algorithms have demonstrated linear convergence with respect to the communication rounds. However, communicating Hessian matrices is often unfeasible due to their quadratic communication complexity. In…

Machine Learning · Computer Science 2024-01-08 Jian Li , Yong Liu , Wei Wang , Haoran Wu , Weiping Wang

A q-Gauss-Newton algorithm is an iterative procedure that solves nonlinear unconstrained optimization problems based on minimization of the sum squared errors of the objective function residuals. Main advantage of the algorithm is that it…

Optimization and Control · Mathematics 2021-05-28 Danijela Protic , Miomir Stankovic

We present a novel communication-efficient Newton-type algorithm for finite-sum optimization over a distributed computing environment. Our method, named DINO, overcomes both theoretical and practical shortcomings of similar existing…

Optimization and Control · Mathematics 2020-06-09 Rixon Crane , Fred Roosta

Stochastic optimization methods have become a class of popular optimization tools in machine learning. Especially, stochastic gradient descent (SGD) has been widely used for machine learning problems such as training neural networks due to…

Optimization and Control · Mathematics 2021-02-26 Qingsong Zhang , Feihu Huang , Cheng Deng , Heng Huang

We establish a continuous-time framework for analyzing Deep Q-Networks (DQNs) via stochastic control and Forward-Backward Stochastic Differential Equations (FBSDEs). Considering a continuous-time Markov Decision Process (MDP) driven by a…

Machine Learning · Computer Science 2025-05-06 Qian Qi

We propose deep distributed recurrent Q-networks (DDRQN), which enable teams of agents to learn to solve communication-based coordination tasks. In these tasks, the agents are not given any pre-designed communication protocol. Therefore, in…

Artificial Intelligence · Computer Science 2016-02-09 Jakob N. Foerster , Yannis M. Assael , Nando de Freitas , Shimon Whiteson

Gradient quantization is an emerging technique in reducing communication costs in distributed learning. Existing gradient quantization algorithms often rely on engineering heuristics or empirical observations, lacking a systematic approach…

Machine Learning · Computer Science 2021-08-02 Guangfeng Yan , Shao-Lun Huang , Tian Lan , Linqi Song

Several key results in distributed source coding offer the intuition that little improvement in compression can be gained from intersensor communication when the information is coded in long blocks. However, when sensors are restricted to…

Information Theory · Computer Science 2015-03-24 John Z. Sun , Vivek K. Goyal

Deep learning has enjoyed tremendous success in a variety of applications but its application to quantile regressions remains scarce. A major advantage of the deep learning approach is its flexibility to model complex data in a more…

Statistics Theory · Mathematics 2021-06-14 Qixian Zhong , Jane-Ling Wang

Optimization problems, arise in many practical applications, from the view points of both theory and numerical methods. Especially, significant improvement in deep learning training came from the Quasi-Newton methods. Quasi-Newton search…

Optimization and Control · Mathematics 2024-11-19 Jiongcheng Li

We introduce a distributed quantum-classical framework that synergizes photonic quantum neural networks (QNNs) with matrix-product-state (MPS) mapping to achieve parameter-efficient training of classical neural networks. By leveraging…

Quantum Physics · Physics 2025-05-14 Kuan-Cheng Chen , Chen-Yu Liu , Yu Shang , Felix Burt , Kin K. Leung

Control of large-scale networked systems often necessitates the availability of complex models for the interactions amongst the agents. However in many applications, building accurate models of agents or interactions amongst them might be…

Optimization and Control · Mathematics 2019-03-21 Siavash Alemzadeh , Mehran Mesbahi