English
Related papers

Related papers: Accelerated Polynomial Evaluation and Differentiat…

200 papers

Bilevel optimization has gained significant attention in recent years due to its broad applications in machine learning. This paper focuses on bilevel optimization in decentralized networks and proposes a novel single-loop algorithm for…

Optimization and Control · Mathematics 2024-04-24 Youran Dong , Shiqian Ma , Junfeng Yang , Chao Yin

We present a massively parallel solver that accelerates DC loadflow computations for power grid topology optimization tasks. Our approach leverages low-rank updates of the Power Transfer Distribution Factors (PTDFs) to represent substation…

Systems and Control · Electrical Eng. & Systems 2025-01-30 Nico Westerbeck , Joost van Dijk , Jan Viebahn , Christian Merz , Dirk Witthaut

We give an algorithm for reversion of formal power series, based on an efficient way to implement the Lagrange inversion formula. Our algorithm requires $O(n^{1/2}(M(n) + MM(n^{1/2})))$ operations where $M(n)$ and $MM(n)$ are the costs of…

Symbolic Computation · Computer Science 2013-12-03 Fredrik Johansson

We present a systematic study on the linear convergence rates of the powers of (real or complex) matrices. We derive a characterization when the optimal convergence rate is attained. This characterization is given in terms of…

Optimization and Control · Mathematics 2014-07-03 Heinz H. Bauschke , J. Y. Bello Cruz , Tran T. A. Nghia , Hung M. Phan , Xianfu Wang

Gradient-based algorithms, popular strategies to optimization problems, are essential for many modern machine-learning techniques. Theoretically, extreme points of certain cost functions can be found iteratively along the directions of the…

Quantum Physics · Physics 2021-04-07 Keren Li , Pan Gao , Shijie Wei , Jiancun Gao , Guilu Long

Fast convergent, accurate, computationally efficient, parallelizable, and robust matrix inversion and parameter estimation algorithms are required in many time-critical and accuracy-critical applications such as system identification,…

Optimization and Control · Mathematics 2020-08-27 Alexander Stotsky

Deep learning harnesses massive parallel floating-point processing to train and evaluate large neural networks. Trends indicate that deeper and larger neural networks with an increasing number of parameters achieve higher accuracy than…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Brad Larson , Bishal Upadhyaya , Luke McDermott , Siddha Ganju

It has been shown that a class of probabilistic domain models cannot be learned correctly by several existing algorithms which employ a single-link look ahead search. When a multi-link look ahead search is used, the computational complexity…

Artificial Intelligence · Computer Science 2013-02-08 TongSheng Chu , Yang Xiang

The possibilities of exploiting the special structure of d.c. programs, which consist of optimizing the difference of convex functions, are currently more or less limited to variants of the DCA proposed by Pham Dinh Tao and Le Thi Hoai An…

Optimization and Control · Mathematics 2016-10-21 Sebastian Banert , Radu Ioan Bot

In recent years, the PageRank algorithm has garnered significant attention due to its crucial role in search engine technologies and its applications across various scientific fields. It is well-known that the power method is a classical…

Numerical Analysis · Mathematics 2024-06-10 Guangcong Meng , Yuehua Feng , Yongxin Dong

The massive quantities of genomic data being made available through gene sequencing techniques are enabling breakthroughs in genomic science in many areas such as medical advances in the diagnosis and treatment of diseases. Analyzing this…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-09-24 Wayne Joubert , James Nance , Sharlee Climer , Deborah Weighill , Daniel Jacobson

Being able to learn from complex data with phase information is imperative for many signal processing applications. Today' s real-valued deep neural networks (DNNs) have shown efficiency in latent information analysis but fall short when…

Machine Learning · Computer Science 2021-08-11 Hongwu Peng , Shanglin Zhou , Scott Weitze , Jiaxin Li , Sahidul Islam , Tong Geng , Ang Li , Wei Zhang , Minghu Song , Mimi Xie , Hang Liu , Caiwen Ding

Discrete variational methods show excellent performance in numerical simulations of different mechanical systems. In this paper, we introduce an iterative procedure for the solution of discrete variational equations for boundary value…

Optimization and Control · Mathematics 2022-06-22 Sebastián J. Ferraro , David Martín de Diego , Rodrigo Takuro Sato Martín de Almagro

This paper develops a continuous-time primal-dual accelerated method with an increasing damping coefficient for a class of convex optimization problems with affine equality constraints. This paper analyzes critical values for parameters in…

Optimization and Control · Mathematics 2022-02-16 Xianlin Zeng , Jinlong Lei , Jie Chen

Parallel computing is a standard approach to achieving high-performance computing (HPC). Three commonly used methods to implement parallel computing include: 1) applying multithreading technology on single-core or multi-core CPUs; 2)…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-09-18 Xinyao Yi

Mixed-integer optimisation problems can be computationally challenging. Here, we introduce and analyse two efficient algorithms with a specific sequential design that are aimed at dealing with sampled problems within this class. At each…

Optimization and Control · Mathematics 2023-03-07 Mohammadreza Chamanbaz , Roland Bouffanais

The aim of this paper is to show that Digital Signal Processors (DSPs) can be used to efficiently implement complex algorithms. As an example we have chosen the problem of enumerating closed two-dimensional random paths. An Evaluation…

Computational Physics · Physics 2007-05-23 B. Afsari , N. Sadeghi-Meybodi , S. Rouhani

Probabilistic power flow (PPF) plays a critical role in power system analysis. However, the high computational burden makes it challenging for the practical implementation of PPF. This paper proposes a model-based deep learning approach to…

Signal Processing · Electrical Eng. & Systems 2019-09-17 Yan Yang , Zhifang Yang , Juan Yu , Baosen Zhang

We develop a first-order accelerated algorithm for a class of constrained bilinear saddle-point problems with applications to network systems. The algorithm is a modified time-varying primal-dual version of an accelerated mirror-descent…

Optimization and Control · Mathematics 2024-10-04 Weijian Li , Xianlin Zeng , Lacra Pavel

We consider the problem of simultaneously learning to linearly combine a very large number of kernels and learn a good predictor based on the learnt kernel. When the number of kernels $d$ to be combined is very large, multiple kernel…

Machine Learning · Computer Science 2015-03-20 Arash Afkanpour , András György , Csaba Szepesvári , Michael Bowling