English
Related papers

Related papers: Adjoint computations by algorithmic differentiatio…

200 papers

We propose a novel data-driven method to accelerate the convergence of Alternating Direction Method of Multipliers (ADMM) for solving distributed DC optimal power flow (DC-OPF) where lines are shared between independent network partitions.…

Optimization and Control · Mathematics 2020-09-16 David Biagioni , Peter Graf , Xiangyu Zhang , Ahmed Zamzam , Kyri Baker , Jennifer King

In the fields of statistics, machine learning, image science, and related areas, there is an increasing demand for decentralized collection or storage of large-scale datasets, as well as distributed solution methods. To tackle this…

Optimization and Control · Mathematics 2024-01-17 Bowen Li , Bin Shi

This paper considers a convex optimization problem with cost and constraints that evolve over time. The function to be minimized is strongly convex and possibly non-differentiable, and variables are coupled through linear constraints. In…

Systems and Control · Electrical Eng. & Systems 2021-01-13 Yijian Zhang , Emiliano Dall'Anese , Mingyi Hong

Considering the high computation cost produced in conventional computation fluid dynamic simulations, machine learning methods have been introduced to flow dynamic simulations in recent years. However, most of studies focus mainly on…

Fluid Dynamics · Physics 2020-10-13 M. Cheng , F. Fang , C. C. Pain , I. M. Navon

Fractional-order differential equations (FDEs) enhance traditional differential equations by extending the order of differential operators from integers to real numbers, offering greater flexibility in modeling complex dynamical systems…

Machine Learning · Computer Science 2025-03-24 Qiyu Kang , Xuhao Li , Kai Zhao , Wenjun Cui , Yanan Zhao , Weihua Deng , Wee Peng Tay

This paper presents a novel accelerated distributed algorithm for unconstrained consensus optimization over static undirected networks. The proposed algorithm combines the benefits of acceleration from momentum, the robustness of the…

Optimization and Control · Mathematics 2024-05-15 Eduardo Sebastián , Mauro Franceschelli , Andrea Gasparri , Eduardo Montijano , Carlos Sagüés

Metasurfaces are an emerging technology that may supplant many of the conventional optics found in imaging devices, displays, and precision scientific instruments. Here, we develop a method for designing optical systems composed of multiple…

Optics · Physics 2019-10-23 Adam S. Backer

We present a method for efficient differentiable simulation of articulated bodies. This enables integration of articulated body dynamics into deep learning frameworks, and gradient-based optimization of neural networks that operate on…

Machine Learning · Computer Science 2021-09-17 Yi-Ling Qiao , Junbang Liang , Vladlen Koltun , Ming C. Lin

The open-source multiphysics suite SU2 features discrete adjoints by means of operator overloading automatic differentiation (AD). While both primal and discrete adjoint solvers support MPI parallelism, hybrid parallelism using both MPI and…

Mathematical Software · Computer Science 2025-04-23 Johannes Blühdorn , Pedro Gomes , Max Aehle , Nicolas R. Gauger

MPI derived datatypes are an abstraction that simplifies handling of non-contiguous data in MPI applications. These datatypes are recursively constructed at runtime from primitive Named Types defined in the MPI standard. More recently, the…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-04-22 Carl Pearson , Kun Wu , I-Hsin Chung , Jinjun Xiong , Wen-Mei Hwu

In this work, we discuss the Automatic Adjoint Differentiation (AAD) for functions of the form $G=\frac{1}{2}\sum_1^m (Ey_i-C_i)^2$, which often appear in the calibration of stochastic models. { We demonstrate that it allows a perfect…

Computational Finance · Quantitative Finance 2019-12-11 Dmitri Goloubentsev , Evgeny Lakshtanov

The new class of alternating-conjugate splitting methods is presented and analyzed. They are obtained by concatenating a given composition involving complex coefficients with the same composition but with the complex conjugate coefficients.…

Numerical Analysis · Mathematics 2025-12-19 J. Bernier , S. Blanes , F. Casas , A. Escorihuela-Tomàs

Adjoint method is widely used in aerodynamic design because only once solution of flow field is required for adjoint method to obtain the gradients of all design variables. However, the calculation cost of adjoint vector is approximately…

Fluid Dynamics · Physics 2021-01-01 Mengfei Xu , Shufang Song , Xuxiang Sun , Wengang Chen , Weiwei Zhang

The parallel alternating direction method of multipliers (ADMM) algorithms have gained popularity in statistics and machine learning due to their efficient handling of large sample data problems. However, the parallel structure of these…

Statistics Theory · Mathematics 2024-04-11 Xiaofei Wu , Jiancheng Jiang , Zhimin Zhang

The purpose of this study is to show some mathematical aspects of the adjoint method that is a numerical method for the Cauchy problem, an inverse boundary value problem. The adjoint method is an iterative method based on the variational…

Numerical Analysis · Mathematics 2009-04-16 Takemi Shigeta

This paper introduces a novel method for numerically stabilizing sequential continuous adjoint flow solvers utilizing an elliptic relaxation strategy. The proposed approach is formulated as a Partial Differential Equation (PDE) containing a…

Fluid Dynamics · Physics 2025-01-23 Niklas Kühl

In the theory and practice of inverse problems for partial differential equations (PDEs) much attention is paid to the problem of the identification of coefficients from some additional information. This work deals with the problem of…

Numerical Analysis · Computer Science 2013-04-23 P. N. Vabishchevich , V. I. Vasil'ev

Large scale, non-convex optimization problems arising in many complex networks such as the power system call for efficient and scalable distributed optimization algorithms. Existing distributed methods are usually iterative and require…

Optimization and Control · Mathematics 2017-10-26 Junyao Guo , Gabriela Hug , Ozan Tonguz

Solving large complex partial differential equations (PDEs), such as those that arise in computational fluid dynamics (CFD), is a computationally expensive process. This has motivated the use of deep learning approaches to approximate the…

Machine Learning · Computer Science 2020-08-18 Filipe de Avila Belbute-Peres , Thomas D. Economon , J. Zico Kolter

In this paper we propose an efficient distributed algorithm for solving loosely coupled convex optimization problems. The algorithm is based on a primal-dual interior-point method in which we use the alternating direction method of…

Optimization and Control · Mathematics 2015-02-10 Mariette Annergren , Sina Khoshfetrat Pakazad , Anders Hansson , Bo Wahlberg