English
Related papers

Related papers: Error Analysis of an Incremental POD Algorithm for…

200 papers

Simultaneous perturbation stochastic approximation (SPSA) is widely used in stochastic optimization due to its high efficiency, asymptotic stability, and reduced number of required loss function measurements. However, the standard SPSA…

Optimization and Control · Mathematics 2023-02-07 Zhichao Jia , Ziyi Wei , James C. Spall

By singular value decomposition (SVD) of a numerically singular Hessian matrix and a numerically singular system of linear equations for the experimental data (accumulated in the respective ${\chi ^2}$ function) and constraints, least…

High Energy Physics - Phenomenology · Physics 2014-08-27 Mehrdad Goshtasbpour

Accurate simulations are essential for engineering applications, and intricate continuum mechanical material models are constructed to achieve this goal. However, the increasing complexity of the material models and geometrical properties…

Computational Engineering, Finance, and Science · Computer Science 2023-11-30 Steffen Kastian , Jannick Kehls , Tim Brepols , Stefanie Reese

We study the convergence of the Augmented Decomposition Algorithm (ADA) proposed in [32] for solving multi-block separable convex minimization problems subject to linear constraints. We show that the global convergence rate of the exact ADA…

Optimization and Control · Mathematics 2018-08-28 Hongsheng Liu , Shu Lu

Eigendecomposition of symmetric matrices is at the heart of many computer vision algorithms. However, the derivatives of the eigenvectors tend to be numerically unstable, whether using the SVD to compute them analytically or using the Power…

Computer Vision and Pattern Recognition · Computer Science 2021-04-09 Wei Wang , Zheng Dang , Yinlin Hu , Pascal Fua , Mathieu Salzmann

Stochastic gradient descent (SGD) algorithm and its variations have been effectively used to optimize neural network models. However, with the rapid growth of big data and deep learning, SGD is no longer the most suitable choice due to its…

Machine Learning · Computer Science 2024-02-13 Anuraganand Sharma

Particle advection is one of the foundational algorithms for visualization and analysis and is central to understanding vector fields common to scientific simulations. Achieving efficient performance with large data in a distributed memory…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-10-15 Zhe Wang , Kenneth Moreland , Matthew Larsen , James Kress , Hank Childs , David Pugmire

Neural operators have emerged as a promising paradigm for learning solution operators of partial differential equa- tions (PDEs) directly from data. Existing methods, such as those based on Fourier or graph techniques, make strong as-…

Machine Learning · Computer Science 2025-11-14 Noam Koren , Ralf J. J. Mackenbach , Ruud J. G. van Sloun , Kira Radinsky , Daniel Freedman

The definition of partial differential equation (PDE) models usually involves a set of parameters whose values may vary over a wide range. The solution of even a single set of parameter values may be quite expensive. In many cases, e.g.,…

Numerical Analysis · Mathematics 2016-11-17 Max Gunzburger , Nan Jiang , Michael Schneier

A space-time-parameters structure of parametric parabolic PDEs motivates the application of tensor methods to define reduced order models (ROMs). Within a tensor-based ROM framework, the matrix SVD - a traditional dimension reduction…

Numerical Analysis · Mathematics 2024-08-22 Alexander V. Mamonov , Maxim A. Olshanskii

While the proper orthogonal decomposition (POD) is optimal under certain norms it's also expensive to compute. For large matrix sizes, it is well known that the QR decomposition provides a tractable alternative. Under the assumption that it…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-12-18 Harbir Antil , Dangxing Chen , Scott E. Field

In this work we propose tailored model order reduction for varying boundary optimal control problems governed by parametric partial differential equations. With varying boundary control, we mean that a specific parameter changes where the…

Numerical Analysis · Mathematics 2024-01-22 Maria Strazzullo , Fabio Vicini

There introduce Particle Optimized Gradient Descent (POGD), an algorithm based on the gradient descent but integrates the particle swarm optimization (PSO) principle to achieve the iteration. From the experiments, this algorithm has…

Machine Learning · Computer Science 2022-10-20 Feihu Han , Sida Xing , Sui Yang Khoo

We present a class of numerical algorithms which adapt a quantum error correction scheme to a channel model. Given an encoding and a channel model, it was previously shown that the quantum operation that maximizes the average entanglement…

Quantum Physics · Physics 2009-11-13 Andrew S. Fletcher , Peter W. Shor , Moe Z. Win

The need to estimate a positive definite solution to an overdetermined linear system of equations with multiple right hand side vectors arises in several process control contexts. The coefficient and the right hand side matrices are…

Numerical Analysis · Mathematics 2015-06-16 Negin Bagherpour , Nezam Mahdavi Amiri

Deep operator networks (DeepONets) are powerful architectures for fast and accurate emulation of complex dynamics. As their remarkable generalization capabilities are primarily enabled by their projection-based attribute, we investigate…

Machine Learning · Computer Science 2022-11-15 Simone Venturi , Tiernan Casey

In this paper we propose a new inexact dual decomposition algorithm for solving separable convex optimization problems. This algorithm is a combination of three techniques: dual Lagrangian decomposition, smoothing and excessive gap. The…

Optimization and Control · Mathematics 2013-02-11 Quoc Tran Dinh , Ion Necoara , Moritz Diehl

A classical problem in matrix computations is the efficient and reliable approximation of a given matrix by a matrix of lower rank. The truncated singular value decomposition (SVD) is known to provide the best such approximation for any…

Numerical Analysis · Mathematics 2014-08-12 Ming Gu

Deep learning-based reduced order models (DL-ROMs) have been recently proposed to overcome common limitations shared by conventional reduced order models (ROMs) - built, e.g., through proper orthogonal decomposition (POD) - when applied to…

Numerical Analysis · Mathematics 2021-11-03 Stefania Fresca , Andrea Manzoni

While there exists a rich array of matrix column subset selection problem (CSSP) algorithms for use with interpolative and CUR-type decompositions, their use can often become prohibitive as the size of the input matrix increases. In an…

Numerical Analysis · Mathematics 2024-03-12 Maria Emelianenko , Guy B. Oldaker