中文
相关论文

相关论文: Half-Precision Kronecker Product SVD Preconditione…

200 篇论文

Low-rank approximation of images via singular value decomposition is well-received in the era of big data. However, singular value decomposition (SVD) is only for order-two data, i.e., matrices. It is necessary to flatten a higher order…

机器学习 · 计算机科学 2022-08-26 Liang Liao , Sen Lin , Lun Li , Xiuwei Zhang , Song Zhao , Yan Wang , Xinqiang Wang , Qi Gao , Jingyu Wang

A space-time-parameters structure of parametric parabolic PDEs motivates the application of tensor methods to define reduced order models (ROMs). Within a tensor-based ROM framework, the matrix SVD - a traditional dimension reduction…

数值分析 · 数学 2024-08-22 Alexander V. Mamonov , Maxim A. Olshanskii

In this paper we propose novel methods for completion (from limited samples) and de-noising of multilinear (tensor) data and as an application consider 3-D and 4- D (color) video data completion and de-noising. We exploit the recently…

计算机视觉与模式识别 · 计算机科学 2014-10-31 Zemin Zhang , Gregory Ely , Shuchin Aeron , Ning Hao , Misha Kilmer

Tensors, which provide a powerful and flexible model for representing multi-attribute data and multi-way interactions, play an indispensable role in modern data science across various fields in science and engineering. A fundamental task is…

机器学习 · 计算机科学 2022-06-23 Tian Tong , Cong Ma , Ashley Prater-Bennette , Erin Tripp , Yuejie Chi

Stabilizing autonomous linear time delay systems, particularly when addressing an unlimited number of pointwise and distributed delays (DDs) under dissipative constraints, poses a significant challenge. Existing solutions are often hindered…

最优化与控制 · 数学 2026-04-13 Qian Feng , Wei Xing Zheng , Feng Xiao , Xiaoyu Wang

This paper considers the problem of updating the rank-k truncated Singular Value Decomposition (SVD) of matrices subject to the addition of new rows and/or columns over time. Such matrix problems represent an important computational kernel…

For linear ill-posed problems with nontrivial null spaces, Tikhonov regularization and truncated singular value decomposition (TSVD) typically yield solutions that are close to the minimum norm solution. Such a bias is not always desirable,…

数值分析 · 数学 2024-12-10 Ole Løseth Elvetun , Kim Knudsen , Bjørn Fredrik Nielsen

Distributed training with synchronous stochastic gradient descent (SGD) on GPU clusters has been widely used to accelerate the training process of deep models. However, SGD only utilizes the first-order gradient in model parameter updates,…

分布式、并行与集群计算 · 计算机科学 2021-07-15 Shaohuai Shi , Lin Zhang , Bo Li

We propose numerical algorithms for solving large deformation diffeomorphic image registration problems. We formulate the nonrigid image registration problem as a problem of optimal control. This leads to an infinite-dimensional partial…

数值分析 · 数学 2015-05-08 Andreas Mang , George Biros

We study robust convex quadratic programs where the uncertain problem parameters can contain both continuous and integer components. Under the natural boundedness assumption on the uncertainty set, we show that the generic problems are…

最优化与控制 · 数学 2018-12-19 Areesh Mittal , Can Gokalp , Grani A. Hanasusanto

Recent trends in lower precision, e.g. half-precision floating point, training have shown improved system performance and reduced memory usage for Deep Learning while maintaining accuracy. However, current GNN systems cannot achieve such…

机器学习 · 计算机科学 2025-09-17 Arnab Kanti Tarafder , Yidong Gong , Pradeep Kumar

In an iterative approach for solving linear systems with ill-conditioned, symmetric positive definite (SPD) kernel matrices, both fast matrix-vector products and fast preconditioning operations are required. Fast (linear-scaling)…

数值分析 · 数学 2021-01-13 Xin Xing , Hua Huang , Edmond Chow

In this work we present a space-time least squares isogeometric discretization of the Schr\"odinger equation and propose a preconditioner for the arising linear system in the parametric domain. Exploiting the tensor product structure of the…

数值分析 · 数学 2023-12-01 Andrea Bressan , Alen Kushova , Giancarlo Sangalli , Mattia Tani

In this work we focus on the preconditioning of a Galerkin space-time isogeometric discretization of the heat equation. Exploiting the tensor product structure of the basis functions in the parametric domain, we propose a preconditioner…

数值分析 · 数学 2020-11-03 Gabriele Loli , Monica Montardini , Giancarlo Sangalli , Mattia Tani

Least squares method is one of the simplest and most popular techniques applied in data fitting, imaging processing and high dimension data analysis. The classic methods like QR and SVD decomposition for solving least squares problems has a…

数值分析 · 数学 2018-06-11 Long Chen , Huiwen Wu

We propose in this paper a Proper Generalized Decomposition (PGD) solver for reduced-order modeling of linear elastodynamic problems. It primarily focuses on enhancing the computational efficiency of a previously introduced PGD solver based…

计算工程、金融与科学 · 计算机科学 2024-05-15 Clément Vella , Pierre Gosselet , Serge Prudhomme

In usual (non-stochastic) tensor network calculations, the truncated singular value decomposition (SVD) is often used for approximating a tensor, and it causes systematic errors. By introducing stochastic noise in the approximation,…

高能物理 - 格点 · 物理学 2023-07-05 Erika Arai , Hiroshi Ohki , Shinji Takeda , Masaaki Tomii

We propose a sparse reconstruction framework for solving inverse problems. Opposed to existing sparse regularization techniques that are based on frame representations, we train an encoder-decoder network by including an $\ell^1$-penalty.…

数值分析 · 数学 2019-08-07 Daniel Obmann , Johannes Schwab , Markus Haltmeier

Matrix completion is a widely used technique for image inpainting and personalized recommender system, etc. In this work, we focus on accelerating the matrix completion using faster randomized singular value decomposition (rSVD). Firstly,…

机器学习 · 计算机科学 2018-10-17 Xu Feng , Wenjian Yu , Yaohang Li

Constrained least squares problems arise in a variety of applications, and many iterative methods are already available to compute their solutions. This paper proposes a new efficient approach to solve nonnegative linear least squares…

数值分析 · 数学 2017-01-09 Silvia Gazzola , Yves Wiaux