English
Related papers

Related papers: Parallel two-stage reduction to Hessenberg-triangu…

200 papers

We propose a novel image-to-pencil translation method that could not only generate high-quality pencil sketches but also offer the drawing process. Existing pencil sketch algorithms are based on texture rendering rather than the direct…

Computer Vision and Pattern Recognition · Computer Science 2020-12-17 Zhengyan Tong , Xuanhong Chen , Bingbing Ni , Xiaohang Wang

Quantum process tomography is a critical task for characterizing the dynamics of quantum systems and achieving precise quantum control. In this paper, we propose a two-stage solution for both trace-preserving and non-trace-preserving…

We propose a two-scale finite element method designed for heterogeneous microstructures. Our approach exploits domain diffeomorphisms between the microscopic structures to gain computational efficiency. By using a conveniently constructed…

Numerical Analysis · Mathematics 2024-10-24 Omar Richardson , Omar Lakkis , Adrian Muntean , Chandrasekhar Venkataraman

In this paper we present a bilevel optimization scheme for the solution of a general image deblurring problem, in which a parametric variational-like approach is encapsulated within a machine learning scheme to provide a high quality…

Image and Video Processing · Electrical Eng. & Systems 2022-10-20 Silvia Bonettini , Giorgia Franchini , Danilo Pezzi , Marco Prato

We propose a first-order method for convex optimization, where instead of being restricted to the gradient from a single parameter, gradients from multiple parameters can be used during each step of gradient descent. This setup is…

Machine Learning · Computer Science 2023-02-08 Yash Chandak , Shiv Shankar , Venkata Gandikota , Philip S. Thomas , Arya Mazumdar

This paper presents new parallel algorithms for generating Euclidean minimum spanning trees and spatial clustering hierarchies (known as HDBSCAN$^*$). Our approach is based on generating a well-separated pair decomposition followed by using…

Data Structures and Algorithms · Computer Science 2021-04-05 Yiqiu Wang , Shangdi Yu , Yan Gu , Julian Shun

We study fast and reliable generative transport for the 3D KS (Keller-Segel) and KPP (Kolmogorov-Petrovsky-Piskunov) equations in the presence of fluid flows with the goal to approximate the map between initial and terminal distributions…

Computational Physics · Physics 2026-01-29 Zhenda Shen , Zhongjian Wang , Jack Xin , Zhiwen Zhang

Such problems as computation of spectra of spin chains and vibrational spectra of molecules can be written as high-dimensional eigenvalue problems, i.e., when the eigenvector can be naturally represented as a multidimensional tensor. Tensor…

Numerical Analysis · Mathematics 2019-09-04 Maxim Rakhuba , Alexander Novikov , Ivan Oseledets

The tempered Lefschetz thimble method is a parallel-tempering algorithm towards solving the numerical sign problem. It uses the flow time of the gradient flow as a tempering parameter and is expected to tame both the sign and multimodal…

Strongly Correlated Electrons · Physics 2019-12-25 Masafumi Fukuma , Nobuyuki Matsumoto , Naoya Umeda

Compression aims to reduce the size of an input, while maintaining its relevant properties. For multi-parameter persistent homology, compression is a necessary step in any computational pipeline, since standard constructions lead to large…

Algebraic Topology · Mathematics 2022-08-17 Ulderico Fugacci , Michael Kerber , Alexander Rolle

The functional renormalisation group (fRG) has evolved into a versatile tool in condensed matter theory for studying important aspects of correlated electron systems. Practical applications of the method often involve a high numerical…

Computational Physics · Physics 2016-09-21 Daniel Rohe

Second-order training methods have better convergence properties than gradient descent but are rarely used in practice for large-scale training due to their computational overhead. This can be viewed as a hardware limitation (imposed by…

Machine Learning · Computer Science 2024-05-24 Kaelan Donatella , Samuel Duffield , Maxwell Aifer , Denis Melanson , Gavin Crooks , Patrick J. Coles

Bilevel optimization has gained prominence in various applications. In this study, we introduce a framework for solving bilevel optimization problems, where the variables in both the lower and upper levels are constrained on Riemannian…

Optimization and Control · Mathematics 2024-11-05 Andi Han , Bamdev Mishra , Pratik Jawanpuria , Akiko Takeda

A general framework for oblique projections of nonhermitian matrices onto rational Krylov subspaces is developed. To obtain this framework we revisit the classical rational Krylov subspace algorithm and prove that the projected matrix can…

Numerical Analysis · Mathematics 2019-11-18 Niel Van Buggenhout , Marc Van Barel , Raf Vandebril

We consider the distance from a (square or rectangular) matrix pencil to the nearest matrix pencil in 2-norm that has a set of specified eigenvalues. We derive a singular value optimization characterization for this problem and illustrate…

Numerical Analysis · Mathematics 2012-05-22 Daniel Kressner , Emre Mengi , Ivica Nakic , Ninoslav Truhar

Second-order information is valuable for many applications but challenging to compute. Several works focus on computing or approximating Hessian diagonals, but even this simplification introduces significant additional costs compared to…

Machine Learning · Computer Science 2024-07-08 Mohamed Elsayed , Homayoon Farrahi , Felix Dangel , A. Rupam Mahmood

We develop a new parallel algorithm for minimizing Lipschitz, convex functions with a stochastic subgradient oracle. The total number of queries made and the query depth, i.e., the number of parallel rounds of queries, match the prior…

Optimization and Control · Mathematics 2024-06-12 Arun Jambulapati , Aaron Sidford , Kevin Tian

Tensor decompositions such as the canonical format and the tensor train format have been widely utilized to reduce storage costs and operational complexities for high-dimensional data, achieving linear scaling with the input dimension…

Numerical Analysis · Mathematics 2020-02-11 Oscar Mickelin , Sertac Karaman

Gradient-based meta-learning approaches have been successful in few-shot learning, transfer learning, and a wide range of other domains. Despite its efficacy and simplicity, the burden of calculating the Hessian matrix with large memory…

Machine Learning · Computer Science 2020-06-09 Jin-Hwa Kim , Junyoung Park , Yongseok Choi

We prove the existence of an open set of $n_1\times n_2 \times n_3$ tensors of rank $r$ on which a popular and efficient class of algorithms for computing tensor rank decompositions based on a reduction to a linear matrix pencil, typically…

Numerical Analysis · Mathematics 2022-09-02 Carlos Beltrán , Paul Breiding , Nick Vannieuwenhoven