English
Related papers

Related papers: Efficient Numerical Algorithm for Large-Scale Damp…

200 papers

We present a kernel-independent method that applies hierarchical matrices to the problem of maximum likelihood estimation for Gaussian processes. The proposed approximation provides natural and scalable stochastic estimators for its…

Computation · Statistics 2019-03-26 Christopher J. Geoga , Mihai Anitescu , Michael L. Stein

Efficient sampling from un-normalized target distributions is pivotal in scientific computing and machine learning. While neural samplers have demonstrated potential with a special emphasis on sampling efficiency, existing neural implicit…

Machine Learning · Computer Science 2024-11-05 Weijian Luo , Wei Deng

We present a quantum algorithm that analyzes time series data simulated by a quantum differential equation solver. The proposed algorithm is a quantum version of the dynamic mode decomposition algorithm used in diverse fields such as fluid…

Quantum Physics · Physics 2024-10-17 Yuta Mizuno , Tamiki Komatsuzaki

We study the problem of the decentralized computation of entropy-regularized semi-discrete Wasserstein barycenters over a network. Building upon recent primal-dual approaches, we propose a sampling gradient quantization scheme that allows…

Optimization and Control · Mathematics 2020-10-28 Roman Krawtschenko , César A. Uribe , Alexander Gasnikov , Pavel Dvurechensky

We develop an efficient quantum implementation of an important signal processing algorithm for line spectral estimation: the matrix pencil method, which determines the frequencies and damping factors of signals consisting of finite sums of…

Quantum Physics · Physics 2017-04-05 A. Steffens , P. Rebentrost , I. Marvian , J. Eisert , S. Lloyd

In this work we describe an efficient implementation of a hierarchy of algorithms for the decomposition of dense matrices over the field with two elements (GF(2)). Matrix decomposition is an essential building block for solving dense…

Mathematical Software · Computer Science 2010-06-10 Martin R. Albrecht , Clément Pernet

In this work, several multilevel decoupled algorithms are proposed for a mixed Navier-Stokes/Darcy model. These algorithms are based on either successively or parallelly solving two linear subdomain problems after solving a coupled…

Numerical Analysis · Mathematics 2017-02-28 Mingchao Cai , Peiqi Huang , Mo Mu

In this paper, we present a fast and effective method for solving the Poisson-modified total variation model proposed in [9]. The existence and uniqueness of the model are again proved using different method. A semi-implicit difference…

Optimization and Control · Mathematics 2017-04-05 Wei Wang , Chuanjiang He

The development of mechanistic models of biological systems is a central part of Systems Biology. One major task in developing these models is the inference of the correct model parameters. Due to the size of most realistic models and their…

Quantitative Methods · Quantitative Biology 2016-06-28 Jan Mikelson , Mustafa Khammash

This paper introduces a method for efficiently approximating the inverse of the Fisher information matrix, a crucial step in achieving effective variational Bayes inference. A notable aspect of our approach is the avoidance of analytically…

Methodology · Statistics 2024-04-29 A. Godichon-Baggioni , D. Nguyen , M-N Tran

Many problems encountered in science and engineering can be formulated as estimating a low-rank object (e.g., matrices and tensors) from incomplete, and possibly corrupted, linear measurements. Through the lens of matrix and tensor…

Machine Learning · Computer Science 2023-10-11 Cong Ma , Xingyu Xu , Tian Tong , Yuejie Chi

Incorporating a deep generative model as the prior distribution in inverse problems has established substantial success in reconstructing images from corrupted observations. Notwithstanding, the existing optimization approaches use gradient…

Machine Learning · Computer Science 2023-01-31 Tianci Liu , Tong Yang , Quan Zhang , Qi Lei

The Hadamard decomposition is a powerful technique for data analysis and matrix compression, which decomposes a given matrix into the element-wise product of two or more low-rank matrices. In this paper, we develop an efficient algorithm to…

Machine Learning · Computer Science 2025-04-23 Samuel Wertz , Arnaud Vandaele , Nicolas Gillis

In recent years, several algorithms, which approximate matrix decomposition, have been developed. These algorithms are based on metric conservation features for linear spaces of random projection types. We show that an i.i.d sub-Gaussian…

Numerical Analysis · Mathematics 2016-02-11 Yariv Aizenbud , Amir Averbuch

This paper is about how to partition decision variables while decomposing a large-scale optimization problem for the best performance of distributed solution methods. Solving a large-scale optimization problem sequen- tially can be…

Optimization and Control · Mathematics 2017-10-26 Yuchen Zheng , Ilbin Lee , Nicoleta Serban

The resolution of many large-scale inverse problems using MCMC methods requires a step of drawing samples from a high dimensional Gaussian distribution. While direct Gaussian sampling techniques, such as those based on Cholesky…

Methodology · Statistics 2015-06-22 Clément Gilavert , Saïd Moussaoui , Jérôme Idier

In this paper, a gradient-free distributed algorithm is introduced to solve a set constrained optimization problem under a directed communication network. Specifically, at each time-step, the agents locally compute a so-called…

Optimization and Control · Mathematics 2021-09-06 Yipeng Pang , Guoqiang Hu

We introduce a novel method to compute a rank $m$ approximation of the inverse of the Hessian matrix in the distributed regime. By leveraging the differences in gradients and parameters of multiple Workers, we are able to efficiently…

Machine Learning · Computer Science 2017-09-18 Sébastien M. R. Arnold , Chunming Wang

We propose a stepsize adaptation scheme for stochastic gradient descent. It operates directly with the loss function and rescales the gradient in order to make fixed predicted progress on the loss. We demonstrate its capabilities by…

Machine Learning · Computer Science 2018-12-03 Michal Rolinek , Georg Martius

Increasing effort is put into the development of methods for learning mechanistic models from data. This task entails not only the accurate estimation of parameters but also a suitable model structure. Recent work on the discovery of…

Machine Learning · Computer Science 2024-07-01 Justin N. Kreikemeyer , Philipp Andelfinger , Adelinde M. Uhrmacher