English
Related papers

Related papers: Scalable parallel algorithm for solving non-statio…

200 papers

An algorithm for non-stationary spatial modelling using multiple secondary variables is developed. It combines Geostatistics with Quantile Random Forests to give a new interpolation and stochastic simulation algorithm. This paper introduces…

Methodology · Statistics 2022-01-13 Colin Daly

Graphical models have found widespread applications in many areas of modern statistics and machine learning. Iterative Proportional Fitting (IPF) and its variants have become the default method for undirected graphical model estimation, and…

Methodology · Statistics 2024-08-22 Kshitij Khare , Syed Rahman , Bala Rajaratnam , Jiayuan Zhou

Stationary Random Functions have been successfully applied in geostatistical applications for decades. In some instances, the assumption of a homogeneous spatial dependence structure across the entire domain of interest is unrealistic. A…

Methodology · Statistics 2014-12-04 Francky Fouedjio , Nicolas Desassis , Thomas Romary

A general high-order fully explicit scheme based on projective integration methods is here presented to solve systems of degenerate parabolic equations in general dimensions. The method is based on a BGK approximation of the…

Numerical Analysis · Mathematics 2025-03-10 Tommaso Tenna

We consider the problem of minimizing a sum of several convex non-smooth functions. We introduce a new algorithm called the selective linearization method, which iteratively linearizes all but one of the functions and employs simple…

Optimization and Control · Mathematics 2016-08-16 Yu Du , Xiaodong Lin , Andrzej Ruszczynski

Parallel tempering (PT) methods are a popular class of Markov chain Monte Carlo schemes used to sample complex high-dimensional probability distributions. They rely on a collection of $N$ interacting auxiliary chains targeting tempered…

Computation · Statistics 2021-07-28 Saifuddin Syed , Alexandre Bouchard-Côté , George Deligiannidis , Arnaud Doucet

We develop a new randomized iterative algorithm---stochastic dual ascent (SDA)---for finding the projection of a given vector onto the solution space of a linear system. The method is dual in nature: with the dual being a non-strongly…

Numerical Analysis · Mathematics 2016-01-29 Robert Mansel Gower , Peter Richtarik

We propose a new randomized method for solving systems of nonlinear equations, which can find sparse solutions or solutions under certain simple constraints. The scheme only takes gradients of component functions and uses Bregman…

Optimization and Control · Mathematics 2024-02-26 Robert Gower , Dirk A. Lorenz , Maximilian Winkler

An algorithm is discussed for converting a class of recursive processes to a parallel system. It is argued that this algorithm can be superior to certain methods currently found in the literature for an important subset of problems. The…

Computational Physics · Physics 2009-11-10 W. R. Gibbs

In this paper, a practicable simulation-free model order reduction method by nonlinear moment matching is developed. Based on the steady-state interpretation of linear moment matching, we comprehensively explain the extension of this…

Systems and Control · Electrical Eng. & Systems 2024-12-20 Maria Cruz Varona , Raphael Gebhart , Julian Suk , Boris Lohmann

We present a parallel hierarchical solver for general sparse linear systems on distributed-memory machines. For large-scale problems, this fully algebraic algorithm is faster and more memory-efficient than sparse direct solvers because it…

Numerical Analysis · Mathematics 2017-12-21 Chao Chen , Hadi Pouransari , Sivasankaran Rajamanickam , Erik G. Boman , Eric Darve

Consider the classical problem of solving a general linear system of equations $Ax=b$. It is well known that the (successively over relaxed) Gauss-Seidel scheme and many of its variants may not converge when $A$ is neither diagonally…

Optimization and Control · Mathematics 2019-05-14 Meisam Razaviyayn , Mingyi Hong , Navid Reyhanian , Zhi-Quan Luo

We propose a distributed positioning algorithm to estimate the unknown positions of a number of target nodes, given distance measurements between target nodes and between target nodes and a number of reference nodes at known positions.…

Information Theory · Computer Science 2017-04-26 Mohammad Reza Gholami , Luba Tetruashvili , Erik G. Ström , Yair Censor

The article presents and evaluates a scalable FRaGenLP algorithm for generating random linear programming problems of large dimension $n$ on cluster computing systems. To ensure the consistency of the problem and the boundedness of the…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-11-29 Leonid B. Sokolinsky , Irina M. Sokolinskaya

In this paper, a nonlinear system of fractional ordinary differential equations with multiple scales in time is investigated. We are interested in the effective long-term computation of the solution. The main challenge is how to obtain the…

Numerical Analysis · Mathematics 2022-01-07 Zhaoyang Wang , Ping Lin

Many recently proposed gradient projection algorithms with inertial extrapolation step for solving quasi-variational inequalities in Hilbert spaces are proven to be strongly convergent with no linear rate given when the cost operator is…

Optimization and Control · Mathematics 2024-04-23 Yonghong Yao , Lateef O. Jolaoso , Yekini Shehu

Edge-centric distributed computations have appeared as a recent technique to improve the shortcomings of think-like-a-vertex algorithms on large scale-free networks. In order to increase parallelism on this model, edge partitioning -…

Data Structures and Algorithms · Computer Science 2018-10-12 Sebastian Schlag , Christian Schulz , Daniel Seemaier , Darren Strash

This work introduces a new method designed for Bayesian deep learning called scalable Bayesian Monte Carlo (SBMC). The method is comprised of a model and an algorithm. The model interpolates between a point estimator and the posterior. The…

In this paper we discuss an application of Stochastic Approximation to statistical estimation of high-dimensional sparse parameters. The proposed solution reduces to resolving a penalized stochastic optimization problem on each stage of a…

Machine Learning · Statistics 2022-10-25 Sasila Ilandarideva , Yannis Bekri , Anatoli Juditsky , Vianney Perchet

In this papers, we couple the parareal algorithm with projection methods of the trajectory on a specific manifold, defined by the preservation of some conserved quantities of the differential equations. First, projection methods are…

Numerical Analysis · Mathematics 2017-05-24 Liying Zhang , Weien Zhou , Lihai ji