English
Related papers

Related papers: GParareal: A time-parallel ODE solver using Gaussi…

200 papers

Stiff systems of ordinary differential equations (ODEs) and sparse training data are common in scientific problems. This paper describes efficient, implicit, vectorized methods for integrating stiff systems of ordinary differential…

Numerical Analysis · Mathematics 2023-10-16 Mark C. Messner , Tianchen Hu , Tianju Chen

In this paper we propose a new parallel algorithm for solving global optimization (GO) multidimensional problems. The method unifies two powerful approaches for accelerating the search: parallel computations and local tuning on the behavior…

Optimization and Control · Mathematics 2011-03-31 Yaroslav D. Sergeyev

Gaussian processes are a versatile probabilistic machine learning model whose effectiveness often depends on good hyperparameters, which are typically learned by maximising the marginal likelihood. In this work, we consider iterative…

Machine Learning · Computer Science 2024-05-29 Jihao Andreas Lin , Shreyas Padhy , Bruno Mlodozeniec , José Miguel Hernández-Lobato

We describe a new algorithm for Gaussian Elimination suitable for general (unsymmetric and possibly singular) sparse matrices, of any entry type, which has a natural parallel and distributed-memory formulation but degrades gracefully to…

Mathematical Software · Computer Science 2012-01-17 Riccardo Murri

A version of the time-parallel algorithm parareal is analyzed and applied to stochastic models in chemical kinetics. A fast predictor at the macroscopic scale (evaluated in serial) is available in the form of the usual reaction rate…

Numerical Analysis · Mathematics 2009-09-16 Stefan Engblom

We present a multi-objective evolutionary optimization algorithm that uses Gaussian process (GP) regression-based models to select trial solutions in a multi-generation iterative procedure. In each generation, a surrogate model is…

Neural and Evolutionary Computing · Computer Science 2020-05-22 Xiaobiao Huang , Minghao Song , Zhe Zhang

The parareal in time algorithm allows to perform parallel simulations of time dependent problems. This algorithm has been implemented on many types of time dependent problems with some success. Recent contributions have allowed to extend…

Numerical Analysis · Mathematics 2015-03-19 Xiaoying Dai , Yvon Maday

In this paper, we consider the challenge of maximizing an unknown function f for which evaluations are noisy and are acquired with high cost. An iterative procedure uses the previous measures to actively select the next estimation of f…

Machine Learning · Computer Science 2013-09-03 Emile Contal , David Buffoni , Alexandre Robicquet , Nicolas Vayatis

Gaussian process (GP) regression with 1D inputs can often be performed in linear time via a stochastic differential equation formulation. However, for non-Gaussian likelihoods, this requires application of approximate inference methods…

Machine Learning · Computer Science 2020-07-20 Paul E. Chang , William J. Wilkinson , Mohammad Emtiyaz Khan , Arno Solin

In this work, we present a novel machine learning approach for pricing high-dimensional American options based on the modified Gaussian process regression (GPR). We incorporate deep kernel learning and sparse variational Gaussian processes…

Computational Finance · Quantitative Finance 2024-04-19 Jirong Zhuang , Deng Ding , Weiguo Lu , Xuan Wu , Gangnan Yuan

An extremely common bottleneck encountered in statistical learning algorithms is inversion of huge covariance matrices, examples being in evaluating Gaussian likelihoods for a large number of data points. We propose general parallel…

Methodology · Statistics 2013-12-09 Anjishnu Banerjee , Joshua Vogelstein , David Dunson

This paper presents a method of performing topology optimisation of transient heat conduction problems using the parallel-in-time method Parareal. To accommodate the adjoint analysis, the Parareal method was modified to store intermediate…

Computational Engineering, Finance, and Science · Computer Science 2024-12-02 Magnus Appel , Joe Alexandersen

Gaussian process regression (GPR) is a non-parametric Bayesian technique for interpolating or fitting data. The main barrier to further uptake of this powerful tool rests in the computational costs associated with the matrices which arise…

Machine Learning · Statistics 2016-05-16 Christopher J. Moore , Alvin J. K. Chua , Christopher P. L. Berry , Jonathan R. Gair

Witnessing the advancing scale and complexity of chip design and benefiting from high-performance computation technologies, the simulation of Very Large Scale Integration (VLSI) Circuits imposes an increasing requirement for acceleration…

Data Structures and Algorithms · Computer Science 2023-04-27 Weijie Fang , Yanggeng Fu , Jiaquan Gao , Longkun Guo , Gregory Gutin , Xiaoyan Zhang

We present an algorithm to parallelize the inverse fast multipole method (IFMM), which is an approximate direct solver for dense linear systems. The parallel scheme is based on a greedy coloring algorithm, where two nodes in the hierarchy…

Computational Physics · Physics 2020-02-19 Toru Takahashi , Chao Chen , Eric Darve

We introduce a new interpretation of sparse variational approximations for Gaussian processes using inducing points, which can lead to more scalable algorithms than previous methods. It is based on decomposing a Gaussian process as a sum of…

Machine Learning · Statistics 2024-02-27 Jiaxin Shi , Michalis K. Titsias , Andriy Mnih

Generative models based on flow matching have attracted significant attention for their simplicity and superior performance in high-resolution image synthesis. By leveraging the instantaneous change-of-variables formula, one can directly…

Computer Vision and Pattern Recognition · Computer Science 2025-01-06 Yasi Zhang , Peiyu Yu , Yaxuan Zhu , Yingshan Chang , Feng Gao , Ying Nian Wu , Oscar Leong

The aim of this paper is to develop novel quantum algorithms for Gaussian process quadrature methods. Gaussian process quadratures are numerical integration methods where Gaussian processes are used as functional priors for the integrands…

Computation · Statistics 2025-02-21 Cristian A. Galvis-Florez , Ahmad Farooq , Simo Särkkä

We present the application of a micro/macro parareal algorithm for a 1-D energy balance climate model with discontinuous and non-monotone coefficients and forcing terms. The micro/macro parareal method uses a coarse propagator, based on a…

Numerical Analysis · Mathematics 2023-05-23 Giovanni Samaey , Thomas Slawig

A new parallel solver for the volumetric integral equations (IE) of electrodynamics is presented. The solver is based on the Galerkin method which ensures the convergent numerical solution. The main features include: (i) the memory usage is…

Numerical Analysis · Mathematics 2017-01-10 Mikhail Kruglyakov , Lidia Bloshanskaya