English
Related papers

Related papers: Multi-level Parareal algorithm with Averaging for …

200 papers

A space-time adaptive scheme is presented for solving advection equations in two space dimensions. The gradient-augmented level set method using a semi-Lagrangian formulation with backward time integration is coupled with a point value…

Computational Physics · Physics 2015-04-20 Dmitry Kolomenskiy , Jean-Christophe Nave , Kai Schneider

Nonparametric density estimation is an unsupervised learning problem. In this work we propose a two-step procedure that casts the density estimation problem in the first step into a supervised regression problem. The advantage is that we…

Statistics Theory · Mathematics 2024-06-04 Thijs Bos , Johannes Schmidt-Hieber

The increasing size of deep learning models has made distributed training across multiple devices essential. However, current methods such as distributed data-parallel training suffer from large communication and synchronization overheads…

Machine Learning · Computer Science 2025-02-10 Cabrel Teguemne Fokam , Khaleelulla Khan Nazeer , Lukas König , David Kappel , Anand Subramoney

We construct a space-time parallel method for solving parabolic partial differential equations by coupling the Parareal algorithm in time with overlapping domain decomposition in space. The goal is to obtain a discretization consisting of…

Numerical Analysis · Mathematics 2022-01-17 Jehanzeb Chaudhry , Donald Estep , Simon Tavener

We consider a three-level parallelisation scheme. The second and third levels define a classical two-level parallelisation scheme and some load balancing algorithm is used to distribute tasks among processes. It is well-known that for many…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-09-24 Rima Kriauzienė , Andrej Bugajev , Raimondas Čiegis

The parareal in time algorithm allows to efficiently use parallel computing for the simulation of time-dependent problems. It is based on a decomposition of the time interval into subintervals, and on a predictor-corrector strategy, where…

Numerical Analysis · Mathematics 2010-11-30 X. Dai , C. Le Bris , F. Legoll , Y. Maday

To address the difficult problem of multi-step ahead prediction of non-parametric autoregressions, we consider a forward bootstrap approach. Employing a local constant estimator, we can analyze a general type of non-parametric time series…

Methodology · Statistics 2023-11-02 Dimitris N. Politis , Kejin Wu

Bilevel programming has recently received attention in the literature due to its wide range of applications, including reinforcement learning and hyper-parameter optimization. However, it is widely assumed that the underlying bilevel…

Machine Learning · Computer Science 2024-10-11 Parvin Nazari , Ahmad Mousavi , Davoud Ataee Tarzanagh , George Michailidis

In this paper, a new iterative two-level algorithm is presented for solving the finite element discretization for nonsymmetric or indefinite elliptic problems. The iterative two-level algorithm uses the same coarse space as the traditional…

Numerical Analysis · Mathematics 2023-01-05 Ming Tang , Xiaoqing Xing , Ying Yang , Liuqiang Zhong

In this paper, a novel two-level framework was proposed and applied to solve the output average consensus problem over heterogeneous multi-agent systems. This approach is mainly based on the recent technique of system abstraction. For given…

Systems and Control · Computer Science 2017-02-03 Yutao Tang

In the present paper we consider the varying coefficient model which represents a useful tool for exploring dynamic patterns in many applications. Existing methods typically provide asymptotic evaluation of precision of estimation…

Statistics Theory · Mathematics 2013-02-07 Olga Klopp , Marianna Pensky

We propose a variant of the classical conditional gradient method for sparse inverse problems with differentiable measurement models. Such models arise in many practical problems including superresolution, time-series modeling, and matrix…

Optimization and Control · Mathematics 2015-07-07 Nicholas Boyd , Geoffrey Schiebinger , Benjamin Recht

Most modern supervised statistical/machine learning (ML) methods are explicitly designed to solve prediction problems very well. Achieving this goal does not imply that these methods automatically deliver good estimators of causal…

We highlight a striking difference in behavior between two widely used variants of coordinate ascent variational inference: the sequential and parallel algorithms. While such differences were known in the numerical analysis literature in…

Machine Learning · Statistics 2026-03-24 Debdeep Pati

In this survey we review useful tools that naturally arise in the study of pointwise convergence problems in analysis, ergodic theory and probability. We will pay special attention to quantitative aspects of pointwise convergence phenomena…

Dynamical Systems · Mathematics 2022-09-07 Mariusz Mirek , Tomasz Z. Szarek , James Wright

We present a new hybrid numerical method for multiscale partial differential equations, which simultaneously captures the global macroscopic information and resolves the local microscopic events over regions of relatively small size. The…

Numerical Analysis · Mathematics 2017-07-04 Yufang Huang , Jianfeng Lu , Pingbing Ming

The long time effect of nonlinear perturbation to oscillatory linear systems can be characterized by the averaging method, and we consider first-order averaging for its simplest applicability to high-dimensional problems. Instead of the…

Classical Analysis and ODEs · Mathematics 2018-12-05 Molei Tao

This paper concerns statistical inference for the components of a high-dimensional regression parameter despite possible endogeneity of each regressor. Given a first-stage linear model for the endogenous regressors and a second-stage linear…

Statistics Theory · Mathematics 2019-11-25 David Gold , Johannes Lederer , Jing Tao

The Vertex Separator Problem for a graph is to find the smallest collection of vertices whose removal breaks the graph into two disconnected subsets that satisfy specified size constraints. In the paper 10.1016/j.ejor.2014.05.042, the…

Data Structures and Algorithms · Computer Science 2016-07-19 William W. Hager , James T. Hungerford , Ilya Safro

A multiscale numerical method is proposed for the solution of semi-linear elliptic stochastic partial differential equations with localized uncertainties and non-linearities, the uncertainties being modeled by a set of random parameters. It…

Numerical Analysis · Mathematics 2019-01-23 Anthony Nouy , Florent Pled