English
Related papers

Related papers: Iterative Statistical Linear Regression for Gaussi…

200 papers

In the first part of this paper, uniqueness of strong solution is established for the Vlasov-unsteady Stokes problem in 3D. The second part deals with a semi discrete scheme, which is based on the coupling of discontinuous Galerkin…

Numerical Analysis · Mathematics 2024-12-17 Harsha Hutridurga , Krishan Kumar , Amiya K. Pani

The purpose of this paper is to review and highlight some connections between the problem of nonlinear smoothing and optimal control of the Liouville equation. The latter has been an active area of recent research interest owing to work in…

Optimization and Control · Mathematics 2023-03-23 Jin W. Kim , Prashant G. Mehta

Gaussian processes are a powerful framework for uncertainty-aware function approximation and sequential decision-making. Unfortunately, their classical formulation does not scale gracefully to large amounts of data and modern hardware for…

Machine Learning · Computer Science 2025-07-10 Jihao Andreas Lin

We consider numerical schemes for computing the linear response of steady-state averages of stochastic dynamics with respect to a perturbation of the drift part of the stochastic differential equation. The schemes are based on Girsanov's…

Numerical Analysis · Mathematics 2019-12-18 Petr Plechac , Gabriel Stoltz , Ting Wang

We study the steady-state Navier-Stokes equations in the context of stochastic finite element discretizations. Specifically, we assume that the viscosity is a random field given in the form of a generalized polynomial chaos expansion. For…

Numerical Analysis · Mathematics 2016-04-26 Bedřich Sousedík , Howard C. Elman

Practical diffusion sampling is a numerical approximation problem: under a fixed inference budget, one must simulate a reverse-time ODE or SDE using only a limited number of denoising steps, so discretization error is often the dominant…

Machine Learning · Computer Science 2026-05-12 Samuel Hurault , Thomas Moreau , Gabriel Peyré

In this work, we consider the problem of steering the first two moments of the uncertain state of an unknown discrete-time stochastic nonlinear system to a given terminal distribution in finite time. Toward that goal, first, a…

Optimization and Control · Mathematics 2021-04-05 Alexandros Tsolovikos , Efstathios Bakolas

The Gaussian process (GP) regression can be severely biased when the data are contaminated by outliers. This paper presents a new robust GP regression algorithm that iteratively trims the most extreme data points. While the new algorithm…

Machine Learning · Computer Science 2021-06-15 Zhao-Zhou Li , Lu Li , Zhengyi Shao

A central issue in machine learning is how to train models on sensitive user data. Industry has widely adopted a simple algorithm: Stochastic Gradient Descent with noise (a.k.a. Stochastic Gradient Langevin Dynamics). However, foundational…

Machine Learning · Computer Science 2023-03-01 Jason M. Altschuler , Kunal Talwar

The increased demand for online prediction and the growing availability of large data sets drives the need for computationally efficient models. While exact Gaussian process regression shows various favorable theoretical properties…

Machine Learning · Computer Science 2021-08-02 Armin Lederer , Alejandro Jose Ordonez Conejo , Korbinian Maier , Wenxin Xiao , Jonas Umlauft , Sandra Hirche

Bayesian nonparametric regression under a rescaled Gaussian process prior offers smoothness-adaptive function estimation with near minimax-optimal error rates. Hierarchical extensions of this approach, equipped with stochastic variable…

Statistics Theory · Mathematics 2020-12-15 Sheng Jiang , Surya T. Tokdar

This paper investigates the state estimation problem for a class of complex networks, in which the dynamics of each node is subject to Gaussian noise, system uncertainties and nonlinearities. Based on a regularized least-squares approach,…

Systems and Control · Electrical Eng. & Systems 2021-03-16 Peihu Duan , Qishao Wang , Zhisheng Duan , Guanrong Chen

We consider stochastic optimal control of linear dynamical systems with additive non-Gaussian disturbance. We propose a novel, sampling-free approach, based on Fourier transformations and convex optimization, to cast the stochastic optimal…

Optimization and Control · Mathematics 2020-10-06 Vignesh Sivaramakrishnan , Abraham P. Vinod , Meeko M. K. Oishi

In this work, we study distributed sketching methods for large scale regression problems. We leverage multiple randomized sketches for reducing the problem dimensions as well as preserving privacy and improving straggler resilience in…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-06-23 Burak Bartan , Mert Pilanci

The problem of Bayesian filtering and smoothing in nonlinear models with additive noise is an active area of research. Classical Taylor series as well as more recent sigma-point based methods are two well-known strategies to deal with these…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-02-02 Fatemeh Yaghoobi , Adrien Corenflos , Sakira Hassan , Simo Särkkä

We develop a Bayesian methodology for numerical solution of the incompressible Navier--Stokes equations with quantified uncertainty. The central idea is to treat discretized Navier--Stokes dynamics as a state-space model and to view…

Computation · Statistics 2026-02-04 Nicholas Polson , Vadim Sokolov

Stochastic optimization lies at the core of most statistical learning models. The recent great development of stochastic algorithmic tools focused significantly onto proximal gradient iterations, in order to find an efficient approach for…

Machine Learning · Computer Science 2020-03-31 Andrei Patrascu , Ciprian Paduraru , Paul Irofti

Unconstrained optimization problems become more common in scientific computing and engineering applications with the rapid development of artificial intelligence, and numerical methods for solving them more quickly and efficiently have been…

Optimization and Control · Mathematics 2025-04-17 Lin Li , Pengcheng Xie , Li Zhang

We introduce and analyze an algorithm for the minimization of convex functions that are the sum of differentiable terms and proximable terms composed with linear operators. The method builds upon the recently developed smoothed gap…

Optimization and Control · Mathematics 2017-06-20 Quang Van Nguyen , Olivier Fercoq , Volkan Cevher

Smoothed model checking based on Gaussian process classification provides a powerful approach for statistical model checking of parametric continuous time Markov chain models. The method constructs a model for the functional dependence of…

Machine Learning · Computer Science 2021-04-21 Paul Piho , Jane Hillston