English
Related papers

Related papers: A parallel solver for random input problems via Ka…

200 papers

In this paper, we consider the problem of stochastic optimization, where the objective function is in terms of the expectation of a (possibly non-convex) cost function that is parametrized by a random variable. While the convergence speed…

Information Theory · Computer Science 2019-10-23 Naeimeh Omidvar , An Liu , Vincent Lau , Danny H. K. Tsang , Mohammad Reza Pakravan

The hypercube queueing model was initially developed to address spatial queueing problems and has found wide applications in emergency services, such as ambulance and police systems. While the model was originally designed for homogeneous…

Optimization and Control · Mathematics 2026-03-10 Cheng Hua , Jun Luo , Arthur J. Swersey , Yixing Wen

This paper introduces a novel K-means clustering algorithm, an advancement on the conventional Big-means methodology. The proposed method efficiently integrates parallel processing, stochastic sampling, and competitive optimization to…

Machine Learning · Computer Science 2024-03-28 Rustam Mussabayev , Ravil Mussabayev

We present a parallel GPU-accelerated solver for branch Model Predictive Control problems. Based on iterative LQR methods, our solver exploits the tree-sparse structure and implements temporal parallelism using the parallel scan algorithm.…

Systems and Control · Electrical Eng. & Systems 2025-06-17 Luyao Zhang , Chenghuai Lin , Sergio Grammatico

We develop a new parallel algorithm for minimizing Lipschitz, convex functions with a stochastic subgradient oracle. The total number of queries made and the query depth, i.e., the number of parallel rounds of queries, match the prior…

Optimization and Control · Mathematics 2024-06-12 Arun Jambulapati , Aaron Sidford , Kevin Tian

As CPU clock speeds have stagnated and high performance computers continue to have ever higher core counts, increased parallelism is needed to take advantage of these new architectures. Traditional serial time-marching schemes can be a…

Numerical Analysis · Mathematics 2022-08-29 David A. Vargas , Robert D. Falgout , Stefanie Günther , Jacob B. Schroder

We propose a new method, the continuous Galerkin method with globally and locally supported basis functions (CG-GL), to address the parametric robustness issues of reduced-order models (ROMs) by incorporating solution-based adaptivity with…

Numerical Analysis · Mathematics 2023-10-10 Han Gao , Matthew J. Zahr

We present a new approach for constructing a data-driven surrogate model and using it for Bayesian parameter estimation in partial differential equation (PDE) models. We first use parameter observations and Gaussian Process regression to…

Numerical Analysis · Mathematics 2020-07-15 Jing Li , Alexandre M Tartakovsky

Pseudorandom number generators are required for many computational tasks, such as stochastic modelling and simulation. This paper investigates the serial CPU and parallel GPU implementation of a Linear Congruential Generator based on the…

Mathematical Software · Computer Science 2012-06-25 Gleb Beliakov , Michael Johnstone , Doug Creighton , Tim Wilkin

This article explores the estimation of parameters and states for linear stochastic systems with deterministic control inputs. It introduces a novel Kalman filtering approach called Kalman Filtering with Correlated Noises Recursive…

Systems and Control · Electrical Eng. & Systems 2025-07-11 Abd El Mageed Hag Elamin Khalid

Nowadays, several industrial applications are being ported to parallel architectures. In fact, these platforms allow acquire more performance for system modelling and simulation. In the electric machines area, there are many problems which…

Distributed, Parallel, and Cluster Computing · Computer Science 2010-10-25 Antonio Wendell De Oliveira Rodrigues , Frédéric Guyomarch , Yvonnick Le Menach , Jean-Luc Dekeyser

We are concerned with a novel Bayesian statistical framework for the characterization of natural subsurface formations, a very challenging task. Because of the large dimension of the stochastic space of the prior distribution in the…

Numerical Analysis · Mathematics 2023-02-23 Alsadig Ali , Abdullah Al-Mamun , Felipe Pereira , Arunasalam Rahunanthan

We propose a new algorithm called Parle for parallel training of deep networks that converges 2-4x faster than a data-parallel implementation of SGD, while achieving significantly improved error rates that are nearly state-of-the-art on…

Machine Learning · Computer Science 2017-09-12 Pratik Chaudhari , Carlo Baldassi , Riccardo Zecchina , Stefano Soatto , Ameet Talwalkar , Adam Oberman

We consider linearizations of stochastic differential equations with additive noise using the Karhunen-Lo\`eve expansion. We obtain our linearizations by truncating the expansion and writing the solution as a series of matrix-vector…

Numerical Analysis · Mathematics 2020-04-14 Antti Koskela , Samuel D. Relton

A version of the time-parallel algorithm parareal is analyzed and applied to stochastic models in chemical kinetics. A fast predictor at the macroscopic scale (evaluated in serial) is available in the form of the usual reaction rate…

Numerical Analysis · Mathematics 2009-09-16 Stefan Engblom

The implementation of a vast majority of machine learning (ML) algorithms boils down to solving a numerical optimization problem. In this context, Stochastic Gradient Descent (SGD) methods have long proven to provide good results, both in…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-10-06 Janis Keuper , Franz-Josef Pfreundt

Parametric search has been widely used in geometric algorithms. Cole's improvement provides a way of saving a logarithmic factor in the running time over what is achievable using the standard method. Unfortunately, this improvement comes at…

Data Structures and Algorithms · Computer Science 2013-06-14 Michael T. Goodrich , Paweł Pszona

Sequential models, such as Recurrent Neural Networks and Neural Ordinary Differential Equations, have long suffered from slow training due to their inherent sequential nature. For many years this bottleneck has persisted, as many thought…

Machine Learning · Computer Science 2024-01-17 Yi Heng Lim , Qi Zhu , Joshua Selfridge , Muhammad Firmansyah Kasim

Convex regression (CR) problem deals with fitting a convex function to a finite number of observations. It has many applications in various disciplines, such as statistics, economics, operations research, and electrical engineering.…

Optimization and Control · Mathematics 2014-09-24 Necdet Serhat Aybat , Zi Wang

The Parareal algorithm allows to solve evolution problems exploiting parallelization in time. Its convergence and stability have been proved under the assumption of regular (smooth) inputs. We present and analyze here a new Parareal…

Numerical Analysis · Mathematics 2019-04-09 Martin J. Gander , Iryna Kulchytska-Ruchka , Innocent Niyonzima , Sebastian Schöps