English
Related papers

Related papers: Probabilistic Iterative Methods for Linear Systems

200 papers

We present a proximal algorithm that performs a variational recursion on the space of joint probability measures to propagate the stochastic uncertainties in power system dynamics over high dimensional state space. The proposed algorithm…

Optimization and Control · Mathematics 2022-08-26 Abhishek Halder , Kenneth F. Caluya , Pegah Ojaghi , Xinbo Geng

This paper presents a Distributed Stochastic Model Predictive Control algorithm for networks of linear systems with multiplicative uncertainties and local chance constraints on the states and control inputs. The chance constraints are…

Optimization and Control · Mathematics 2023-03-07 Christoph Mark , Steven Liu

In this work, we introduce an iterative linearised finite element method for the solution of Bingham fluid flow problems. The proposed algorithm has the favourable property that a subsequence of the sequence of iterates generated converges…

Numerical Analysis · Mathematics 2021-09-14 Pascal Heid , Endre Süli

A random set is a generalisation of a random variable, i.e. a set-valued random variable. The random set theory allows a unification of other uncertainty descriptions such as interval variable, mass belief function in Dempster-Shafer theory…

Numerical Analysis · Mathematics 2018-11-27 Truong-Vinh Hoang , Hermann G. Matthies

This paper mainly addresses the optimization of $p$-th moment of $\mathbb{R}^n$-valued random variable. Through an ingenious approximation mechanism, one transforms the maximization problem into a sequence of minimization problems, which…

Optimization and Control · Mathematics 2016-07-26 Xiaojun Lu , Yanhua Wu

This paper presents an algorithm to apply nonlinear control design approaches in the case of stochastic systems with partial state observation. Deterministic nonlinear control approaches are formulated under the assumption of full state…

Systems and Control · Electrical Eng. & Systems 2023-09-19 Mohammad S. Ramadan , Mohammad Alsuwaidan , Ahmed Atallah , Sylvia Herbert

System state estimation constitutes a key problem in several applications involving multi-agent system architectures. This rests upon the estimation of the state of each agent in the group, which is supposed to access only relative…

Systems and Control · Electrical Eng. & Systems 2021-07-16 Marco Fabris , Giulia Michieletto , Angelo Cenedese

In this paper, we propose a probabilistic optimization method, named probabilistic incremental proximal gradient (PIPG) method, by developing a probabilistic interpretation of the incremental proximal gradient algorithm. We explicitly model…

Optimization and Control · Mathematics 2019-06-20 Ömer Deniz Akyildiz , Émilie Chouzenoux , Víctor Elvira , Joaquín Míguez

Projection-based iterative methods for solving large over-determined linear systems are well-known for their simplicity and computational efficiency. It is also known that the correct choice of a sketching procedure (i.e., preprocessing…

Numerical Analysis · Mathematics 2019-12-03 Elizaveta Rebrova , Deanna Needell

Empirical likelihood approach is one of non-parametric statistical methods, which is applied to the hypothesis testing or construction of confidence regions for pivotal unknown quantities. This method has been applied to the case of…

Statistics Theory · Mathematics 2015-09-21 Fumiya Akashi , Yan Liu , Masanobu Taniguchi

In many applications, accurate class probability estimates are required, but many types of models produce poor quality probability estimates despite achieving acceptable classification accuracy. Even though probability calibration has been…

Machine Learning · Computer Science 2020-02-18 Tim Leathart , Maksymilian Polaczuk

This paper studies the problem of {\em learning} the probability distribution $P_X$ of a discrete random variable $X$ using indirect and sequential samples. At each time step, we choose one of the possible $K$ functions, $g_1, \ldots, g_K$…

Machine Learning · Computer Science 2018-08-17 Samarth Gupta , Gauri Joshi , Osman Yağan

In this paper we develop proximal methods for statistical learning. Proximal point algorithms are useful in statistics and machine learning for obtaining optimization solutions for composite functions. Our approach exploits closed-form…

Machine Learning · Statistics 2015-06-02 Nicholas G. Polson , James G. Scott , Brandon T. Willard

We present a new class of preconditioned iterative methods for solving linear systems of the form $Ax = b$. Our methods are based on constructing a low-rank Nystr\"om approximation to $A$ using sparse random matrix sketching. This…

Data Structures and Algorithms · Computer Science 2025-04-14 Michał Dereziński , Christopher Musco , Jiaming Yang

In this paper, a modification of the conventional approximations to the quasi-maximum likelihood method is introduced for the parameter estimation of diffusion processes from discrete observations. This is based on a convergent…

Optimization and Control · Mathematics 2013-12-19 J. C. Jimenez

Probabilistic Manifold Decomposition (PMD)\cite{doi:10.1137/25M1738863}, developed in our earlier work, provides a nonlinear model reduction by embedding high-dimensional dynamics onto low-dimensional probabilistic manifolds. The PMD has…

Numerical Analysis · Mathematics 2026-01-13 Jiaming Guo , Dunhui Xiao

There is an increasing amount of literature focused on Bayesian computational methods to address problems with intractable likelihood. One approach is a set of algorithms known as Approximate Bayesian Computational (ABC) methods. One of the…

Methodology · Statistics 2015-10-27 Weixuan Zhu , Juan Miguel Marin , Fabrizio Leisen

In this paper, we introduce the new optimal perturbation iteration method based on the perturbation iteration algorithms for the approximate solutions of nonlinear differential equations of many types. The proposed method is illustrated by…

Numerical Analysis · Mathematics 2016-09-21 Sinan Deniz , Necdet Bildik

Complex continuous or mixed joint distributions (e.g., P(Y | z_1, z_2, ..., z_N)) generally lack closed-form solutions, often necessitating approximations such as MCMC. This paper proposes Indeterminate Probability Theory (IPT), which makes…

Machine Learning · Computer Science 2025-06-24 Tao Yang , Chuang Liu , Xiaofeng Ma , Weijia Lu , Ning Wu , Bingyang Li , Zhifei Yang , Peng Liu , Lin Sun , Xiaodong Zhang , Can Zhang

Solving a large-scale system of linear equations is a key step at the heart of many algorithms in machine learning, scientific computing, and beyond. When the problem dimension is large, computational and/or memory constraints make it…

Machine Learning · Computer Science 2017-12-12 Navid Azizan-Ruhi , Farshad Lahouti , Salman Avestimehr , Babak Hassibi