English
Related papers

Related papers: Probabilistic divide-and-conquer: deterministic se…

200 papers

In big data analysis, a simple task such as linear regression can become very challenging as the variable dimension $p$ grows. As a result, variable screening is inevitable in many scientific studies. In recent years, randomized algorithms…

Methodology · Statistics 2019-02-13 Yu-Hsiang Cheng , Tzee-Ming Huang , Su-Yun Huang

In this paper, we combine deterministic splitting methods with a polynomial chaos expansion method for solving stochastic parabolic evolution problems. The stochastic differential equation is reduced to a system of deterministic equations…

Numerical Analysis · Mathematics 2021-07-02 Andreas Kofler , Tijana Levajković , Hermann Mena , Alexander Ostermann

We give a highly efficient "semi-agnostic" algorithm for learning univariate probability distributions that are well approximated by piecewise polynomial density functions. Let $p$ be an arbitrary distribution over an interval $I$ which is…

Machine Learning · Computer Science 2013-05-15 Siu-On Chan , Ilias Diakonikolas , Rocco A. Servedio , Xiaorui Sun

We analyze the recent Multi-index Stochastic Collocation (MISC) method for computing statistics of the solution of a partial differential equation (PDEs) with random data, where the random coefficient is parametrized by means of a countable…

Numerical Analysis · Mathematics 2016-07-22 Abdul-Lateef Haji-Ali , Fabio Nobile , Lorenzo Tamellini , Raul Tempone

We give a principled method for decomposing the predictive uncertainty of a model into aleatoric and epistemic components with explicit semantics relating them to the real-world data distribution. While many works in the literature have…

Machine Learning · Computer Science 2024-12-30 Gustaf Ahdritz , Aravind Gollakota , Parikshit Gopalan , Charlotte Peale , Udi Wieder

We provide a comprehensive characterisation of the theoretical properties of the divide-and-conquer sequential Monte Carlo (DaC-SMC) algorithm. We firmly establish it as a well-founded method by showing that it possesses the same basic…

Methodology · Statistics 2023-07-04 Juan Kuntz , Francesca R. Crucinio , Adam M. Johansen

We propose a divide-and-conquer (DAC) algorithm for constrained convex optimization over networks, where the global objective is the sum of local objectives attached to individual agents. The algorithm is fully distributed: each iteration…

Optimization and Control · Mathematics 2025-10-03 Nazar Emirov , Guohui Song , Qiyu Sun

The sparse factorization of a large matrix is fundamental in modern statistical learning. In particular, the sparse singular value decomposition and its variants have been utilized in multivariate regression, factor analysis, biclustering,…

Machine Learning · Statistics 2020-03-19 Kun Chen , Ruipeng Dong , Wanwan Xu , Zemin Zheng

The numerical solution of differential equations can be formulated as an inference problem to which formal statistical approaches can be applied. However, nonlinear partial differential equations (PDEs) pose substantial challenges from an…

Numerical Analysis · Mathematics 2021-08-26 Junyang Wang , Jon Cockayne , Oksana Chkrebtii , T. J. Sullivan , Chris. J. Oates

Spatially distributed problems are often approximately modelled in terms of partial differential equations (PDEs) for appropriate coarse-grained quantities (e.g. concentrations). The derivation of accurate such PDEs starting from finer…

Quantitative Methods · Quantitative Biology 2009-11-13 Liang Qiao , Radek Erban , C. T. Kelley , Ioannis G. Kevrekidis

Divide-and-conquer dividing by a half recurrences, of the form $x_n =a\cdot x_{\left\lceil{n}/{2}\right\rceil}+a\cdot x_{\left\lfloor{n}/{2}\right\rfloor}+p(n)$, $n\geq 2$, appear in many areas of applied mathematics, from the analysis of…

Discrete Mathematics · Computer Science 2023-01-11 Tomás M. Coronado , Arnau Mir , Francesc Rosselló

In engineering, accurately modeling nonlinear dynamic systems from data contaminated by noise is both essential and complex. Established Sequential Monte Carlo (SMC) methods, used for the Bayesian identification of these systems, facilitate…

Machine Learning · Statistics 2024-04-25 Joe D. Longbottom , Max D. Champneys , Timothy J. Rogers

This work aims at making a comprehensive contribution in the general area of parametric inference for discretely observed diffusion processes. Established approaches for likelihood-based estimation invoke a time-discretisation scheme for…

Methodology · Statistics 2024-01-30 Yuga Iguchi , Alexandros Beskos , Matthew M. Graham

This paper studies the problem of distribution matching (DM), which is a fundamental machine learning problem seeking to robustly align two probability distributions. Our approach is established on a relaxed formulation, called partial…

Machine Learning · Computer Science 2025-05-27 Zi-Ming Wang , Nan Xue , Ling Lei , Rebecka Jörnsten , Gui-Song Xia

Formalisms for specifying statistical models, such as probabilistic-programming languages, typically consist of two components: a specification of a stochastic process (the prior), and a specification of observations that restrict the…

Databases · Computer Science 2015-01-06 Vince Barany , Balder ten Cate , Benny Kimelfeld , Dan Olteanu , Zografoula Vagena

Simulation-based inference methods that feature correct conditional coverage of confidence sets based on observations that have been compressed to a scalar test statistic require accurate modeling of either the p-value function or the…

Machine Learning · Statistics 2025-08-18 Ali Al Kadhim , Harrison B. Prosper

We propose an exact slice sampler for Hierarchical Dirichlet process (HDP) and its associated mixture models (Teh et al., 2006). Although there are existing MCMC algorithms for sampling from the HDP, a slice sampler has been missing from…

Machine Learning · Statistics 2019-03-22 Arash A. Amini , Marina Paez , Lizhen Lin , Zahra S. Razaee

We present an approach to deep estimation of discrete conditional probability distributions. Such models have several applications, including generative modeling of audio, image, and video data. Our approach combines two main techniques:…

Machine Learning · Statistics 2017-03-01 Wesley Tansey , Karl Pichotta , James G. Scott

Piecewise Deterministic Markov Processes (PDMPs) are studied in a general framework. First, different constructions are proven to be equivalent. Second, we introduce a coupling between two PDMPs following the same differential flow which…

Probability · Mathematics 2021-08-03 Alain Durmus , Arnaud Guillin , Pierre Monmarché

We propose a novel distribution-free scheme to solve optimization problems where the goal is to minimize the expected value of a cost function subject to probabilistic constraints. Unlike standard sampling-based methods, our idea consists…

Optimization and Control · Mathematics 2025-05-28 Francesco Cordiano , Matin Jafarian , Bart De Schutter
‹ Prev 1 4 5 6 7 8 10 Next ›