English
Related papers

Related papers: A Gaussian Belief Propagation Solver for Large Sca…

200 papers

Support vector machine (SVM) is a particularly powerful and flexible supervised learning model that analyzes data for both classification and regression, whose usual algorithm complexity scales polynomially with the dimension of data space…

Machine Learning · Computer Science 2023-03-08 Chen Ding , Tian-Yi Bao , He-Liang Huang

Belief Propagation (BP) is a powerful algorithm for distributed inference in probabilistic graphical models, however it quickly becomes infeasible for practical compute and memory budgets. Many efficient, non-parametric forms of BP have…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-01-30 Tom Yates , Yuzhou Cheng , Ignacio Alzugaray , Danyal Akarca , Pedro A. M. Mediano , Andrew J. Davison

This paper investigates the asymptotic behavior of the soft-margin and hard-margin support vector machine (SVM) classifiers for simultaneously high-dimensional and numerous data (large $n$ and large $p$ with $n/p\to\delta$) drawn from a…

Information Theory · Computer Science 2020-03-31 Abla Kammoun , Mohamed-Slim Alouini

This paper develops methods of distributed Bayesian hypothesis tests for fault detection and diagnosis that are based on belief propagation and optimization in graphical models. The main challenges in developing distributed statistical…

Systems and Control · Computer Science 2015-01-20 Kwang-Ki K. Kim

Interior-point methods are state-of-the-art algorithms for solving linear programming (LP) problems with polynomial complexity. Specifically, the Karmarkar algorithm typically solves LP problems in time O(n^{3.5}), where $n$ is the number…

Information Theory · Computer Science 2009-04-16 Danny Bickson , Yoav Tock , Ori Shental , Danny Dolev

The support vector machine (SVM) is an important class of learning machines for function approach, pattern recognition, and time-serious prediction, etc. It maps samples into the feature space by so-called support vectors of selected…

Machine Learning · Statistics 2016-02-15 Hong Zhao

Emulating computationally intensive scientific simulations is crucial for enabling uncertainty quantification, optimization, and informed decision-making at scale. Gaussian Processes (GPs) offer a flexible and data-efficient foundation for…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-03-26 Qilong Pan , Sameh Abdulah , Mustafa Abduljabbar , Hatem Ltaief , Andreas Herten , Mathis Bode , Matthew Pratola , Arindam Fadikar , Marc G. Genton , David E. Keyes , Ying Sun

This paper deals with Gibbs samplers that include high dimensional conditional Gaussian distributions. It proposes an efficient algorithm that avoids the high dimensional Gaussian sampling and relies on a random excursion along a small set…

Computation · Statistics 2016-04-20 Olivier Féron , François Orieux , Jean-François Giovannelli

Precise coordinated planning over a forward time window enables safe and highly efficient motion when many robots must work together in tight spaces, but this would normally require centralised control of all devices which is difficult to…

Robotics · Computer Science 2023-01-27 Aalok Patwardhan , Riku Murai , Andrew J. Davison

Belief propagation (BP) is a popular method for performing probabilistic inference on graphical models. In this work, we enhance BP and propose self-guided belief propagation (SBP) that incorporates the pairwise potentials only gradually.…

Machine Learning · Statistics 2024-10-30 Christian Knoll , Adrian Weller , Franz Pernkopf

To speed up Gaussian process inference, a number of fast kernel matrix-vector multiplication (MVM) approximation algorithms have been proposed over the years. In this paper, we establish an exact fast kernel MVM algorithm based on exact…

Machine Learning · Statistics 2025-08-05 Nicolas Langrené , Xavier Warin , Pierre Gruet

The Support Vector Machine (SVM) of Vapnik (1998) has become widely established as one of the leading approaches to pattern recognition and machine learning. It expresses predictions in terms of a linear combination of kernel functions…

Machine Learning · Computer Science 2013-01-18 Christopher M. Bishop , Michael Tipping

We present a novel distributed Gauss-Newton method for the non-linear state estimation (SE) model based on a probabilistic inference method called belief propagation (BP). The main novelty of our work comes from applying BP sequentially…

Information Theory · Computer Science 2018-08-28 Mirsad Cosovic , Dejan Vukobratovic

The principal support vector machines method (Li et al., 2011) is a powerful tool for sufficient dimension reduction that replaces original predictors with their low-dimensional linear combinations without loss of information. However, the…

Machine Learning · Statistics 2019-12-02 Jun Jin , Chao Ying , Zhou Yu

In this paper, we argue for the utility of deterministic inference in the classical problem of numerical linear algebra, that of solving a linear system. We show how the Gaussian belief propagation solver, known to work for symmetric…

Numerical Analysis · Mathematics 2020-02-26 Vladimir Fanaskov

The support vector machine (SVM) is a well-established classification method whose name refers to the particular training examples, called support vectors, that determine the maximum margin separating hyperplane. The SVM classifier is known…

Statistics Theory · Mathematics 2022-06-15 Daniel Hsu , Vidya Muthukumar , Ji Xu

In the quest for scalable Bayesian computational algorithms we need to exploit the full potential of existing methodologies. In this note we point out that message passing algorithms, which are very well developed for inference in graphical…

Computation · Statistics 2017-09-05 Omiros Papaspiliopoulos , Giacomo Zanella

Support vector machines (SVMs) are a standard method in the machine learning toolbox, in particular for tabular data. Non-linear kernel SVMs often deliver highly accurate predictors, however, at the cost of long training times. That problem…

Machine Learning · Computer Science 2022-07-05 Tobias Glasmachers

An importance sampling and bagging approach to solving the support vector machine (SVM) problem in the context of large databases is presented and evaluated. Our algorithm builds on the nearest neighbors ideas presented in Camelo at al.…

Machine Learning · Statistics 2018-08-20 R. Bárcenas , M. D. Gónzalez--Lima , A. J. Quiroz

Quantum systems are the future candidates for computers and information processing devices. Information about quantum states and processes may be incomplete and scattered in these systems. We use a quantum version of Belief Propagation(BP)…

Quantum Physics · Physics 2014-09-09 Farzad Ghafari Jouneghani , Mohammad Babazadeh , Davoud Salami , Hossein Movla