English
Related papers

Related papers: Robust volatility updates for Hierarchical Gaussia…

200 papers

This paper introduces a novel family of generalized exponentiated gradient (EG) updates derived from an Alpha-Beta divergence regularization function. Collectively referred to as EGAB, the proposed updates belong to the category of…

Machine Learning · Computer Science 2024-12-30 Andrzej Cichocki , Sergio Cruces , Auxiliadora Sarmiento , Toshihisa Tanaka

We develop and analyze a broad family of stochastic/randomized algorithms for inverting a matrix. We also develop specialized variants maintaining symmetry or positive definiteness of the iterates. All methods in the family converge…

Numerical Analysis · Mathematics 2016-03-24 Robert M. Gower , Peter Richtárik

Quantifying uncertainty and updating reliability are essential for ensuring the safety and performance of engineering systems. This study develops a hierarchical Bayesian modeling (HBM) framework to quantify uncertainty and update…

Methodology · Statistics 2024-12-31 Xinyu Jia , Weinan Hou , Costas Papadimitriou

Parameter inference for linear and non-Gaussian state space models is challenging because the likelihood function contains an intractable integral over the latent state variables. While Markov chain Monte Carlo (MCMC) methods provide exact…

Computation · Statistics 2025-07-22 Bao Anh Vu , David Gunawan , Andrew Zammit-Mangion

This paper proposes a novel graph-based regularized regression estimator - the hierarchical feature regression (HFR) -, which mobilizes insights from the domains of machine learning and graph theory to estimate robust parameters for a…

Machine Learning · Statistics 2022-01-11 Johann Pfitzinger

Ensemble Kalman filters are based on a Gaussian assumption, which can limit their performance in some non-Gaussian settings. This paper reviews two nonlinear, non-Gaussian extensions of the Ensemble Kalman Filter: Gaussian anamorphosis (GA)…

Computation · Statistics 2022-03-08 Ian Grooms

We have previously investigated the effect of the gravitational constant variation on the gravitational wave propagation. Pure theoretical analysis indicates that the leading order effect of the gravitational constant variation corrects the…

General Relativity and Quantum Cosmology · Physics 2025-09-01 Jiachen An , Bing Sun , Zhoujian Cao

In this work, we adopt a general framework based on the Gibbs posterior to update belief distributions for inverse problems governed by partial differential equations (PDEs). The Gibbs posterior formulation is a generalization of standard…

Computation · Statistics 2019-07-04 Zilong Zou , Sayan Mukherjee , Harbir Antil , Wilkins Aquino

The increasing sensitivity of current and upcoming gravitational-wave (GW) detectors poses stringent requirements on the accuracy of the GW models used for data analysis. If these requirements are not met, systematic errors could dominate…

General Relativity and Quantum Cosmology · Physics 2025-08-29 Lorenzo Pompili , Alessandra Buonanno , Michael Pürrer

In the past few years, deep generative models, such as generative adversarial networks \autocite{GAN}, variational autoencoders \autocite{vaepaper}, and their variants, have seen wide adoption for the task of modelling complex data…

Machine Learning · Statistics 2020-09-02 Guilherme G. P. Freitas Pires , Mário A. T. Figueiredo

The combination of inducing point methods with stochastic variational inference has enabled approximate Gaussian Process (GP) inference on large datasets. Unfortunately, the resulting predictive distributions often exhibit substantially…

Machine Learning · Statistics 2020-12-29 Martin Jankowiak , Geoff Pleiss , Jacob R. Gardner

Variational inference methods for latent variable statistical models have gained popularity because they are relatively fast, can handle large data sets, and have deterministic convergence guarantees. However, in practice it is unclear…

Methodology · Statistics 2017-03-22 Hachem Saddiki , Andrew C. Trapp , Patrick Flaherty

We introduce a novel stochastic variational inference method for Gaussian process ($\mathcal{GP}$) regression, by deriving a posterior over a learnable set of coresets: i.e., over pseudo-input/output, weighted pairs. Unlike former free-form…

Machine Learning · Computer Science 2025-03-06 Mert Ketenci , Adler Perotte , Noémie Elhadad , Iñigo Urteaga

Voltage control in power distribution networks has been greatly challenged by the increasing penetration of volatile and intermittent devices. These devices can also provide limited reactive power resources that can be used to regulate the…

Systems and Control · Computer Science 2016-07-26 Hao Jan Liu , Wei Shi , Hao Zhu

In this work we consider a new family of algorithms for sequential prediction, Hierarchical Partitioning Forecasters (HPFs). Our goal is to provide appealing theoretical - regret guarantees on a powerful model class - and practical -…

Machine Learning · Computer Science 2023-05-23 Christopher Mattern

This paper introduces a new probabilistic model for online learning which dynamically incorporates information from stochastic gradients of an arbitrary loss function. Similar to probabilistic filtering, the model maintains a Gaussian…

Machine Learning · Statistics 2015-05-27 Pedro A. Ortega , Koby Crammer , Daniel D. Lee

Adaptive learning is necessary for non-stationary environments where the learning machine needs to forget past data distribution. Efficient algorithms require a compact model update to not grow in computational burden with the incoming data…

Machine Learning · Computer Science 2023-07-11 Vanessa Gómez-Verdejo , Emilio Parrado-Hernández , Manel Martínez-Ramón

Bayesian Federated Learning (BFL) enables uncertainty quantification and robust adaptation in distributed learning. In contrast to the frequentist approach, it estimates the posterior distribution of a global model, offering insights into…

Machine Learning · Computer Science 2025-04-23 Usevalad Milasheuski , Luca Barbieri , Sanaz Kianoush , Monica Nicoli , Stefano Savazzi

Accurate power flow analysis is critical for modern distribution systems, yet classical solvers face scalability issues, and current machine learning models often struggle with generalization. We introduce BOOST-RPF, a novel method that…

Machine Learning · Computer Science 2026-03-24 Ehimare Okoyomon , Christoph Goebel

Social bots are increasingly polluting online platforms by spreading misinformation and engaging in coordinated manipulation, posing severe threats to cybersecurity. Graph Neural Networks (GNNs) have become mainstream for social bot…

Social and Information Networks · Computer Science 2025-12-01 Zida Liu , Jun Gao , Zhang Ji , Li Zhao