English
Related papers

Related papers: Scalable Data Assimilation with Message Passing

200 papers

We consider the problem of signal estimation in a generalized linear model (GLM). GLMs include many canonical problems in statistical estimation, such as linear regression, phase retrieval, and 1-bit compressed sensing. Recent work has…

Information Theory · Computer Science 2024-10-29 Pablo Pascual Cobo , Kuan Hsieh , Ramji Venkataramanan

In this work, we address the problem of solving a series of underdetermined linear inverse problems subject to a sparsity constraint. We generalize the spike-and-slab prior distribution to encode a priori correlation of the support of the…

Machine Learning · Statistics 2018-01-19 Michael Riis Andersen , Aki Vehtari , Ole Winther , Lars Kai Hansen

Low-order thermoacoustic models are qualitatively correct, but they are typically quantitatively inaccurate. We propose a time-domain bias-aware method to make qualitatively low--order models quantitatively (more) accurate. First, we…

Fluid Dynamics · Physics 2022-11-10 Andrea Nóvoa , Luca Magri

We describe a new approach allowing for systematic causal attribution of weather and climate-related events, in near-real time. The method is purposely designed to facilitate its implementation at meteorological centers by relying on data…

Adaptive learning is necessary for non-stationary environments where the learning machine needs to forget past data distribution. Efficient algorithms require a compact model update to not grow in computational burden with the incoming data…

Machine Learning · Computer Science 2023-07-11 Vanessa Gómez-Verdejo , Emilio Parrado-Hernández , Manel Martínez-Ramón

A common divide-and-conquer approach for Bayesian computation with big data is to partition the data, perform local inference for each piece separately, and combine the results to obtain a global posterior approximation. While being…

We consider the estimation of Dirichlet Process Mixture Models (DPMMs) in distributed environments, where data are distributed across multiple computing nodes. A key advantage of Bayesian nonparametric models such as DPMMs is that they…

Machine Learning · Statistics 2017-09-20 Ruohui Wang , Dahua Lin

Message passing algorithms, whose iterative nature captures well complicated interactions among interconnected variables in complex systems and extracts information from the fixed point of iterated messages, provide a powerful toolkit in…

Disordered Systems and Neural Networks · Physics 2022-02-28 Chun-Yan Zhao , Yan-Rong Fu , Jin-Hua Zhao

In meteorology, engineering and computer sciences, data assimilation is routinely employed as the optimal way to combine noisy observations with prior model information for obtaining better estimates of a state, and thus better forecasts,…

Geophysics · Physics 2009-08-12 M. J. Werner , K. Ide , D. Sornette

A recurrent task in coordinated systems is managing (estimating, predicting, or controlling) signals that vary in space, such as distributed sensed data or computation outcomes. Especially in large-scale settings, the problem can be…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-02-14 Roberto Casadei , Stefano Mariani , Danilo Pianini , Mirko Viroli , Franco Zambonelli

This paper presents novel Gaussian process decentralized data fusion algorithms exploiting the notion of agent-centric support sets for distributed cooperative perception of large-scale environmental phenomena. To overcome the limitations…

Machine Learning · Statistics 2017-11-17 Ruofei Ouyang , Kian Hsiang Low

With the transition to a smart grid, we are witnessing a significant growth in sensor deployments and smart metering infrastructure in the distribution system. However, information from these sensors and meters are typically unevenly…

Systems and Control · Electrical Eng. & Systems 2020-11-24 Shweta Dahale , Balasubramaniam Natarajan

The paper considers the problem of distributed adaptive linear parameter estimation in multi-agent inference networks. Local sensing model information is only partially available at the agents and inter-agent communication is assumed to be…

Optimization and Control · Mathematics 2012-08-07 Soummya Kar , Jose' M. F. Moura , H. Vincent Poor

Data assimilation is the process of estimating the state of a dynamical system over time by combining model predictions with measurements. This task becomes challenging when the system is nonlinear and high-dimensional. To address this,…

Machine Learning · Statistics 2026-05-22 Eunbi Yoon , Won Chang , Donghan Kim , Dae Wook Kim

This article introduces novel and practicable Bayesian factor analysis frameworks that are computationally feasible for moderate to large spatiotemporal data. Previous Bayesian analysis of spatiotemporal data has utilized a Bayesian factor…

Methodology · Statistics 2025-02-18 Yifan Cheng , Cheng Li

A flexible representation of uncertainty that remains within the standard framework of probabilistic measure theory is presented along with a study of its properties. This representation relies on a specific type of outer measure that is…

Information Theory · Computer Science 2016-11-10 Jeremie Houssineau , Daniel E. Clark

In this paper we consider a network of spatially distributed sensors which collect measurement samples of a spatial field, and aim at estimating in a distributed way (without any central coordinator) the entire field by suitably fusing all…

Systems and Control · Computer Science 2018-05-23 Francesco Sasso , Angelo Coluccia , Giuseppe Notarstefano

Approximate message passing is an iterative algorithm for compressed sensing and related applications. A solid theory about the performance and convergence of the algorithm exists for measurement matrices having iid entries of zero mean.…

Information Theory · Computer Science 2014-10-03 Francesco Caltagirone , Florent Krzakala , Lenka Zdeborová

Spatial fields in the Earth and environmental sciences are often available at multiple scales or resolutions. While coarse-scale data (e.g., from global circulation models) are often abundant, they lack the local detail provided by…

Methodology · Statistics 2026-04-01 Alejandro Calle-Saldarriaga , Paul F. V. Wiemann , Matthias Katzfuss

We consider Bayesian inverse problems arising in data assimilation for dynamical systems governed by partial and stochastic partial differential equations. The space-time dependent field is inferred jointly with static parameters of the…

Computation · Statistics 2026-03-20 Baptiste Simandoux , Nikolas Kantas , Dan Crisan