English
Related papers

Related papers: Estimating model evidence using ensemble-based dat…

200 papers

Climate field reconstructions (CFR) attempt to estimate spatiotemporal fields of climate variables in the past using climate proxies such as tree rings, ice cores, and corals. Data Assimilation (DA) methods are a recent and promising new…

Methodology · Statistics 2020-08-06 Trevor Harris , Bo Li , Nathan Steiger , Jason Smerdon , Naveen Narisetty , Derek Tucker

Large Language Model ensembles improve reasoning accuracy, but only up to a performance boundary beyond which additional deliberation degrades accuracy. We introduce DASE (Deliberative Adaptive Stopping Ensemble), a stopping heuristic for…

Machine Learning · Computer Science 2026-05-15 Roberto E. Medina

Domain Adaptation (DA) has received widespread attention from deep learning researchers in recent years because of its potential to improve test accuracy with out-of-distribution labeled data. Most state-of-the-art DA algorithms require an…

Machine Learning · Computer Science 2022-05-27 Christopher Liao , Theodoros Tsiligkaridis , Brian Kulis

Decision trees and random forest remain highly competitive for classification on medium-sized, standard datasets due to their robustness, minimal preprocessing requirements, and interpretability. However, a single tree suffers from high…

Machine Learning · Statistics 2025-12-02 Cencheng Shen , Yuexiao Dong , Carey E. Priebe

We study prediction-assimilation systems, which have become routine in meteorology and oceanography and are rapidly spreading to other areas of the geosciences and of continuum physics. The long-term, nonlinear stability of such a system…

Chaotic Dynamics · Physics 2009-11-13 Alberto Carrassi , Michael Ghil , Anna Trevisan , Francesco Uboldi

We consider data assimilation for the heat equation using a finite element space semi-discretization. The approach is optimization based, but the design of regularization operators and parameters rely on techniques from the theory of…

Numerical Analysis · Mathematics 2016-09-19 Erik Burman , Lauri Oksanen

The generation of initial conditions via accurate data assimilation is crucial for weather forecasting and climate modeling. We propose DiffDA as a denoising diffusion model capable of assimilating atmospheric variables using predicted…

Computational Engineering, Finance, and Science · Computer Science 2024-06-11 Langwen Huang , Lukas Gianinazzi , Yuejiang Yu , Peter D. Dueben , Torsten Hoefler

Given the prevalence of rolling bearing fault diagnosis as a practical issue across various working conditions, the limited availability of samples compounds the challenge. Additionally, the complexity of the external environment and the…

Artificial Intelligence · Computer Science 2023-08-30 Jiang Liu , Wei Dai

Ensemble Learning methods combine multiple algorithms performing the same task to build a group with superior quality. These systems are well adapted to the distributed setup, where each peer or machine of the network hosts one algorithm…

Machine Learning · Computer Science 2021-10-19 Gaëlle Candel , David Naccache

Ensemble models can be used to estimate prediction uncertainties in machine learning models. However, an ensemble of N models is approximately N times more computationally demanding compared to a single model when it is used for inference.…

Machine Learning · Computer Science 2026-03-04 Vidit Agrawal , Shixin Zhang , Lane E. Schultz , Dane Morgan

Data assimilation is a technique for increasing the accuracy of simulations of solutions to partial differential equations by incorporating observable data into the solution as time evolves. Recently, a promising new algorithm for data…

Analysis of PDEs · Mathematics 2018-12-06 Adam Larios , Collin Victor

Multi-model ensembles provide a pragmatic approach to the representation of model uncertainty in climate prediction. However, such representations are inherently ad hoc, and, as shown, probability distributions of climate variables based on…

Atmospheric and Oceanic Physics · Physics 2009-08-26 T. N. Palmer , F. J. Doblas-Reyes , A. Weisheimer , G. J. Shutts , J. Berner , J. M. Murphy

This chapter provides various perspective on an important challenge in data assimilation: model error. While the overall goal is to understand the implication of model error of any type in data assimilation, we emphasize on the effect of…

Dynamical Systems · Mathematics 2015-07-02 John Harlim

Accurately estimating high quantiles beyond the largest observed value is crucial for risk assessment and devising effective adaptation strategies to prevent a greater disaster. The generalized extreme value distribution is widely used for…

Methodology · Statistics 2026-02-24 Yonggwan Shin , Yire Shin , Jeong-Soo Park

We investigate the ability to discover data assimilation (DA) schemes meant for chaotic dynamics with deep learning. The focus is on learning the analysis step of sequential DA, from state trajectories and their observations, using a simple…

In the field of machine learning, ensemble learning is widely recognized as a pivotal strategy for pushing the boundaries of predictive performance. Traditional static ensemble methods typically assign weights by treating each base learner…

Machine Learning · Computer Science 2026-03-06 Yanxin Liu , Yunqi Zhang

It is often of interest to perform clustering on longitudinal data, yet it is difficult to formulate an intuitive model for which estimation is computationally feasible. We propose a model-based clustering method for clustering objects that…

Methodology · Statistics 2020-05-19 Daniel K. Sewell , Yuguo Chen , William Bernhard , Tracy Sulkin

Background: As empirical software engineering evolves, more studies adopt data strategies$-$approaches that investigate digital artifacts such as models, source code, or system logs rather than relying on human subjects. Synthesizing…

The use of machine learning (ML) models in meteorology has attracted significant attention for their potential to improve weather forecasting efficiency and accuracy. GraphCast and NeuralGCM, two promising ML-based weather models, are at…

Atmospheric and Oceanic Physics · Physics 2024-11-25 Xiaoxu Tian , Daniel Holdaway , Daryl Kleist

An original graph clustering approach to efficient localization of error covariances is proposed within an ensemble-variational data assimilation framework. Here the localization term is very generic and refers to the idea of breaking up a…

Statistics Theory · Mathematics 2020-02-03 Sibo Cheng , Jean-Philippe Argaud , Bertrand Iooss , Angélique Ponçot , Didier Lucor