English
Related papers

Related papers: A Framework for Automatic Validation and Applicati…

200 papers

The paper presents experiments of driving a physics-based thermosphere model by assimilating electron density (Ne) and temperature (Tn) data using the ensemble adjustment Kalman filter (EAKF) technique. This study not only helps to gauge…

Space Physics · Physics 2019-03-22 Timothy Kodikara , Kefei Zhang

In a previous work \citep{luo2016sparse2d_spej}, the authors proposed an ensemble-based 4D seismic history matching (SHM) framework, which has some relatively new ingredients, in terms of the type of seismic data in choice, the way to…

Data Analysis, Statistics and Probability · Physics 2018-03-13 Xiaodong Luo , Tuhin Bhakta , Morten Jakobsen , Geir Nævdal

There is an urgent need to build models to tackle Indoor Air Quality issue. Since the model should be accurate and fast, Reduced Order Modelling technique is used to reduce the dimensionality of the problem. The accuracy of the model, that…

Today's scientific simulations generate exceptionally large volumes of data, challenging the capacities of available I/O bandwidth and storage space. This necessitates a substantial reduction in data volume, for which error-bounded lossy…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-10-02 Daoce Wang , Jesus Pulido , Pascal Grosset , Jiannan Tian , James Ahrens , Dingwen Tao

In industrial and IoT environments, massive amounts of real-time and historical process data are continuously generated and archived. With sensors and devices capturing every operational detail, the volume of time-series data has become a…

Databases · Computer Science 2025-11-03 Reham Faqehi , Haya Alhuraib , Hamad Saiari , Zyad Bamigdad

The number of component classifiers chosen for an ensemble greatly impacts the prediction ability. In this paper, we use a geometric framework for a priori determining the ensemble size, which is applicable to most of existing batch and…

Machine Learning · Computer Science 2018-10-02 Hamed Bonab , Fazli Can

The weighting of critical-point samples in the weighted randomized maximum likelihood method depend on the magnitude of the data mismatch at the critical points and on the Jacobian of the transformation from the prior density to the…

Methodology · Statistics 2023-01-16 Yuming Ba , Dean S. Oliver

We propose two new methods based/inspired by machine learning for tabular data and distance-free localization to enhance the covariance estimations in an ensemble data assimilation. The main goal is to enhance the data assimilation results…

Machine Learning · Computer Science 2025-07-31 Vinicius L. S. Silva , Gabriel S. Seabra , Alexandre A. Emerick

Ensemble weather predictions require statistical post-processing of systematic errors to obtain reliable and accurate probabilistic forecasts. Traditionally, this is accomplished with distributional regression models in which the parameters…

Machine Learning · Statistics 2019-04-01 Stephan Rasp , Sebastian Lerch

Data assimilation combines forecasts from a numerical model with observations. Most of the current data assimilation algorithms consider the model and observation error terms as additive Gaussian noise, specified by their covariance…

Improved estimation of hydrometeorological states from down-sampled observations and background model forecasts in a noisy environment, has been a subject of growing research in the past decades. Here, we introduce a unified framework that…

Data Analysis, Statistics and Probability · Physics 2014-09-15 Ardeshir Mohammad Ebtehaj , Efi Foufoula-Georgiou

Data-driven prediction and physics-agnostic machine-learning methods have attracted increased interest in recent years achieving forecast horizons going well beyond those to be expected for chaotic dynamical systems. In a separate strand of…

Data Analysis, Statistics and Probability · Physics 2021-05-19 Georg A. Gottwald , Sebastian Reich

Reduced-order models based on level-set methods are widely used tools to qualitatively capture and track the nonlinear dynamics of an interface. The aim of this paper is to develop a physics-informed, data-driven, statistically rigorous…

Computational Physics · Physics 2019-09-20 Hans Yu , Matthew P. Juniper , Luca Magri

With the ever-increasing execution scale of high performance computing (HPC) applications, vast amounts of data are being produced by scientific research every day. Error-bounded lossy compression has been considered a very promising…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-10-24 Jinyang Liu , Sheng Di , Kai Zhao , Xin Liang , Zizhong Chen , Franck Cappello

Ensemble classifiers have been investigated by many in the artificial intelligence and machine learning community. Majority voting and weighted majority voting are two commonly used combination schemes in ensemble learning. However,…

Machine Learning · Computer Science 2021-06-17 Shengli Wu , Weimin Ding

Chaos is ubiquitous in physical systems. The associated sensitivity to initial conditions is a significant obstacle in forecasting the weather and other geophysical fluid flows. Data assimilation is the process whereby the uncertainty in…

Data Analysis, Statistics and Probability · Physics 2020-11-03 Alberto Carrassi , Marc Bocquet , Jonathan Demaeyer , Colin Grudzien , Patrick Raanes , Stephane Vannitsem

Ensemble data assimilation methods such as the Ensemble Kalman Filter (EnKF) are a key component of probabilistic weather forecasting. They represent the uncertainty in the initial conditions by an ensemble which incorporates information…

Applications · Statistics 2018-10-17 Sylvain Robert , Daniel Leuenberger , Hans R. Künsch

The Ensemble Score Filter (EnSF) has emerged as a promising approach to leverage score-based diffusion models for solving high-dimensional and nonlinear data assimilation problems. While initial applications of EnSF to the Lorenz-96 model…

Numerical Analysis · Mathematics 2025-10-24 Zezhong Zhang , Feng Bao , Guannan Zhang

Multi-sample aggregation strategies, such as majority voting and best-of-N sampling, are widely used in contemporary large language models (LLMs) to enhance predictive accuracy across various tasks. A key challenge in this process is…

Machine Learning · Computer Science 2025-06-17 Weihua Du , Yiming Yang , Sean Welleck

Standard methods of data assimilation assume prior knowledge of a model that describes the system dynamics and an observation function that maps the model state to a predicted output. An accurate mapping from model state to observation…

Dynamical Systems · Mathematics 2019-05-22 Franz Hamilton , Tyrus Berry , Timothy Sauer