English
Related papers

Related papers: A retrieval strategy for interactive ensemble data…

200 papers

Errors in the representation of clouds in convection-permitting numerical weather prediction models can be introduced by different sources. These can be the forcing and boundary conditions, the representation of orography, the accuracy of…

Atmospheric and Oceanic Physics · Physics 2022-03-14 Stefanie Legler , Tijana Janjic

The ensemble random forest filter (ERFF) is presented as an alternative to the ensemble Kalman filter (EnKF) for the purpose of inverse modeling. The EnKF is a data assimilation approach that forecasts and updates parameter estimates…

Machine Learning · Computer Science 2022-07-11 Vanessa A. Godoy , Gian F. Napa-García , J. Jaime Gómez-Hernández

Data assimilation algorithms integrate prior information from numerical model simulations with observed data. Ensemble-based filters, regarded as state-of-the-art, are widely employed for large-scale estimation tasks in disciplines such as…

Numerical Analysis · Mathematics 2024-05-24 Iris Rammelmüller , Gottfried Hastermann , Jana de Wiljes

With the increasing penetration of high-frequency sensors across a number of biological and physical systems, the abundance of the resulting observations offers opportunities for higher statistical accuracy of down-stream estimates, but…

Optimization and Control · Mathematics 2020-11-06 Shushu Zhang , Vivak Patel

The space weather community has begun to use frontier methods such as data assimilation, machine learning, and ensemble modeling to advance current operational forecasting efforts. This was highlighted by a multi-disciplinary session at the…

Space Physics · Physics 2018-11-22 Sophie A. Murray

Data assimilation combines forecasts from a numerical model with observations. Most of the current data assimilation algorithms consider the model and observation error terms as additive Gaussian noise, specified by their covariance…

Satellite-based estimates of greenhouse gas (GHG) properties from observations of reflected solar spectra are integral for understanding and monitoring complex terrestrial systems and their impact on the carbon cycle due to their near…

Information retrieval involves selecting artifacts from a corpus that are most relevant to a given search query. The flavor of retrieval typically used in classical applications can be termed as homogeneous and relaxed, where queries and…

Information Retrieval · Computer Science 2023-10-10 Anirudh Khatry , Yasharth Bajpai , Priyanshu Gupta , Sumit Gulwani , Ashish Tiwari

The generation of initial conditions via accurate data assimilation is crucial for weather forecasting and climate modeling. We propose DiffDA as a denoising diffusion model capable of assimilating atmospheric variables using predicted…

Computational Engineering, Finance, and Science · Computer Science 2024-06-11 Langwen Huang , Lukas Gianinazzi , Yuejiang Yu , Peter D. Dueben , Torsten Hoefler

Working with a two-stage ice sheet model, we explore how statistical data assimilation methods can be used to improve predictions of glacier melt and relatedly, sea level rise. We find that the EnKF improves model runs initialized using…

Dynamical Systems · Mathematics 2023-05-23 Emily Corcoran , Logan Knudsen , Talea Mayo , Hannah Park-Kaufmann , Alexander Robel

Recent retrieval-augmented models enhance basic methods by building a hierarchical structure over retrieved text chunks through recursive embedding, clustering, and summarization. The most relevant information is then retrieved from both…

Computation and Language · Computer Science 2024-10-03 Charbel Chucri , Rami Azouz , Joachim Ott

Inferring the state and unknown parameters of a network of coupled oscillators is of utmost importance. This task is made harder when only partial and noisy observations are available, which is a typical scenario in realistic…

Adaptation and Self-Organizing Systems · Physics 2025-04-07 Lauren D. Smith , Georg A. Gottwald

We present a probabilistic framework for both (i) determining the initial settings of kernel adaptive filters (KAFs) and (ii) constructing fully-adaptive KAFs whereby in addition to weights and dictionaries, kernel parameters are learnt…

Machine Learning · Statistics 2017-07-21 Iván Castro , Cristóbal Silva , Felipe Tobar

Data assimilation (DA) aims to estimate the full state of a dynamical system by combining partial and noisy observations with a prior model forecast, commonly referred to as the background. In atmospheric applications, this problem is…

Atmospheric and Oceanic Physics · Physics 2025-05-29 Jing-An Sun , Hang Fan , Junchao Gong , Ben Fei , Kun Chen , Fenghua Ling , Wenlong Zhang , Wanghan Xu , Li Yan , Pierre Gentine , Lei Bai

Accurate and efficient global ocean state estimation remains a grand challenge for Earth system science, hindered by the dual bottlenecks of computational scalability and degraded data fidelity in traditional data assimilation (DA) and deep…

Machine Learning · Computer Science 2025-11-11 Yanfei Xiang , Yuan Gao , Hao Wu , Quan Zhang , Ruiqi Shu , Xiao Zhou , Xi Wu , Xiaomeng Huang

Global maps of the solar photospheric magnetic flux are fundamental drivers for simulations of the corona and solar wind and therefore are important predictors of geoeffective events. However, observations of the solar photosphere are only…

Mathematical Physics · Physics 2015-06-23 Kyle S. Hickmann , Humberto C. Godinez , Carl J. Henney , C. Nick Arge

Atmospheric retrievals on exoplanets usually involve computationally intensive Bayesian sampling methods. Large parameter spaces and increasingly complex atmospheric models create a computational bottleneck forcing a trade-off between…

Instrumentation and Methods for Astrophysics · Physics 2018-11-28 Tiziano Zingales , Ingo Peter Waldmann

Data assimilation (DA) estimates a dynamical system's state from noisy observations. Recent generative models like the ensemble score filter (EnSF) improve DA in high-dimensional nonlinear settings but are computationally expensive. We…

Machine Learning · Statistics 2025-09-30 Taos Transue , Bohan Chen , So Takao , Bao Wang

Generalizable NeRF can directly synthesize novel views across new scenes, eliminating the need for scene-specific retraining in vanilla NeRF. A critical enabling factor in these approaches is the extraction of a generalizable 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Zhiyuan Min , Yawei Luo , Wei Yang , Yuesong Wang , Yi Yang

Kernel-based methods are heavily used in machine learning. However, they suffer from $O(N^2)$ complexity in the number $N$ of considered data points. In this paper, we propose an approximation procedure, which reduces this complexity to…

Numerical Analysis · Mathematics 2024-11-20 Johannes Hertrich