English
Related papers

Related papers: Align-DA: Align Score-based Atmospheric Data Assim…

200 papers

The generation of initial conditions via accurate data assimilation is crucial for weather forecasting and climate modeling. We propose DiffDA as a denoising diffusion model capable of assimilating atmospheric variables using predicted…

Computational Engineering, Finance, and Science · Computer Science 2024-06-11 Langwen Huang , Lukas Gianinazzi , Yuejiang Yu , Peter D. Dueben , Torsten Hoefler

We commonly refer to state-estimation theory in geosciences as data assimilation. This term encompasses the entire sequence of operations that, starting from the observations of a system, and from additional statistical and dynamical…

Atmospheric and Oceanic Physics · Physics 2018-06-11 Alberto Carrassi , Marc Bocquet , Laurent Bertino , Geir Evensen

Domain Adaptation (DA), the process of effectively adapting task models learned on one domain, the source, to other related but distinct domains, the targets, with no or minimal retraining, is typically accomplished using the process of…

Computer Vision and Pattern Recognition · Computer Science 2019-09-30 Behnam Gholami , Pritish Sahu , Minyoung Kim , Vladimir Pavlovic

This paper is a contribution in the context of variational data assimilation combined with statistical learning. The framework of data assimilation traditionally uses data collected at sensor locations in order to bring corrections to a…

Numerical Analysis · Mathematics 2023-05-09 Amina Benaceur , Barbara Verfürth

Data assimilation (DA) plays a pivotal role in diverse applications, ranging from climate predictions and weather forecasts to trajectory planning for autonomous vehicles. A prime example is the widely used ensemble Kalman filter (EnKF),…

Dynamical Systems · Mathematics 2024-01-03 Mohamad Abed El Rahman Hammoud , Naila Raboudi , Edriss S. Titi , Omar Knio , Ibrahim Hoteit

Domain adaptation (DA) aims to generalize a learning model across training and testing data despite the mismatch of their data distributions. In light of a theoretical estimation of upper error bound, we argue in this paper that an…

Computer Vision and Pattern Recognition · Computer Science 2018-01-01 Lingkun Luo , Liming Chen , Shiqiang Hu , Ying Lu , Xiaofang Wang

Domain adaptation (DA) is transfer learning which aims to learn an effective predictor on target data from source data despite data distribution mismatch between source and target. We present in this paper a novel unsupervised DA method for…

Computer Vision and Pattern Recognition · Computer Science 2018-02-23 Lingkun Luo , Liming Chen , Ying lu , Shiqiang Hu

IIn recent years, there has been a growing interest in applying data assimilation (DA) methods, originally designed for state estimation, to the model selection problem. In this setting, Carrassi et al. (2017) introduced the contextual…

Methodology · Statistics 2018-10-10 Sammy Metref , Alexis Hannart , Juan Ruiz , Marc Bocquet , Alberto Carrassi , Michael Ghil

Preference learning is critical for aligning large language models (LLMs) with human values, yet its success hinges on high-quality datasets comprising three core components: Preference \textbf{A}nnotations, \textbf{I}nstructions, and…

Computation and Language · Computer Science 2025-09-03 Bingxiang He , Wenbin Zhang , Jiaxi Song , Cheng Qian , Zixuan Fu , Bowen Sun , Ning Ding , Haiwen Hong , Longtao Huang , Hui Xue , Ganqu Cui , Wanxiang Che , Zhiyuan Liu , Maosong Sun

Covariance localization is a critical component of ensemble-based data assimilation (DA) and many current localization schemes simply dampen correlations as a function of distance. Increases in computational resources, broadening scope of…

Data Analysis, Statistics and Probability · Physics 2025-08-27 Shay Gilpin , Matthias Morzfeld , Kevin K. Lin

Data assimilation refers to the process of obtaining an estimate of a system's state using a model for the system's time evolution and a time series of measurements that are possibly noisy and incomplete. However, for practical reasons, the…

Chaotic Dynamics · Physics 2007-05-23 Matthew Cornick , Brian Hunt , Edward Ott , Michael F. Schatz

A method of data assimilation (DA) is employed to estimate electrophysiological parameters of neurons simultaneously with their synaptic connectivity in a small model biological network. The DA procedure is cast as an optimization, with a…

Neurons and Cognition · Quantitative Biology 2020-02-05 Eve Armstrong

We study prediction-assimilation systems, which have become routine in meteorology and oceanography and are rapidly spreading to other areas of the geosciences and of continuum physics. The long-term, nonlinear stability of such a system…

Chaotic Dynamics · Physics 2009-11-13 Alberto Carrassi , Michael Ghil , Anna Trevisan , Francesco Uboldi

We apply two data assimilation (DA) methods, a smoother and a filter, and a model-free machine learning (ML) shallow network to forecast two weakly turbulent systems. We analyse the effect of the spatial sparsity of observations on accuracy…

Fluid Dynamics · Physics 2024-07-16 Vikrant Gupta , Yuanqing Chen , Minping Wan

Active Alignment (AA) is a key technology for the large-scale automated assembly of high-precision optical systems. Compared with labor-intensive per-model on-device calibration, a digital-twin pipeline built on optical simulation offers a…

Computer Vision and Pattern Recognition · Computer Science 2026-01-09 Wenyong Li , Qi Jiang , Weijian Hu , Kailun Yang , Zhanjun Zhang , Wenjun Tian , Kaiwei Wang , Jian Bai

When aligning large language models (LLMs), their performance on various tasks (such as being helpful, harmless, and honest) depends heavily on the composition of their training data. However, selecting a data mixture that achieves strong…

Machine Learning · Computer Science 2025-06-03 Nicholas E. Corrado , Julian Katz-Samuels , Adithya Devraj , Hyokun Yun , Chao Zhang , Yi Xu , Yi Pan , Bing Yin , Trishul Chilimbi

Data assimilation has become a key technique for combining physical models with observational data to estimate state variables. However, classical assimilation algorithms often struggle with the high nonlinearity present in both physical…

Machine Learning · Computer Science 2025-07-22 Zhuoyuan Li , Bin Dong , Pingwen Zhang

Unsupervised Domain Adaptation (DA) is used to automatize the task of labeling data: an unlabeled dataset (target) is annotated using a labeled dataset (source) from a related domain. We cast domain adaptation as the problem of finding…

Machine Learning · Statistics 2018-03-22 Twan van Laarhoven , Elena Marchiori

Continuous data assimilation (CDA) is successfully implemented for the first time for efficient dynamical downscaling of a global atmospheric reanalysis. A comparison of the performance of CDA with the standard grid and spectral nudging…

Atmospheric and Oceanic Physics · Physics 2019-07-31 Srinivas Desamsetti , Hari Prasad Dasari , Sabique Langodan , Edriss S Titi , Omar Knio , Ibrahim Hoteit

Accurate and efficient global ocean state estimation remains a grand challenge for Earth system science, hindered by the dual bottlenecks of computational scalability and degraded data fidelity in traditional data assimilation (DA) and deep…

Machine Learning · Computer Science 2025-11-11 Yanfei Xiang , Yuan Gao , Hao Wu , Quan Zhang , Ruiqi Shu , Xiao Zhou , Xi Wu , Xiaomeng Huang