中文
相关论文

相关论文: Data assimilation with model errors

200 篇论文

Optimization in engineering requires appropriate models. In this article, a regression method for enhancing the predictive power of a model by exploiting expert knowledge in the form of shape constraints, or more specifically, monotonicity…

With the increasing penetration of high-frequency sensors across a number of biological and physical systems, the abundance of the resulting observations offers opportunities for higher statistical accuracy of down-stream estimates, but…

最优化与控制 · 数学 2020-11-06 Shushu Zhang , Vivak Patel

This book chapter introduces regression approaches and regression adjustment for Approximate Bayesian Computation (ABC). Regression adjustment adjusts parameter values after rejection sampling in order to account for the imperfect match…

统计方法学 · 统计学 2017-07-06 Michael GB Blum

Transfer Learning aims to optimally aggregate samples from a target distribution, with related samples from a so-called source distribution to improve target risk. Multiple procedures have been proposed over the last two decades to address…

机器学习 · 统计学 2025-04-29 Steve Hanneke , Samory Kpotufe

This paper provides an introduction to Double/Debiased Machine Learning (DML). DML is a general approach to performing inference about a target parameter in the presence of nuisance functions: objects that are needed to identify the target…

We show that for linear dynamical systems with skew-adjoint generators, the initial state estimate given by the back and forth nudging method with colocated feedback, converges to the minimizer of the discrepancy between the measured and…

最优化与控制 · 数学 2016-06-30 Atte Aalto

Statistical Data Assimilation (SDA) is the transfer of information from field or laboratory observations to a user selected model of the dynamical system producing those observations. The data is noisy and the model has errors; the…

统计计算 · 统计学 2019-01-16 Adrian S. Wong , Kangbo Hao , Zheng Fang , Henry D. I. Abarbanel

In dealing with veracity of data analytics, fuzzy methods are more and more relying on probabilistic and statistical techniques to underpin their applicability. Conversely, standard statistical models usually disregard to take into account…

统计理论 · 数学 2019-12-23 Elvira Di Nardo , Rosaria Simone

When training predictive models on data with missing entries, the most widely used and versatile approach is a pipeline technique where we first impute missing entries and then compute predictions. In this paper, we view prediction with…

机器学习 · 计算机科学 2025-02-25 Dimitris Bertsimas , Arthur Delarue , Jean Pauphilet

The performance of deep neural networks is strongly influenced by the training dataset setup. In particular, when attributes having a strong correlation with the target attribute are present, the trained model can provide unintended…

机器学习 · 计算机科学 2023-02-14 Sumyeong Ahn , Seongyoon Kim , Se-young Yun

This paper considers the two-dataset problem, where data are collected from two potentially different populations sharing common aspects. This problem arises when data are collected by two different types of researchers or from two…

统计方法学 · 统计学 2022-09-27 Steven N. MacEachern , Koji Miyawaki

Neural networks are popular state-of-the-art models for many different tasks.They are often trained via back-propagation to find a value of the weights that correctly predicts the observed data. Although back-propagation has shown good…

机器学习 · 统计学 2020-12-29 Simón Rodríguez Santana , Daniel Hernández-Lobato

This paper improves upon existing data pruning methods for image classification by introducing a novel pruning metric and pruning procedure based on importance sampling. The proposed pruning metric explicitly accounts for data separability,…

计算机视觉与模式识别 · 计算机科学 2024-09-24 Steven Grosz , Rui Zhao , Rajeev Ranjan , Hongcheng Wang , Manoj Aggarwal , Gerard Medioni , Anil Jain

A procedure for unfolding the true distribution from experimental data is presented. Machine learning methods are applied for simultaneous identification of an apparatus function and solving of an inverse problem. A priori information about…

数据分析、统计与概率 · 物理学 2011-05-26 Nikolai Gagunashvili

Gender bias exists in natural language datasets which neural language models tend to learn, resulting in biased text generation. In this research, we propose a debiasing approach based on the loss function modification. We introduce a new…

计算与语言 · 计算机科学 2019-06-05 Yusu Qian , Urwa Muaz , Ben Zhang , Jae Won Hyun

We illustrate the use of tools (asymptotic theories of standard error quantification using appropriate statistical models, bootstrapping, model comparison techniques) in addition to sensitivity that may be employed to determine the…

偏微分方程分析 · 数学 2015-03-17 H. T. Banks , M Doumic , C Kruse , S Prigent , H Rezaei

Additional training of a deep learning model can cause negative effects on the results, turning an initially positive sample into a negative one (degradation). Such degradation is possible in real-world use cases due to the diversity of…

机器学习 · 计算机科学 2022-05-19 Akihito Yoshii , Susumu Tokumoto , Fuyuki Ishikawa

In meteorology, engineering and computer sciences, data assimilation is routinely employed as the optimal way to combine noisy observations with prior model information for obtaining better estimates of a state, and thus better forecasts,…

地球物理 · 物理学 2009-08-12 M. J. Werner , K. Ide , D. Sornette

Negation is a core construction in natural language. Despite being very successful on many tasks, state-of-the-art pre-trained language models often handle negation incorrectly. To improve language models in this regard, we propose to…

计算与语言 · 计算机科学 2021-05-11 Arian Hosseini , Siva Reddy , Dzmitry Bahdanau , R Devon Hjelm , Alessandro Sordoni , Aaron Courville

This dissertation explores the impact of bias in deep neural networks and presents methods for reducing its influence on model performance. The first part begins by categorizing and describing potential sources of bias and errors in data…

机器学习 · 计算机科学 2023-08-21 Agnieszka Mikołajczyk-Bareła