English
Related papers

Related papers: Fine Tuning a Simulation-Driven Estimator

200 papers

In recent years, machine learning models have achieved success based on the independently and identically distributed assumption. However, this assumption can be easily violated in real-world applications, leading to the Out-of-Distribution…

Machine Learning · Computer Science 2024-03-27 Yifan Hao , Yong Lin , Difan Zou , Tong Zhang

We consider an online two-stage stochastic optimization with long-term constraints over a finite horizon of $T$ periods. At each period, we take the first-stage action, observe a model parameter realization and then take the second-stage…

Machine Learning · Computer Science 2024-01-03 Piao Hu , Jiashuo Jiang , Guodong Lyu , Hao Su

Systematics contaminate observables, leading to distribution shifts relative to theoretically simulated signals-posing a major challenge for using pre-trained models to label such observables. Since systematics are often poorly understood…

Instrumentation and Methods for Astrophysics · Physics 2025-11-18 Sultan Hassan , Sambatra Andrianomena , Benjamin D. Wandelt

We present a hybrid a-priori/a-posteriori goal oriented error estimator for a combination of dynamic iteration-based solution of ordinary differential equations discretized by finite elements. Our novel error estimator combines estimates…

Numerical Analysis · Mathematics 2026-02-13 Erik Weyl , Andreas Bartel , Manuel Schaller

Ordinary Differential Equations are a simple but powerful framework for modeling complex systems. Parameter estimation from times series can be done by Nonlinear Least Squares (or other classical approaches), but this can give…

Methodology · Statistics 2014-10-29 Quentin Clairon , Nicolas Brunel

Efficient and accurate state estimation is essential for the optimal management of the future smart grid. However, to meet the requirements of deploying the future grid at a large scale, the state estimation algorithm must be able to…

Information Theory · Computer Science 2017-09-29 Jung-Chieh Chen , Hwei-Ming Chung , Chao-Kai Wen , Wen-Tai Li , Jen-Hao Teng

Out-of-distribution (OOD) detection remains challenging for deep learning models, particularly when test-time OOD samples differ significantly from training outliers. We propose OODD, a novel test-time OOD detection method that dynamically…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Yifeng Yang , Lin Zhu , Zewen Sun , Hengyu Liu , Qinying Gu , Nanyang Ye

Many parallel and distributed computing research results are obtained in simulation, using simulators that mimic real-world executions on some target system. Each such simulator is configured by picking values for parameters that define the…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-07-03 Jesse McDonald , Maximilian Horzela , Frédéric Suter , Henri Casanova

One of the most important problems in system identification and statistics is how to estimate the unknown parameters of a given model. Optimization methods and specialized procedures, such as Empirical Minimization (EM) can be used in case…

Methodology · Statistics 2024-02-09 Braghadeesh Lakshminarayanan , Cristian R. Rojas

In vehicle dynamics control, many variables of interest cannot be directly measured, as sensors might be costly, fragile, or even not available. Therefore, real-time estimation techniques need to be used. The previous approach suffers from…

Systems and Control · Electrical Eng. & Systems 2023-03-10 Giorgio Riva , Simone Formentin , Matteo Corno , Sergio M. Savaresi

Improving out-of-distribution (OOD) generalization during in-distribution (ID) adaptation is a primary goal of robust fine-tuning of zero-shot models beyond naive fine-tuning. However, despite decent OOD generalization performance from…

Computer Vision and Pattern Recognition · Computer Science 2024-11-08 Changdae Oh , Hyesu Lim , Mijoo Kim , Dongyoon Han , Sangdoo Yun , Jaegul Choo , Alexander Hauptmann , Zhi-Qi Cheng , Kyungwoo Song

We modify the Double Machine Learning estimator to broaden its applicability to macroeconomic time-series settings. A deterministic cross-fitting step, termed Reverse Cross-Fitting, leverages the time-reversibility of stationary series to…

Econometrics · Economics 2026-03-12 Milos Ciganovic , Federico D'Amario , Massimiliano Tancioni

Parameter inference in ordinary differential equations is an important problem in many applied sciences and in engineering, especially in a data-scarce setting. In this work, we introduce a novel generative modeling approach based on…

Machine Learning · Computer Science 2019-12-06 Philippe Wenk , Gabriele Abbati , Michael A Osborne , Bernhard Schölkopf , Andreas Krause , Stefan Bauer

Machine learning models, while progressively advanced, rely heavily on the IID assumption, which is often unfulfilled in practice due to inevitable distribution shifts. This renders them susceptible and untrustworthy for deployment in…

Machine Learning · Computer Science 2024-03-05 Han Yu , Jiashuo Liu , Xingxuan Zhang , Jiayun Wu , Peng Cui

Large-scale computer experiments are becoming increasingly important in science. A multi-step procedure is introduced to statisticians for modeling such experiments, which builds an accurate interpolator in multiple steps. In practice, the…

Statistics Theory · Mathematics 2012-03-13 Ben Haaland , Peter Z. G. Qian

A new way to design parameter estimators with enhanced performance is proposed in the paper. The procedure consists of two stages, first, the generation of new regression forms via the application of a dynamic operator to the original…

Systems and Control · Computer Science 2020-01-22 Aranovskiy Stanislav , Bobtsov Alexey , Ortega Romeo , Pyrkin Anton

An accurate distribution network model is crucial for monitoring, state estimation and energy management. However, existing data-driven methods often struggle with scalability or impose a heavy computational burden on large distribution…

Systems and Control · Electrical Eng. & Systems 2025-03-12 Sakirat Wolly , Xiaozhe Wang

Detecting out-of-distribution (OOD) data is a fundamental challenge in the deployment of machine learning models. From a security standpoint, this is particularly important because OOD test data can result in misleadingly confident yet…

Machine Learning · Computer Science 2025-02-25 Onat Gungor , Amanda Sofie Rios , Nilesh Ahuja , Tajana Rosing

Digital twins (DT) of industrial processes have become increasingly important. They aim to digitally represent the physical world to help evaluate, optimize, and predict physical processes and behaviors. Therefore, DT is a vital tool to…

Software Engineering · Computer Science 2023-02-28 Yunpeng Ma , Khalil Younis , Bestoun S. Ahmed , Andreas Kassler , Pavel Krakhmalev , Andreas Thore , Hans Lindback

In this paper, we address the problem of conducting statistical inference in settings involving large-scale data that may be high-dimensional and contaminated by outliers. The high volume and dimensionality of the data require distributed…

Machine Learning · Statistics 2022-11-30 Emadaldin Mozafari-Majd , Visa Koivunen