English
Related papers

Related papers: Optimizing large-scale structure data analysis wit…

200 papers

When inferring unknown parameters or comparing different models, data must be compared to underlying theory. Even if a model has no closed-form solution to derive summary statistics, it is often still possible to simulate mock data in order…

Cosmology and Nongalactic Astrophysics · Physics 2019-12-20 Niall Jeffrey , Filipe B. Abdalla

Systematic inaccuracy is inherent in any computational estimate of a non-linear average, due to the availability of only a finite number of data values, N. Free energy differences (DF) between two states or systems are critically important…

Computational Physics · Physics 2009-11-07 Daniel M. Zuckerman , Thomas B. Woolf

Gradient-based solvers risk convergence to local optima, leading to incorrect researcher inference. Heuristic-based algorithms are able to ``break free" of these local optima to eventually converge to the true global optimum. However, given…

Econometrics · Economics 2024-01-17 Zachary Porreca

Scientific fields such as insider-threat detection and highway-safety planning often lack sufficient amounts of time-series data to estimate statistical models for the purpose of scientific discovery. Moreover, the available limited data…

Machine Learning · Statistics 2018-03-16 Daniel Emaasit , Matthew Johnson

While considerable advance has been made to account for statistical uncertainties in astronomical analyses, systematic instrumental uncertainties have been generally ignored. This can be crucial to a proper interpretation of analysis…

This paper focuses on the identification of dynamical systems with tailor-made model structures, where neural networks are used to approximate uncertain components and domain knowledge is retained, if available. These model structures are…

Machine Learning · Computer Science 2021-10-29 Marco Forgione , Dario Piga

Taking uncertainty into account is crucial when making strategic decisions. To guard against the risk of adverse scenarios, traditional optimisation techniques incorporate uncertainty on the basis of prior knowledge on its distribution. In…

Optimization and Control · Mathematics 2022-12-06 Julien Vaes , Vassilis M. Charitopoulos

Conventional uncertainty-aware temporal difference (TD) learning often assumes a zero-mean Gaussian distribution for TD errors, leading to inaccurate error representations and compromised uncertainty estimation. We introduce a novel…

Machine Learning · Computer Science 2025-02-04 Seyeon Kim , Joonhun Lee , Namhoon Cho , Sungjun Han , Wooseop Hwang

This paper tackles the problem of robust covariance matrix estimation when the data is incomplete. Classical statistical estimation methodologies are usually built upon the Gaussian assumption, whereas existing robust estimation ones assume…

Top-K sparse softmax gating mixture of experts has been widely used for scaling up massive deep-learning architectures without increasing the computational cost. Despite its popularity in real-world applications, the theoretical…

Machine Learning · Statistics 2024-02-27 Huy Nguyen , Pedram Akbarian , Fanqi Yan , Nhat Ho

Bayesian inference represents a principled way to incorporate Earth structure uncertainty in full-waveform moment tensor inversions, but traditional approaches generally require significant approximations that risk biasing the resulting…

Geophysics · Physics 2026-03-20 A. A. Saoulis , T. -S. Pham , A. M. G. Ferreira

A common problem in the optimization of structures is the handling of uncertainties in the parameters. If the parameters appear in the constraints, the uncertainties can lead to an infinite number of constraints. Usually the constraints…

Optimization and Control · Mathematics 2012-05-01 Daniel P. Mohr , Ina Stein , Thomas Matzies , Christina A. Knapek

Despite the growing availability of sensing and data in general, we remain unable to fully characterise many in-service engineering systems and structures from a purely data-driven approach. The vast data and resources available to capture…

Machine Learning · Computer Science 2023-09-20 Elizabeth J Cross , Timothy J Rogers , Daniel J Pitchforth , Samuel J Gibson , Matthew R Jones

This paper studies estimation of linear panel regression models with heterogeneous coefficients, when both the regressors and the residual contain a possibly common, latent, factor structure. Our theory is (nearly) efficient, because based…

Econometrics · Economics 2019-03-01 Marco Avarucci , Paolo Zaffaroni

The stochastic density functional theory (DFT) [Phys. Rev. Lett. 111, 106402 (2013)] is a valuable linear scaling approach to Kohn-Sham DFT that does not rely on the sparsity of the density matrix. Linear (and often sub-linear) scaling is…

Chemical Physics · Physics 2019-02-20 Ming Chen , Roi Baer , Daniel Neuhauser , Eran Rabani

In the domain of physics experiments, data fitting is a pivotal technique for extracting insights from both experimental and simulated datasets. This article presents an approximation method designed to estimate the systematic errors…

Data Analysis, Statistics and Probability · Physics 2024-02-29 Lu Li

This paper presents a theory of error in cross-validation testing of algorithms for predicting real-valued attributes. The theory justifies the claim that predicting real-valued attributes requires balancing the conflicting demands of…

Machine Learning · Computer Science 2007-05-23 Peter D. Turney

In the era of precision cosmology, establishing the correct magnitude of statistical errors in cosmological parameters is of crucial importance. However, widely used approximations in galaxy surveys analyses can lead to parameter…

Cosmology and Nongalactic Astrophysics · Physics 2020-10-07 Nicola Bellomo , José Luis Bernal , Giulio Scelfo , Alvise Raccanelli , Licia Verde

High-dimensional limit theorems have been shown useful to derive tuning rules for finding the optimal scaling in random-walk Metropolis algorithms. The assumptions under which weak convergence results are proved are however restrictive: the…

Methodology · Statistics 2022-02-16 Sebastian M Schmon , Philippe Gagnon

Rolling bearings are subject to various faults due to its long-time operation under harsh environment, which will lead to unexpected breakdown of machinery system and cause severe accidents. Deep learning methods recently have gained…

Machine Learning · Computer Science 2021-09-21 Mingxuan Liang , Kai Zhou