English
Related papers

Related papers: A sampling method based on highest density regions…

200 papers

This paper presents a physics and data co-driven surrogate modeling method for efficient rare event simulation of civil and mechanical systems with high-dimensional input uncertainties. The method fuses interpretable low-fidelity physical…

Computation · Statistics 2024-05-10 Jianhua Xian , Ziqi Wang

Optimization in the latent space of variational autoencoders is a promising approach to generate high-dimensional discrete objects that maximize an expensive black-box property (e.g., drug-likeness in molecular generation, function…

Machine Learning · Computer Science 2021-07-02 Pascal Notin , José Miguel Hernández-Lobato , Yarin Gal

In many statistical and econometric applications, we gather individual samples from various interconnected populations that undeniably exhibit common latent structures. Utilizing a model that incorporates these latent structures for such…

Methodology · Statistics 2023-09-19 Archer Gong Zhang , Jiahua Chen

We consider the problem of hypothesis testing for discrete distributions. In the standard model, where we have sample access to an underlying distribution $p$, extensive research has established optimal bounds for uniformity testing,…

Machine Learning · Computer Science 2024-12-03 Maryam Aliakbarpour , Piotr Indyk , Ronitt Rubinfeld , Sandeep Silwal

An unsupervised and a supervised classification approaches for Hilbert random curves are studied. Both rest on the use of a surrogate of the probability density which is defined, in a distribution-free mixture context, from an asymptotic…

Methodology · Statistics 2016-03-30 Enea G. Bongiorno , Aldo Goia

Many engineering systems are subject to spatially distributed uncertainty, i.e. uncertainty that can be modeled as a random field. Altering the mean or covariance of this uncertainty will in general change the statistical distribution of…

Optimization and Control · Mathematics 2014-07-09 Eric Dow , Qiqi Wang

It is now practically the norm for data to be very high dimensional in areas such as genetics, machine vision, image analysis and many others. When analyzing such data, parametric models are often too inflexible while nonparametric…

Methodology · Statistics 2011-05-31 Abhishek Bhattacharya , Garritt Page , David Dunson

Inferring parameter distributions of complex industrial systems from noisy time series data requires methods to deal with the uncertainty of the underlying data and the used simulation model. Bayesian inference is well suited for these…

Applications · Statistics 2021-06-18 David N. John , Livia Stohrer , Claudia Schillings , Michael Schick , Vincent Heuveline

We develop a method for the evaluation of extreme event statistics associated with nonlinear dynamical systems, using a small number of samples. From an initial dataset of design points, we formulate a sequential strategy that provides the…

Machine Learning · Computer Science 2022-06-08 Mustafa A. Mohamad , Themistoklis P. Sapsis

With the ubiquitous availability of unstructured data, growing attention is paid as how to adjust for selection bias in such non-probability samples. The majority of the robust estimators proposed by prior literature are either fully or…

Methodology · Statistics 2022-04-08 Ali Rafei , Michael R. Elliott , Carol A. C. Flannagan

Geographical data are generally autocorrelated. In this case, it is preferable to select spread units. In this paper, we propose a new method for selecting well-spread samples from a finite spatial population with equal or unequal inclusion…

Methodology · Statistics 2020-08-11 Raphaël Jauslin , Yves Tillé

Risk modeling with EHR data is challenging due to a lack of direct observations on the disease outcome, and the high dimensionality of the candidate predictors. In this paper, we develop a surrogate assisted semi-supervised-learning (SAS)…

Statistics Theory · Mathematics 2021-05-05 Jue Hou , Zijian Guo , Tianxi Cai

Bayesian inverse modeling is important for a better understanding of hydrological processes. However, this approach can be computationally demanding, as it usually requires a large number of model evaluations. To address this issue, one can…

Computation · Statistics 2020-02-24 Jiangjiang Zhang , Qiang Zheng , Dingjiang Chen , Laosheng Wu , Lingzao Zeng

This article presents an original methodology for the prediction of steady turbulent aerodynamic fields. Due to the important computational cost of high-fidelity aerodynamic simulations, a surrogate model is employed to cope with the…

Fluid Dynamics · Physics 2019-12-05 Romain Dupuis , Jean-Christophe Jouhaud , Pierre Sagaut

Oilfield development related decisions are made using reservoir simulation-based optimization study in which different production scenarios and well controls are compared. Such simulations are computationally expensive and so surrogate…

Machine Learning · Computer Science 2022-03-01 Ajitabh Kumar

This paper proposes a novel method for testing observability in Gaussian models using discrete density approximations (deterministic samples) of (multivariate) Gaussians. Our notion of observability is defined by the existence of the…

Systems and Control · Electrical Eng. & Systems 2022-08-19 Ariane Hanebeck , Claudia Czado

We study compressed sensing when the sampling vectors are chosen from the rows of a unitary matrix. In the literature, these sampling vectors are typically chosen randomly; the use of randomness has enabled major empirical and theoretical…

Information Theory · Computer Science 2026-04-07 Yaniv Plan , Matthew S. Scott , Ozgur Yilmaz

Driven by increased complexity of dynamical systems, the solution of system of differential equations through numerical simulation in optimization problems has become computationally expensive. This paper provides a smart data driven…

Optimization and Control · Mathematics 2021-08-25 Kainat Khowaja , Mykhaylo Shcherbatyy , Wolfgang Karl Härdle

We present a framework for automatically structuring and training fast, approximate, deep neural surrogates of stochastic simulators. Unlike traditional approaches to surrogate modeling, our surrogates retain the interpretable structure and…

Accurate estimates of subnational health and demographic indicators are critical for informing health policy decisions. Many countries collect relevant data using complex household surveys, but when data are limited, direct survey weighted…

Methodology · Statistics 2022-09-07 Peter A. Gao , Jon Wakefield