English
Related papers

Related papers: Rare event estimation using stochastic spectral em…

200 papers

This paper considers the classical problem of sampling with Monte Carlo methods a target rare event distribution defined by a score function that is very expensive to compute. We assume we can build using evaluations of the true score, an…

Computation · Statistics 2024-10-25 Frédéric Cérou , Patrick Héas , Mathias Rousset

We study the $L_1$-regularized maximum likelihood estimator/estimation (MLE) problem for discrete Markov random fields (MRFs), where efficient and scalable learning requires both sparse regularization and approximate inference. To address…

Machine Learning · Computer Science 2020-05-14 Sinong Geng , Zhaobin Kuang , Jie Liu , Stephen Wright , David Page

Metamodeling of complex numerical systems has recently attracted the interest of the mathematical programming community. Despite the progress in high performance computing, simulations remain costly, as a matter of fact, the assessment of…

Other Statistics · Statistics 2018-11-13 Soumaya Azzi , Yuanyuan Huang , Bruno Sudret , Joe Wiart

We theoretically propose a new method in cavity- and surface-enhanced Raman spectroscopy (SERS) with improved temporal resolution in the measurement of stochastic Raman spectral fluctuations. Our approach combines Fourier spectroscopy and…

Optics · Physics 2025-07-02 Colburn Cobb-Bruno , Hendrik Utzat

We propose a stochastic approximation method for approximating the efficient frontier of chance-constrained nonlinear programs. Our approach is based on a bi-objective viewpoint of chance-constrained programs that seeks solutions on the…

Optimization and Control · Mathematics 2020-05-29 Rohit Kannan , James Luedtke

Stochastic differential equations (SDEs) are increasingly used in longitudinal data analysis, compartmental models, growth modelling, and other applications in a number of disciplines. Parameter estimation, however, currently requires…

Methodology · Statistics 2018-09-12 Oscar García

Rare-event simulation techniques, such as importance sampling (IS), constitute powerful tools to speed up challenging estimation of rare catastrophic events. These techniques often leverage the knowledge and analysis on underlying system…

Methodology · Statistics 2021-11-04 Mansur Arief , Yuanlu Bai , Wenhao Ding , Shengyi He , Zhiyuan Huang , Henry Lam , Ding Zhao

A method (Ember) for non-stationary spatial modelling with multiple secondary variables by combining Geostatistics with Random Forests is applied to a three-dimensional Reservoir Model. It extends the Random Forest method to an…

Computational Engineering, Finance, and Science · Computer Science 2020-11-12 Colin Daly

Distribution System State Estimation (DSSE) is becoming increasingly important with the integration of Distributed Energy Resources (DERs) and the active operation of distribution networks (DNs), but it remains challenging due to the…

Optimization and Control · Mathematics 2026-05-25 J. G. De la Varga , S. Pineda , A. Stratigakos , J. M. Morales

Stochastic rounding (SR) is a probabilistic method used to round numbers to floating-point and fixed-point representations. In length $n$ summation, the worst-case error of SR grows as $\sqrt{n}$ with high probability, unlike for standard…

Numerical Analysis · Mathematics 2026-03-09 El-Mehdi El Arar , Massimiliano Fasi , Silviu-Ioan Filip , Mantas Mikaitis

Data assimilation methods aim at estimating the state of a system by combining observations with a physical model. When sequential data assimilation is considered, the joint distribution of the latent state and the observations is described…

Methodology · Statistics 2018-04-23 Thi Tuyet Trang Chau , Pierre Ailliot , Valérie Monbet , Pierre Tandeo

We propose a random feature model for approximating high-dimensional sparse additive functions called the hard-ridge random feature expansion method (HARFE). This method utilizes a hard-thresholding pursuit-based algorithm applied to the…

Machine Learning · Statistics 2023-10-10 Esha Saha , Hayden Schaeffer , Giang Tran

Sequential neural posterior estimation (SNPE) techniques have been recently proposed for dealing with simulation-based models with intractable likelihoods. Unlike approximate Bayesian computation, SNPE techniques learn the posterior from…

Machine Learning · Statistics 2025-01-17 Yifei Xiong , Xiliang Yang , Sanguo Zhang , Zhijian He

We introduce Locally Linear Embedding (LLE) to the astronomical community as a new classification technique, using SDSS spectra as an example data set. LLE is a nonlinear dimensionality reduction technique which has been studied in the…

Instrumentation and Methods for Astrophysics · Physics 2015-05-13 J. T. VanderPlas , A. J. Connolly

In this paper, we introduce a new stochastic approximation (SA) type algorithm, namely the randomized stochastic gradient (RSG) method, for solving an important class of nonlinear (possibly nonconvex) stochastic programming (SP) problems.…

Optimization and Control · Mathematics 2015-10-27 Saeed Ghadimi , Guanghui Lan

This paper proposes an approach, Spectral Dynamics Embedding Control (SDEC), to optimal control for nonlinear stochastic systems. This method reveals an infinite-dimensional feature representation induced by the system's nonlinear…

Machine Learning · Computer Science 2025-08-27 Zhaolin Ren , Tongzheng Ren , Haitong Ma , Na Li , Bo Dai

We present a novel probabilistic finite element method (FEM) for the solution and uncertainty quantification of elliptic partial differential equations based on random meshes, which we call random mesh FEM (RM-FEM). Our methodology allows…

Numerical Analysis · Mathematics 2021-06-17 Assyr Abdulle , Giacomo Garegnani

This paper introduces a practical sampling method for training surrogate models in the context of uncertainty propagation. We propose a heuristic method to uniformly draw samples within highest density regions of the density given by the…

Methodology · Statistics 2025-09-15 Jocelyn Minini , Micha Wasem

Supervised dimensionality reduction strategies have been of great interest. However, current supervised dimensionality reduction approaches are difficult to scale for situations characterized by large datasets given the high computational…

Machine Learning · Computer Science 2018-11-09 Amir-Hossein Karimi , Alexander Wong , Ali Ghodsi

The cross-entropy (CE) method is a popular stochastic method for optimization due to its simplicity and effectiveness. Designed for rare-event simulations where the probability of a target event occurring is relatively small, the CE-method…

Machine Learning · Computer Science 2020-09-22 Robert J. Moss