English
Related papers

Related papers: Rare event estimation using stochastic spectral em…

200 papers

Stochastic neighbor embedding (SNE) and related nonlinear manifold learning algorithms achieve high-quality low-dimensional representations of similarity data, but are notoriously slow to train. We propose a generic formulation of embedding…

Machine Learning · Computer Science 2012-06-22 Max Vladymyrov , Miguel Carreira-Perpinan

This paper presents a new methodology for structural reliability analysis via stochastic finite element method (SFEM). A novel sample-based SFEM is firstly used to compute structural stochastic responses of all spatial points at the same…

Computational Physics · Physics 2020-08-19 Zhibao Zheng

Rare events are events that are expected to occur infrequently, or more technically, those that have low probabilities (say, order of $10^{-3}$ or less) of occurring according to a probability model. In the context of uncertainty…

Computation · Statistics 2015-08-21 James L. Beck , Konstantin M. Zuev

Stochastic simulation algorithms such as likelihood weighting often give fast, accurate approximations to posterior probabilities in probabilistic networks, and are the methods of choice for very large networks. Unfortunately, the special…

Artificial Intelligence · Computer Science 2016-11-26 Keiji Kanazawa , Daphne Koller , Stuart Russell

PET requires accurate, precise, and efficient scatter correction techniques. Conventional scatter estimation typically relies on tail-fitted single-scatter simulation (SSS) strategy. However, the accuracy of tail-fitted SSS is limited, for…

Spectral embedding based on the Singular Value Decomposition (SVD) is a widely used "preprocessing" step in many learning tasks, typically leading to dimensionality reduction by projecting onto a number of dominant singular vectors and…

Machine Learning · Statistics 2015-09-29 Dinesh Ramasamy , Upamanyu Madhow

Stochastic Differential Equations (SDEs) serve as a powerful modeling tool in various scientific domains, including systems science, engineering, and ecological science. While the specific form of SDEs is typically known for a given…

Methodology · Statistics 2024-02-27 Xin Cai , Jingyu Yang , Zhibao Li , Hongqiao Wang , Miao Huang

We propose a multilevel stochastic approximation (MLSA) scheme for the computation of the value-at-risk (VaR) and expected shortfall (ES) of a financial loss, which can only be computed via simulations conditionally on the realisation of…

Computational Finance · Quantitative Finance 2026-04-14 Stéphane Crépey , Noufel Frikha , Azar Louzi

The challenges posed by complex stochastic models used in computational ecology, biology and genetics have stimulated the development of approximate approaches to statistical inference. Here we focus on Synthetic Likelihood (SL), a…

Methodology · Statistics 2017-06-09 Matteo Fasiolo , Simon N. Wood , Florian Hartig , Mark V. Bravington

We present a novel sampling-based method for estimating probabilities of rare or failure events. Our approach is founded on the Ensemble Kalman filter (EnKF) for inverse problems. Therefore, we reformulate the rare event problem as an…

Numerical Analysis · Mathematics 2021-12-15 Fabian Wagner , Iason Papaioannou , Elisabeth Ullmann

This paper tackles the challenge of parameter calibration in stochastic models, particularly in scenarios where the likelihood function is unavailable in an analytical form. We introduce a gradient-based simulated parameter estimation…

Machine Learning · Statistics 2025-03-25 Zehao Li , Yijie Peng

Spectral Embedding (SE) has often been used to map data points from non-linear manifolds to linear subspaces for the purpose of classification and clustering. Despite significant advantages, the subspace structure of data in the original…

Computer Vision and Pattern Recognition · Computer Science 2023-05-16 Hira Yaseen , Arif Mahmood

Disorder is a pervasive characteristic of natural systems, offering a wealth of non-repeating patterns. In this study, we present a novel storage method that harnesses naturally-occurring random structures to store an arbitrary pattern in a…

Disordered Systems and Neural Networks · Physics 2023-07-04 Marco Leonetti , Giorgio Gosti , Giancarlo Ruocco

Representation learning often plays a critical role in reinforcement learning by managing the curse of dimensionality. A representative class of algorithms exploits a spectral decomposition of the stochastic transition dynamics to construct…

Machine Learning · Computer Science 2023-03-08 Tongzheng Ren , Tianjun Zhang , Lisa Lee , Joseph E. Gonzalez , Dale Schuurmans , Bo Dai

Supervised deep-embedding methods project inputs of a domain to a representational space in which same-class instances lie near one another and different-class instances lie far apart. We propose a probabilistic method that treats…

Machine Learning · Statistics 2019-09-27 Tyler R. Scott , Karl Ridgeway , Michael C. Mozer

In this work, the development and implementation of the effective stochastic potential (ESP) method is presented to perform efficient conformational sampling of molecules. The overarching goal of this work is to alleviate the computational…

Chemical Physics · Physics 2018-08-01 Jeremy A. Scher , Michael G. Bayne , Amogh Srihari , Shikha Nangia , Arindam Chakraborty

We consider the problem of estimating parameters of stochastic differential equations (SDEs) with discrete-time observations that are either completely or partially observed. The transition density between two observations is generally…

Methodology · Statistics 2015-09-09 Libo Sun , Chihoon Lee , Jennifer A. Hoeting

This paper studies the remote state estimation problem of linear time-invariant systems with stochastic event-triggered sensor schedules in the presence of packet drops between the sensor and the estimator. It is shown that the system state…

Optimization and Control · Mathematics 2019-04-04 Liang Xu , Yilin Mo , Lihua Xie

The spectral risk has wide applications in machine learning, especially in real-world decision-making, where people are not only concerned with models' average performance. By assigning different weights to the losses of different sample…

Optimization and Control · Mathematics 2024-07-23 Yuze Ge , Rujun Jiang

State-space models (SSMs) are powerful probabilistic tools for modeling time-varying systems with latent dynamics. Inference in SSMs involves the estimation of latent states and parameters. In this work, we focus on parameter inference,…

Computation · Statistics 2026-05-22 Kostas Tsampourakis , Víctor Elvira