English
Related papers

Related papers: Everything everywhere all at once: a probability-b…

200 papers

This paper studies binary logistic regression for rare events data, or imbalanced data, where the number of events (observations in one class, often called cases) is significantly smaller than the number of nonevents (observations in the…

Machine Learning · Statistics 2020-06-02 HaiYing Wang

In rare-event simulation, an importance sampling (IS) estimator is regarded as efficient if its relative error, namely the ratio between its standard deviation and mean, is sufficiently controlled. It is widely known that when a rare-event…

Statistics Theory · Mathematics 2022-10-31 Yuanlu Bai , Zhiyuan Huang , Henry Lam , Ding Zhao

Atomistic modelling of phase transitions, chemical reactions, or other rare events that involve overcoming high free energy barriers usually entails prohibitively long simulation times. Introducing a bias potential as a function of an…

Computational Physics · Physics 2019-11-06 Federico Giberti , Bingqing Cheng , Gareth Aneurin Tribello , Michele Ceriotti

The computational study of conformational transitions in RNA and proteins with atomistic molecular dynamics often requires suitable enhanced sampling techniques. We here introduce a novel method where concurrent metadynamics are integrated…

Computational Physics · Physics 2015-09-01 Alejandro Gil-Ley , Giovanni Bussi

Finding and sampling rare trajectories in dynamical systems is a difficult computational task underlying numerous problems and applications. In this paper we show how to construct Metropolis- Hastings Monte Carlo methods that can…

Chaotic Dynamics · Physics 2017-10-16 Jorge C. Leitao , Joao M. Viana Parente Lopes , Eduardo G. Altmann

Rare event sampling in dynamical systems is a fundamental problem arising in the natural sciences, which poses significant computational challenges due to an exponentially large space of trajectories. For settings where the dynamical system…

We present a novel sampling-based method for estimating probabilities of rare or failure events. Our approach is founded on the Ensemble Kalman filter (EnKF) for inverse problems. Therefore, we reformulate the rare event problem as an…

Numerical Analysis · Mathematics 2021-12-15 Fabian Wagner , Iason Papaioannou , Elisabeth Ullmann

Branching processes are a class of continuous-time Markov chains (CTMCs) with ubiquitous applications. A general difficulty in statistical inference under partially observed CTMC models arises in computing transition probabilities when the…

Computation · Statistics 2015-03-10 Jason Xu , Vladimir N. Minin

Random sampling is an essential tool in the processing and transmission of data. It is used to summarize data too large to store or manipulate and meet resource constraints on bandwidth or battery power. Estimators that are applied to the…

Databases · Computer Science 2015-03-19 Edith Cohen , Haim Kaplan

Typical causal effects are defined based on the marginal distribution of potential outcomes. However, many real-world applications require causal estimands involving the joint distribution of potential outcomes to enable more nuanced…

Methodology · Statistics 2026-04-17 Peng Wu , Xiaojie Mao

The Adaptive Multilevel Splitting algorithm is a very powerful and versatile iterative method to estimate the probability of rare events, based on an interacting particle systems. In an other article, in a so-called idealized setting, the…

Probability · Mathematics 2019-10-21 Charles-Edouard Bréhier , Ludovic Goudenège , Loic Tudela

Large-scale rare events data are commonly encountered in practice. To tackle the massive rare events data, we propose a novel distributed estimation method for logistic regression in a distributed system. For a distributed framework, we…

Methodology · Statistics 2023-04-06 Xuetong Li , Xuening Zhu , Hansheng Wang

In this paper we develop a perturbation method to predict the rate of occurrence of rare events for singularly perturbed stochastic systems using a probability density function approach. In contrast to a stochastic normal form approach, we…

Dynamical Systems · Mathematics 2015-06-16 Christoffer R. Heckman , Ira B. Schwartz

Interacting particle systems with many degrees of freedom may undergo phase transitions to sustain atypical fluctuations of dynamical observables such as the current or the activity. This leads in some cases to symmetry-broken space-time…

Statistical Mechanics · Physics 2019-08-23 Carlos Pérez-Espigares , Pablo I. Hurtado

Random sampling is a technique for signal acquisition which is gaining popularity in practical signal processing systems. Nowadays, event-driven analog-to-digital converters make random sampling feasible in practical applications. A process…

Data Structures and Algorithms · Computer Science 2015-10-08 Jacek Pierzchlewski , Thomas Arildsen

In multi-center clinical trials, due to various reasons, the individual-level data are strictly restricted to be assessed publicly. Instead, the summarized information is widely available from published results. With the advance of…

Methodology · Statistics 2021-01-05 Jing Qin , Yukun Liu , Pengfei Li

Bayesian inference with Markov Chain Monte Carlo (MCMC) is challenging when the likelihood function is irregular and expensive to compute. We explore several sampling algorithms that make use of subset evaluations to reduce computational…

Machine Learning · Statistics 2025-05-16 Conor Rosato , Harvinder Lehal , Simon Maskell , Lee Devlin , Malcolm Strens

In recent years, several climate subsystems have been identified that may undergo a relatively rapid transition compared to the changes in their forcing. Such transitions are rare events in general, and simulating long-enough trajectories…

Atmospheric and Oceanic Physics · Physics 2023-06-30 Valérian Jacques-Dumas , René M. van Westen , Freddy Bouchet , Henk A. Dijkstra

The Sun is observed in unprecedented detail, enabling studies of its activity on very small spatiotemporal scales. However, the large volume of data collected by our telescopes cannot be fully analyzed with conventional methods. Popular…

Solar and Stellar Astrophysics · Physics 2026-05-29 C. J. Díaz Baso , I. J. Soler Poquet , C. Kuckein , M. van Noort , N. Poirier

We study batched bandit experiments and consider the problem of inference conditional on the realized stopping time, assignment probabilities, and target parameter, where all of these may be chosen adaptively using information up to the…

Methodology · Statistics 2026-01-21 Jiafeng Chen , Isaiah Andrews