English
Related papers

Related papers: Rare event modeling with self-regularized normaliz…

200 papers

Although neural networks are conventionally optimized towards zero training loss, it has been recently learned that targeting a non-zero training loss threshold, referred to as a flood level, often enables better test time generalization.…

Machine Learning · Computer Science 2023-11-07 Wonho Bae , Yi Ren , Mohamad Osama Ahmed , Frederick Tung , Danica J. Sutherland , Gabriel L. Oliveira

Continuous normalizing flows (CNFs) learn an ordinary differential equation to transform prior samples into data. Flow matching (FM) has recently emerged as a simulation-free approach for training CNFs by regressing a velocity model towards…

Machine Learning · Statistics 2024-05-28 Tianyu Xie , Yu Zhu , Longlin Yu , Tong Yang , Ziheng Cheng , Shiyue Zhang , Xiangyu Zhang , Cheng Zhang

Normalizing Flows (NFs) are able to model complicated distributions p(y) with strong inter-dimensional correlations and high multimodality by transforming a simple base density p(z) through an invertible neural network under the change of…

Machine Learning · Computer Science 2023-11-14 Christina Winkler , Daniel Worrall , Emiel Hoogeboom , Max Welling

Anomaly detection is a challenging task that frequently arises in practically all areas of industry and science, from fraud detection and data quality monitoring to finding rare cases of diseases and searching for new physics. Most of the…

Machine Learning · Computer Science 2021-11-22 Artem Ryzhikov , Maxim Borisyak , Andrey Ustyuzhanin , Denis Derkach

Uncertainty quantification provides quantitative measures on the reliability of candidate solutions of ill-posed inverse problems. Due to their sequential nature, Monte Carlo sampling methods require large numbers of sampling steps for…

Geophysics · Physics 2021-04-14 Ali Siahkoohi , Felix J. Herrmann

Supervised learning usually requires a large amount of labelled data. However, attaining ground-truth labels is costly for many tasks. Alternatively, weakly supervised methods learn with cheap weak signals that only approximately label some…

Machine Learning · Computer Science 2024-11-26 You Lu , Wenzhuo Song , Chidubem Arachie , Bert Huang

While recent developments in autonomous vehicle (AV) technology highlight substantial progress, we lack tools for rigorous and scalable testing. Real-world testing, the $\textit{de facto}$ evaluation environment, places the public in…

Machine Learning · Computer Science 2019-01-15 Matthew O'Kelly , Aman Sinha , Hongseok Namkoong , John Duchi , Russ Tedrake

Accurate position reconstruction in noble-element time-projection chambers (TPCs) is critical for rare-event searches in astroparticle physics, yet is systematically limited by electric field distortions arising from charge accumulation on…

Instrumentation and Detectors · Physics 2025-11-05 Ivy Li , Peter Gaemers , Juehang Qin , Naija Bruckner , Maris Arthurs , Maria Elena Monzani , Christopher Tunnell

Turbulence remains one of the last unresolved problems of classical physics and a major bottleneck to accurate flow prediction in climate, aerospace, and energy systems. Industrial simulations therefore rely on averaged representations of…

Fluid Dynamics · Physics 2026-05-18 Zhuoran Liu , Haochen Wang , Zhuolin Zhao , Heng Xiao

Conditional Normalizing Flows (CNFs) are flexible generative models capable of representing complicated distributions with high dimensionality and large interdimensional correlations, making them appealing for structured output learning.…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Mohsen Zand , Ali Etemad , Michael Greenspan

An important step in the design of autonomous systems is to evaluate the probability that a failure will occur. In safety-critical domains, the failure probability is extremely small so that the evaluation of a policy through Monte Carlo…

Machine Learning · Computer Science 2022-11-23 Anthony Corso , Kyu-Young Kim , Shubh Gupta , Grace Gao , Mykel J. Kochenderfer

Emergency situations in scheduling systems often trigger local functional failures that undermine system stability and even cause system collapse. Existing methods primarily rely on robust scheduling or reactive scheduling, handling…

Artificial Intelligence · Computer Science 2026-04-14 Shixing Zhao , Zheng Si , Pengpeng Ouyang , Zhengqing Hu , Wanqi Zhu , Dong Chen , Yibo Guo , Mingliang Xu

Obtaining samples from the posterior distribution of inverse problems with expensive forward operators is challenging especially when the unknowns involve the strongly heterogeneous Earth. To meet these challenges, we propose a…

Machine Learning · Statistics 2021-01-12 Ali Siahkoohi , Gabrio Rizzuti , Mathias Louboutin , Philipp A. Witte , Felix J. Herrmann

We explore the ability of normalizing flow (NF) generative models to reproduce weak-lensing summary statistics when trained on a set of cosmological simulations. Our analysis focuses on how accurately NF models recover the mean, standard…

Cosmology and Nongalactic Astrophysics · Physics 2026-01-29 Joaquin Armijo , Leander Thiele , Jia Liu

Deep neural networks (DNNs) often suffer from the overconfidence issue, where incorrect predictions are made with high confidence scores, hindering the applications in critical systems. In this paper, we propose a novel approach called…

Computer Vision and Pattern Recognition · Computer Science 2024-11-08 Yijun Liu , Jiequan Cui , Zhuotao Tian , Senqiao Yang , Qingdong He , Xiaoling Wang , Jingyong Su

In this paper, we consider a problem of failure prediction in the context of predictive maintenance applications. We present a new approach for rare failures prediction, based on a general methodology, which takes into account peculiar…

Machine Learning · Computer Science 2019-05-29 Evgeny Burnaev

Survival analysis, or time-to-event modelling, is a classical statistical problem that has garnered a lot of interest for its practical use in epidemiology, demographics or actuarial sciences. Recent advances on the subject from the point…

Machine Learning · Computer Science 2021-07-28 Guillaume Ausset , Tom Ciffreo , Francois Portier , Stephan Clémençon , Timothée Papin

From Physics and Biology to Seismology and Economics, the behaviour of countless systems is determined by impactful yet unlikely transitions between metastable states known as \emph{rare events}, the study of which is essential for…

Computational Physics · Physics 2025-07-22 Solomon Asghar , Qing-Xiang Pei , Giorgio Volpe , Ran Ni

Normalizing Flows (NFs) have been established as a principled framework for generative modeling. Standard NFs consist of a forward process and a reverse process: the forward process maps data to noise, while the reverse process generates…

Machine Learning · Computer Science 2025-12-12 Yiyang Lu , Qiao Sun , Xianbang Wang , Zhicheng Jiang , Hanhong Zhao , Kaiming He

Diffusion and flow-matching models trained with limited data often tend to memorize the training data instead of generalization, leading to severely reduced diversity. In this paper, we provide a dynamical perspective and identify this…

Machine Learning · Computer Science 2026-02-02 Songtao Li , Tianqi Hou , Zhenyu Liao , Ting Gao