中文
相关论文

相关论文: Stable Training of Normalizing Flows for High-dime…

200 篇论文

We present an efficient deep learning technique for the model reduction of the Navier-Stokes equations for unsteady flow problems. The proposed technique relies on the Convolutional Neural Network (CNN) and the stochastic gradient descent…

流体动力学 · 物理学 2018-08-16 Tharindu P. Miyanawala , Rajeev K. Jaiman

We demonstrate several techniques to encourage practical uses of neural networks for fluid flow estimation. In the present paper, three perspectives which are remaining challenges for applications of machine learning to fluid dynamics are…

流体动力学 · 物理学 2022-05-19 Masaki Morimoto , Kai Fukami , Kai Zhang , Koji Fukagata

High-fidelity modeling of turbulent flows is one of the major challenges in computational physics, with diverse applications in engineering, earth sciences and astrophysics, among many others. The rising popularity of high-fidelity…

流体动力学 · 物理学 2019-03-06 Arvind Mohan , Don Daniel , Michael Chertkov , Daniel Livescu

Flow models have rapidly become the go-to method for training and deploying large-scale generators, owing their success to inference-time flexibility via adjustable integration steps. A crucial ingredient in flow training is the choice of…

Normalizing flows (NF) are a class of powerful generative models that have gained popularity in recent years due to their ability to model complex distributions with high flexibility and expressiveness. In this work, we introduce a new type…

机器学习 · 计算机科学 2023-06-08 Jonas Köhler , Michele Invernizzi , Pim de Haan , Frank Noé

Normalizing flows are a popular class of models for approximating probability distributions. However, their invertible nature limits their ability to model target distributions whose support have a complex topological structure, such as…

机器学习 · 统计学 2022-02-25 Vincent Stimper , Bernhard Schölkopf , José Miguel Hernández-Lobato

Many systems in physics, engineering, and biology exhibit multiscale stochastic dynamics, where low-dimensional slow variables evolve under the influence of high-dimensional fast processes. In practice, observations are often limited to a…

机器学习 · 统计学 2026-05-12 Anan Saha , Arnab Ganguly

Existing machine learning methods for causal inference usually estimate quantities expressed via the mean of potential outcomes (e.g., average treatment effect). However, such quantities do not capture the full information about the…

机器学习 · 计算机科学 2023-06-21 Valentyn Melnychuk , Dennis Frauen , Stefan Feuerriegel

Normalizing flows are generative models that provide tractable density estimation via an invertible transformation from a simple base distribution to a complex target distribution. However, this technique cannot directly model data…

机器学习 · 统计学 2021-11-15 Brendan Leigh Ross , Jesse C. Cresswell

Small-scale turbulence can be comprehensively described in terms of velocity gradients, which makes them an appealing starting point for low-dimensional modeling. Typical models consist of stochastic equations based on closures for…

流体动力学 · 物理学 2024-03-01 Maurizio Carbone , Vincent J. Peterhans , Alexander S. Ecker , Michael Wilczek

Sampling methods (e.g., node-wise, layer-wise, or subgraph) has become an indispensable strategy to speed up training large-scale Graph Neural Networks (GNNs). However, existing sampling methods are mostly based on the graph structural…

机器学习 · 计算机科学 2021-09-07 Weilin Cong , Rana Forsati , Mahmut Kandemir , Mehrdad Mahdavi

This paper shows a novel machine learning model for realized volatility (RV) prediction using a normalizing flow, an invertible neural network. Since RV is known to be skewed and have a fat tail, previous methods transform RV into values…

计算工程、金融与科学 · 计算机科学 2023-10-24 Xin Du , Kai Moriyama , Kumiko Tanaka-Ishii

In this work, we demonstrate how to reliably estimate epistemic uncertainty while maintaining the flexibility needed to capture complicated aleatoric distributions. To this end, we propose an ensemble of Normalizing Flows (NF), which are…

机器学习 · 计算机科学 2023-10-05 Lucas Berry , David Meger

The framework of normalizing flows provides a general strategy for flexible variational inference of posteriors over latent variables. We propose a new type of normalizing flow, inverse autoregressive flow (IAF), that, in contrast to…

机器学习 · 计算机科学 2017-02-01 Diederik P. Kingma , Tim Salimans , Rafal Jozefowicz , Xi Chen , Ilya Sutskever , Max Welling

Normalizing flows are invertible neural networks with tractable change-of-volume terms, which allow optimization of their parameters to be efficiently performed via maximum likelihood. However, data of interest are typically assumed to live…

机器学习 · 统计学 2021-11-04 Anthony L. Caterini , Gabriel Loaiza-Ganem , Geoff Pleiss , John P. Cunningham

Simulating complex dynamics like fluids with traditional simulators is computationally challenging. Deep learning models have been proposed as an efficient alternative, extending or replacing parts of traditional simulators. We investigate…

机器学习 · 计算机科学 2022-03-16 Jonathan Klimesch , Philipp Holl , Nils Thuerey

Normalizing flow is a generative modeling approach with efficient sampling. However, Flow-based models suffer two issues: 1) If the target distribution is manifold, due to the unmatch between the dimensions of the latent target distribution…

机器学习 · 计算机科学 2024-04-24 Qinglong Meng , Chongkun Xia , Xueqian Wang

Sampling from high-dimensional, multi-modal distributions remains a fundamental challenge across domains such as statistical Bayesian inference and physics-based machine learning. In this paper, we propose Annealing Flow (AF), a method…

机器学习 · 统计学 2025-05-28 Dongze Wu , Yao Xie

Neural Radiance Fields (NeRF) has emerged as a compelling framework for scene representation and 3D recovery. To improve its performance on real-world data, depth regularizations have proven to be the most effective ones. However, depth…

计算机视觉与模式识别 · 计算机科学 2025-07-08 Aoxiang Fan , Corentin Dumery , Nicolas Talabot , Pascal Fua

Normalizing Flows (NFs) describe a class of models that express a complex target distribution as the composition of a series of bijective transformations over a simpler base distribution. By limiting the space of candidate transformations…

机器学习 · 计算机科学 2023-09-11 Keegan Kelly , Lorena Piedras , Sukrit Rao , David Roth