English
Related papers

Related papers: IDF++: Analyzing and Improving Integer Discrete Fl…

200 papers

Digital filters for recursively computing the discrete Fourier transform (DFT) and estimating the frequency spectrum of sampled signals are examined, with an emphasis on magnitude-response and numerical stability. In this tutorial-style…

Systems and Control · Computer Science 2015-08-26 Hugh L. Kennedy

Discrete flow models offer a powerful framework for learning distributions over discrete state spaces and have demonstrated superior performance compared to the discrete diffusion models. However, their convergence properties and error…

Statistics Theory · Mathematics 2026-05-27 Zhengyan Wan , Yidong Ouyang , Qiang Yao , Liyan Xie , Fang Fang , Hongyuan Zha , Guang Cheng

We propose a family of adaptive integer compression operators for distributed Stochastic Gradient Descent (SGD) that do not communicate a single float. This is achieved by multiplying floating-point vectors with a number known to every…

Machine Learning · Computer Science 2022-03-22 Konstantin Mishchenko , Bokun Wang , Dmitry Kovalev , Peter Richtárik

We present a finite element variational integrator for compressible flows. The numerical scheme is derived by discretizing, in a structure preserving way, the Lie group formulation of fluid dynamics on diffeomorphism groups and the…

Numerical Analysis · Mathematics 2019-10-15 Evan S. Gawlik , François Gay-Balmaz

Flow-based generative models are a family of exact log-likelihood models with tractable sampling and latent-variable inference, hence conceptually attractive for modeling complex distributions. However, flow-based models are limited by…

Machine Learning · Computer Science 2019-05-09 Huadong Liao , Jiawei He , Kunxian Shu

The framework of normalizing flows provides a general strategy for flexible variational inference of posteriors over latent variables. We propose a new type of normalizing flow, inverse autoregressive flow (IAF), that, in contrast to…

Machine Learning · Computer Science 2017-02-01 Diederik P. Kingma , Tim Salimans , Rafal Jozefowicz , Xi Chen , Ilya Sutskever , Max Welling

A program is non-interferent if it leaks no secret information to an observable output. However, non-interference is too strict in many practical cases and quantitative information flow (QIF) has been proposed and studied in depth.…

Cryptography and Security · Computer Science 2019-10-23 Bao Trung Chu , Kenji Hashimoto , Hiroyuki Seki

Let a cluster (network) of sensors be connected by the communication links, each link having a capacity upper bound. Each sensor observes a discrete random variable in private and one sensor serves as a cluster header or sink. Here, we…

Information Theory · Computer Science 2018-04-06 Ni Ding , Parastoo Sadeghi , David Smith , Thierry Rakotoarivelo

Future architectures designed to deliver exascale performance motivate the need for novel algorithmic changes in order to fully exploit their capabilities. In this paper, the performance of several numerical algorithms, characterised by…

Data Structures and Algorithms · Computer Science 2016-10-31 Satya P. Jammy , Christian T. Jacobs , Neil D. Sandham

This paper studies the benefits of pressure-robust discretizations in the scope of optimal control of incompressible flows. Gradient forces that may appear in the data can have a negative impact on the accuracy of state and control and can…

Optimization and Control · Mathematics 2022-03-07 Christian Merdon , Winnifried Wollner

The stable numerical integration of shocks in compressible flow simulations relies on the reduction or elimination of Gibbs phenomena (unstable, spurious oscillations). A popular method to virtually eliminate Gibbs oscillations caused by…

This work presents mixed variational flows (MixFlows), a new variational family that consists of a mixture of repeated applications of a map to an initial reference distribution. First, we provide efficient algorithms for i.i.d. sampling,…

Machine Learning · Statistics 2025-06-03 Zuheng Xu , Naitong Chen , Trevor Campbell

Likelihood-based generative models are the backbones of lossless compression due to the guaranteed existence of codes with lengths close to negative log likelihood. However, there is no guaranteed existence of computationally efficient…

Machine Learning · Computer Science 2020-01-07 Jonathan Ho , Evan Lohn , Pieter Abbeel

This paper introduces a novel approach to compute the numerical fluxes at the cell boundaries in the finite volume approach. Explicit gradients used in deriving the reconstruction polynomials are replaced by high-order gradients computed by…

Numerical Analysis · Mathematics 2021-06-04 Amareshwara Sainadh Chamarthi , Steven H. Frankel , Abhishek Chintagunta

We introduce an algorithmic framework based on tensor networks for computing fluid flows around immersed objects in curvilinear coordinates. We show that the tensor network simulations can be carried out solely using highly compressed…

This paper solves the discretised multiphase flow equations using tools and methods from machine-learning libraries. The idea comes from the observation that convolutional layers can be used to express a discretisation as a neural network…

This paper introduces Bayesian Flow Networks (BFNs), a new class of generative model in which the parameters of a set of independent distributions are modified with Bayesian inference in the light of noisy data samples, then passed as input…

Machine Learning · Computer Science 2025-03-12 Alex Graves , Rupesh Kumar Srivastava , Timothy Atkinson , Faustino Gomez

Provable nonlinear stability bounds the discrete approximation and ensures that the discretization does not diverge. For high-order methods, discrete nonlinear stability and entropy stability, have been successfully implemented for…

Numerical Analysis · Mathematics 2023-12-14 Alexander Cicchino , Siva Nadarajah

Integer-forcing source coding has been proposed as a low-complexity method for compression of distributed correlated Gaussian sources. In this scheme, each encoder quantizes its observation using the same fine lattice and reduces the result…

Information Theory · Computer Science 2019-06-05 Elad Domanovitz , Uri Erez

Turbulent flow over permeable interface is omnipresent featuring complex flow topology. In this work, a data driven, end to end machine learning model has been developed to model the turbulent flow in porous media. For the same, we have…

Fluid Dynamics · Physics 2023-11-28 Xu Chu , Sandeep Pandey