English
Related papers

Related papers: Fast and Unified Path Gradient Estimators for Norm…

200 papers

We consider a regularized expected reward optimization problem in the non-oblivious setting that covers many existing problems in reinforcement learning (RL). In order to solve such an optimization problem, we apply and analyze the…

Machine Learning · Computer Science 2024-08-21 Ling Liang , Haizhao Yang

We reinterpret multiplicative noise in neural networks as auxiliary random variables that augment the approximate posterior in a variational setting for Bayesian neural networks. We show that through this interpretation it is both efficient…

Machine Learning · Statistics 2017-06-14 Christos Louizos , Max Welling

Learning to integrate non-linear equations from highly resolved direct numerical simulations (DNSs) has seen recent interest for reducing the computational load for fluid simulations. Here, we focus on determining a flux-limiter for shock…

Fluid Dynamics · Physics 2023-03-31 Nga Nguyen-Fotiadis , Michael McKerns , Andrew Sornborger

We develop multi-step gradient methods for network-constrained optimization of strongly convex functions with Lipschitz-continuous gradients. Given the topology of the underlying network and bounds on the Hessian of the objective function,…

Optimization and Control · Mathematics 2015-06-12 Euhanna Ghadimi , Iman Shames , Mikael Johansson

While nowadays most gradient-based optimization methods focus on exploring the high-dimensional geometric features, the random error accumulated in a stochastic version of any algorithm implementation has not been stressed yet. In this…

Machine Learning · Computer Science 2020-08-14 Tong Yang , Long Sha , Pengyu Hong

Natural-gradient methods enable fast and simple algorithms for variational inference, but due to computational difficulties, their use is mostly limited to \emph{minimal} exponential-family (EF) approximations. In this paper, we extend…

Machine Learning · Statistics 2020-11-09 Wu Lin , Mohammad Emtiyaz Khan , Mark Schmidt

Normalizing flows have emerged as an important family of deep neural networks for modelling complex probability distributions. In this note, we revisit their coupling and autoregressive transformation layers as probabilistic graphical…

Machine Learning · Computer Science 2020-06-05 Antoine Wehenkel , Gilles Louppe

We present algorithms for efficiently learning regularizers that improve generalization. Our approach is based on the insight that regularizers can be viewed as upper bounds on the generalization gap, and that reducing the slack in the…

Machine Learning · Computer Science 2019-02-25 Matthew Streeter

Owing to the edge preserving ability and low computational cost of the total variation (TV), variational models with the TV regularization have been widely investigated in the field of multiplicative noise removal. The key points of the…

Computer Vision and Pattern Recognition · Computer Science 2015-03-18 Dai-Qiang Chen , Li-Zhi Cheng

The future motion of traffic participants is inherently uncertain. To plan safely, therefore, an autonomous agent must take into account multiple possible trajectory outcomes and prioritize them. Recently, this problem has been addressed…

Computer Vision and Pattern Recognition · Computer Science 2021-08-02 Christoph Schöller , Alois Knoll

We present efficient finite difference estimators for goal-oriented sensitivity indices with applications to the generalized Langevin equation (GLE). In particular, we apply these estimators to analyze an extended variable formulation of…

Numerical Analysis · Mathematics 2018-09-18 Eric Joseph Hall , Markos A. Katsoulakis , Luc Rey-Bellet

Normalizing flows are a class of deep generative models that provide a promising route to sample lattice field theories more efficiently than conventional Monte Carlo simulations. In this work we show that the theoretical framework of…

High Energy Physics - Lattice · Physics 2022-07-07 Michele Caselle , Elia Cellini , Alessandro Nada , Marco Panero

Optical flow estimation can be formulated as an end-to-end supervised learning problem, which yields estimates with a superior accuracy-runtime tradeoff compared to alternative methodology. In this paper, we make such networks estimate…

Computer Vision and Pattern Recognition · Computer Science 2018-12-21 Eddy Ilg , Özgün Çiçek , Silvio Galesso , Aaron Klein , Osama Makansi , Frank Hutter , Thomas Brox

This paper introduces a framework for estimating fair optimal predictions using machine learning where the notion of fairness can be quantified using path-specific causal effects. We use a recently developed approach based on Lagrange…

Machine Learning · Computer Science 2024-08-06 Razieh Nabi , David Benkeser

A trivializing map is a field transformation whose Jacobian determinant exactly cancels the interaction terms in the action, providing a representation of the theory in terms of a deterministic transformation of a distribution from which…

High Energy Physics - Lattice · Physics 2022-01-03 Luigi Del Debbio , Joe Marsh Rossney , Michael Wilson

An adaptive sampling approach for efficient detection of bifurcation boundaries in parametrized fluid flow problems is presented herein. The study extends the machine-learning approach of Silvester~(J. Comput. Phys., 553 (2026), 114743),…

Fluid Dynamics · Physics 2026-02-19 Anshima Singh , David J. Silvester

This paper is concerned about a learning algorithm for a probabilistic model of spiking neural networks (SNNs). Jimenez Rezende & Gerstner (2014) proposed a stochastic variational inference algorithm to train SNNs with hidden neurons. The…

Neural and Evolutionary Computing · Computer Science 2021-06-04 Hiroshi Kajino

Sampling noisy intermediate-scale quantum devices is a fundamental step that converts coherent quantum-circuit outputs to measurement data for running variational quantum algorithms that utilize gradient and Hessian methods in cost-function…

Quantum Physics · Physics 2023-07-04 Y. S. Teo

Accelerated gradient descent iterations are widely used in optimization. It is known that, in the continuous-time limit, these iterations converge to a second-order differential equation which we refer to as the accelerated gradient flow.…

Optimization and Control · Mathematics 2020-06-16 Mohammad Farazmand

Normalizing flows are a powerful tool to create flexible probability distributions with a wide range of potential applications in cosmology. Here we are studying normalizing flows which represent cosmological observables at field level,…

Cosmology and Nongalactic Astrophysics · Physics 2021-05-26 Adam Rouhiainen , Utkarsh Giri , Moritz Münchmeyer