English
Related papers

Related papers: Neural Control Variates with Automatic Integration

200 papers

We estimate the parameter of a stationary time series process by minimizing the integrated weighted mean squared error between the empirical and simulated characteristic function, when the true characteristic functions cannot be explicitly…

Statistics Theory · Mathematics 2021-02-03 Richard A. Davis , Thiago do Rêgo Sousa , Claudia Klüppelberg

The analysis of variance (ANOVA) decomposition offers a systematic method to understand the interaction effects that contribute to a specific decision output. In this paper we introduce Neural-ANOVA, an approach to decompose neural networks…

Machine Learning · Statistics 2025-08-01 Steffen Limmer , Steffen Udluft , Clemens Otte

This paper develops algorithms for high-dimensional stochastic control problems based on deep learning and dynamic programming. Unlike classical approximate dynamic programming approaches, we first approximate the optimal policy by means of…

Probability · Mathematics 2021-09-21 Côme Huré , Huyên Pham , Achref Bachouch , Nicolas Langrené

Using neural networks to solve variational problems, and other scientific machine learning tasks, has been limited by a lack of consistency and an inability to exactly integrate expressions involving neural network architectures. We address…

Machine Learning · Computer Science 2021-10-28 Jonas A. Actor , Andy Huang , Nathaniel Trask

We introduce a variational algorithm to estimate the likelihood of a rare event within a nonequilibrium molecular dynamics simulation through the evaluation of an optimal control force. Optimization of a control force within a chosen basis…

Statistical Mechanics · Physics 2021-01-14 Avishek Das , David T. Limmer

Unmanned ground vehicles operating in complex environments must adaptively adjust to modeling uncertainties and external disturbances to perform tasks such as wall following and obstacle avoidance. This paper introduces an adaptive control…

Systems and Control · Electrical Eng. & Systems 2025-03-04 Hengye Yang , Yanxiao Chen , Zexuan Fan , Lin Shao , Tao Sun

This work introduces a novel multilevel Monte Carlo (MLMC) metamodeling approach for variance function estimation. Although devising an efficient experimental design for simulation metamodeling can be elusive, the MLMC-based approach…

Methodology · Statistics 2025-04-22 Jingtao Zhang , Xi Chen

We introduce a class of Monte Carlo estimators that aim to overcome the rapid growth of variance with dimension often observed for standard estimators by exploiting the target's independence structure. We identify the most basic…

Statistics Theory · Mathematics 2021-11-02 Juan Kuntz , Francesca R. Crucinio , Adam M. Johansen

In this paper we propose a Deep Learning architecture to approximate diffeomorphisms diffeotopic to the identity. We consider a control system of the form $\dot x = \sum_{i=1}^lF_i(x)u_i$, with linear dependence in the controls, and we use…

Optimization and Control · Mathematics 2023-11-20 Alessandro Scagliotti

The inherent approximation ability of neural networks plays an essential role in adaptive neural control, where the prerequisite for existence of the compact set is crucial in the control designs. Instead of using practical system state, in…

Systems and Control · Electrical Eng. & Systems 2025-05-01 Mingxuan Sun , Shengxiang Zou

The article outlines the methodology of structural and parametric synthesis of neural network controllers for controlling objects with limiters under incomplete information about the controlled object. Artificial neural networks are used to…

Robotics · Computer Science 2023-12-29 Sergey Feofilov , Dmitry Khapkin , Andrey Kozyr , Eduard Heiss , Andrey Efromeev

This paper presents a novel algorithm to obtain the closed-form anti-derivative of a function using Deep Neural Network architecture. In the past, mathematicians have developed several numerical techniques to approximate the values of…

Numerical Analysis · Mathematics 2022-09-20 D. Chakraborty , S. Gopalakrishnan

In Constraint Programming, constraints are usually represented as predicates allowing or forbidding combinations of values. However, some algorithms exploit a finer representation: error functions. Their usage comes with a price though: it…

Artificial Intelligence · Computer Science 2023-03-09 Florian Richoux , Jean-François Baffier

In this paper a novel modification of the multilevel Monte Carlo approach, allowing for further significant complexity reduction, is proposed. The idea of the modification is to use the method of control variates to reduce variance at level…

Computational Finance · Quantitative Finance 2017-03-14 Denis Belomestny , Tigran Nagapetyan

We propose to use deep neural networks for generating samples in Monte Carlo integration. Our work is based on non-linear independent components estimation (NICE), which we extend in numerous ways to improve performance and enable its…

Machine Learning · Computer Science 2019-09-04 Thomas Müller , Brian McWilliams , Fabrice Rousselle , Markus Gross , Jan Novák

This paper proposes a robust control strategy that integrates Iterative Learning Control (ILC) with a simple lateral neural network to enhance the trajectory tracking performance of a linear Lorentz force actuator under friction and model…

Systems and Control · Electrical Eng. & Systems 2025-11-18 Ali Mashhadireza , Ali Sadighi

We introduce a new algorithm for approximate inference that combines reparametrization, Markov chain Monte Carlo and variational methods. We construct a very flexible implicit variational distribution synthesized by an arbitrary Markov…

Machine Learning · Statistics 2017-08-07 Michalis K. Titsias

We describe and analyze a variance reduction approach for Monte Carlo (MC) sampling that accelerates the estimation of statistics of computationally expensive simulation models using an ensemble of models with lower cost. These lower cost…

Computation · Statistics 2021-05-04 Alex A. Gorodetsky , Gianluca Geraci , Mike Eldred , John D. Jakeman

This paper presents the Variation Network (VarNet), a generative model providing means to manipulate the high-level attributes of a given input. The originality of our approach is that VarNet is not only capable of handling pre-defined…

Machine Learning · Computer Science 2019-09-17 Gaëtan Hadjeres , Frank Nielsen

Approximate inference in complex probabilistic models such as deep Gaussian processes requires the optimisation of doubly stochastic objective functions. These objectives incorporate randomness both from mini-batch subsampling of the data…

Machine Learning · Statistics 2020-03-26 Ayman Boustati , Sattar Vakili , James Hensman , ST John